Class: Html2rss::RequestService::BotasaurusContract::ParsedResponse

Inherits:
Object
  • Object
show all
Defined in:
lib/html2rss/request_service/botasaurus_contract.rb

Overview

Parsed Botasaurus response wrapper.

Constant Summary collapse

DEFAULT_HEADERS =

Fallback headers when upstream omits response headers.

{ 'content-type' => 'text/html' }.freeze

Instance Method Summary collapse

Constructor Details

#initialize(payload:, transport_status:) ⇒ ParsedResponse

Returns a new instance of ParsedResponse.

Parameters:

  • payload (Hash{String => Object}) —

    parsed Botasaurus response payload

  • transport_status (Integer) —

    HTTP status returned by Botasaurus



51
52
53
54
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 51

def initialize(payload:, transport_status:)
  @payload = payload
  @transport_status = transport_status
end

Instance Method Details

#challenge_block? ⇒ Boolean

Returns true when upstream classified request as challenge blocked.

Returns:

  • (Boolean) —

    true when upstream classified request as challenge blocked



57
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 57

def challenge_block? = error_category == 'challenge_block'

#challenge_message ⇒ String

Returns normalized challenge error message.

Returns:

  • (String) —

    normalized challenge error message



65
66
67
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 65

def challenge_message
  error || 'Botasaurus challenge block detected.'
end

#final_url ⇒ String?

Returns final URL reported by upstream.

Returns:

  • (String, nil) —

    final URL reported by upstream



102
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 102

def final_url = payload['final_url']

#headers ⇒ Hash{String => String}

Returns normalized response headers.

Returns:

  • (Hash{String => String}) —

    normalized response headers



88
89
90
91
92
93
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 88

def headers
  raw_headers = payload['headers']
  return DEFAULT_HEADERS.dup unless raw_headers.is_a?(Hash) && raw_headers.any?

  raw_headers.to_h { |key, value| [key.to_s, value.to_s] }
end

#html ⇒ String

Returns rendered HTML body from Botasaurus.

Returns:

  • (String) —

    rendered HTML body from Botasaurus

Raises:



80
81
82
83
84
85
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 80

def html
  value = payload['html']
  raise BotasaurusConnectionFailed, "Botasaurus response missing required 'html' field" if value.nil?

  value.to_s
end

#status ⇒ Integer

Returns resolved status code (payload status_code or transport status).

Returns:

  • (Integer) —

    resolved status code (payload status_code or transport status)



96
97
98
99
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 96

def status
  status_code = payload['status_code']
  status_code.is_a?(Integer) ? status_code : transport_status
end

#transport_meta ⇒ Hash{String => Object}

Returns allowlisted upstream telemetry (frozen).

Returns:

  • (Hash{String => Object}) —

    allowlisted upstream telemetry (frozen)



105
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 105

def transport_meta = payload.slice(*META_KEYS).compact.freeze

#upstream_failure? ⇒ Boolean

Returns true when upstream returned non-200 or an error payload.

Returns:

  • (Boolean) —

    true when upstream returned non-200 or an error payload



60
61
62
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 60

def upstream_failure?
  status != 200 || error_message?
end

#upstream_failure_message ⇒ String

Returns actionable upstream failure summary.

Returns:

  • (String) —

    actionable upstream failure summary



70
71
72
73
74
75
76
 
# File 'lib/html2rss/request_service/botasaurus_contract.rb', line 70

def upstream_failure_message
  details = ["status=#{status}"]
  details << "error_category=#{error_category}" if error_category
  details << "error=#{error}" if error
  details << "request_id=#{request_id}" if request_id
  "Botasaurus scrape failed (#{details.join(', ')})."
end