Class: Html2rss::FeedPipeline::AutoFallback

Inherits:
Object
  • Object
show all
Defined in:
lib/html2rss/feed_pipeline/auto_fallback.rb

Overview

Retries feed extraction across concrete request strategies for the :auto plan.

Owned by Html2rss::FeedPipeline; invoked only after StrategyPlan resolves :auto. Hosted by the pipeline instance: session + extract call back into FeedPipeline.

Defined Under Namespace

Classes: AttemptState

Constant Summary collapse

CHAIN =

Ordered list of concrete request strategies attempted by the :auto plan.

%i[faraday botasaurus].freeze
NON_FALLBACK_ERRORS =

Error classes that should abort auto fallback immediately.

[
  RequestService::UnknownStrategy,
  RequestService::InvalidUrl,
  RequestService::UnsupportedUrlScheme,
  RequestService::UnsupportedResponseContentType,
  RequestService::RequestBudgetExceeded,
  RequestService::PrivateNetworkDenied,
  RequestService::CrossOriginFollowUpDenied,
  RequestService::ResponseTooLarge
].freeze

Instance Method Summary collapse

Constructor Details

#initialize(strategies:, budget:, pipeline:, config:, resources:) ⇒ void

Parameters:



87
88
89
90
91
92
93
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 87

def initialize(strategies:, budget:, pipeline:, config:, resources:)
  @strategies = strategies
  @budget = budget
  @pipeline = pipeline
  @config = config
  @resources = resources
end

Instance Method Details

#callHtml2rss::FeedPipeline::PipelineOutcome

Returns scrape-finished state for materialization.

Returns:



97
98
99
100
101
102
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 97

def call
  state = run_attempts
  return state.result if state.succeeded?

  finalize_failure(attempts: state.attempts, response: state.last_response)
end