Class: Html2rss::FeedPipeline::AutoFallback

Inherits:
Object
  • Object
show all
Defined in:
lib/html2rss/feed_pipeline/auto_fallback.rb

Overview

Retries feed extraction across concrete request strategies for the :auto plan.

Owned by Html2rss::FeedPipeline; invoked only after StrategyPlan resolves :auto. Hosted by the pipeline instance: session + extract call back into FeedPipeline.

Defined Under Namespace

Classes: AttemptState

Constant Summary collapse

CHAIN =

Ordered list of concrete request strategies attempted by the :auto plan.

%i[faraday botasaurus].freeze
NON_FALLBACK_ERRORS =

Error classes that should abort auto fallback immediately.

[
  RequestService::UnknownStrategy,
  RequestService::InvalidUrl,
  RequestService::UnsupportedUrlScheme,
  RequestService::UnsupportedResponseContentType,
  RequestService::RequestBudgetExceeded,
  RequestService::PrivateNetworkDenied,
  RequestService::CrossOriginFollowUpDenied,
  RequestService::ResponseTooLarge,
  RequestService::BrowserlessConfigurationError
].freeze

Instance Method Summary collapse

Constructor Details

#initialize(strategies:, budget:, pipeline:, config:, resources:) ⇒ void

Parameters:



81
82
83
84
85
86
87
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 81

def initialize(strategies:, budget:, pipeline:, config:, resources:)
  @strategies = strategies
  @budget = budget
  @pipeline = pipeline
  @config = config
  @resources = resources
end

Instance Method Details

#callHtml2rss::FeedPipeline::PipelineOutcome

Returns scrape-finished state for materialization.

Returns:



91
92
93
94
95
96
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 91

def call
  state = run_attempts
  return state.result if state.succeeded?

  finalize_failure(attempts: state.attempts)
end