Class: Html2rss::FeedPipeline::AutoFallback

Inherits:
Object
  • Object
show all
Defined in:
lib/html2rss/feed_pipeline/auto_fallback.rb

Overview

Retries feed extraction across concrete request strategies for the :auto plan.

Owned by Html2rss::FeedPipeline; invoked only after StrategyPlan resolves :auto. Hosted by the pipeline instance: session + extract call back into FeedPipeline.

Defined Under Namespace

Classes: AttemptState

Constant Summary collapse

CHAIN =

Ordered list of concrete request strategies attempted by the :auto plan.

%i[faraday botasaurus].freeze
NON_FALLBACK_ERRORS =

Error classes that should abort auto fallback immediately.

[
  RequestService::UnknownStrategy,
  RequestService::InvalidUrl,
  RequestService::UnsupportedUrlScheme,
  RequestService::RequestBudgetExceeded,
  RequestService::PrivateNetworkDenied,
  RequestService::CrossOriginFollowUpDenied,
  RequestService::ResponseTooLarge
].freeze

Instance Method Summary collapse

Constructor Details

#initialize(strategies:, budget:, pipeline:, config:, resources:) ⇒ void

Parameters:



110
111
112
113
114
115
116
117
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 110

def initialize(strategies:, budget:, pipeline:, config:, resources:)
  @strategies = strategies
  @budget = budget
  @pipeline = pipeline
  @config = config
  @resources = resources
  @scrape_target = ScrapeTarget.from_config(config)
end

Instance Method Details

#callHtml2rss::FeedPipeline::PipelineOutcome

Returns scrape-finished state for materialization.

Returns:



121
122
123
124
125
126
# File 'lib/html2rss/feed_pipeline/auto_fallback.rb', line 121

def call
  state = run_attempts
  return state.result if state.succeeded?

  finalize_failure(attempts: state.attempts, response: state.last_response)
end