Class: Archaeo::Fetcher

Inherits:
Object
  • Object
show all
Defined in:
lib/archaeo/fetcher.rb

Overview

Downloads archived content from the Wayback Machine.

Constructs the appropriate archive URL, follows redirects, and returns a Page model with content and metadata.

Constant Summary collapse

MAX_REDIRECTS = 
5
BASE = 
"https://web.archive.org"

Instance Method Summary collapse

Constructor Details

#initialize(client: HttpClient.new) ⇒ Fetcher

Returns a new instance of Fetcher.



12
13
14
 
# File 'lib/archaeo/fetcher.rb', line 12

def initialize(client: HttpClient.new)
  @client = client
end

Instance Method Details

#fetch(url, timestamp:, identity: false) ⇒ Object 



16
17
18
19
20
21
22
 
# File 'lib/archaeo/fetcher.rb', line 16

def fetch(url, timestamp:, identity: false)
  ts = Timestamp.coerce(timestamp)
  archive_url = ArchiveUrl.new(url, timestamp: ts,
                                    identity: identity)
  response = follow_redirects(archive_url.to_s)
  build_page(response, archive_url.to_s, url, ts)
end