Class: LlmScraper::ContentFetchers::Base

Inherits:
Object
  • Object
show all
Defined in:
lib/llm_scraper/content_fetchers/base.rb

Direct Known Subclasses

Firecrawl, Jina, Local, Markdownify

Instance Method Summary collapse

Instance Method Details

#fetch(url) ⇒ String

Returns cleaned text/markdown content.

Parameters:

  • url (String)

Returns:

  • (String)

    cleaned text/markdown content

Raises:



9
10
11
# File 'lib/llm_scraper/content_fetchers/base.rb', line 9

def fetch(url)
  raise NotImplementedError, "#{self.class}#fetch not implemented"
end