Module: Crawlberg

Defined in:
lib/crawlberg.rb,
lib/crawlberg/native.rb,
lib/crawlberg/native.rb,
lib/crawlberg/native.rb,
lib/crawlberg/version.rb,
sig/types.rbs

Overview

This file is auto-generated by alef — DO NOT EDIT. alef:hash:f7e33a4b1d5b184786dfb2eda4aeb9ec78fc531755dc568fe3e352702193b559 To regenerate: alef generate To verify freshness: alef verify --exit-code frozen_string_literal: true

Defined Under Namespace

Classes: ActionResult, ArticleMetadata, AssetCategory, AuthConfig, AuthConfigBasic, AuthConfigBearer, AuthConfigHeader, BatchCrawlResult, BatchCrawlResults, BatchCrawlStreamRequest, BatchScrapeResult, BatchScrapeResults, BrowserBackend, BrowserConfig, BrowserExtras, BrowserMode, BrowserWait, CitationReference, CitationResult, ContentConfig, CookieInfo, CrawlConfig, CrawlEngineHandle, CrawlEvent, CrawlEventComplete, CrawlEventError, CrawlEventPage, CrawlPageResult, CrawlResult, CrawlStreamRequest, DownloadedAsset, DownloadedDocument, ExtractionMeta, FaviconInfo, FeedInfo, FeedType, HeadingInfo, HreflangEntry, ImageInfo, ImageSource, InteractionResult, JsonLdEntry, LinkInfo, LinkType, MapResult, MarkdownResult, PageAction, PageActionClick, PageActionExecuteJs, PageActionPress, PageActionScrape, PageActionScreenshot, PageActionScroll, PageActionTypeText, PageActionWait, PageMetadata, ProxyConfig, ResponseMeta, ScrapeResult, ScrollDirection, SitemapUrl, SsrfPolicy

Constant Summary collapse

VERSION =

The version string for this package.

Returns:

  • (String)
"1.0.1"

Class Method Summary collapse

Class Method Details

.batch_crawlBatchCrawlResults

Parameters:

Returns:



528
# File 'sig/types.rbs', line 528

def self.batch_crawl: (CrawlEngineHandle engine, Array[String] urls) -> BatchCrawlResults

.batch_scrapeBatchScrapeResults

Parameters:

Returns:



526
# File 'sig/types.rbs', line 526

def self.batch_scrape: (CrawlEngineHandle engine, Array[String] urls) -> BatchScrapeResults

.crawlCrawlResult

Parameters:

Returns:



520
# File 'sig/types.rbs', line 520

def self.crawl: (CrawlEngineHandle engine, String url) -> CrawlResult

.create_engineCrawlEngineHandle

Parameters:

Returns:



516
# File 'sig/types.rbs', line 516

def self.create_engine: (?CrawlConfig config) -> CrawlEngineHandle

.generate_citationsCitationResult

Parameters:

  • markdown (String)

Returns:



514
# File 'sig/types.rbs', line 514

def self.generate_citations: (String markdown) -> CitationResult

.interactInteractionResult

Parameters:

Returns:



524
# File 'sig/types.rbs', line 524

def self.interact: (CrawlEngineHandle engine, String url, Array[PageAction] actions) -> InteractionResult

.map_urlsMapResult

Parameters:

Returns:



522
# File 'sig/types.rbs', line 522

def self.map_urls: (CrawlEngineHandle engine, String url) -> MapResult

.scrapeScrapeResult

Parameters:

Returns:



518
# File 'sig/types.rbs', line 518

def self.scrape: (CrawlEngineHandle engine, String url) -> ScrapeResult