Module: Crawlberg

Defined in:
lib/crawlberg.rb,
lib/crawlberg/native.rb,
lib/crawlberg/native.rb,
lib/crawlberg/native.rb,
lib/crawlberg/native.rb,
lib/crawlberg/version.rb,
sig/types.rbs

Overview

This file is auto-generated by alef — DO NOT EDIT. alef:hash:0a9a0a6f7c1b865f2c375eef53bab2695c7dbf595519ca3bd7f5d258c2936ef7 To regenerate: alef generate To verify freshness: alef verify frozen_string_literal: true

Defined Under Namespace

Classes: ActionResult, ArticleMetadata, AssetCategory, AuthConfig, AuthConfigBasic, AuthConfigBearer, AuthConfigHeader, BatchCrawlResult, BatchCrawlResults, BatchCrawlStreamRequest, BatchScrapeResult, BatchScrapeResults, BrowserBackend, BrowserConfig, BrowserExtras, BrowserMode, BrowserWait, CitationReference, CitationResult, ContentConfig, ContentFilterKind, CookieInfo, CrawlConfig, CrawlEngineHandle, CrawlEvent, CrawlEventComplete, CrawlEventError, CrawlEventPage, CrawlPageResult, CrawlResult, CrawlStrategyKind, CrawlStreamRequest, DocumentContentEncoding, DownloadedAsset, DownloadedDocument, ExtractionMeta, FaviconInfo, FeedInfo, FeedType, HeadingInfo, HostMatcher, HostMatcherCidr, HostMatcherExact, HostMatcherSuffix, HreflangEntry, ImageInfo, ImageSource, InteractionResult, JsonLdEntry, LinkInfo, LinkType, MapResult, MarkdownResult, PageAction, PageActionClick, PageActionExecuteJs, PageActionPress, PageActionScrape, PageActionScreenshot, PageActionScroll, PageActionTypeText, PageActionWait, PageMetadata, ProxyConfig, ResponseMeta, ScrapeResult, ScrollDirection, SitemapUrl, SsrfPolicy

Constant Summary collapse

VERSION =

The version string for this package.

Returns:

  • (String)
"1.4.0"

Class Method Summary collapse

Class Method Details

.batch_crawlBatchCrawlResults

Parameters:

Returns:



538
# File 'sig/types.rbs', line 538

def self.batch_crawl: (CrawlEngineHandle engine, Array[String] urls) -> BatchCrawlResults

.batch_scrapeBatchScrapeResults

Parameters:

Returns:



540
# File 'sig/types.rbs', line 540

def self.batch_scrape: (CrawlEngineHandle engine, Array[String] urls) -> BatchScrapeResults

.crawlCrawlResult

Parameters:

Returns:



542
# File 'sig/types.rbs', line 542

def self.crawl: (CrawlEngineHandle engine, String url) -> CrawlResult

.create_engineCrawlEngineHandle

Parameters:

Returns:



544
# File 'sig/types.rbs', line 544

def self.create_engine: (?CrawlConfig config) -> CrawlEngineHandle

.generate_citationsCitationResult

Parameters:

  • markdown (String)

Returns:



546
# File 'sig/types.rbs', line 546

def self.generate_citations: (String markdown) -> CitationResult

.interactInteractionResult

Parameters:

Returns:



548
# File 'sig/types.rbs', line 548

def self.interact: (CrawlEngineHandle engine, String url, Array[PageAction] actions) -> InteractionResult

.map_urlsMapResult

Parameters:

Returns:



550
# File 'sig/types.rbs', line 550

def self.map_urls: (CrawlEngineHandle engine, String url) -> MapResult

.scrapeScrapeResult

Parameters:

Returns:



552
# File 'sig/types.rbs', line 552

def self.scrape: (CrawlEngineHandle engine, String url) -> ScrapeResult