Module: Html2rss::AutoSource::Discovery

Defined in:

lib/html2rss/auto_source/discovery.rb,
lib/html2rss/auto_source/discovery/sitemap.rb,
lib/html2rss/auto_source/discovery/dom_clustering.rb,
lib/html2rss/auto_source/discovery/list_candidates.rb,
lib/html2rss/auto_source/discovery/semantic_containers.rb,
lib/html2rss/auto_source/discovery/semantic_anchor_candidates.rb,
lib/html2rss/auto_source/discovery/dom_clustering/group_scorer.rb,
lib/html2rss/auto_source/discovery/dom_clustering/overlap_resolver.rb

Overview

Card/list discovery helpers used by AutoSource scrapers before field extraction.

Html2rss::Html::ArticleExtractor fills article fields from a container; discovery finds those containers.

DOM list discovery for anchorless or classless pages is owned by DomClustering.

Defined Under Namespace

Classes: DomClustering, ListCandidates, SemanticAnchorCandidates, SemanticContainers, Sitemap