Class: ApplicationCrawler

Inherits:
Vessel::Cargo show all
Defined in:
lib/vessel/skeleton/config/environments/dev/dev.rb,
lib/vessel/skeleton/config/environments/prod/prod.rb

Constant Summary

Constants included from Vessel::Cargo::Settings

Vessel::Cargo::Settings::DELAY, Vessel::Cargo::Settings::MAX_THREADS, Vessel::Cargo::Settings::MIDDLEWARE, Vessel::Cargo::Settings::MIN_THREADS, Vessel::Cargo::Settings::NETWORK_ERROR_ATTEMPTS, Vessel::Cargo::Settings::START_URLS

Constants included from Vessel::Cargo::Callbacks

Vessel::Cargo::Callbacks::INFO_INTERVAL

Instance Attribute Summary

Attributes inherited from Vessel::Cargo

#domain, #page, #response, #settings, #size

Method Summary

Methods inherited from Vessel::Cargo

build_request, #initialize, #parse, run, start_requests, store_cookies

Methods included from Vessel::Cargo::Settings

#allow_cookies, #blacklist, #cookie, #cookies, #delay, #domain, #driver, #headers, #middleware, #name, #network_error_attempts, #proxy, #settings, #start_urls, #threads, #to_domain_name, #whitelist

Methods included from Vessel::Util

#deep_clone

Methods included from Vessel::Cargo::Fieldable

#field, #fields

Methods included from Vessel::Cargo::Callbacks

#after, #after_change, #before, #before_start, #before_stop, #info, #on_error

Constructor Details

This class inherits a constructor from Vessel::Cargo