Class: Aws::BedrockAgent::Types::WebCrawlerLimits

Inherits:

Struct

• Object
• Struct
• Aws::BedrockAgent::Types::WebCrawlerLimits

Includes:

Structure

Defined in:

lib/aws-sdk-bedrockagent/types.rb

Overview

The rate limits for the URLs that you want to crawl. You should be authorized to crawl the URLs.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #max_pages ⇒ Integer

  The max number of web pages crawled from your source URLs, up to 25,000 pages.

• #rate_limit ⇒ Integer

  The max rate at which pages are crawled, up to 300 per minute per host.

Instance Attribute Details

#max_pages ⇒ Integer

The max number of web pages crawled from your source URLs, up to 25,000 pages. If the web pages exceed this limit, the data source sync will fail and no web pages will be ingested.

Returns:

• (Integer)

# File 'lib/aws-sdk-bedrockagent/types.rb', line 12142

class WebCrawlerLimits < Struct.new(
  :rate_limit,
  :max_pages)
  SENSITIVE = []
  include Aws::Structure
end

#rate_limit ⇒ Integer

The max rate at which pages are crawled, up to 300 per minute per host.

Returns:

• (Integer)

# File 'lib/aws-sdk-bedrockagent/types.rb', line 12142

class WebCrawlerLimits < Struct.new(
  :rate_limit,
  :max_pages)
  SENSITIVE = []
  include Aws::Structure
end