Class: Aws::Glue::Types::S3Target

Inherits:

Struct

• Object
• Struct
• Aws::Glue::Types::S3Target

Includes:

Structure

Defined in:

lib/aws-sdk-glue/types.rb

Overview

Note:

When making an API call, you may pass S3Target data as a hash:

{
  path: "Path",
  exclusions: ["Path"],
  connection_name: "ConnectionName",
  sample_size: 1,
  event_queue_arn: "EventQueueArn",
  dlq_event_queue_arn: "EventQueueArn",
}

Specifies a data store in Amazon Simple Storage Service (Amazon S3).

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #connection_name ⇒ String

  The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

• #dlq_event_queue_arn ⇒ String

  A valid Amazon dead-letter SQS ARN.

• #event_queue_arn ⇒ String

  A valid Amazon SQS ARN.

• #exclusions ⇒ Array<String>

  A list of glob patterns used to exclude from the crawl.

• #path ⇒ String

  The path to the Amazon S3 target.

• #sample_size ⇒ Integer

  Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset.

Instance Attribute Details

#connection_name ⇒ String

The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end

#dlq_event_queue_arn ⇒ String

A valid Amazon dead-letter SQS ARN. For example, `arn:aws:sqs:region:account:deadLetterQueue`.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end

#event_queue_arn ⇒ String

A valid Amazon SQS ARN. For example, `arn:aws:sqs:region:account:sqs`.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end

#exclusions ⇒ Array<String>

A list of glob patterns used to exclude from the crawl. For more information, see [Catalog Tables with a Crawler].

[1]: docs.aws.amazon.com/glue/latest/dg/add-crawler.html

Returns:

• (Array<String>)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end

#path ⇒ String

The path to the Amazon S3 target.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end

#sample_size ⇒ Integer

Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

Returns:

• (Integer)

# File 'lib/aws-sdk-glue/types.rb', line 21020

class S3Target < Struct.new(
  :path,
  :exclusions,
  :connection_name,
  :sample_size,
  :event_queue_arn,
  :dlq_event_queue_arn)
  SENSITIVE = []
  include Aws::Structure
end