Class: Aws::Glue::Types::DirectKinesisSource

Inherits:

Struct

• Object
• Struct
• Aws::Glue::Types::DirectKinesisSource

Includes:

Structure

Defined in:

lib/aws-sdk-glue/types.rb

Overview

Note:

When making an API call, you may pass DirectKinesisSource data as a hash:

{
  name: "NodeName", # required
  window_size: 1,
  detect_schema: false,
  streaming_options: {
    endpoint_url: "EnclosedInStringProperty",
    stream_name: "EnclosedInStringProperty",
    classification: "EnclosedInStringProperty",
    delimiter: "EnclosedInStringProperty",
    starting_position: "latest", # accepts latest, trim_horizon, earliest
    max_fetch_time_in_ms: 1,
    max_fetch_records_per_shard: 1,
    max_record_per_read: 1,
    add_idle_time_between_reads: false,
    idle_time_between_reads_in_ms: 1,
    describe_shard_interval: 1,
    num_retries: 1,
    retry_interval_ms: 1,
    max_retry_interval_ms: 1,
    avoid_empty_batches: false,
    stream_arn: "EnclosedInStringProperty",
    role_arn: "EnclosedInStringProperty",
    role_session_name: "EnclosedInStringProperty",
  },
  data_preview_options: {
    polling_time: 1,
    record_polling_limit: 1,
  },
}

Specifies a direct Amazon Kinesis data source.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #data_preview_options ⇒ Types::StreamingDataPreviewOptions

  Additional options for data preview.

• #detect_schema ⇒ Boolean

  Whether to automatically determine the schema from the incoming data.

• #name ⇒ String

  The name of the data source.

• #streaming_options ⇒ Types::KinesisStreamingSourceOptions

  Additional options for the Kinesis streaming data source.

• #window_size ⇒ Integer

  The amount of time to spend processing each micro batch.

Instance Attribute Details

#data_preview_options ⇒ Types::StreamingDataPreviewOptions

Additional options for data preview.

Returns:

• (Types::StreamingDataPreviewOptions)

# File 'lib/aws-sdk-glue/types.rb', line 9528

class DirectKinesisSource < Struct.new(
  :name,
  :window_size,
  :detect_schema,
  :streaming_options,
  :data_preview_options)
  SENSITIVE = []
  include Aws::Structure
end

#detect_schema ⇒ Boolean

Whether to automatically determine the schema from the incoming data.

Returns:

• (Boolean)

# File 'lib/aws-sdk-glue/types.rb', line 9528

class DirectKinesisSource < Struct.new(
  :name,
  :window_size,
  :detect_schema,
  :streaming_options,
  :data_preview_options)
  SENSITIVE = []
  include Aws::Structure
end

#name ⇒ String

The name of the data source.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 9528

class DirectKinesisSource < Struct.new(
  :name,
  :window_size,
  :detect_schema,
  :streaming_options,
  :data_preview_options)
  SENSITIVE = []
  include Aws::Structure
end

#streaming_options ⇒ Types::KinesisStreamingSourceOptions

Additional options for the Kinesis streaming data source.

Returns:

• (Types::KinesisStreamingSourceOptions)

# File 'lib/aws-sdk-glue/types.rb', line 9528

class DirectKinesisSource < Struct.new(
  :name,
  :window_size,
  :detect_schema,
  :streaming_options,
  :data_preview_options)
  SENSITIVE = []
  include Aws::Structure
end

#window_size ⇒ Integer

The amount of time to spend processing each micro batch.

Returns:

• (Integer)

# File 'lib/aws-sdk-glue/types.rb', line 9528

class DirectKinesisSource < Struct.new(
  :name,
  :window_size,
  :detect_schema,
  :streaming_options,
  :data_preview_options)
  SENSITIVE = []
  include Aws::Structure
end