Class: Aws::BedrockAgent::Types::HierarchicalChunkingConfiguration
- Inherits:
-
Struct
- Object
- Struct
- Aws::BedrockAgent::Types::HierarchicalChunkingConfiguration
- Includes:
- Structure
- Defined in:
- lib/aws-sdk-bedrockagent/types.rb
Overview
Settings for hierarchical document chunking for a data source. Hierarchical chunking splits documents into layers of chunks where the first layer contains large chunks, and the second layer contains smaller chunks derived from the first layer.
You configure the number of tokens to overlap, or repeat across adjacent chunks. For example, if you set overlap tokens to 60, the last 60 tokens in the first chunk are also included at the beginning of the second chunk. For each layer, you must also configure the maximum number of tokens in a chunk.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#level_configurations ⇒ Array<Types::HierarchicalChunkingLevelConfiguration>
Token settings for each layer.
-
#overlap_tokens ⇒ Integer
The number of tokens to repeat across chunks in the same layer.
Instance Attribute Details
#level_configurations ⇒ Array<Types::HierarchicalChunkingLevelConfiguration>
Token settings for each layer.
4139 4140 4141 4142 4143 4144 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 4139 class HierarchicalChunkingConfiguration < Struct.new( :level_configurations, :overlap_tokens) SENSITIVE = [] include Aws::Structure end |
#overlap_tokens ⇒ Integer
The number of tokens to repeat across chunks in the same layer.
4139 4140 4141 4142 4143 4144 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 4139 class HierarchicalChunkingConfiguration < Struct.new( :level_configurations, :overlap_tokens) SENSITIVE = [] include Aws::Structure end |