Class: Aws::BedrockAgent::Types::ChunkingConfiguration
- Inherits:
-
Struct
- Object
- Struct
- Aws::BedrockAgent::Types::ChunkingConfiguration
- Includes:
- Structure
- Defined in:
- lib/aws-sdk-bedrockagent/types.rb
Overview
Details about how to chunk the documents in the data source. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#chunking_strategy ⇒ String
Knowledge base can split your source data into chunks.
-
#fixed_size_chunking_configuration ⇒ Types::FixedSizeChunkingConfiguration
Configurations for when you choose fixed-size chunking.
-
#hierarchical_chunking_configuration ⇒ Types::HierarchicalChunkingConfiguration
Settings for hierarchical document chunking for a data source.
-
#semantic_chunking_configuration ⇒ Types::SemanticChunkingConfiguration
Settings for semantic document chunking for a data source.
Instance Attribute Details
#chunking_strategy ⇒ String
Knowledge base can split your source data into chunks. A chunk refers to an excerpt from a data source that is returned when the knowledge base that it belongs to is queried. You have the following options for chunking your data. If you opt for ‘NONE`, then you may want to pre-process your files by splitting them up such that each file corresponds to a chunk.
-
‘FIXED_SIZE` – Amazon Bedrock splits your source data into chunks of the approximate size that you set in the `fixedSizeChunkingConfiguration`.
-
‘HIERARCHICAL` – Split documents into layers of chunks where the first layer contains large chunks, and the second layer contains smaller chunks derived from the first layer.
-
‘SEMANTIC` – Split documents into chunks based on groups of similar content derived with natural language processing.
-
‘NONE` – Amazon Bedrock treats each file as one chunk. If you choose this option, you may want to pre-process your documents by splitting them into separate files.
1046 1047 1048 1049 1050 1051 1052 1053 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 1046 class ChunkingConfiguration < Struct.new( :chunking_strategy, :fixed_size_chunking_configuration, :hierarchical_chunking_configuration, :semantic_chunking_configuration) SENSITIVE = [] include Aws::Structure end |
#fixed_size_chunking_configuration ⇒ Types::FixedSizeChunkingConfiguration
Configurations for when you choose fixed-size chunking. If you set the ‘chunkingStrategy` as `NONE`, exclude this field.
1046 1047 1048 1049 1050 1051 1052 1053 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 1046 class ChunkingConfiguration < Struct.new( :chunking_strategy, :fixed_size_chunking_configuration, :hierarchical_chunking_configuration, :semantic_chunking_configuration) SENSITIVE = [] include Aws::Structure end |
#hierarchical_chunking_configuration ⇒ Types::HierarchicalChunkingConfiguration
Settings for hierarchical document chunking for a data source. Hierarchical chunking splits documents into layers of chunks where the first layer contains large chunks, and the second layer contains smaller chunks derived from the first layer.
1046 1047 1048 1049 1050 1051 1052 1053 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 1046 class ChunkingConfiguration < Struct.new( :chunking_strategy, :fixed_size_chunking_configuration, :hierarchical_chunking_configuration, :semantic_chunking_configuration) SENSITIVE = [] include Aws::Structure end |
#semantic_chunking_configuration ⇒ Types::SemanticChunkingConfiguration
Settings for semantic document chunking for a data source. Semantic chunking splits a document into into smaller documents based on groups of similar content derived from the text with natural language processing.
1046 1047 1048 1049 1050 1051 1052 1053 |
# File 'lib/aws-sdk-bedrockagent/types.rb', line 1046 class ChunkingConfiguration < Struct.new( :chunking_strategy, :fixed_size_chunking_configuration, :hierarchical_chunking_configuration, :semantic_chunking_configuration) SENSITIVE = [] include Aws::Structure end |