Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1LlmBasedMetricSpec

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

Specification for an LLM based metric.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1LlmBasedMetricSpec

Returns a new instance of GoogleCloudAiplatformV1beta1LlmBasedMetricSpec.



27648
27649
27650
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27648

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#additional_config ⇒ Hash<String,Object>

Optional. Optional additional configuration for the metric. Corresponds to the JSON property additionalConfig

Returns:

  • (Hash<String,Object>) 


27608
27609
27610
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27608

def additional_config
  @additional_config
end

#judge_autorater_config ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1AutoraterConfig

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset. Corresponds to the JSON property judgeAutoraterConfig

Returns:



27614
27615
27616
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27614

def judge_autorater_config
  @judge_autorater_config
end

#metric_prompt_template ⇒ String

Required. Template for the prompt sent to the judge model. Corresponds to the JSON property metricPromptTemplate

Returns:

  • (String) 


27619
27620
27621
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27619

def metric_prompt_template
  @metric_prompt_template
end

#predefined_rubric_generation_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PredefinedMetricSpec

The spec for a pre-defined metric. Corresponds to the JSON property predefinedRubricGenerationSpec

Returns:



27624
27625
27626
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27624

def predefined_rubric_generation_spec
  @predefined_rubric_generation_spec
end

#result_parser_config ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluationParserConfig

Config for parsing LLM responses. It can be used to parse the LLM response to be evaluated, or the LLM response from LLM-based metrics/Autoraters. Corresponds to the JSON property resultParserConfig

Returns:



27630
27631
27632
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27630

def result_parser_config
  @result_parser_config
end

#rubric_generation_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RubricGenerationSpec

Specification for how rubrics should be generated. Corresponds to the JSON property rubricGenerationSpec

Returns:



27635
27636
27637
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27635

def rubric_generation_spec
  @rubric_generation_spec
end

#rubric_group_key ⇒ String

Use a pre-defined group of rubrics associated with the input. Refers to a key in the rubric_groups map of EvaluationInstance. Corresponds to the JSON property rubricGroupKey

Returns:

  • (String) 


27641
27642
27643
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27641

def rubric_group_key
  @rubric_group_key
end

#system_instruction ⇒ String

Optional. System instructions for the judge model. Corresponds to the JSON property systemInstruction

Returns:

  • (String) 


27646
27647
27648
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27646

def system_instruction
  @system_instruction
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



27653
27654
27655
27656
27657
27658
27659
27660
27661
27662
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 27653

def update!(**args)
  @additional_config = args[:additional_config] if args.key?(:additional_config)
  @judge_autorater_config = args[:judge_autorater_config] if args.key?(:judge_autorater_config)
  @metric_prompt_template = args[:metric_prompt_template] if args.key?(:metric_prompt_template)
  @predefined_rubric_generation_spec = args[:predefined_rubric_generation_spec] if args.key?(:predefined_rubric_generation_spec)
  @result_parser_config = args[:result_parser_config] if args.key?(:result_parser_config)
  @rubric_generation_spec = args[:rubric_generation_spec] if args.key?(:rubric_generation_spec)
  @rubric_group_key = args[:rubric_group_key] if args.key?(:rubric_group_key)
  @system_instruction = args[:system_instruction] if args.key?(:system_instruction)
end