Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluationRunMetricRubricBasedMetricSpec

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

Specification for a metric that is based on rubrics.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1EvaluationRunMetricRubricBasedMetricSpec

Returns a new instance of GoogleCloudAiplatformV1beta1EvaluationRunMetricRubricBasedMetricSpec.



19913
19914
19915
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19913

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#inline_rubrics ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluationRunMetricRubricBasedMetricSpecRepeatedRubrics

Defines a list of rubrics, used when providing rubrics inline. Corresponds to the JSON property inlineRubrics

Returns:



19889
19890
19891
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19889

def inline_rubrics
  @inline_rubrics
end

#judge_autorater_config ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluationRunEvaluationConfigAutoraterConfig

The autorater config used for the evaluation run. Corresponds to the JSON property judgeAutoraterConfig

Returns:



19894
19895
19896
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19894

def judge_autorater_config
  @judge_autorater_config
end

#metric_prompt_template ⇒ String

Optional. Template for the prompt used by the judge model to evaluate against rubrics. Corresponds to the JSON property metricPromptTemplate

Returns:

  • (String) 


19900
19901
19902
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19900

def metric_prompt_template
  @metric_prompt_template
end

#rubric_generation_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluationRunMetricRubricGenerationSpec

Specification for how rubrics should be generated. Corresponds to the JSON property rubricGenerationSpec

Returns:



19905
19906
19907
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19905

def rubric_generation_spec
  @rubric_generation_spec
end

#rubric_group_key ⇒ String

Use a pre-defined group of rubrics associated with the input content. This refers to a key in the rubric_groups map of RubricEnhancedContents. Corresponds to the JSON property rubricGroupKey

Returns:

  • (String) 


19911
19912
19913
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19911

def rubric_group_key
  @rubric_group_key
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



19918
19919
19920
19921
19922
19923
19924
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 19918

def update!(**args)
  @inline_rubrics = args[:inline_rubrics] if args.key?(:inline_rubrics)
  @judge_autorater_config = args[:judge_autorater_config] if args.key?(:judge_autorater_config)
  @metric_prompt_template = args[:metric_prompt_template] if args.key?(:metric_prompt_template)
  @rubric_generation_spec = args[:rubric_generation_spec] if args.key?(:rubric_generation_spec)
  @rubric_group_key = args[:rubric_group_key] if args.key?(:rubric_group_key)
end