Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluateInstancesResponse

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

Response message for EvaluationService.EvaluateInstances.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1EvaluateInstancesResponse

Returns a new instance of GoogleCloudAiplatformV1beta1EvaluateInstancesResponse.



18632
18633
18634
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18632

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#bleu_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1BleuResults

Results for bleu metric. Corresponds to the JSON property bleuResults

Returns:



18467
18468
18469
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18467

def bleu_results
  @bleu_results
end

#coherence_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1CoherenceResult

Spec for coherence result. Corresponds to the JSON property coherenceResult

Returns:



18472
18473
18474
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18472

def coherence_result
  @coherence_result
end

#comet_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1CometResult

Spec for Comet result - calculates the comet score for the given instance using the version specified in the spec. Corresponds to the JSON property cometResult

Returns:



18478
18479
18480
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18478

def comet_result
  @comet_result
end

#exact_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ExactMatchResults

Results for exact match metric. Corresponds to the JSON property exactMatchResults

Returns:



18483
18484
18485
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18483

def exact_match_results
  @exact_match_results
end

#fluency_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1FluencyResult

Spec for fluency result. Corresponds to the JSON property fluencyResult

Returns:



18488
18489
18490
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18488

def fluency_result
  @fluency_result
end

#fulfillment_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1FulfillmentResult

Spec for fulfillment result. Corresponds to the JSON property fulfillmentResult

Returns:



18493
18494
18495
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18493

def fulfillment_result
  @fulfillment_result
end

#groundedness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1GroundednessResult

Spec for groundedness result. Corresponds to the JSON property groundednessResult

Returns:



18498
18499
18500
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18498

def groundedness_result
  @groundedness_result
end

#metric_results ⇒ Array<Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1MetricResult>

Metric results for each instance. The order of the metric results is guaranteed to be the same as the order of the instances in the request. Corresponds to the JSON property metricResults

Returns:



18504
18505
18506
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18504

def metric_results
  @metric_results
end

#metricx_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1MetricxResult

Spec for MetricX result - calculates the MetricX score for the given instance using the version specified in the spec. Corresponds to the JSON property metricxResult

Returns:



18510
18511
18512
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18510

def metricx_result
  @metricx_result
end

#pairwise_metric_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseMetricResult

Spec for pairwise metric result. Corresponds to the JSON property pairwiseMetricResult

Returns:



18515
18516
18517
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18515

def pairwise_metric_result
  @pairwise_metric_result
end

#pairwise_question_answering_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseQuestionAnsweringQualityResult

Spec for pairwise question answering quality result. Corresponds to the JSON property pairwiseQuestionAnsweringQualityResult

Returns:



18520
18521
18522
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18520

def pairwise_question_answering_quality_result
  @pairwise_question_answering_quality_result
end

#pairwise_summarization_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseSummarizationQualityResult

Spec for pairwise summarization quality result. Corresponds to the JSON property pairwiseSummarizationQualityResult

Returns:



18525
18526
18527
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18525

def pairwise_summarization_quality_result
  @pairwise_summarization_quality_result
end

#pointwise_metric_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PointwiseMetricResult

Spec for pointwise metric result. Corresponds to the JSON property pointwiseMetricResult

Returns:



18530
18531
18532
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18530

def pointwise_metric_result
  @pointwise_metric_result
end

#question_answering_correctness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringCorrectnessResult

Spec for question answering correctness result. Corresponds to the JSON property questionAnsweringCorrectnessResult

Returns:



18535
18536
18537
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18535

def question_answering_correctness_result
  @question_answering_correctness_result
end

#question_answering_helpfulness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringHelpfulnessResult

Spec for question answering helpfulness result. Corresponds to the JSON property questionAnsweringHelpfulnessResult

Returns:



18540
18541
18542
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18540

def question_answering_helpfulness_result
  @question_answering_helpfulness_result
end

#question_answering_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringQualityResult

Spec for question answering quality result. Corresponds to the JSON property questionAnsweringQualityResult

Returns:



18545
18546
18547
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18545

def question_answering_quality_result
  @question_answering_quality_result
end

#question_answering_relevance_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringRelevanceResult

Spec for question answering relevance result. Corresponds to the JSON property questionAnsweringRelevanceResult

Returns:



18550
18551
18552
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18550

def question_answering_relevance_result
  @question_answering_relevance_result
end

#rouge_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RougeResults

Results for rouge metric. Corresponds to the JSON property rougeResults

Returns:



18555
18556
18557
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18555

def rouge_results
  @rouge_results
end

#rubric_based_instruction_following_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RubricBasedInstructionFollowingResult

Result for RubricBasedInstructionFollowing metric. Corresponds to the JSON property rubricBasedInstructionFollowingResult

Returns:



18560
18561
18562
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18560

def rubric_based_instruction_following_result
  @rubric_based_instruction_following_result
end

#safety_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SafetyResult

Spec for safety result. Corresponds to the JSON property safetyResult

Returns:



18565
18566
18567
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18565

def safety_result
  @safety_result
end

#summarization_helpfulness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationHelpfulnessResult

Spec for summarization helpfulness result. Corresponds to the JSON property summarizationHelpfulnessResult

Returns:



18570
18571
18572
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18570

def summarization_helpfulness_result
  @summarization_helpfulness_result
end

#summarization_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationQualityResult

Spec for summarization quality result. Corresponds to the JSON property summarizationQualityResult

Returns:



18575
18576
18577
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18575

def summarization_quality_result
  @summarization_quality_result
end

#summarization_verbosity_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationVerbosityResult

Spec for summarization verbosity result. Corresponds to the JSON property summarizationVerbosityResult

Returns:



18580
18581
18582
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18580

def summarization_verbosity_result
  @summarization_verbosity_result
end

#tool_call_valid_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolCallValidResults

Results for tool call valid metric. Corresponds to the JSON property toolCallValidResults

Returns:



18585
18586
18587
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18585

def tool_call_valid_results
  @tool_call_valid_results
end

#tool_name_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolNameMatchResults

Results for tool name match metric. Corresponds to the JSON property toolNameMatchResults

Returns:



18590
18591
18592
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18590

def tool_name_match_results
  @tool_name_match_results
end

#tool_parameter_key_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolParameterKeyMatchResults

Results for tool parameter key match metric. Corresponds to the JSON property toolParameterKeyMatchResults

Returns:



18595
18596
18597
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18595

def tool_parameter_key_match_results
  @tool_parameter_key_match_results
end

#tool_parameter_kv_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolParameterKvMatchResults

Results for tool parameter key value match metric. Corresponds to the JSON property toolParameterKvMatchResults

Returns:



18600
18601
18602
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18600

def tool_parameter_kv_match_results
  @tool_parameter_kv_match_results
end

#trajectory_any_order_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryAnyOrderMatchResults

Results for TrajectoryAnyOrderMatch metric. Corresponds to the JSON property trajectoryAnyOrderMatchResults

Returns:



18605
18606
18607
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18605

def trajectory_any_order_match_results
  @trajectory_any_order_match_results
end

#trajectory_exact_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryExactMatchResults

Results for TrajectoryExactMatch metric. Corresponds to the JSON property trajectoryExactMatchResults

Returns:



18610
18611
18612
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18610

def trajectory_exact_match_results
  @trajectory_exact_match_results
end

#trajectory_in_order_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryInOrderMatchResults

Results for TrajectoryInOrderMatch metric. Corresponds to the JSON property trajectoryInOrderMatchResults

Returns:



18615
18616
18617
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18615

def trajectory_in_order_match_results
  @trajectory_in_order_match_results
end

#trajectory_precision_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryPrecisionResults

Results for TrajectoryPrecision metric. Corresponds to the JSON property trajectoryPrecisionResults

Returns:



18620
18621
18622
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18620

def trajectory_precision_results
  @trajectory_precision_results
end

#trajectory_recall_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryRecallResults

Results for TrajectoryRecall metric. Corresponds to the JSON property trajectoryRecallResults

Returns:



18625
18626
18627
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18625

def trajectory_recall_results
  @trajectory_recall_results
end

#trajectory_single_tool_use_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectorySingleToolUseResults

Results for TrajectorySingleToolUse metric. Corresponds to the JSON property trajectorySingleToolUseResults

Returns:



18630
18631
18632
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18630

def trajectory_single_tool_use_results
  @trajectory_single_tool_use_results
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



18637
18638
18639
18640
18641
18642
18643
18644
18645
18646
18647
18648
18649
18650
18651
18652
18653
18654
18655
18656
18657
18658
18659
18660
18661
18662
18663
18664
18665
18666
18667
18668
18669
18670
18671
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 18637

def update!(**args)
  @bleu_results = args[:bleu_results] if args.key?(:bleu_results)
  @coherence_result = args[:coherence_result] if args.key?(:coherence_result)
  @comet_result = args[:comet_result] if args.key?(:comet_result)
  @exact_match_results = args[:exact_match_results] if args.key?(:exact_match_results)
  @fluency_result = args[:fluency_result] if args.key?(:fluency_result)
  @fulfillment_result = args[:fulfillment_result] if args.key?(:fulfillment_result)
  @groundedness_result = args[:groundedness_result] if args.key?(:groundedness_result)
  @metric_results = args[:metric_results] if args.key?(:metric_results)
  @metricx_result = args[:metricx_result] if args.key?(:metricx_result)
  @pairwise_metric_result = args[:pairwise_metric_result] if args.key?(:pairwise_metric_result)
  @pairwise_question_answering_quality_result = args[:pairwise_question_answering_quality_result] if args.key?(:pairwise_question_answering_quality_result)
  @pairwise_summarization_quality_result = args[:pairwise_summarization_quality_result] if args.key?(:pairwise_summarization_quality_result)
  @pointwise_metric_result = args[:pointwise_metric_result] if args.key?(:pointwise_metric_result)
  @question_answering_correctness_result = args[:question_answering_correctness_result] if args.key?(:question_answering_correctness_result)
  @question_answering_helpfulness_result = args[:question_answering_helpfulness_result] if args.key?(:question_answering_helpfulness_result)
  @question_answering_quality_result = args[:question_answering_quality_result] if args.key?(:question_answering_quality_result)
  @question_answering_relevance_result = args[:question_answering_relevance_result] if args.key?(:question_answering_relevance_result)
  @rouge_results = args[:rouge_results] if args.key?(:rouge_results)
  @rubric_based_instruction_following_result = args[:rubric_based_instruction_following_result] if args.key?(:rubric_based_instruction_following_result)
  @safety_result = args[:safety_result] if args.key?(:safety_result)
  @summarization_helpfulness_result = args[:summarization_helpfulness_result] if args.key?(:summarization_helpfulness_result)
  @summarization_quality_result = args[:summarization_quality_result] if args.key?(:summarization_quality_result)
  @summarization_verbosity_result = args[:summarization_verbosity_result] if args.key?(:summarization_verbosity_result)
  @tool_call_valid_results = args[:tool_call_valid_results] if args.key?(:tool_call_valid_results)
  @tool_name_match_results = args[:tool_name_match_results] if args.key?(:tool_name_match_results)
  @tool_parameter_key_match_results = args[:tool_parameter_key_match_results] if args.key?(:tool_parameter_key_match_results)
  @tool_parameter_kv_match_results = args[:tool_parameter_kv_match_results] if args.key?(:tool_parameter_kv_match_results)
  @trajectory_any_order_match_results = args[:trajectory_any_order_match_results] if args.key?(:trajectory_any_order_match_results)
  @trajectory_exact_match_results = args[:trajectory_exact_match_results] if args.key?(:trajectory_exact_match_results)
  @trajectory_in_order_match_results = args[:trajectory_in_order_match_results] if args.key?(:trajectory_in_order_match_results)
  @trajectory_precision_results = args[:trajectory_precision_results] if args.key?(:trajectory_precision_results)
  @trajectory_recall_results = args[:trajectory_recall_results] if args.key?(:trajectory_recall_results)
  @trajectory_single_tool_use_results = args[:trajectory_single_tool_use_results] if args.key?(:trajectory_single_tool_use_results)
end