Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1EvaluateInstancesResponse

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

Response message for EvaluationService.EvaluateInstances.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1EvaluateInstancesResponse

Returns a new instance of GoogleCloudAiplatformV1beta1EvaluateInstancesResponse.



15489
15490
15491
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15489

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#bleu_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1BleuResults

Results for bleu metric. Corresponds to the JSON property bleuResults

Returns:



15324
15325
15326
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15324

def bleu_results
  @bleu_results
end

#coherence_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1CoherenceResult

Spec for coherence result. Corresponds to the JSON property coherenceResult

Returns:



15329
15330
15331
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15329

def coherence_result
  @coherence_result
end

#comet_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1CometResult

Spec for Comet result - calculates the comet score for the given instance using the version specified in the spec. Corresponds to the JSON property cometResult

Returns:



15335
15336
15337
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15335

def comet_result
  @comet_result
end

#exact_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ExactMatchResults

Results for exact match metric. Corresponds to the JSON property exactMatchResults

Returns:



15340
15341
15342
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15340

def exact_match_results
  @exact_match_results
end

#fluency_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1FluencyResult

Spec for fluency result. Corresponds to the JSON property fluencyResult

Returns:



15345
15346
15347
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15345

def fluency_result
  @fluency_result
end

#fulfillment_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1FulfillmentResult

Spec for fulfillment result. Corresponds to the JSON property fulfillmentResult

Returns:



15350
15351
15352
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15350

def fulfillment_result
  @fulfillment_result
end

#groundedness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1GroundednessResult

Spec for groundedness result. Corresponds to the JSON property groundednessResult

Returns:



15355
15356
15357
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15355

def groundedness_result
  @groundedness_result
end

#metric_results ⇒ Array<Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1MetricResult>

Metric results for each instance. The order of the metric results is guaranteed to be the same as the order of the instances in the request. Corresponds to the JSON property metricResults

Returns:



15361
15362
15363
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15361

def metric_results
  @metric_results
end

#metricx_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1MetricxResult

Spec for MetricX result - calculates the MetricX score for the given instance using the version specified in the spec. Corresponds to the JSON property metricxResult

Returns:



15367
15368
15369
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15367

def metricx_result
  @metricx_result
end

#pairwise_metric_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseMetricResult

Spec for pairwise metric result. Corresponds to the JSON property pairwiseMetricResult

Returns:



15372
15373
15374
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15372

def pairwise_metric_result
  @pairwise_metric_result
end

#pairwise_question_answering_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseQuestionAnsweringQualityResult

Spec for pairwise question answering quality result. Corresponds to the JSON property pairwiseQuestionAnsweringQualityResult

Returns:



15377
15378
15379
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15377

def pairwise_question_answering_quality_result
  @pairwise_question_answering_quality_result
end

#pairwise_summarization_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseSummarizationQualityResult

Spec for pairwise summarization quality result. Corresponds to the JSON property pairwiseSummarizationQualityResult

Returns:



15382
15383
15384
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15382

def pairwise_summarization_quality_result
  @pairwise_summarization_quality_result
end

#pointwise_metric_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PointwiseMetricResult

Spec for pointwise metric result. Corresponds to the JSON property pointwiseMetricResult

Returns:



15387
15388
15389
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15387

def pointwise_metric_result
  @pointwise_metric_result
end

#question_answering_correctness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringCorrectnessResult

Spec for question answering correctness result. Corresponds to the JSON property questionAnsweringCorrectnessResult

Returns:



15392
15393
15394
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15392

def question_answering_correctness_result
  @question_answering_correctness_result
end

#question_answering_helpfulness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringHelpfulnessResult

Spec for question answering helpfulness result. Corresponds to the JSON property questionAnsweringHelpfulnessResult

Returns:



15397
15398
15399
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15397

def question_answering_helpfulness_result
  @question_answering_helpfulness_result
end

#question_answering_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringQualityResult

Spec for question answering quality result. Corresponds to the JSON property questionAnsweringQualityResult

Returns:



15402
15403
15404
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15402

def question_answering_quality_result
  @question_answering_quality_result
end

#question_answering_relevance_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1QuestionAnsweringRelevanceResult

Spec for question answering relevance result. Corresponds to the JSON property questionAnsweringRelevanceResult

Returns:



15407
15408
15409
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15407

def question_answering_relevance_result
  @question_answering_relevance_result
end

#rouge_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RougeResults

Results for rouge metric. Corresponds to the JSON property rougeResults

Returns:



15412
15413
15414
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15412

def rouge_results
  @rouge_results
end

#rubric_based_instruction_following_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RubricBasedInstructionFollowingResult

Result for RubricBasedInstructionFollowing metric. Corresponds to the JSON property rubricBasedInstructionFollowingResult

Returns:



15417
15418
15419
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15417

def rubric_based_instruction_following_result
  @rubric_based_instruction_following_result
end

#safety_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SafetyResult

Spec for safety result. Corresponds to the JSON property safetyResult

Returns:



15422
15423
15424
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15422

def safety_result
  @safety_result
end

#summarization_helpfulness_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationHelpfulnessResult

Spec for summarization helpfulness result. Corresponds to the JSON property summarizationHelpfulnessResult

Returns:



15427
15428
15429
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15427

def summarization_helpfulness_result
  @summarization_helpfulness_result
end

#summarization_quality_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationQualityResult

Spec for summarization quality result. Corresponds to the JSON property summarizationQualityResult

Returns:



15432
15433
15434
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15432

def summarization_quality_result
  @summarization_quality_result
end

#summarization_verbosity_result ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SummarizationVerbosityResult

Spec for summarization verbosity result. Corresponds to the JSON property summarizationVerbosityResult

Returns:



15437
15438
15439
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15437

def summarization_verbosity_result
  @summarization_verbosity_result
end

#tool_call_valid_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolCallValidResults

Results for tool call valid metric. Corresponds to the JSON property toolCallValidResults

Returns:



15442
15443
15444
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15442

def tool_call_valid_results
  @tool_call_valid_results
end

#tool_name_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolNameMatchResults

Results for tool name match metric. Corresponds to the JSON property toolNameMatchResults

Returns:



15447
15448
15449
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15447

def tool_name_match_results
  @tool_name_match_results
end

#tool_parameter_key_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolParameterKeyMatchResults

Results for tool parameter key match metric. Corresponds to the JSON property toolParameterKeyMatchResults

Returns:



15452
15453
15454
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15452

def tool_parameter_key_match_results
  @tool_parameter_key_match_results
end

#tool_parameter_kv_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ToolParameterKvMatchResults

Results for tool parameter key value match metric. Corresponds to the JSON property toolParameterKvMatchResults

Returns:



15457
15458
15459
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15457

def tool_parameter_kv_match_results
  @tool_parameter_kv_match_results
end

#trajectory_any_order_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryAnyOrderMatchResults

Results for TrajectoryAnyOrderMatch metric. Corresponds to the JSON property trajectoryAnyOrderMatchResults

Returns:



15462
15463
15464
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15462

def trajectory_any_order_match_results
  @trajectory_any_order_match_results
end

#trajectory_exact_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryExactMatchResults

Results for TrajectoryExactMatch metric. Corresponds to the JSON property trajectoryExactMatchResults

Returns:



15467
15468
15469
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15467

def trajectory_exact_match_results
  @trajectory_exact_match_results
end

#trajectory_in_order_match_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryInOrderMatchResults

Results for TrajectoryInOrderMatch metric. Corresponds to the JSON property trajectoryInOrderMatchResults

Returns:



15472
15473
15474
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15472

def trajectory_in_order_match_results
  @trajectory_in_order_match_results
end

#trajectory_precision_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryPrecisionResults

Results for TrajectoryPrecision metric. Corresponds to the JSON property trajectoryPrecisionResults

Returns:



15477
15478
15479
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15477

def trajectory_precision_results
  @trajectory_precision_results
end

#trajectory_recall_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectoryRecallResults

Results for TrajectoryRecall metric. Corresponds to the JSON property trajectoryRecallResults

Returns:



15482
15483
15484
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15482

def trajectory_recall_results
  @trajectory_recall_results
end

#trajectory_single_tool_use_results ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1TrajectorySingleToolUseResults

Results for TrajectorySingleToolUse metric. Corresponds to the JSON property trajectorySingleToolUseResults

Returns:



15487
15488
15489
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15487

def trajectory_single_tool_use_results
  @trajectory_single_tool_use_results
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



15494
15495
15496
15497
15498
15499
15500
15501
15502
15503
15504
15505
15506
15507
15508
15509
15510
15511
15512
15513
15514
15515
15516
15517
15518
15519
15520
15521
15522
15523
15524
15525
15526
15527
15528
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 15494

def update!(**args)
  @bleu_results = args[:bleu_results] if args.key?(:bleu_results)
  @coherence_result = args[:coherence_result] if args.key?(:coherence_result)
  @comet_result = args[:comet_result] if args.key?(:comet_result)
  @exact_match_results = args[:exact_match_results] if args.key?(:exact_match_results)
  @fluency_result = args[:fluency_result] if args.key?(:fluency_result)
  @fulfillment_result = args[:fulfillment_result] if args.key?(:fulfillment_result)
  @groundedness_result = args[:groundedness_result] if args.key?(:groundedness_result)
  @metric_results = args[:metric_results] if args.key?(:metric_results)
  @metricx_result = args[:metricx_result] if args.key?(:metricx_result)
  @pairwise_metric_result = args[:pairwise_metric_result] if args.key?(:pairwise_metric_result)
  @pairwise_question_answering_quality_result = args[:pairwise_question_answering_quality_result] if args.key?(:pairwise_question_answering_quality_result)
  @pairwise_summarization_quality_result = args[:pairwise_summarization_quality_result] if args.key?(:pairwise_summarization_quality_result)
  @pointwise_metric_result = args[:pointwise_metric_result] if args.key?(:pointwise_metric_result)
  @question_answering_correctness_result = args[:question_answering_correctness_result] if args.key?(:question_answering_correctness_result)
  @question_answering_helpfulness_result = args[:question_answering_helpfulness_result] if args.key?(:question_answering_helpfulness_result)
  @question_answering_quality_result = args[:question_answering_quality_result] if args.key?(:question_answering_quality_result)
  @question_answering_relevance_result = args[:question_answering_relevance_result] if args.key?(:question_answering_relevance_result)
  @rouge_results = args[:rouge_results] if args.key?(:rouge_results)
  @rubric_based_instruction_following_result = args[:rubric_based_instruction_following_result] if args.key?(:rubric_based_instruction_following_result)
  @safety_result = args[:safety_result] if args.key?(:safety_result)
  @summarization_helpfulness_result = args[:summarization_helpfulness_result] if args.key?(:summarization_helpfulness_result)
  @summarization_quality_result = args[:summarization_quality_result] if args.key?(:summarization_quality_result)
  @summarization_verbosity_result = args[:summarization_verbosity_result] if args.key?(:summarization_verbosity_result)
  @tool_call_valid_results = args[:tool_call_valid_results] if args.key?(:tool_call_valid_results)
  @tool_name_match_results = args[:tool_name_match_results] if args.key?(:tool_name_match_results)
  @tool_parameter_key_match_results = args[:tool_parameter_key_match_results] if args.key?(:tool_parameter_key_match_results)
  @tool_parameter_kv_match_results = args[:tool_parameter_kv_match_results] if args.key?(:tool_parameter_kv_match_results)
  @trajectory_any_order_match_results = args[:trajectory_any_order_match_results] if args.key?(:trajectory_any_order_match_results)
  @trajectory_exact_match_results = args[:trajectory_exact_match_results] if args.key?(:trajectory_exact_match_results)
  @trajectory_in_order_match_results = args[:trajectory_in_order_match_results] if args.key?(:trajectory_in_order_match_results)
  @trajectory_precision_results = args[:trajectory_precision_results] if args.key?(:trajectory_precision_results)
  @trajectory_recall_results = args[:trajectory_recall_results] if args.key?(:trajectory_recall_results)
  @trajectory_single_tool_use_results = args[:trajectory_single_tool_use_results] if args.key?(:trajectory_single_tool_use_results)
end