Class: Google::Apis::AiplatformV1::GoogleCloudAiplatformV1EvaluateInstancesRequest

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1/classes.rb,
lib/google/apis/aiplatform_v1/representations.rb,
lib/google/apis/aiplatform_v1/representations.rb

Overview

Request message for EvaluationService.EvaluateInstances.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1EvaluateInstancesRequest

Returns a new instance of GoogleCloudAiplatformV1EvaluateInstancesRequest.



6940
6941
6942
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6940

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#bleu_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1BleuInput

Input for bleu metric. Corresponds to the JSON property bleuInput



6788
6789
6790
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6788

def bleu_input
  @bleu_input
end

#coherence_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1CoherenceInput

Input for coherence metric. Corresponds to the JSON property coherenceInput



6793
6794
6795
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6793

def coherence_input
  @coherence_input
end

#comet_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1CometInput

Input for Comet metric. Corresponds to the JSON property cometInput



6798
6799
6800
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6798

def comet_input
  @comet_input
end

#exact_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1ExactMatchInput

Input for exact match metric. Corresponds to the JSON property exactMatchInput



6803
6804
6805
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6803

def exact_match_input
  @exact_match_input
end

#fluency_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1FluencyInput

Input for fluency metric. Corresponds to the JSON property fluencyInput



6808
6809
6810
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6808

def fluency_input
  @fluency_input
end

#fulfillment_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1FulfillmentInput

Input for fulfillment metric. Corresponds to the JSON property fulfillmentInput



6813
6814
6815
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6813

def fulfillment_input
  @fulfillment_input
end

#groundedness_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1GroundednessInput

Input for groundedness metric. Corresponds to the JSON property groundednessInput



6818
6819
6820
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6818

def groundedness_input
  @groundedness_input
end

#metricx_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1MetricxInput

Input for MetricX metric. Corresponds to the JSON property metricxInput



6823
6824
6825
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6823

def metricx_input
  @metricx_input
end

#pairwise_metric_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseMetricInput

Input for pairwise metric. Corresponds to the JSON property pairwiseMetricInput



6828
6829
6830
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6828

def pairwise_metric_input
  @pairwise_metric_input
end

#pairwise_question_answering_quality_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseQuestionAnsweringQualityInput

Input for pairwise question answering quality metric. Corresponds to the JSON property pairwiseQuestionAnsweringQualityInput



6833
6834
6835
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6833

def pairwise_question_answering_quality_input
  @pairwise_question_answering_quality_input
end

#pairwise_summarization_quality_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseSummarizationQualityInput

Input for pairwise summarization quality metric. Corresponds to the JSON property pairwiseSummarizationQualityInput



6838
6839
6840
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6838

def pairwise_summarization_quality_input
  @pairwise_summarization_quality_input
end

#pointwise_metric_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1PointwiseMetricInput

Input for pointwise metric. Corresponds to the JSON property pointwiseMetricInput



6843
6844
6845
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6843

def pointwise_metric_input
  @pointwise_metric_input
end

#question_answering_correctness_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringCorrectnessInput

Input for question answering correctness metric. Corresponds to the JSON property questionAnsweringCorrectnessInput



6848
6849
6850
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6848

def question_answering_correctness_input
  @question_answering_correctness_input
end

#question_answering_helpfulness_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringHelpfulnessInput

Input for question answering helpfulness metric. Corresponds to the JSON property questionAnsweringHelpfulnessInput



6853
6854
6855
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6853

def question_answering_helpfulness_input
  @question_answering_helpfulness_input
end

#question_answering_quality_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringQualityInput

Input for question answering quality metric. Corresponds to the JSON property questionAnsweringQualityInput



6858
6859
6860
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6858

def question_answering_quality_input
  @question_answering_quality_input
end

#question_answering_relevance_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringRelevanceInput

Input for question answering relevance metric. Corresponds to the JSON property questionAnsweringRelevanceInput



6863
6864
6865
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6863

def question_answering_relevance_input
  @question_answering_relevance_input
end

#rouge_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1RougeInput

Input for rouge metric. Corresponds to the JSON property rougeInput



6868
6869
6870
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6868

def rouge_input
  @rouge_input
end

#safety_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1SafetyInput

Input for safety metric. Corresponds to the JSON property safetyInput



6873
6874
6875
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6873

def safety_input
  @safety_input
end

#summarization_helpfulness_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationHelpfulnessInput

Input for summarization helpfulness metric. Corresponds to the JSON property summarizationHelpfulnessInput



6878
6879
6880
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6878

def summarization_helpfulness_input
  @summarization_helpfulness_input
end

#summarization_quality_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationQualityInput

Input for summarization quality metric. Corresponds to the JSON property summarizationQualityInput



6883
6884
6885
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6883

def summarization_quality_input
  @summarization_quality_input
end

#summarization_verbosity_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationVerbosityInput

Input for summarization verbosity metric. Corresponds to the JSON property summarizationVerbosityInput



6888
6889
6890
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6888

def summarization_verbosity_input
  @summarization_verbosity_input
end

#tool_call_valid_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolCallValidInput

Input for tool call valid metric. Corresponds to the JSON property toolCallValidInput



6893
6894
6895
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6893

def tool_call_valid_input
  @tool_call_valid_input
end

#tool_name_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolNameMatchInput

Input for tool name match metric. Corresponds to the JSON property toolNameMatchInput



6898
6899
6900
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6898

def tool_name_match_input
  @tool_name_match_input
end

#tool_parameter_key_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKeyMatchInput

Input for tool parameter key match metric. Corresponds to the JSON property toolParameterKeyMatchInput



6903
6904
6905
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6903

def tool_parameter_key_match_input
  @tool_parameter_key_match_input
end

#tool_parameter_kv_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKvMatchInput

Input for tool parameter key value match metric. Corresponds to the JSON property toolParameterKvMatchInput



6908
6909
6910
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6908

def tool_parameter_kv_match_input
  @tool_parameter_kv_match_input
end

#trajectory_any_order_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryAnyOrderMatchInput

Instances and metric spec for TrajectoryAnyOrderMatch metric. Corresponds to the JSON property trajectoryAnyOrderMatchInput



6913
6914
6915
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6913

def trajectory_any_order_match_input
  @trajectory_any_order_match_input
end

#trajectory_exact_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryExactMatchInput

Instances and metric spec for TrajectoryExactMatch metric. Corresponds to the JSON property trajectoryExactMatchInput



6918
6919
6920
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6918

def trajectory_exact_match_input
  @trajectory_exact_match_input
end

#trajectory_in_order_match_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryInOrderMatchInput

Instances and metric spec for TrajectoryInOrderMatch metric. Corresponds to the JSON property trajectoryInOrderMatchInput



6923
6924
6925
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6923

def trajectory_in_order_match_input
  @trajectory_in_order_match_input
end

#trajectory_precision_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryPrecisionInput

Instances and metric spec for TrajectoryPrecision metric. Corresponds to the JSON property trajectoryPrecisionInput



6928
6929
6930
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6928

def trajectory_precision_input
  @trajectory_precision_input
end

#trajectory_recall_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryRecallInput

Instances and metric spec for TrajectoryRecall metric. Corresponds to the JSON property trajectoryRecallInput



6933
6934
6935
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6933

def trajectory_recall_input
  @trajectory_recall_input
end

#trajectory_single_tool_use_inputGoogle::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectorySingleToolUseInput

Instances and metric spec for TrajectorySingleToolUse metric. Corresponds to the JSON property trajectorySingleToolUseInput



6938
6939
6940
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6938

def trajectory_single_tool_use_input
  @trajectory_single_tool_use_input
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



6945
6946
6947
6948
6949
6950
6951
6952
6953
6954
6955
6956
6957
6958
6959
6960
6961
6962
6963
6964
6965
6966
6967
6968
6969
6970
6971
6972
6973
6974
6975
6976
6977
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6945

def update!(**args)
  @bleu_input = args[:bleu_input] if args.key?(:bleu_input)
  @coherence_input = args[:coherence_input] if args.key?(:coherence_input)
  @comet_input = args[:comet_input] if args.key?(:comet_input)
  @exact_match_input = args[:exact_match_input] if args.key?(:exact_match_input)
  @fluency_input = args[:fluency_input] if args.key?(:fluency_input)
  @fulfillment_input = args[:fulfillment_input] if args.key?(:fulfillment_input)
  @groundedness_input = args[:groundedness_input] if args.key?(:groundedness_input)
  @metricx_input = args[:metricx_input] if args.key?(:metricx_input)
  @pairwise_metric_input = args[:pairwise_metric_input] if args.key?(:pairwise_metric_input)
  @pairwise_question_answering_quality_input = args[:pairwise_question_answering_quality_input] if args.key?(:pairwise_question_answering_quality_input)
  @pairwise_summarization_quality_input = args[:pairwise_summarization_quality_input] if args.key?(:pairwise_summarization_quality_input)
  @pointwise_metric_input = args[:pointwise_metric_input] if args.key?(:pointwise_metric_input)
  @question_answering_correctness_input = args[:question_answering_correctness_input] if args.key?(:question_answering_correctness_input)
  @question_answering_helpfulness_input = args[:question_answering_helpfulness_input] if args.key?(:question_answering_helpfulness_input)
  @question_answering_quality_input = args[:question_answering_quality_input] if args.key?(:question_answering_quality_input)
  @question_answering_relevance_input = args[:question_answering_relevance_input] if args.key?(:question_answering_relevance_input)
  @rouge_input = args[:rouge_input] if args.key?(:rouge_input)
  @safety_input = args[:safety_input] if args.key?(:safety_input)
  @summarization_helpfulness_input = args[:summarization_helpfulness_input] if args.key?(:summarization_helpfulness_input)
  @summarization_quality_input = args[:summarization_quality_input] if args.key?(:summarization_quality_input)
  @summarization_verbosity_input = args[:summarization_verbosity_input] if args.key?(:summarization_verbosity_input)
  @tool_call_valid_input = args[:tool_call_valid_input] if args.key?(:tool_call_valid_input)
  @tool_name_match_input = args[:tool_name_match_input] if args.key?(:tool_name_match_input)
  @tool_parameter_key_match_input = args[:tool_parameter_key_match_input] if args.key?(:tool_parameter_key_match_input)
  @tool_parameter_kv_match_input = args[:tool_parameter_kv_match_input] if args.key?(:tool_parameter_kv_match_input)
  @trajectory_any_order_match_input = args[:trajectory_any_order_match_input] if args.key?(:trajectory_any_order_match_input)
  @trajectory_exact_match_input = args[:trajectory_exact_match_input] if args.key?(:trajectory_exact_match_input)
  @trajectory_in_order_match_input = args[:trajectory_in_order_match_input] if args.key?(:trajectory_in_order_match_input)
  @trajectory_precision_input = args[:trajectory_precision_input] if args.key?(:trajectory_precision_input)
  @trajectory_recall_input = args[:trajectory_recall_input] if args.key?(:trajectory_recall_input)
  @trajectory_single_tool_use_input = args[:trajectory_single_tool_use_input] if args.key?(:trajectory_single_tool_use_input)
end