Class: Google::Apis::AiplatformV1::GoogleCloudAiplatformV1EvaluateInstancesRequest
- Inherits:
-
Object
- Object
- Google::Apis::AiplatformV1::GoogleCloudAiplatformV1EvaluateInstancesRequest
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- lib/google/apis/aiplatform_v1/classes.rb,
lib/google/apis/aiplatform_v1/representations.rb,
lib/google/apis/aiplatform_v1/representations.rb
Overview
Request message for EvaluationService.EvaluateInstances.
Instance Attribute Summary collapse
-
#bleu_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1BleuInput
Input for bleu metric.
-
#coherence_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CoherenceInput
Input for coherence metric.
-
#comet_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CometInput
Input for Comet metric.
-
#exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ExactMatchInput
Input for exact match metric.
-
#fluency_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FluencyInput
Input for fluency metric.
-
#fulfillment_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FulfillmentInput
Input for fulfillment metric.
-
#groundedness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1GroundednessInput
Input for groundedness metric.
-
#metricx_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1MetricxInput
Input for MetricX metric.
-
#pairwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseMetricInput
Input for pairwise metric.
-
#pairwise_question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
-
#pairwise_summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
-
#pointwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PointwiseMetricInput
Input for pointwise metric.
-
#question_answering_correctness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
-
#question_answering_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
-
#question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringQualityInput
Input for question answering quality metric.
-
#question_answering_relevance_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringRelevanceInput
Input for question answering relevance metric.
-
#rouge_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1RougeInput
Input for rouge metric.
-
#safety_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SafetyInput
Input for safety metric.
-
#summarization_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationHelpfulnessInput
Input for summarization helpfulness metric.
-
#summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationQualityInput
Input for summarization quality metric.
-
#summarization_verbosity_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationVerbosityInput
Input for summarization verbosity metric.
-
#tool_call_valid_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolCallValidInput
Input for tool call valid metric.
-
#tool_name_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolNameMatchInput
Input for tool name match metric.
-
#tool_parameter_key_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKeyMatchInput
Input for tool parameter key match metric.
-
#tool_parameter_kv_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKvMatchInput
Input for tool parameter key value match metric.
-
#trajectory_any_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryAnyOrderMatchInput
Instances and metric spec for TrajectoryAnyOrderMatch metric.
-
#trajectory_exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryExactMatchInput
Instances and metric spec for TrajectoryExactMatch metric.
-
#trajectory_in_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryInOrderMatchInput
Instances and metric spec for TrajectoryInOrderMatch metric.
-
#trajectory_precision_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryPrecisionInput
Instances and metric spec for TrajectoryPrecision metric.
-
#trajectory_recall_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryRecallInput
Instances and metric spec for TrajectoryRecall metric.
-
#trajectory_single_tool_use_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectorySingleToolUseInput
Instances and metric spec for TrajectorySingleToolUse metric.
Instance Method Summary collapse
-
#initialize(**args) ⇒ GoogleCloudAiplatformV1EvaluateInstancesRequest
constructor
A new instance of GoogleCloudAiplatformV1EvaluateInstancesRequest.
-
#update!(**args) ⇒ Object
Update properties of this object.
Constructor Details
#initialize(**args) ⇒ GoogleCloudAiplatformV1EvaluateInstancesRequest
Returns a new instance of GoogleCloudAiplatformV1EvaluateInstancesRequest.
6940 6941 6942 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6940 def initialize(**args) update!(**args) end |
Instance Attribute Details
#bleu_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1BleuInput
Input for bleu metric.
Corresponds to the JSON property bleuInput
6788 6789 6790 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6788 def bleu_input @bleu_input end |
#coherence_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CoherenceInput
Input for coherence metric.
Corresponds to the JSON property coherenceInput
6793 6794 6795 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6793 def coherence_input @coherence_input end |
#comet_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CometInput
Input for Comet metric.
Corresponds to the JSON property cometInput
6798 6799 6800 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6798 def comet_input @comet_input end |
#exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ExactMatchInput
Input for exact match metric.
Corresponds to the JSON property exactMatchInput
6803 6804 6805 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6803 def exact_match_input @exact_match_input end |
#fluency_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FluencyInput
Input for fluency metric.
Corresponds to the JSON property fluencyInput
6808 6809 6810 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6808 def fluency_input @fluency_input end |
#fulfillment_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FulfillmentInput
Input for fulfillment metric.
Corresponds to the JSON property fulfillmentInput
6813 6814 6815 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6813 def fulfillment_input @fulfillment_input end |
#groundedness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1GroundednessInput
Input for groundedness metric.
Corresponds to the JSON property groundednessInput
6818 6819 6820 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6818 def groundedness_input @groundedness_input end |
#metricx_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1MetricxInput
Input for MetricX metric.
Corresponds to the JSON property metricxInput
6823 6824 6825 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6823 def metricx_input @metricx_input end |
#pairwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseMetricInput
Input for pairwise metric.
Corresponds to the JSON property pairwiseMetricInput
6828 6829 6830 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6828 def pairwise_metric_input @pairwise_metric_input end |
#pairwise_question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
Corresponds to the JSON property pairwiseQuestionAnsweringQualityInput
6833 6834 6835 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6833 def pairwise_question_answering_quality_input @pairwise_question_answering_quality_input end |
#pairwise_summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
Corresponds to the JSON property pairwiseSummarizationQualityInput
6838 6839 6840 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6838 def pairwise_summarization_quality_input @pairwise_summarization_quality_input end |
#pointwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PointwiseMetricInput
Input for pointwise metric.
Corresponds to the JSON property pointwiseMetricInput
6843 6844 6845 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6843 def pointwise_metric_input @pointwise_metric_input end |
#question_answering_correctness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
Corresponds to the JSON property questionAnsweringCorrectnessInput
6848 6849 6850 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6848 def question_answering_correctness_input @question_answering_correctness_input end |
#question_answering_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
Corresponds to the JSON property questionAnsweringHelpfulnessInput
6853 6854 6855 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6853 def question_answering_helpfulness_input @question_answering_helpfulness_input end |
#question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringQualityInput
Input for question answering quality metric.
Corresponds to the JSON property questionAnsweringQualityInput
6858 6859 6860 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6858 def question_answering_quality_input @question_answering_quality_input end |
#question_answering_relevance_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringRelevanceInput
Input for question answering relevance metric.
Corresponds to the JSON property questionAnsweringRelevanceInput
6863 6864 6865 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6863 def question_answering_relevance_input @question_answering_relevance_input end |
#rouge_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1RougeInput
Input for rouge metric.
Corresponds to the JSON property rougeInput
6868 6869 6870 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6868 def rouge_input @rouge_input end |
#safety_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SafetyInput
Input for safety metric.
Corresponds to the JSON property safetyInput
6873 6874 6875 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6873 def safety_input @safety_input end |
#summarization_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationHelpfulnessInput
Input for summarization helpfulness metric.
Corresponds to the JSON property summarizationHelpfulnessInput
6878 6879 6880 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6878 def summarization_helpfulness_input @summarization_helpfulness_input end |
#summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationQualityInput
Input for summarization quality metric.
Corresponds to the JSON property summarizationQualityInput
6883 6884 6885 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6883 def summarization_quality_input @summarization_quality_input end |
#summarization_verbosity_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationVerbosityInput
Input for summarization verbosity metric.
Corresponds to the JSON property summarizationVerbosityInput
6888 6889 6890 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6888 def summarization_verbosity_input @summarization_verbosity_input end |
#tool_call_valid_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolCallValidInput
Input for tool call valid metric.
Corresponds to the JSON property toolCallValidInput
6893 6894 6895 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6893 def tool_call_valid_input @tool_call_valid_input end |
#tool_name_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolNameMatchInput
Input for tool name match metric.
Corresponds to the JSON property toolNameMatchInput
6898 6899 6900 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6898 def tool_name_match_input @tool_name_match_input end |
#tool_parameter_key_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKeyMatchInput
Input for tool parameter key match metric.
Corresponds to the JSON property toolParameterKeyMatchInput
6903 6904 6905 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6903 def tool_parameter_key_match_input @tool_parameter_key_match_input end |
#tool_parameter_kv_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKvMatchInput
Input for tool parameter key value match metric.
Corresponds to the JSON property toolParameterKvMatchInput
6908 6909 6910 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6908 def tool_parameter_kv_match_input @tool_parameter_kv_match_input end |
#trajectory_any_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryAnyOrderMatchInput
Instances and metric spec for TrajectoryAnyOrderMatch metric.
Corresponds to the JSON property trajectoryAnyOrderMatchInput
6913 6914 6915 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6913 def trajectory_any_order_match_input @trajectory_any_order_match_input end |
#trajectory_exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryExactMatchInput
Instances and metric spec for TrajectoryExactMatch metric.
Corresponds to the JSON property trajectoryExactMatchInput
6918 6919 6920 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6918 def trajectory_exact_match_input @trajectory_exact_match_input end |
#trajectory_in_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryInOrderMatchInput
Instances and metric spec for TrajectoryInOrderMatch metric.
Corresponds to the JSON property trajectoryInOrderMatchInput
6923 6924 6925 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6923 def trajectory_in_order_match_input @trajectory_in_order_match_input end |
#trajectory_precision_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryPrecisionInput
Instances and metric spec for TrajectoryPrecision metric.
Corresponds to the JSON property trajectoryPrecisionInput
6928 6929 6930 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6928 def trajectory_precision_input @trajectory_precision_input end |
#trajectory_recall_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryRecallInput
Instances and metric spec for TrajectoryRecall metric.
Corresponds to the JSON property trajectoryRecallInput
6933 6934 6935 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6933 def trajectory_recall_input @trajectory_recall_input end |
#trajectory_single_tool_use_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectorySingleToolUseInput
Instances and metric spec for TrajectorySingleToolUse metric.
Corresponds to the JSON property trajectorySingleToolUseInput
6938 6939 6940 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6938 def trajectory_single_tool_use_input @trajectory_single_tool_use_input end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
6945 6946 6947 6948 6949 6950 6951 6952 6953 6954 6955 6956 6957 6958 6959 6960 6961 6962 6963 6964 6965 6966 6967 6968 6969 6970 6971 6972 6973 6974 6975 6976 6977 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6945 def update!(**args) @bleu_input = args[:bleu_input] if args.key?(:bleu_input) @coherence_input = args[:coherence_input] if args.key?(:coherence_input) @comet_input = args[:comet_input] if args.key?(:comet_input) @exact_match_input = args[:exact_match_input] if args.key?(:exact_match_input) @fluency_input = args[:fluency_input] if args.key?(:fluency_input) @fulfillment_input = args[:fulfillment_input] if args.key?(:fulfillment_input) @groundedness_input = args[:groundedness_input] if args.key?(:groundedness_input) @metricx_input = args[:metricx_input] if args.key?(:metricx_input) @pairwise_metric_input = args[:pairwise_metric_input] if args.key?(:pairwise_metric_input) @pairwise_question_answering_quality_input = args[:pairwise_question_answering_quality_input] if args.key?(:pairwise_question_answering_quality_input) @pairwise_summarization_quality_input = args[:pairwise_summarization_quality_input] if args.key?(:pairwise_summarization_quality_input) @pointwise_metric_input = args[:pointwise_metric_input] if args.key?(:pointwise_metric_input) @question_answering_correctness_input = args[:question_answering_correctness_input] if args.key?(:question_answering_correctness_input) @question_answering_helpfulness_input = args[:question_answering_helpfulness_input] if args.key?(:question_answering_helpfulness_input) @question_answering_quality_input = args[:question_answering_quality_input] if args.key?(:question_answering_quality_input) @question_answering_relevance_input = args[:question_answering_relevance_input] if args.key?(:question_answering_relevance_input) @rouge_input = args[:rouge_input] if args.key?(:rouge_input) @safety_input = args[:safety_input] if args.key?(:safety_input) @summarization_helpfulness_input = args[:summarization_helpfulness_input] if args.key?(:summarization_helpfulness_input) @summarization_quality_input = args[:summarization_quality_input] if args.key?(:summarization_quality_input) @summarization_verbosity_input = args[:summarization_verbosity_input] if args.key?(:summarization_verbosity_input) @tool_call_valid_input = args[:tool_call_valid_input] if args.key?(:tool_call_valid_input) @tool_name_match_input = args[:tool_name_match_input] if args.key?(:tool_name_match_input) @tool_parameter_key_match_input = args[:tool_parameter_key_match_input] if args.key?(:tool_parameter_key_match_input) @tool_parameter_kv_match_input = args[:tool_parameter_kv_match_input] if args.key?(:tool_parameter_kv_match_input) @trajectory_any_order_match_input = args[:trajectory_any_order_match_input] if args.key?(:trajectory_any_order_match_input) @trajectory_exact_match_input = args[:trajectory_exact_match_input] if args.key?(:trajectory_exact_match_input) @trajectory_in_order_match_input = args[:trajectory_in_order_match_input] if args.key?(:trajectory_in_order_match_input) @trajectory_precision_input = args[:trajectory_precision_input] if args.key?(:trajectory_precision_input) @trajectory_recall_input = args[:trajectory_recall_input] if args.key?(:trajectory_recall_input) @trajectory_single_tool_use_input = args[:trajectory_single_tool_use_input] if args.key?(:trajectory_single_tool_use_input) end |