Class: Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest

Inherits:

Object

• Object
• Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest

Extended by:

Protobuf::MessageExts::ClassMethods

Includes:

Protobuf::MessageExts

Defined in:

proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb

Overview

Request message for EvaluationService.EvaluateInstances.

Instance Attribute Summary

• #bleu_input ⇒ ::Google::Cloud::AIPlatform::V1::BleuInput

  Instances and metric spec for bleu metric.

• #coherence_input ⇒ ::Google::Cloud::AIPlatform::V1::CoherenceInput

  Input for coherence metric.

• #exact_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ExactMatchInput

  Auto metric instances.

• #fluency_input ⇒ ::Google::Cloud::AIPlatform::V1::FluencyInput

  LLM-based metric instance.

• #fulfillment_input ⇒ ::Google::Cloud::AIPlatform::V1::FulfillmentInput

  Input for fulfillment metric.

• #groundedness_input ⇒ ::Google::Cloud::AIPlatform::V1::GroundednessInput

  Input for groundedness metric.

• #location ⇒ ::String

  Required.

• #pairwise_metric_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput

  Input for pairwise metric.

• #pairwise_question_answering_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput

  Input for pairwise question answering quality metric.

• #pairwise_summarization_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput

  Input for pairwise summarization quality metric.

• #pointwise_metric_input ⇒ ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput

  Input for pointwise metric.

• #question_answering_correctness_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput

  Input for question answering correctness metric.

• #question_answering_helpfulness_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput

  Input for question answering helpfulness metric.

• #question_answering_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput

  Input for question answering quality metric.

• #question_answering_relevance_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput

  Input for question answering relevance metric.

• #rouge_input ⇒ ::Google::Cloud::AIPlatform::V1::RougeInput

  Instances and metric spec for rouge metric.

• #safety_input ⇒ ::Google::Cloud::AIPlatform::V1::SafetyInput

  Input for safety metric.

• #summarization_helpfulness_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput

  Input for summarization helpfulness metric.

• #summarization_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput

  Input for summarization quality metric.

• #summarization_verbosity_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput

  Input for summarization verbosity metric.

• #tool_call_valid_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolCallValidInput

  Tool call metric instances.

• #tool_name_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput

  Input for tool name match metric.

• #tool_parameter_key_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput

  Input for tool parameter key match metric.

• #tool_parameter_kv_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput

  Input for tool parameter key value match metric.

Instance Attribute Details

#bleu_input ⇒ ::Google::Cloud::AIPlatform::V1::BleuInput

Returns Instances and metric spec for bleu metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::BleuInput) —

  Instances and metric spec for bleu metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#coherence_input ⇒ ::Google::Cloud::AIPlatform::V1::CoherenceInput

Returns Input for coherence metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::CoherenceInput) —

  Input for coherence metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#exact_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ExactMatchInput

Returns Auto metric instances. Instances and metric spec for exact match metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::ExactMatchInput) —

  Auto metric instances. Instances and metric spec for exact match metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#fluency_input ⇒ ::Google::Cloud::AIPlatform::V1::FluencyInput

Returns LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::FluencyInput) —

  LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#fulfillment_input ⇒ ::Google::Cloud::AIPlatform::V1::FulfillmentInput

Returns Input for fulfillment metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::FulfillmentInput) —

  Input for fulfillment metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#groundedness_input ⇒ ::Google::Cloud::AIPlatform::V1::GroundednessInput

Returns Input for groundedness metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::GroundednessInput) —

  Input for groundedness metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#location ⇒ ::String

Returns Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}.

Returns:

• (::String) —

  Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_metric_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput

Returns Input for pairwise metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) —

  Input for pairwise metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_question_answering_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput

Returns Input for pairwise question answering quality metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) —

  Input for pairwise question answering quality metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_summarization_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput

Returns Input for pairwise summarization quality metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) —

  Input for pairwise summarization quality metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pointwise_metric_input ⇒ ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput

Returns Input for pointwise metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) —

  Input for pointwise metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_correctness_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput

Returns Input for question answering correctness metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) —

  Input for question answering correctness metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_helpfulness_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput

Returns Input for question answering helpfulness metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) —

  Input for question answering helpfulness metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput

Returns Input for question answering quality metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) —

  Input for question answering quality metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_relevance_input ⇒ ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput

Returns Input for question answering relevance metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) —

  Input for question answering relevance metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#rouge_input ⇒ ::Google::Cloud::AIPlatform::V1::RougeInput

Returns Instances and metric spec for rouge metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::RougeInput) —

  Instances and metric spec for rouge metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#safety_input ⇒ ::Google::Cloud::AIPlatform::V1::SafetyInput

Returns Input for safety metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::SafetyInput) —

  Input for safety metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_helpfulness_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput

Returns Input for summarization helpfulness metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) —

  Input for summarization helpfulness metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_quality_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput

Returns Input for summarization quality metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) —

  Input for summarization quality metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_verbosity_input ⇒ ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput

Returns Input for summarization verbosity metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) —

  Input for summarization verbosity metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_call_valid_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolCallValidInput

Returns Tool call metric instances. Input for tool call valid metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::ToolCallValidInput) —

  Tool call metric instances. Input for tool call valid metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_name_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput

Returns Input for tool name match metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) —

  Input for tool name match metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_parameter_key_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput

Returns Input for tool parameter key match metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) —

  Input for tool parameter key match metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_parameter_kv_match_input ⇒ ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput

Returns Input for tool parameter key value match metric.

Returns:

• (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) —

  Input for tool parameter key value match metric.

# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 104

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end