Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1Metric

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

The metric used for running evaluations.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1Metric

Returns a new instance of GoogleCloudAiplatformV1beta1Metric.



33810
33811
33812
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33810

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#aggregation_metrics ⇒ Array<String>

Optional. The aggregation metrics to use. Corresponds to the JSON property aggregationMetrics

Returns:

  • (Array<String>) 


33755
33756
33757
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33755

def aggregation_metrics
  @aggregation_metrics
end

#bleu_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1BleuSpec

Spec for bleu score metric - calculates the precision of n-grams in the prediction as compared to reference - returns a score ranging between 0 to 1. Corresponds to the JSON property bleuSpec

Returns:



33761
33762
33763
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33761

def bleu_spec
  @bleu_spec
end

#computation_based_metric_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ComputationBasedMetricSpec

Specification for a computation based metric. Corresponds to the JSON property computationBasedMetricSpec

Returns:



33766
33767
33768
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33766

def computation_based_metric_spec
  @computation_based_metric_spec
end

#custom_code_execution_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1CustomCodeExecutionSpec

Specificies a metric that is populated by evaluating user-defined Python code. Corresponds to the JSON property customCodeExecutionSpec

Returns:



33771
33772
33773
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33771

def custom_code_execution_spec
  @custom_code_execution_spec
end

#exact_match_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1ExactMatchSpec

Spec for exact match metric - returns 1 if prediction and reference exactly matches, otherwise 0. Corresponds to the JSON property exactMatchSpec

Returns:



33777
33778
33779
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33777

def exact_match_spec
  @exact_match_spec
end

#llm_based_metric_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1LlmBasedMetricSpec

Specification for an LLM based metric. Corresponds to the JSON property llmBasedMetricSpec

Returns:



33782
33783
33784
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33782

def llm_based_metric_spec
  @llm_based_metric_spec
end

#metadata ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1MetricMetadata

Metadata about the metric, used for visualization and organization. Corresponds to the JSON property metadata

Returns:



33787
33788
33789
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33787

def metadata
  @metadata
end

#pairwise_metric_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PairwiseMetricSpec

Spec for pairwise metric. Corresponds to the JSON property pairwiseMetricSpec

Returns:



33792
33793
33794
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33792

def pairwise_metric_spec
  @pairwise_metric_spec
end

#pointwise_metric_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PointwiseMetricSpec

Spec for pointwise metric. Corresponds to the JSON property pointwiseMetricSpec

Returns:



33797
33798
33799
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33797

def pointwise_metric_spec
  @pointwise_metric_spec
end

#predefined_metric_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1PredefinedMetricSpec

The spec for a pre-defined metric. Corresponds to the JSON property predefinedMetricSpec

Returns:



33802
33803
33804
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33802

def predefined_metric_spec
  @predefined_metric_spec
end

#rouge_spec ⇒ Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1RougeSpec

Spec for rouge score metric - calculates the recall of n-grams in prediction as compared to reference - returns a score ranging between 0 and 1. Corresponds to the JSON property rougeSpec

Returns:



33808
33809
33810
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33808

def rouge_spec
  @rouge_spec
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



33815
33816
33817
33818
33819
33820
33821
33822
33823
33824
33825
33826
33827
 
# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 33815

def update!(**args)
  @aggregation_metrics = args[:aggregation_metrics] if args.key?(:aggregation_metrics)
  @bleu_spec = args[:bleu_spec] if args.key?(:bleu_spec)
  @computation_based_metric_spec = args[:computation_based_metric_spec] if args.key?(:computation_based_metric_spec)
  @custom_code_execution_spec = args[:custom_code_execution_spec] if args.key?(:custom_code_execution_spec)
  @exact_match_spec = args[:exact_match_spec] if args.key?(:exact_match_spec)
  @llm_based_metric_spec = args[:llm_based_metric_spec] if args.key?(:llm_based_metric_spec)
  @metadata = args[:metadata] if args.key?(:metadata)
  @pairwise_metric_spec = args[:pairwise_metric_spec] if args.key?(:pairwise_metric_spec)
  @pointwise_metric_spec = args[:pointwise_metric_spec] if args.key?(:pointwise_metric_spec)
  @predefined_metric_spec = args[:predefined_metric_spec] if args.key?(:predefined_metric_spec)
  @rouge_spec = args[:rouge_spec] if args.key?(:rouge_spec)
end