Class: Google::Apis::AiplatformV1::GoogleCloudAiplatformV1AutoraterConfig

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1/classes.rb,
lib/google/apis/aiplatform_v1/representations.rb,
lib/google/apis/aiplatform_v1/representations.rb

Overview

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1AutoraterConfig

Returns a new instance of GoogleCloudAiplatformV1AutoraterConfig.



1329
1330
1331
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1329

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#autorater_model ⇒ String

Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use. Publisher model format: projects/project/locations/ location/publishers/*/models/* Tuned model endpoint format: projects/ project/locations/location/endpoints/endpoint` Corresponds to the JSON propertyautoraterModel`

Returns:

  • (String) 


1310
1311
1312
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1310

def autorater_model
  @autorater_model
end

#flip_enabled ⇒ Boolean Also known as: flip_enabled?

Optional. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec. candidate_response_field_name and PairwiseMetricSpec. baseline_response_field_name. When rendering PairwiseMetricSpec. metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias. Corresponds to the JSON property flipEnabled

Returns:

  • (Boolean) 


1320
1321
1322
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1320

def flip_enabled
  @flip_enabled
end

#sampling_count ⇒ Fixnum

Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32. Corresponds to the JSON property samplingCount

Returns:

  • (Fixnum) 


1327
1328
1329
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1327

def sampling_count
  @sampling_count
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



1334
1335
1336
1337
1338
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1334

def update!(**args)
  @autorater_model = args[:autorater_model] if args.key?(:autorater_model)
  @flip_enabled = args[:flip_enabled] if args.key?(:flip_enabled)
  @sampling_count = args[:sampling_count] if args.key?(:sampling_count)
end