Class: Google::Apis::AiplatformV1::GoogleCloudAiplatformV1AutoraterConfig

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/aiplatform_v1/classes.rb,
lib/google/apis/aiplatform_v1/representations.rb,
lib/google/apis/aiplatform_v1/representations.rb

Overview

The configs for autorater. This is applicable to both EvaluateInstances and EvaluateDataset.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1AutoraterConfig

Returns a new instance of GoogleCloudAiplatformV1AutoraterConfig.



1286
1287
1288
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1286

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#autorater_model ⇒ String

Optional. The fully qualified name of the publisher model or tuned autorater endpoint to use. Publisher model format: projects/project/locations/ location/publishers/*/models/* Tuned model endpoint format: projects/ project/locations/location/endpoints/endpoint` Corresponds to the JSON propertyautoraterModel`

Returns:

  • (String) 


1267
1268
1269
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1267

def autorater_model
  @autorater_model
end

#flip_enabled ⇒ Boolean Also known as: flip_enabled?

Optional. Whether to flip the candidate and baseline responses. This is only applicable to the pairwise metric. If enabled, also provide PairwiseMetricSpec. candidate_response_field_name and PairwiseMetricSpec. baseline_response_field_name. When rendering PairwiseMetricSpec. metric_prompt_template, the candidate and baseline fields will be flipped for half of the samples to reduce bias. Corresponds to the JSON property flipEnabled

Returns:

  • (Boolean) 


1277
1278
1279
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1277

def flip_enabled
  @flip_enabled
end

#sampling_count ⇒ Fixnum

Optional. Number of samples for each instance in the dataset. If not specified, the default is 4. Minimum value is 1, maximum value is 32. Corresponds to the JSON property samplingCount

Returns:

  • (Fixnum) 


1284
1285
1286
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1284

def sampling_count
  @sampling_count
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



1291
1292
1293
1294
1295
 
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 1291

def update!(**args)
  @autorater_model = args[:autorater_model] if args.key?(:autorater_model)
  @flip_enabled = args[:flip_enabled] if args.key?(:flip_enabled)
  @sampling_count = args[:sampling_count] if args.key?(:sampling_count)
end