Class: Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation

Inherits:

Object

• Object
• Google::Apis::AiplatformV1beta1::GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation

Includes:

Core::Hashable, Core::JsonObjectSupport

Defined in:

lib/google/apis/aiplatform_v1beta1/classes.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb,
lib/google/apis/aiplatform_v1beta1/representations.rb

Overview

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Instance Attribute Summary

• #draft_model ⇒ String

  Required.

Instance Method Summary

• #initialize(**args) ⇒ GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation constructor

  A new instance of GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation.

• #update!(**args) ⇒ Object

  Update properties of this object.

Constructor Details

#initialize(**args) ⇒ GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation

Returns a new instance of GoogleCloudAiplatformV1beta1SpeculativeDecodingSpecDraftModelSpeculation.

# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 50833

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#draft_model ⇒ String

Required. The resource name of the draft model. Corresponds to the JSON property draftModel

Returns:

• (String)

# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 50831

def draft_model
  @draft_model
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object

# File 'lib/google/apis/aiplatform_v1beta1/classes.rb', line 50838

def update!(**args)
  @draft_model = args[:draft_model] if args.key?(:draft_model)
end