Class: DatadogAPIClient::V2::LLMObsCustomEvalConfigInferenceParams

Inherits:
Object
  • Object
show all
Includes:
BaseGenericModel
Defined in:
lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb

Overview

LLM inference parameters for a custom evaluator.

Instance Attribute Summary collapse

Method Summary

Methods included from BaseGenericModel

included

Instance Attribute Details

#additional_properties ⇒ Object

Returns the value of attribute additional_properties.



42
43
44
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 42

def additional_properties
  @additional_properties
end

#frequency_penalty ⇒ Object

Frequency penalty to reduce repetition.



25
26
27
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 25

def frequency_penalty
  @frequency_penalty
end

#max_tokens ⇒ Object

Maximum number of tokens to generate.



28
29
30
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 28

def max_tokens
  @max_tokens
end

#presence_penalty ⇒ Object

Presence penalty to reduce repetition.



31
32
33
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 31

def presence_penalty
  @presence_penalty
end

#temperature ⇒ Object

Sampling temperature for the LLM.



34
35
36
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 34

def temperature
  @temperature
end

#top_k ⇒ Object

Top-k sampling parameter.



37
38
39
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 37

def top_k
  @top_k
end

#top_p ⇒ Object

Top-p (nucleus) sampling parameter.



40
41
42
 
# File 'lib/datadog_api_client/v2/models/llm_obs_custom_eval_config_inference_params.rb', line 40

def top_p
  @top_p
end