Module: OpenAI::Models::EvalCreateParams::TestingCriterion

Extended by:

Internal::Type::Union

Defined in:

lib/openai/models/eval_create_params.rb

Overview

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

Defined Under Namespace

Classes: LabelModel, Python, ScoreModel, TextSimilarity

Class Method Summary

• .values ⇒ Array<Symbol>
• .variants ⇒ Array(OpenAI::Models::EvalCreateParams::TestingCriterion::LabelModel, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalCreateParams::TestingCriterion::TextSimilarity, OpenAI::Models::EvalCreateParams::TestingCriterion::Python, OpenAI::Models::EvalCreateParams::TestingCriterion::ScoreModel)

Instance Method Summary

• #initialize(pass_threshold: nil) ⇒ Object

  A PythonGrader object that runs a python script on the input.

Methods included from Internal::Type::Union

==, ===, coerce, dump, hash, inspect, to_sorbet_type, variants

Methods included from Internal::Util::SorbetRuntimeSupport

#const_missing, #define_sorbet_constant!, #sorbet_constant_defined?, #to_sorbet_type, to_sorbet_type

Methods included from Internal::Type::Converter

#coerce, coerce, #dump, dump, #inspect, inspect, type_info

Class Method Details

.values ⇒ Array<Symbol>

Returns:

• (Array<Symbol>)

# File 'lib/openai/models/eval_create_params.rb', line 397

.variants ⇒ Array(OpenAI::Models::EvalCreateParams::TestingCriterion::LabelModel, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalCreateParams::TestingCriterion::TextSimilarity, OpenAI::Models::EvalCreateParams::TestingCriterion::Python, OpenAI::Models::EvalCreateParams::TestingCriterion::ScoreModel)

Returns:

• (Array(OpenAI::Models::EvalCreateParams::TestingCriterion::LabelModel, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalCreateParams::TestingCriterion::TextSimilarity, OpenAI::Models::EvalCreateParams::TestingCriterion::Python, OpenAI::Models::EvalCreateParams::TestingCriterion::ScoreModel))

# File 'lib/openai/models/eval_create_params.rb', line 402

Instance Method Details

#initialize(pass_threshold: nil) ⇒ Object

A PythonGrader object that runs a python script on the input.

Parameters:

• pass_threshold (Float) (defaults to: nil) —

  The threshold for the score.

# File 'lib/openai/models/eval_create_params.rb', line 414