Module: OpenAI::Models::EvalRetrieveResponse::TestingCriterion

Extended by:

Internal::Type::Union

Defined in:

lib/openai/models/eval_retrieve_response.rb

Overview

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

Defined Under Namespace

Classes: EvalGraderPython, EvalGraderScoreModel, EvalGraderTextSimilarity

Class Method Summary

• .variants ⇒ Array(OpenAI::Models::Graders::LabelModelGrader, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderTextSimilarity, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderPython, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderScoreModel)

Instance Method Summary

• #initialize(pass_threshold: nil) ⇒ Object

  A PythonGrader object that runs a python script on the input.

Methods included from Internal::Type::Union

==, ===, coerce, dump, hash, inspect, to_sorbet_type, variants

Methods included from Internal::Util::SorbetRuntimeSupport

#const_missing, #define_sorbet_constant!, #sorbet_constant_defined?, #to_sorbet_type, to_sorbet_type

Methods included from Internal::Type::Converter

#coerce, coerce, #dump, dump, #inspect, inspect, type_info

Class Method Details

.variants ⇒ Array(OpenAI::Models::Graders::LabelModelGrader, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderTextSimilarity, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderPython, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderScoreModel)

Returns:

• (Array(OpenAI::Models::Graders::LabelModelGrader, OpenAI::Models::Graders::StringCheckGrader, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderTextSimilarity, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderPython, OpenAI::Models::EvalRetrieveResponse::TestingCriterion::EvalGraderScoreModel))

# File 'lib/openai/models/eval_retrieve_response.rb', line 209

Instance Method Details

#initialize(pass_threshold: nil) ⇒ Object

A PythonGrader object that runs a python script on the input.

Parameters:

• pass_threshold (Float) (defaults to: nil) —

  The threshold for the score.

# File 'lib/openai/models/eval_retrieve_response.rb', line 177