Class: Insika::Evals::Runner::RunCase

Inherits:
Struct
  • Object
show all
Defined in:
lib/insika/evals/runner.rb

Overview

tokens is what the whole case cost, summed over its turns, or nil when no turn reported usage. cached is how much of that was served from the prompt cache, carried separately because it is the number that explains a total. Only the refinement gate reads them (RFC-0013 ยง3.9 records a run's cost); the report and the exit code are untouched.

Instance Attribute Summary collapse

Instance Attribute Details

#cachedObject

Returns the value of attribute cached

Returns:

  • (Object)

    the current value of cached



22
23
24
# File 'lib/insika/evals/runner.rb', line 22

def cached
  @cached
end

#resultObject

Returns the value of attribute result

Returns:

  • (Object)

    the current value of result



22
23
24
# File 'lib/insika/evals/runner.rb', line 22

def result
  @result
end

#timingsObject

Returns the value of attribute timings

Returns:

  • (Object)

    the current value of timings



22
23
24
# File 'lib/insika/evals/runner.rb', line 22

def timings
  @timings
end

#tokensObject

Returns the value of attribute tokens

Returns:

  • (Object)

    the current value of tokens



22
23
24
# File 'lib/insika/evals/runner.rb', line 22

def tokens
  @tokens
end