Class: Brute::Eval::Budget

Inherits:
Data
  • Object
show all
Defined in:
lib/brute/eval/case.rb

Overview

The budget a case allows itself. Lenient on purpose: an agent that took one search too many is worth knowing about, but it is not the same fault as an agent that answered wrongly.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(iterations: 10, tool_calls: 8, tokens: 100_000, seconds: 180) ⇒ Budget

Returns a new instance of Budget.



12
13
14
 
# File 'lib/brute/eval/case.rb', line 12

def initialize(iterations: 10, tool_calls: 8, tokens: 100_000, seconds: 180)
  super
end

Instance Attribute Details

#iterations ⇒ Object (readonly)

Returns the value of attribute iterations

Returns:

  • (Object) —

    the current value of iterations



11
12
13
 
# File 'lib/brute/eval/case.rb', line 11

def iterations
  @iterations
end

#seconds ⇒ Object (readonly)

Returns the value of attribute seconds

Returns:

  • (Object) —

    the current value of seconds



11
12
13
 
# File 'lib/brute/eval/case.rb', line 11

def seconds
  @seconds
end

#tokens ⇒ Object (readonly)

Returns the value of attribute tokens

Returns:

  • (Object) —

    the current value of tokens



11
12
13
 
# File 'lib/brute/eval/case.rb', line 11

def tokens
  @tokens
end

#tool_calls ⇒ Object (readonly)

Returns the value of attribute tool_calls

Returns:

  • (Object) —

    the current value of tool_calls



11
12
13
 
# File 'lib/brute/eval/case.rb', line 11

def tool_calls
  @tool_calls
end