Class: SkillBench::Commands::Run

Inherits:
Object
  • Object
show all
Defined in:
lib/skill_bench/commands/run.rb

Overview

Handles the ‘skill-bench run` command

Class Method Summary collapse

Class Method Details

.run(eval_name:, skill_names:, pack: nil, registry_manifest: nil) ⇒ Hash

Run an eval with specified skill(s)

Parameters:

  • eval_name (String) —

    Name of eval to run (e.g., ‘test-eval’ or ‘evals/test-eval’)

  • skill_names (Array<String>) —

    Names of skills to use

  • pack (String, nil) (defaults to: nil) —

    Optional pack name for registry-based skill resolution

  • registry_manifest (String, nil) (defaults to: nil) —

    Optional path to registry.json manifest

Returns:

  • (Hash) —

    Result with pass/fail and score



15
16
17
18
19
20
21
22
 
# File 'lib/skill_bench/commands/run.rb', line 15

def self.run(eval_name:, skill_names:, pack: nil, registry_manifest: nil)
  Services::RunnerService.call(
    eval_name: eval_name,
    skill_names: skill_names,
    pack: pack,
    registry_manifest: registry_manifest
  )
end