Class: SkillBench::Commands::Run

Inherits:

Object

• Object
• SkillBench::Commands::Run

Defined in:

lib/skill_bench/commands/run.rb

Overview

Handles the ‘skill-bench run` command

Class Method Summary

• .run(eval_name:, skill_names:) ⇒ Hash

  Run an eval with specified skill(s).

Class Method Details

.run(eval_name:, skill_names:) ⇒ Hash

Run an eval with specified skill(s)

Parameters:

• eval_name (String) —

  Name of eval to run (e.g., ‘test-eval’ or ‘evals/test-eval’)

• skill_names (Array<String>) —

  Names of skills to use

Returns:

• (Hash) —

  Result with pass/fail and score

# File 'lib/skill_bench/commands/run.rb', line 13

def self.run(eval_name:, skill_names:)
  Services::RunnerService.call(
    eval_name: eval_name,
    skill_names: skill_names
  )
end