Module: Legion::Extensions::Llm::Vllm::TranslatorParamHelpers

Included in:

Translator

Defined in:

lib/legion/extensions/llm/vllm/translator.rb

Overview

Maps G18 canonical params to vLLM wire keys.

Constant Summary

SUPPORTED_PARAMS =

G18 parameter mapping: supported canonical params.

%i[
  max_tokens temperature top_p top_k stop_sequences
  seed frequency_penalty presence_penalty response_format
].freeze

PARAM_WIRE_KEYS =

vLLM wire keys for supported params (most are 1:1 with canonical names).

{
  max_tokens: :max_tokens,
  temperature: :temperature,
  top_p: :top_p,
  top_k: :top_k,
  stop_sequences: :stop,
  seed: :seed,
  frequency_penalty: :frequency_penalty,
  presence_penalty: :presence_penalty,
  response_format: :response_format
}.freeze