Class: LittleGhost::Providers::OpenRouter

Inherits:
OpenAICompatible show all
Defined in:
lib/little_ghost/providers/open_router.rb

Overview

OpenRouter gives one LittleGhost provider access to models routed through OpenRouter. Agents keep their model roles while the registry selects an OpenRouter model for each role.

provider = LittleGhost::Providers::OpenRouter.new(
api_key: ENV.fetch("OPENROUTER_API_KEY"),
model: ENV.fetch("OPENROUTER_MODEL"),
app_name: "Support Console"
)

site_url and app_name populate attribution headers. Capability metadata controls structured output, tools, tool choice, and parameter filtering. Requests that need a capability ask OpenRouter to route only to providers that advertise it.

Constant Summary collapse

DEFAULT_BASE_URL =

The OpenRouter API endpoint used when base_url is omitted.

"https://openrouter.ai/api/v1/"
TOP_LEVEL_CACHE_MODELS =

:nodoc:

["anthropic/", "~anthropic/"].freeze
MESSAGE_CACHE_MODELS = 
[
  "google/gemini",
  "qwen/qwen3-max",
  "qwen/qwen-plus",
  "qwen/qwen3.6-plus",
  "qwen/qwen3-coder-plus",
  "qwen/qwen3-coder-flash",
  "deepseek/deepseek-v3.2"
].freeze

Constants inherited from OpenAICompatible

LittleGhost::Providers::OpenAICompatible::CONTEXT_OVERFLOW_MARKERS, LittleGhost::Providers::OpenAICompatible::INITIAL_RETRY_DELAY, LittleGhost::Providers::OpenAICompatible::MAX_RETRY_DELAY, LittleGhost::Providers::OpenAICompatible::TRANSIENT_STREAM_ERROR_TYPES

Instance Attribute Summary

Attributes inherited from OpenAICompatible

#api, #model

Instance Method Summary collapse

Methods inherited from OpenAICompatible

#stream

Constructor Details

#initialize(site_url: nil, app_name: nil, base_url: DEFAULT_BASE_URL, **arguments) ⇒ OpenRouter

Configures an OpenRouter client. All OpenAICompatible options, including api_key, model, retry limits, timeouts, and custom transport, apply.



37
38
39
40
41
 
# File 'lib/little_ghost/providers/open_router.rb', line 37

def initialize(site_url: nil, app_name: nil, base_url: DEFAULT_BASE_URL, **arguments)
  @site_url = site_url
  @app_name = app_name
  super(base_url:, api: :chat_completions, **arguments)
end

Instance Method Details

#capabilities(metadata: {}) ⇒ Object

Reads model capabilities from OpenRouter supported_parameters metadata. Missing metadata produces ModelCapabilities.unknown.



45
46
47
48
49
50
51
52
53
54
55
56
 
# File 'lib/little_ghost/providers/open_router.rb', line 45

def capabilities(metadata: {})
  parameters = metadata[:supported_parameters] || metadata["supported_parameters"]
  return ModelCapabilities.unknown unless parameters.is_a?(Array)

  values = parameters.map(&:to_s)
  ModelCapabilities.new(
    native_structured_output: values.any? { |value| %w[structured_outputs response_format].include?(value) },
    tools: values.include?("tools"),
    tool_choice: values.include?("tool_choice"),
    supported_parameters: values
  )
end

#prepare_request(request, capabilities:) ⇒ Object

Filters unsupported model settings when the request requires advertised capabilities.



60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
 
# File 'lib/little_ghost/providers/open_router.rb', line 60

def prepare_request(request, capabilities:)
  return request if request.required_capabilities.empty?
  return request unless capabilities.supported_parameters

  settings = filter_supported_settings(request.settings, capabilities)
  ModelRequest.new(
    messages: request.messages,
    tools: request.tools,
    settings:,
    output_schema: request.output_schema,
    tool_choice: request.tool_choice,
    required_capabilities: request.required_capabilities,
    cancellation_token: request.cancellation_token,
    deadline: request.deadline
  )
end