Module: Legion::Extensions::Llm

Defined in:
lib/legion/extensions/llm.rb,
lib/legion/extensions/llm/provider_settings.rb,
lib/legion/extensions/llm/transport/fleet_lane.rb

Overview

Legion-native namespace for the shared LLM provider framework.

Defined Under Namespace

Modules: ProviderSettings, Routing, Transport, Types

Constant Summary collapse

VERSION = 
LexLLM::VERSION

Class Method Summary collapse

Class Method Details

.default_settings ⇒ Object 



23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
 
# File 'lib/legion/extensions/llm.rb', line 23

def self.default_settings
  {
    fleet: {
      enabled: false,
      scheduler: :basic_get,
      consumer_priority: 0,
      queue_expires_ms: 60_000,
      message_ttl_ms: 120_000,
      queue_max_length: 100,
      delivery_limit: 3,
      consumer_ack_timeout_ms: 300_000,
      endpoint: {
        enabled: false,
        empty_lane_backoff_ms: 250,
        idle_backoff_ms: 1_000,
        max_consecutive_pulls_per_lane: 0,
        accept_when: []
      }
    }
  }
end

.provider_settings ⇒ Object 



45
46
47
 
# File 'lib/legion/extensions/llm.rb', line 45

def self.provider_settings(...)
  ProviderSettings.build(...)
end