Module: Legion::Extensions::Llm::Mlx::Runners::FleetWorker

Defined in:
lib/legion/extensions/llm/mlx/runners/fleet_worker.rb

Overview

Runner entrypoint for MLX fleet request execution.

Class Method Summary collapse

Class Method Details

.handle_fleet_request(payload, delivery: nil, properties: nil) ⇒ Object 



15
16
17
18
19
20
21
22
23
24
 
# File 'lib/legion/extensions/llm/mlx/runners/fleet_worker.rb', line 15

def handle_fleet_request(payload, delivery: nil, properties: nil)
  Legion::Extensions::Llm::Fleet::ProviderResponder.call(
    payload: payload,
    provider_family: Mlx::PROVIDER_FAMILY,
    provider_class: Mlx::Provider,
    provider_instances: -> { Mlx.discover_instances },
    delivery: delivery,
    properties: properties
  )
end