Module: Legion::Extensions::Llm::Bedrock::Runners::FleetWorker

Extended by:
Logging::Helper
Defined in:
lib/legion/extensions/llm/bedrock/runners/fleet_worker.rb

Overview

Runner entrypoint for Bedrock fleet request execution.

Invoked by the Subscription actor as FleetWorker.handle_fleet_request(**message), where message is the fully decoded delivery: the fleet envelope fields (request_id, operation, provider, provider_instance, model, params, signed_token, ...) plus delivery metadata. The whole message is handed to the shared responder, which parses the envelope and acks/rejects through the framework's manual_ack path.

Class Method Summary collapse

Class Method Details

.handle_fleet_request(**message) ⇒ Object 



26
27
28
29
30
31
32
33
34
35
36
37
 
# File 'lib/legion/extensions/llm/bedrock/runners/fleet_worker.rb', line 26

def handle_fleet_request(**message)
  log.debug do
    "bedrock.runner.fleet_worker.handle_fleet_request: request_id=#{message[:request_id]} " \
      "provider_instance=#{message[:provider_instance] || 'default'}"
  end
  Legion::Extensions::Llm::Fleet::ProviderResponder.call(
    payload: message,
    provider_family: Bedrock::PROVIDER_FAMILY,
    provider_class: Bedrock::Provider,
    provider_instances: -> { Bedrock.discover_instances }
  )
end