Class: Legion::Extensions::Llm::Openai::RegistryPublisher

Inherits:
Object
  • Object
show all
Includes:
Logging::Helper
Defined in:
lib/legion/extensions/llm/openai/registry_publisher.rb

Overview

Best-effort publisher for OpenAI provider availability events.

Constant Summary collapse

APP_ID =
'lex-llm-openai'

Instance Method Summary collapse

Constructor Details

#initialize(builder: RegistryEventBuilder.new) ⇒ RegistryPublisher

Returns a new instance of RegistryPublisher.



13
14
15
# File 'lib/legion/extensions/llm/openai/registry_publisher.rb', line 13

def initialize(builder: RegistryEventBuilder.new)
  @builder = builder
end

Instance Method Details

#publish_models_async(models, readiness:) ⇒ Object



17
18
19
20
21
22
23
24
# File 'lib/legion/extensions/llm/openai/registry_publisher.rb', line 17

def publish_models_async(models, readiness:)
  log.info("Publishing #{Array(models).size} model(s) to llm.registry") if respond_to?(:log)
  schedule do
    Array(models).each do |model|
      publish_event(@builder.model_available(model, readiness:))
    end
  end
end