Class: NitroIntelligence::Client::Handlers::BaseHandler

Inherits:

Object

• Object
• NitroIntelligence::Client::Handlers::BaseHandler

Defined in:

lib/nitro_intelligence/client/handlers/base_handler.rb

Direct Known Subclasses

AudioTranscriptionHandler, ChatHandler, ImageHandler, TextToSpeechHandler

Constant Summary

MODALITY_HEADER =

"nip-modality".freeze

REQUESTED_MODEL_HEADER =

"nip-requested-model".freeze

TRACE_ID_HEADER =

Correlation headers understood by the inference gateway (LiteLLM). See https://docs.litellm.ai/docs/proxy/request_headers

"x-litellm-trace-id".freeze

SPEND_LOGS_METADATA_HEADER =

"x-litellm-spend-logs-metadata".freeze

MAX_SPEND_LOGS_METADATA_BYTES =

Headers over ~8KB are rejected by most proxies. Metadata is caller supplied, so cap it rather than turning a large hash into a failed request.

4096

Instance Method Summary

• #initialize(client:) ⇒ BaseHandler constructor

  A new instance of BaseHandler.

Constructor Details

#initialize(client:) ⇒ BaseHandler

Returns a new instance of BaseHandler.

# File 'lib/nitro_intelligence/client/handlers/base_handler.rb', line 19

def initialize(client:)
  @client = client
end