Class: LLM::DeepInfra

Inherits:
OpenAI show all
Defined in:
lib/llm/providers/deepinfra.rb,
lib/llm/providers/deepinfra/audio.rb,
lib/llm/providers/deepinfra/images.rb,
lib/llm/providers/deepinfra/response_adapter.rb

Overview

The DeepInfra class implements a provider for DeepInfra through its OpenAI-compatible API.

Examples:

#!/usr/bin/env ruby
require "llm"

llm = LLM.deepinfra(key: ENV["KEY"])
ctx = LLM::Context.new(llm)
ctx.talk "Hello"
ctx.messages.select(&:assistant?).each { print "[#{_1.role}]", _1.content, "\n" }

Defined Under Namespace

Modules: ResponseAdapter Classes: Audio, Images

Constant Summary collapse

HOST = 
"api.deepinfra.com"
BASE_PATH = 
"/v1/openai"

Instance Method Summary collapse

Methods inherited from OpenAI

#assistant_role, #complete, #models, #server_tools, #web_search

Methods included from OpenAI::RequestAdapter

#adapt

Methods inherited from Provider

#assistant_role, #chat, #complete, #developer_role, #inspect, #interrupt!, #key?, #models, #request_owner, #respond, #schema, #server_tool, #server_tools, #streamable?, #system_role, #tool_role, #tracer, #tracer=, #user_role, #web_search, #with, #with_tracer

Constructor Details

#initialize(host: HOST, base_path: BASE_PATH) ⇒ LLM::DeepInfra

Parameters:

  • key (String, nil) —

    The secret key for authentication

  • host (String) (defaults to: HOST) —

    The host address of the LLM provider

  • base_path (String) (defaults to: BASE_PATH) —

    Optional base path prefix for HTTP API routes.



31
32
33
 
# File 'lib/llm/providers/deepinfra.rb', line 31

def initialize(host: HOST, base_path: BASE_PATH, **)
  super
end

Instance Method Details

#audio ⇒ LLM::DeepInfra::Audio

Returns:



70
71
72
 
# File 'lib/llm/providers/deepinfra.rb', line 70

def audio
  LLM::DeepInfra::Audio.new(self)
end

#default_model ⇒ String

Returns the default model for chat completions

Returns:

  • (String)

See Also:



96
97
98
 
# File 'lib/llm/providers/deepinfra.rb', line 96

def default_model
  "zai-org/GLM-5.2"
end

#embed(input, model: "BAAI/bge-m3", **params) ⇒ LLM::Response

Provides an embedding.

Parameters:

  • input (String, Array<String>) —

    The input to embed

  • model (String) (defaults to: "BAAI/bge-m3") —

    The embedding model to use

  • params (Hash) —

    Other embedding parameters

Returns:

See Also:



58
59
60
 
# File 'lib/llm/providers/deepinfra.rb', line 58

def embed(input, model: "BAAI/bge-m3", **params)
  super
end

#files ⇒ Object

Raises:

  • (NotImplementedError) 


76
77
78
 
# File 'lib/llm/providers/deepinfra.rb', line 76

def files
  raise NotImplementedError
end

#images ⇒ LLM::DeepInfra::Images

Provides an interface to DeepInfra's OpenAI-compatible image API.

Returns:

See Also:



46
47
48
 
# File 'lib/llm/providers/deepinfra.rb', line 46

def images
  LLM::DeepInfra::Images.new(self)
end

#moderations ⇒ Object

Raises:

  • (NotImplementedError) 


82
83
84
 
# File 'lib/llm/providers/deepinfra.rb', line 82

def moderations
  raise NotImplementedError
end

#name ⇒ Symbol

Returns the provider's name

Returns:

  • (Symbol) —

    Returns the provider's name



38
39
40
 
# File 'lib/llm/providers/deepinfra.rb', line 38

def name
  :deepinfra
end

#responses ⇒ Object

Raises:

  • (NotImplementedError) 


64
65
66
 
# File 'lib/llm/providers/deepinfra.rb', line 64

def responses
  raise NotImplementedError
end

#vector_stores ⇒ Object

Raises:

  • (NotImplementedError) 


88
89
90
 
# File 'lib/llm/providers/deepinfra.rb', line 88

def vector_stores
  raise NotImplementedError
end