Class: SmartPrompt::LlamacppAdapter

Inherits:
LLMAdapter show all
Defined in:
lib/smart_prompt/llm_adapter.rb

Instance Method Summary collapse

Constructor Details

#initialize(config) ⇒ LlamacppAdapter

Returns a new instance of LlamacppAdapter.



46
47
48
49
50
51
 
# File 'lib/smart_prompt/llm_adapter.rb', line 46

def initialize(config)
  super
  @client = OpenAI::Client.new(
    uri_base: @config['url']
  )
end

Instance Method Details

#send_request(messages, model = nil) ⇒ Object 



52
53
54
55
56
57
58
59
60
 
# File 'lib/smart_prompt/llm_adapter.rb', line 52

def send_request(messages, model=nil)
  response = @client.chat(
    parameters: {
      messages: messages,
      temperature: @config['temperature'] || 0.7
    }
  )
  response.dig("choices", 0, "message", "content")
end