Class: SolidLoop::LlmUsageParser

Inherits:
Object
  • Object
show all
Defined in:
app/services/solid_loop/llm_usage_parser.rb,
app/services/solid_loop/llm_usage_parser/llama.rb,
app/services/solid_loop/llm_usage_parser/gemini.rb,
app/services/solid_loop/llm_usage_parser/openai.rb,
app/services/solid_loop/llm_usage_parser/anthropic.rb

Defined Under Namespace

Classes: Anthropic, Gemini, Llama, Openai

Class Method Summary collapse

Class Method Details

.estimate(text, messages_text) ⇒ Object 



5
6
7
8
9
10
11
12
13
14
15
16
17
 
# File 'app/services/solid_loop/llm_usage_parser.rb', line 5

def self.estimate(text, messages_text)
  tokens_completion = text.to_s.length / 4
  tokens_prompt = messages_text.to_s.length / 4

  {
    tokens_prompt: tokens_prompt,
    tokens_completion: tokens_completion,
    tokens_total: tokens_prompt + tokens_completion,
    tokens_prompt_cached: 0,
    cost: 0.0,
    tps: 0.0
  }
end