Module: Rixie::TokenCounter

Defined in:
lib/rixie/token_counter.rb

Constant Summary collapse

DEFAULT =

Approximate token count using character length (1 token ≈ 4 characters). Replace via Rixie.configure { |c| c.token_counter = your_callable } to use an exact counter such as tiktoken.

->(messages) { messages.sum { |m| m.content.to_s.length } / 4 }