Class: Kward::TiktokenTokenCounter

Inherits:

Object

Object
Kward::TiktokenTokenCounter

show all

Defined in:: lib/kward/model/context_usage.rb

Overview

Structured context usage result returned to frontends.

Instance Method Summary collapse

#count(text, model:) ⇒ Object

Instance Method Details

#count(text, model:) ⇒ `Object`



85
86
87

# File 'lib/kward/model/context_usage.rb', line 85

def count(text, model:)
  encoding(model).encode(text.to_s).length
end