Class: Kward::TiktokenTokenCounter

Inherits:

Object

Object
Kward::TiktokenTokenCounter

show all

Defined in:: lib/kward/model/context_usage.rb

Instance Method Summary collapse

#count(text, model:) ⇒ Object

Instance Method Details

#count(text, model:) ⇒ `Object`



82
83
84

# File 'lib/kward/model/context_usage.rb', line 82

def count(text, model:)
  encoding(model).encode(text.to_s).length
end