Module: Cohere::Transcribe::Safetensors

Defined in:

lib/cohere/transcribe/safetensors.rb

Overview

Minimal, streaming safetensors support for converting Cohere ASR weights. It deliberately does not materialize a multi-gigabyte checkpoint in Ruby.

Defined Under Namespace

Classes: DTypeConverter, Error, NativeDTypeConverter, Reader, Tensor, TensorSet

Constant Summary

DTYPE_BYTES =

{
  "BF16" => 2,
  "F16" => 2,
  "F32" => 4,
  "I64" => 8
}.freeze

FLOAT_DTYPES =

%w[BF16 F16 F32].freeze

HEADER_LIMIT =

64 * 1024 * 1024

DEFAULT_CHUNK_BYTES =

4 * 1024 * 1024