emb-server
Precompiled emb server binary distributed as a Ruby gem. Runs a Redis-compatible embedding server with ONNX Runtime inference.
Installation
Add to your Gemfile:
gem "emb-server"
Or install globally:
gem install emb-server
Platform support
| Platform | Status |
|---|---|
| macOS (Apple Silicon) | ✓ |
| Linux (x86_64) | ✓ |
| Linux (aarch64) | ✓ |
The gem ships a precompiled binary for each platform. See bin/emb for platform detection logic.
Usage
Quick start
Auto-download a model from HuggingFace and start the server:
emb -model-repo Xenova/all-MiniLM-L6-v2
With a config file
emb -config config.yaml
Options
All emb server options are available as CLI flags.
Companion client
Use the emb Ruby gem to interact with the server from Ruby code—auto-decodes float32 responses, provides proxy and multi-model support.