Module: Legion::Extensions::Llm::Mlx::Provider::Capabilities

Defined in:

lib/legion/extensions/llm/mlx/provider.rb

Overview

Conservative capability predicates for local MLX OpenAI-compatible servers.

Class Method Summary

• .chat?(model) ⇒ Boolean
• .embeddings?(model) ⇒ Boolean
• .functions?(_model) ⇒ Boolean
• .model_id(model) ⇒ Object
• .streaming?(model) ⇒ Boolean
• .vision?(model) ⇒ Boolean

Class Method Details

.chat?(model) ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 25

def chat?(model) = !embeddings?(model)

.embeddings?(model) ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 29

def embeddings?(model) = model_id(model).match?(/embed|bge|e5|nomic/i)

.functions?(_model) ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 28

def functions?(_model) = true

.model_id(model) ⇒ Object

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 31

def model_id(model)
  model.respond_to?(:id) ? model.id.to_s : model.to_s
end

.streaming?(model) ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 26

def streaming?(model) = chat?(model)

.vision?(model) ⇒ Boolean

Returns:

• (Boolean)

# File 'lib/legion/extensions/llm/mlx/provider.rb', line 27

def vision?(model) = model_id(model).match?(/vlm|vision|llava|pixtral|qwen.*vl/i)