Module: LLM::VLLM
- Extended by:
- Backend::ClassMethods, VLLMMethods
- Defined in:
- lib/scout/llm/backends/vllm.rb
Constant Summary collapse
- TAG =
'vllm'- DEFAULT_MODEL =
'vllm'
Method Summary
Methods included from Backend::ClassMethods
ask, chain_tools, client, client_options, embed, embed_query, encode_image, encode_pdf, extra_options, extract_tools, format_messages, format_other, format_tool_call, format_tool_definitions, format_tool_output, gather_response, image, messages, parse_tool_call, prepare_client, process_format, process_response, query, reasoning, tools, update_meta, upload_messages