@openclaw/llama-cpp-provider
Official llama.cpp text-inference and embedding provider for OpenClaw.
This plugin runs local GGUF chat and embedding models in-process through
node-llama-cpp.
Install
openclaw plugins install @openclaw/llama-cpp-provider
Restart the Gateway after installing or updating the plugin. Use Node 24 for native installs and updates.
Configure text inference
Choose Local model (llama.cpp) during onboarding. After explicit consent, OpenClaw downloads Gemma 4 E4B IT Q4_K_M (approximately 5.0 GB) as the default. The bundled download is offered only on machines with at least 16 GiB of RAM. Discovery never downloads a model.
On smaller machines, use Ollama or LM Studio with a smaller model, use a cloud
provider, or configure any custom GGUF through params.modelPath. The 16 GiB
gate applies only to OpenClaw's bundled default download; custom GGUF models
remain available on any machine.
See the llama.cpp provider guide for custom GGUF model configuration and hardware guidance.
Configure embeddings
Set agents.defaults.memorySearch.provider to local. By default, the plugin
downloads and uses the EmbeddingGemma GGUF model. Configure
agents.defaults.memorySearch.local.modelPath to use another local path, Hugging
Face model URI, or HTTPS model URL.
Package
- Plugin id:
llama-cpp - Package:
@openclaw/llama-cpp-provider - Minimum OpenClaw host:
2026.6.2