llama.cpp
Built-in integration
- Installs
- 826 sharing analytics
- Connection
- Works locally
- Upkeep
- Part of Home Assistant
- Quality
- Bronze on the quality scale
- Category
- AI and voice, AI models
- Kind
- Built-in integration
- Needs
- Built into Home Assistant
- Domain
llama_cpp
Independent directory, made by the developer of Vulpo. Not affiliated with Home Assistant or the Open Home Foundation.
About
llama.cpp is a built-in integration for Home Assistant.
Supports
Works locally Talks to your devices on your own network. No vendor cloud in between.
Set up in the UI Add it in Settings, Devices and services. Nothing to download.
Bronze quality Home Assistant's own rating of its code and setup experience.
Updated with Home Assistant Ships and updates with every Home Assistant release.
Setting it up
It is added under Settings, Devices and services, with Add integration.
Connect
- API keyAPI key for the server (optional).
- URLBase URL of your running OpenAI-compatible server (e.g. http://localhost:8080/v1).
Model
- ModelSelect the model to use.
Texts from Home Assistant's source code, Apache License 2.0.
Information
- Installs
- 826 sharing analytics
- Connection
- Works locally
- Upkeep
- Part of Home Assistant
- Quality
- Bronze on the quality scale
- Category
- AI and voice, AI models
- Kind
- Built-in integration
- Needs
- Built into Home Assistant
- Domain
llama_cpp
