Independent directory, made by the developer of Vulpo. Not affiliated with Home Assistant or the Open Home Foundation.

Screenshots From the README of sam3gp8/jarvis-aio.

JARVIS HUD Residence view: a live 3D model of the house with occupied rooms glowing

About

JARVIS AI Assistant is a conversational AI butler integration for Home Assistant with voice, vision and memory features. It registers a conversation agent backed by a language model provider of choice: Groq, OpenAI, Anthropic, Gemini, a custom OpenAI-compatible endpoint, or a local Ollama server. It can look up information on the web, read calendar entities to flag conflicts, and answer questions from documents placed in the config folder. With Nest or Frigate cameras connected, it analyzes doorbell presses and detects packages and mail. A reasoning loop classifies household events by urgency and can propose automations from observed patterns. Setup happens in the UI by entering provider keys or endpoints, and a repair notice appears if the reasoning backend becomes unavailable.

Automatic summary of the README and code of sam3gp8/jarvis-aio. Something wrong, or are you the maintainer and want your own text here? Get in touch

Supports

  • Uses the vendor's cloud Needs an internet connection and an account with the vendor.

  • From the Marketplace Installed through the Marketplace, formerly HACS.

  • Actively maintained Its author released or pushed a change in the last six months.

Provides

  • Cameras

Setting it up

Install it from the Marketplace and restart Home Assistant, then add it under Settings, Devices and services.

JARVIS — Groq

  • Groq API key

JARVIS — OpenAI

  • OpenAI API key

JARVIS — Anthropic

  • Anthropic API key

JARVIS — Gemini

  • Gemini API key

JARVIS — Custom Provider

  • API key (optional, if the endpoint requires one)
  • API base URL (OpenAI-compatible)

JARVIS — Ollama

  • Base URL (leave blank for the default local Ollama endpoint)

JARVIS — Finish Setup

  • Main Agent provider
  • Address me as

JARVIS — Conversation Model

  • Conversation model

After setup

  • Groq API key
  • OpenAI API key
  • Anthropic API key
  • Gemini API key
  • API key (optional, if the endpoint requires one)
  • API base URL (OpenAI-compatible)
  • Base URL (leave blank for the default local Ollama endpoint)
  • Address me as
  • Directive preset
  • Custom directive (optional, overrides preset)
  • Conversation model provider
  • Enable home control (lights, climate, locks, etc.)
  • Let web research escalate to the LLM's own web search when the default backend finds nothing
  • Conversation model

Texts from the code of sam3gp8/jarvis-aio.

Troubleshooting

  • Repair noticesNotices it can show in Settings, Repairs:JARVIS reasoning backend unavailable

Shows in Vulpo

Camera card.

Information

Installs
117 sharing analytics
GitHub stars
31
Connection
Uses the vendor's cloud
Upkeep
Updated in the last 6 months
Version
9.33.0,
Category
AI and voice, AI models
Kind
Marketplace integration
Needs
Needs the Marketplace (HACS on 2026.10 and older)
Domain
jarvis

You might also like

Independent directory, made by the developer of Vulpo. Not affiliated with Home Assistant or the Open Home Foundation. About these numbers