Skip to content
agentusehub

Run the smart home by natural language

Karpathy's Dobby agent controls lights, HVAC, shades, pool and security, alerts on visitors, and replaces six apps.

Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported

Use case overview

Karpathy's Dobby agent controls lights, HVAC, shades, pool and security, alerts on visitors, and replaces six apps.

Reported experience

  1. What they did

    Karpathy built Dobby the Elf Claw as the smart home AI agent. It was given access to control lights, HVAC, shades, pool, and security, with AI used to detect visitors and send alerts. Natural language replaced the six separate apps.

  2. How it went

    All controls now run through one agent. The source gives no further metrics or shortfalls.

Example prompts

Try with OpenClaw
Connect to my smart home devices ([lights, thermostat, shades, security, other]) and let me control them by chat in plain language, like 'dim the living room' or 'set the house to night mode'. Also alert me when [visitor or event] is detected. Test each device with me one at a time, and ask before changing any security or lock settings.
Life Admin & Home

Coach training and diet from wearable data

The poster uses Claude with Apple Health, nutrition and lifting app data, plus medication and bloodwork files, and has it maintain an HTML dashboard.

Claude