Skip to content
agentusehub

Map and control a whole smart home

Karpathy's agent scanned the home network, logged into Sonos, reverse-engineered APIs, mapped lights, HVAC, shades, pool and security, and built a dashboard.

Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported

Use case overview

Karpathy's agent scanned the home network, logged into Sonos, reverse-engineered APIs, mapped lights, HVAC, shades, pool and security, and built a dashboard.

Reported experience

  1. What they did

    Karpathy prompted the agent in chat with "Can you find my Sonos?". The agent scanned the home IP network, logged into the unprotected Sonos, web-searched and reverse-engineered its API endpoints, then repeated the process on lights, HVAC, shades, pool, spa, and security systems. It built its own dashboard and APIs to stitch the systems together; Karpathy later issued commands such as "Dobby, it's sleepy time".

  2. How it went

    The agent produced a unified control center for the full house and now executes high-level commands across all devices. The post states no further metrics or shortfalls.

Example prompts

Try with Claude Code
Scan my home network at [network range] and identify the smart devices on it, such as [lights, speakers, thermostat, cameras]. Map what each one can do and how to control it, then build a simple local dashboard that shows them in one place. Only read and list devices at first, and ask me before logging in to any account or sending any control command.