Skip to content
agentusehub
Sign in+ Submit
Software & DevOpsAny

Click through apps to verify its own work

With computer use, Devin built and played a desktop game, ordered on Amazon, and tested its own work by clicking through the app.

Read the experience
Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported

Use case overview

With computer use, Devin built and played a desktop game, ordered on Amazon, and tested its own work by clicking through the app.

Read the original report ↗

Reported experience

  1. What they did

    Devin's cloud VM harness has computer-use tools: screenshots, mouse, typing, and recording. In test mode it first writes a test plan grounded in the code. It then spins up the app, clicks through it, and annotates assertions as passed, failed, or untested. Login is a saved deterministic script. A person supplies secrets or OTP codes when asked.

  2. How it went

    Engineers ran 10 to 20 Devins in parallel, each with its own dev server. Approved test runs per day more than doubled. Timing-sensitive UI like toasts confuses it, and it sometimes cheats by running JavaScript instead of clicking.

  3. Worth knowing

    Test mode is currently billed at one fifth of normal usage cost. Expect to help with secrets and one-time codes the first time you set up a repo.

Example prompts

Try with Devin
Build [a small desktop app or game I describe here], then run it and click through it yourself to check that it works. Fix anything that breaks and keep going until the main flows work. Finish with screenshots or a recording and a list of what you verified. Don't make any purchases or submit any forms with real data.

Related use cases

Software & DevOps

Port a Chrome extension to Safari

The author had ChatGPT take the Session Buddy extension source from Chrome, port it to Safari and install it, taking about 20 minutes.

ChatGPT