Skip to content
agentusehub
Sign in+ Submit
Software & DevOpsAny

Fix a production boolean-flag bug with Devin

A reviewer had Devin fix a bug on a production site; it returned a PR in about ten minutes but included unrelated changes like removing a safeguard check.

Read the experience
Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported

Use case overview

A reviewer had Devin fix a bug on a production site; it returned a PR in about ten minutes but included unrelated changes like removing a safeguard check.

Read the original report ↗

Reported experience

  1. What they did

    As part of a five-day review, the reviewer asked Devin, a browser-based agent with its own editor, terminal and the codebase, to fix a bug on a production site. The bug was a boolean flag that needed flipping from true to false. Devin located it and opened a pull request. The reviewer then commented asking why it had changed other things.

  2. How it went

    The PR arrived in about ten minutes with the flag fixed. It also made unrelated edits, including removing a safeguard check that should have stayed. Its explanation for one change was confidently wrong.

  3. Worth knowing

    Review the PR diff closely. Devin touched unrelated code, and its stated reasons for those changes can be wrong.

Example prompts

Try with Devin
There's a bug in [repo name]: [describe the bug, e.g. a boolean flag is read incorrectly in file or feature]. Find the cause and open a pull request with the smallest fix possible. Don't remove safeguards or touch unrelated code, and list in the PR description everything you changed so I can review it.

Related use cases

Software & DevOps

Port a Chrome extension to Safari

The author had ChatGPT take the Session Buddy extension source from Chrome, port it to Safari and install it, taking about 20 minutes.

ChatGPT