Software & DevOps
Coordinate sub-agents to monitor PRs and fix prod bugs
A Cursor Projects coordinator agent delegates to sub-agents, watches new PRs and production bugs, spins up agents to fix issues, and surfaces questions to the user.
Cursor
Test Devin on integrations, migration and security review
Answer.AI tried Devin on an observability integration, an nbdev migration and a vulnerability review; it found some real issues, hallucinated others, and failed the migration.
Time saved
Not reported
Setup time
Not reported
Running cost
Not reported
Cost range
Not reported
Use case overview
Answer.AI tried Devin on an observability integration, an nbdev migration and a vulnerability review; it found some real issues, hallucinated others, and failed the migration.
Reported experience
What they did
Answer.AI gave Devin, which works through Slack in its own Docker environment with a browser, editor and shell, about 20 real tasks. These included generating and uploading synthetic data to Braintrust, migrating a Python project to nbdev, and a security review of a repo under 700 lines. People checked the output and often took over.
How it went
The Braintrust integration was abandoned and redone in Cursor. The nbdev migration failed on basic setup. The security review found some real issues but also false positives and hallucinated ones. Overall 14 failures, 3 successes and 3 inconclusive.
Worth knowing
Devin pressed on with impossible tasks for days. The authors suggest a single focused LLM call for something like a small-repo security review.
Example prompts
Take on three tasks in my repo [repo name]: add an integration with [observability tool], migrate [a module or tool] to [target tool or version], and review the code for security vulnerabilities. For each one, tell me how you verified your results, and clearly mark any finding you could not confirm. Open separate pull requests for the work and do not merge anything.
Related use cases
Software & DevOps
Build a project management tool with a 24-hour agent run
Ran a Cursor agent continuously for 24 hours to build a project management tool; the app fully works but is not production ready.
Cursor
Software & DevOps
Port a Chrome extension to Safari
The author had ChatGPT take the Session Buddy extension source from Chrome, port it to Safari and install it, taking about 20 minutes.
ChatGPT