Try Devin on research tasks (mostly failed)
Answer.AI had Devin fetch an author's recent papers and research transcript summarization; it got stuck parsing HTML and returned generic results, rated a failure.

Answer.AI had Devin fetch an author's recent papers and research transcript summarization; it got stuck parsing HTML and returned generic results, rated a failure.
Founders report Devin touching all PRs at ChatPRD and being Gumroad's top contributor with over 1,500 merged PRs.
Scott Wu had Devin build and deploy a mobile-friendly React quiz from a TSV of speaker names and photos, plus a QR-code site to share it.
The author had Devin build and deploy an app, finding it quick on PR feedback but weak on legacy monorepos and costly on broad requests.
Author had Devin build a Gmail API assistant that lists unanswered emails from the past week, since Attio lacks that tab; he wrote the auth part himself in Cursor.
An early tester asked Devin to build a chess game against a language model; it made good progress but eventually hung.
Cognition staff assign Devin work in Slack or Linear; it posts PRs, fixes bugs flagged by review bots and works CI and lint failures until checks pass.
Devin's docs describe reading a Notion PRD to create Linear tickets, producing implementation plans for a backlog, and posting customer health summaries to Slack.
With computer use, Devin built and played a desktop game, ordered on Amazon, and tested its own work by clicking through the app.
Kearney gave Devin repo access to migrate a production Electron app to Vue 3 and update npm packages, committing after every five components.
Devin opened a PR with the endpoint and backend wiring that was merged, but missed API key logic, code style and abstraction, needing review fixes.
A reviewer had Devin set up a project, write code, install dependencies, test endpoints and add error handling in about 4 minutes on a simple task.
A team used Devin for a month on small fixes like chart formatting and API edge cases, with tests and PRs; a complex full-stack task went poorly.
Cognition's team uses a Devin variant called DANA to query their data warehouse, build dashboards and answer data questions, and Devin fills out report forms.
A tester asked Devin to create a basic Pong-style game and a website, and it finished both in under 20 minutes.
Answer.AI testers found Devin completed only 3 of 20 tasks, succeeding at moving Notion data to Google Sheets and building a planet tracker.
A technical writer uses Devin to explore code before documenting it, plus a Slack writing agent built on Devin, reporting about 20,000 lines of docs per month.
Devin scanned a rearchitected codebase and delivered a new README as a PR with accurate setup and API details, but struggled with design rationale and purpose.