What engineering leaders and their teams report about Devin, with every finding tied to its evidence.
Read the findingsPractitioner sentiment, leaders and teams
+39 Positive from 24 sources that take a side
How this figure is madeFrom 23 authors in 23 discussions. Small sample. Use a task pilot to measure accepted work and review time.
Jan 2025 to Oct 2026.
63 sources from practitioners, by month and sentiment.
Leader and team accounts lean positive. All 11 that discuss codebase understanding praise it, as do all 8 discussing ticket delegation. Review is their most frequent concern. 7 of the 8 who discuss it say Devin's pull requests need heavy review, and they split 4 to 3 on whether Devin saves time once review is counted.
Positive, mixed and negative sources
The score counts them as 13 positive, 6 mixed and 4 negative votes, one per author. See How the numbers work.
See the evidenceBelow: 5 praise themes, 2 concerns, 1 point of agreement and 2 disagreements.
Counted for Engineering leaders and teams, from 28 sources. Change group
Every capability practitioners describe positively, ranked by how many sources say so. Open one to read who said it.
Counted for Engineering leaders and teams.
Positive
David Griffiths, Group Head of AI at Citi
A Competitive Differentiator: David Griffiths on Building the World's Most AI-empowered Financial InstitutionCompany perspectives article, Citi
Citi's profile of its Group Head of AI says the bank adopted Devin early to speed up complex, multi-step coding tasks. One task re-mapped more than 30 years of legacy code across the firm in two days.
"Early on, Citi adopted Devin, a coding agent developed by the AI lab Cognition to expedite complex, multi-step coding tasks. One such task involved re-mapping more than 30 years of legacy code across the firm in two days."
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes
Positive
Prashant Naikar, Developer at a startup acquired by a UK company
Using Devin AI Daily for 6 Months: What Actually ChangedPersonal blog post, Medium
After six months of daily use, Prashant Naikar's work shifted to reviewing Devin's pull requests and teaching it the product. Devin navigated the codebase well but missed edge cases and coupling.
Practitioner account; direct use; counts toward Delivered outcomes
Positive
joshgachnang, Hacker News commenter
Comment on: Devin Review: AI to Stop SlopHacker News comment
joshgachnang is impressed with Devin, calling it the best tool for AI-generated features when you know what you want and have patterns to follow, likely helped by its project context.
Practitioner account, pseudonymous; direct use; not counted, repeats a stronger account
Positive
nikisweeting, Engineer at browser-use
Comment on: DeepWiki: Understand Any CodebaseHacker News comment
DeepWiki was instrumental in the browser-use team's refactor of a large codebase from Playwright to pure CDP; nikisweeting rates its follow-up research questions above OpenAI deep research for complex codebases.
Practitioner account, pseudonymous; opinion; not counted, takes no position
Positive
Zach Davis, Director of engineering at LaunchDarkly
Successfully coding with AI in large enterprises: Centralized rules, workflows for tech debt, & morePodcast episode, How I AI (YouTube)
Davis consolidated Cursor rules and a Claude MD file into one in-repo agents directory, started from Devin's per-repo wiki to write docs, got Devin running in front-end-only mode before a colleague set up the back end, and can Slack Devin to pick up the next tech-debt cleanup task.
"…for anybody trying to deploy AI agents in a real engineering team with a real codebase, not just vibe coding. We have Zach Davis, director of engineering at Launch Darkley, who's going to show us how he sets up centralized rules and…"
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes, Adoption and upkeep
Positive
Rick Blalock, co-founder at Agentuity
The Agent-Native CompanyConference talk page with transcript, AI Engineer World's Fair 2025
Blalock reports that it is really common at Agentuity standups to have Devin take on a task, with a pull request to review before the meeting ends. A few months in, Devin has documented so much of the company's code and knows how the team handles certain things; Blalock calls it a superpower.
"We started using it a few months ago. It was good. We had to do some things. And now over time it's learned so much, it's documented so much of our code, it knows how we handle certain things."
"During a team meeting, it's really common to hear things like, "Well, just have Devin go do that."…"
Practitioner account, self-described; direct use; counts toward Delivered outcomes
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Mixed
Hiroki Akamatsu (@hi120ki), AI Security engineer at Mercari
Enabling AI usage at Mercari with Secure Devin ManagementEngineering blog post, Mercari Engineering blog
Mercari's AI Security team built a Terraform provider and automation on Devin's Enterprise API to manage members, ACU caps, secret rotation and API key expiry that Devin lacks natively.
Practitioner account; ran the rollout; counts toward Operational control, Cost predictability and limits, Adoption and upkeep
Positive
Eight Sleep data team (Editorial byline)
How Eight Sleep Uses Devin as a Data AnalystCompany blog post, Eight Sleep blog
Eight Sleep runs Devin in Slack as a data analyst over its dbt repo and warehouse; with curated knowledge it ships 3x more data work and clears ad-hoc asks.
"Faster shipping. We’re shipping 3x as many data features and data investigations each week compared to before…"
Practitioner account, self-described; ran the rollout; not counted, tied to the vendor
Mixed
Daniel Price, docs team at Neon
AI Workflows for Docs: Putting Devin to WorkCompany blog post, Neon
Neon's docs team uses a Devin playbook to set up the weekly changelog, sends it to work through older docs issues and small UI copy fixes, and has it explain code. A feature rename left awkward edits that took 20+ manual commits, and open-ended tasks often failed silently, so Cursor stays their interactive tool.
"Devin does well when the problem is clearly scoped, but once things get open-ended, it still struggles."
"But its edits leaned heavily on direct find/replace, which led to some awkward constructions like “instant instant restore.” It took another 20+ manual commits to polish the changes."
"But when the task is clear and the scope is right, it’s a genuinely helpful assistant."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability
Mixed
Vikram Sreekanti and Joseph E. Gonzalez, RunLLM
One month of using DevinNewsletter, The AI Frontier (Substack)
Sreekanti and Gonzalez found Devin effective on hour-sized fixes that took 1-5 ACUs (US$2-10). A full-stack task they expected a junior engineer to finish within a day was beyond it, and 2 of the 3 bigger tasks, averaging about 20 ACUs, gave no usable results.
"The 3 bigger tasks we tried averaged about 20 ACUs and 2 of the 3 didn’t yield usable results."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Cost predictability and limits, Adoption and upkeep
Counted for Engineering leaders and teams.
Positive
John Wang, Co-Founder and CTO at Assembled
Code review bottlenecks: How we hill climbed our way to higher PR throughputCompany blog post, Assembled
Assembled's CTO reports that non-engineers wrote 13% of all PRs after the rollout, and credits the company's auto-reviewer combined with cloud agents like Devin for letting non-engineers contribute without much engineering handholding.
"The auto-reviewer, combined with cloud agents like Devin, allowed non-engineers to contribute significantly without requiring a large amount of engineering handholding."
"Non-engineers accounted for 13% of all PRs."
Practitioner account, self-described; opinion; not counted until substantiated
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Positive
cloudking, Hacker News commenter
Comment on: Why we built our own background agentHacker News comment
Says the team uses Devin and it works very well: it has its own virtual environment, IDE, terminal and browser, can be configured to run the application, and can modify the app, test changes in the browser and send a screen recording of the working feature with a PR.
Practitioner account, pseudonymous; direct use; counts toward Delivered outcomes
Positive
Sahil Lavingia, CEO of Gumroad, interviewed by Aakash Gupta
How to PM Production Changes with Devin: Tutorial From Gumroad CEO, Sahil LavingiaPodcast episode show notes, The Growth Podcast (Product Growth)
Gumroad's CEO sends small, clear features straight to Devin from Slack and reviews the pull request it opens only as closely as the change's importance calls for.
"Small and clear feature → Straight to Devin…"
"Devin opens a PR. You review it (or don’t, depending on importance)."
Practitioner account, self-described; direct use; counts toward Delivered outcomes
Positive
Eight Sleep data team (Editorial byline)
How Eight Sleep Uses Devin as a Data AnalystCompany blog post, Eight Sleep blog
Eight Sleep runs Devin in Slack as a data analyst over its dbt repo and warehouse; with curated knowledge it ships 3x more data work and clears ad-hoc asks.
"Faster shipping. We’re shipping 3x as many data features and data investigations each week compared to before…"
Practitioner account, self-described; ran the rollout; not counted, tied to the vendor
Positive
Marco Argenti, Chief Information Officer, Goldman Sachs
American Banker: Goldman Sachs staff now write a million gen AI prompts a monthNews report quoting the CIO
Goldman Sachs' CIO describes Devin as a virtual colleague developer teams can delegate work to, beside the Copilot every developer has.
"All the developers have Github Copilot. They are getting the Devin technology. There's a shift from the developer assistant that helps you auto complete your code or generate code for a specific task, so I now have a virtual colleague that I can delegate work to."
Positive
Rick Blalock, co-founder at Agentuity
The Agent-Native CompanyConference talk page with transcript, AI Engineer World's Fair 2025
Blalock reports that it is really common at Agentuity standups to have Devin take on a task, with a pull request to review before the meeting ends. A few months in, Devin has documented so much of the company's code and knows how the team handles certain things; Blalock calls it a superpower.
"We started using it a few months ago. It was good. We had to do some things. And now over time it's learned so much, it's documented so much of our code, it knows how we handle certain things."
"During a team meeting, it's really common to hear things like, "Well, just have Devin go do that."…"
Practitioner account, self-described; direct use; counts toward Delivered outcomes
Positive
Sahil Lavingia, CEO and founder of Gumroad
Gumroad CEO's playbook to 40x his team's productivity with v0, Cursor, and Devin | Sahil LavingiaPodcast episode, How I AI (YouTube)
Lavingia's flow is v0, then Devin, then Cursor: prototype in v0, hand the work to Devin, and open Cursor when Devin fails to completely finish. Ran a US$33,000 competition for whoever merged more Devin PRs than the author in May; the host cites Devin writing 41% of Gumroad's PRs.
"…sort of fails to completely finish then I open it up in cursor. though I did I think last week Devon launched this pairing mode where you can actually like jump in and so I haven't really experimented with that yet but that's presumably I…"
"Yeah, so generally my flow is V0, Devin cursor, is probably how I would say it. Like generally V0 is my prototyping tool of choice. And once I have like a really good prototype that I'm happy with, then I go to Devin and if Devin sort of fails to completely finish then I open it up in cursor."
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes, Operational control, Adoption and upkeep
Mixed
Vikram Sreekanti and Joseph E. Gonzalez, RunLLM
One month of using DevinNewsletter, The AI Frontier (Substack)
Sreekanti and Gonzalez found Devin effective on hour-sized fixes that took 1-5 ACUs (US$2-10). A full-stack task they expected a junior engineer to finish within a day was beyond it, and 2 of the 3 bigger tasks, averaging about 20 ACUs, gave no usable results.
"The 3 bigger tasks we tried averaged about 20 ACUs and 2 of the 3 didn’t yield usable results."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Cost predictability and limits, Adoption and upkeep
Counted for Engineering leaders and teams.
Positive, 7
Positive
Brian Xu, engineer on the Agents team at Rox
Living Evals: an eval suite that grows from productionCompany engineering blog post, Rox
Xu describes how each week Devin "samples" about 350 production conversations from Braintrust and labels them, replays cases in a "preview" environment holding a full copy of Rox, and opens a pull request with each eval. The first sweep's suite covered 72% of unseen conversations, against 43 to 57% for 142 hand-written evals.
"It works in its own environment, so it can stand up a preview environment, use Rox there the way a salesperson would, and open a pull request with the finished eval."
"One automated sweep covered twice as many behaviors as everything we had written by hand."
"When the skill gets something wrong, Devin proposes a fix to the skill itself, and we review it like any other change."
"Every week, Devin, the coding agent from Cognition, reads real conversations on Rox from our production traces in Braintrust, turns them into evals, and opens a pull request that we review."
Practitioner account, self-described; ran the rollout; not counted, tied to the vendor
Positive
deet, Hacker News commenter
Comment on: Cognition launches new SWE-2 model, Rivaling Fable 5.1 and GPT-AstraHacker News comment
deet's team uses Devin heavily and calls it one of the best cloud-hosted, team-managed coding agents, citing its UX, sandboxed testing and QA, and API control.
Practitioner account, pseudonymous; direct use; not counted, takes no position
Positive
Prashant Naikar, Developer at a startup acquired by a UK company
Using Devin AI Daily for 6 Months: What Actually ChangedPersonal blog post, Medium
After six months of daily use, Prashant Naikar's work shifted to reviewing Devin's pull requests and teaching it the product. Devin navigated the codebase well but missed edge cases and coupling.
Practitioner account; direct use; counts toward Delivered outcomes
Positive
cloudking, Hacker News commenter
Comment on: Why we built our own background agentHacker News comment
Says the team uses Devin and it works very well: it has its own virtual environment, IDE, terminal and browser, can be configured to run the application, and can modify the app, test changes in the browser and send a screen recording of the working feature with a PR.
Practitioner account, pseudonymous; direct use; counts toward Delivered outcomes
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Positive
Sahil Lavingia, CEO and founder of Gumroad
Gumroad CEO's playbook to 40x his team's productivity with v0, Cursor, and Devin | Sahil LavingiaPodcast episode, How I AI (YouTube)
Lavingia's flow is v0, then Devin, then Cursor: prototype in v0, hand the work to Devin, and open Cursor when Devin fails to completely finish. Ran a US$33,000 competition for whoever merged more Devin PRs than the author in May; the host cites Devin writing 41% of Gumroad's PRs.
"…sort of fails to completely finish then I open it up in cursor. though I did I think last week Devon launched this pairing mode where you can actually like jump in and so I haven't really experimented with that yet but that's presumably I…"
"Yeah, so generally my flow is V0, Devin cursor, is probably how I would say it. Like generally V0 is my prototyping tool of choice. And once I have like a really good prototype that I'm happy with, then I go to Devin and if Devin sort of fails to completely finish then I open it up in cursor."
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes, Operational control, Adoption and upkeep
Negative
tlarkworthy, Hacker News commenter
Comment on: Thoughts on a month with DevinHacker News comment
Devin impressed when it grasped formatting and local tests, but it kept adding extraneous, breaking changes it could not undo, so tlarkworthy will recommend canceling it.
Practitioner account, pseudonymous; direct use; not counted, repeats a stronger account
Mixed or negative, 1
Negative
Hamel Husain, Isaac Flath, and Johno Whitaker, Answer.AI
Thoughts On A Month With DevinCompany blog post, Answer.AI blog
Over one month the Answer.AI team gave Devin 20 real tasks: 14 failed, 3 succeeded, 3 were inconclusive, and they could not predict which tasks would work.
"The results were sobering. Out of 20 tasks, we had 14 failures, 3 successes (including our 2 initial ones), and 3 inconclusive results."
Practitioner account, self-described; structured test; counts toward Delivered outcomes, Reliability, Operational control
Counted for Engineering leaders and teams.
Positive
David Griffiths, Group Head of AI at Citi
A Competitive Differentiator: David Griffiths on Building the World's Most AI-empowered Financial InstitutionCompany perspectives article, Citi
Citi's profile of its Group Head of AI says the bank adopted Devin early to speed up complex, multi-step coding tasks. One task re-mapped more than 30 years of legacy code across the firm in two days.
"Early on, Citi adopted Devin, a coding agent developed by the AI lab Cognition to expedite complex, multi-step coding tasks. One such task involved re-mapping more than 30 years of legacy code across the firm in two days."
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes
Mixed
Daniel Price, docs team at Neon
AI Workflows for Docs: Putting Devin to WorkCompany blog post, Neon
Neon's docs team uses a Devin playbook to set up the weekly changelog, sends it to work through older docs issues and small UI copy fixes, and has it explain code. A feature rename left awkward edits that took 20+ manual commits, and open-ended tasks often failed silently, so Cursor stays their interactive tool.
"Devin does well when the problem is clearly scoped, but once things get open-ended, it still struggles."
"But its edits leaned heavily on direct find/replace, which led to some awkward constructions like “instant instant restore.” It took another 20+ manual commits to polish the changes."
"But when the task is clear and the scope is right, it’s a genuinely helpful assistant."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability
Positive
nikisweeting, Engineer at browser-use
Comment on: DeepWiki: Understand Any CodebaseHacker News comment
DeepWiki was instrumental in the browser-use team's refactor of a large codebase from Playwright to pure CDP; nikisweeting rates its follow-up research questions above OpenAI deep research for complex codebases.
Practitioner account, pseudonymous; opinion; not counted, takes no position
Positive
Zach Davis, Director of engineering at LaunchDarkly
Successfully coding with AI in large enterprises: Centralized rules, workflows for tech debt, & morePodcast episode, How I AI (YouTube)
Davis consolidated Cursor rules and a Claude MD file into one in-repo agents directory, started from Devin's per-repo wiki to write docs, got Devin running in front-end-only mode before a colleague set up the back end, and can Slack Devin to pick up the next tech-debt cleanup task.
"…for anybody trying to deploy AI agents in a real engineering team with a real codebase, not just vibe coding. We have Zach Davis, director of engineering at Launch Darkley, who's going to show us how he sets up centralized rules and…"
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes, Adoption and upkeep
Mixed
David Griffiths, Chief Technology Officer, Citi
American Banker: Citi is rolling out agentic AI to its 40,000 developersNews report quoting the CTO
Citi's CTO gives developers Devin for simple, repeatable tasks such as upgrades, rewrites, patches, documentation and tests, and would not yet ask an agent to build a complicated feature end to end.
""It's not at the point where you would want to ask the agent to implement a very complicated feature from start to finish. We may get there with the technology in time, but today, I wouldn't recommend anyone to do that. We focus on the simple, repeatable tasks, which it can do at our scale."
Counted for Engineering leaders and teams.
Positive, 5
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Positive
deet, Hacker News commenter
Comment on: Cognition launches new SWE-2 model, Rivaling Fable 5.1 and GPT-AstraHacker News comment
deet's team uses Devin heavily and calls it one of the best cloud-hosted, team-managed coding agents, citing its UX, sandboxed testing and QA, and API control.
Practitioner account, pseudonymous; direct use; not counted, takes no position
Mixed
Vikram Sreekanti and Joseph E. Gonzalez, RunLLM
One month of using DevinNewsletter, The AI Frontier (Substack)
Sreekanti and Gonzalez found Devin effective on hour-sized fixes that took 1-5 ACUs (US$2-10). A full-stack task they expected a junior engineer to finish within a day was beyond it, and 2 of the 3 bigger tasks, averaging about 20 ACUs, gave no usable results.
"The 3 bigger tasks we tried averaged about 20 ACUs and 2 of the 3 didn’t yield usable results."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Cost predictability and limits, Adoption and upkeep
Negative
tlarkworthy, Hacker News commenter
Comment on: Thoughts on a month with DevinHacker News comment
Devin impressed when it grasped formatting and local tests, but it kept adding extraneous, breaking changes it could not undo, so tlarkworthy will recommend canceling it.
Practitioner account, pseudonymous; direct use; not counted, repeats a stronger account
Negative
Hamel Husain, Isaac Flath, and Johno Whitaker, Answer.AI
Thoughts On A Month With DevinCompany blog post, Answer.AI blog
Over one month the Answer.AI team gave Devin 20 real tasks: 14 failed, 3 succeeded, 3 were inconclusive, and they could not predict which tasks would work.
"The results were sobering. Out of 20 tasks, we had 14 failures, 3 successes (including our 2 initial ones), and 3 inconclusive results."
Practitioner account, self-described; structured test; counts toward Delivered outcomes, Reliability, Operational control
Mixed or negative, 2
Mixed
hightrix, Hacker News commenter
Comment on: Cognition launches new SWE-2 model, Rivaling Fable 5.1 and GPT-AstraHacker News comment
hightrix's company has used Devin enterprise seats for about nine months; it beats Copilot, but hightrix now finds Claude and Codex much better and the web and desktop harnesses inconsistent.
Practitioner account, pseudonymous; direct use; counts toward Reliability
Mixed
Kieran Klaassen, GM of Cora at Every
Transcript: 'How Two Engineers Ship Like a Team of 15 With AI Agents'Podcast transcript, AI & I (Every)
Ranking the coding agents his team uses, Klaassen grades Devin a B: less integrated and harder to set up than Cursor or Claude Code, with less well-rounded code quality.
"It's not as integrated. It's a little bit hard to set up, and the code quality is not as well rounded as Cursor or Claude Code."
Practitioner account, self-described; direct use; not counted, from a competitor's side
Every concern practitioners raise, most raised first.
Counted for Engineering leaders and teams.
Raised as a concern, 7
Negative
Fit_Sprinkles_8649, Reddit user in r/programming
Comment on: Someone uses Devin AIReddit comment
Fit_Sprinkles_8649's team dropped Devin after two months: its pull requests ignored existing patterns, so senior developers spent more time reviewing and fixing than writing the code themselves.
Practitioner account, pseudonymous; direct use; counts toward Delivered outcomes
Negative
tlarkworthy, Hacker News commenter
Comment on: Thoughts on a month with DevinHacker News comment
Devin impressed when it grasped formatting and local tests, but it kept adding extraneous, breaking changes it could not undo, so tlarkworthy will recommend canceling it.
Practitioner account, pseudonymous; direct use; not counted, repeats a stronger account
Mixed
steve_avery, Hacker News commenter
Comment on: We tried hard to make Devin work for us, But it didn'tHacker News comment
Devin impressed their team early on but has lately been a letdown; steve_avery is wading through a bloated Devin PR, though the team is not yet ready to cancel.
Practitioner account, pseudonymous; direct use; not counted, repeats a stronger account
Positive
Prashant Naikar, Developer at a startup acquired by a UK company
Using Devin AI Daily for 6 Months: What Actually ChangedPersonal blog post, Medium
After six months of daily use, Prashant Naikar's work shifted to reviewing Devin's pull requests and teaching it the product. Devin navigated the codebase well but missed edge cases and coupling.
Practitioner account; direct use; counts toward Delivered outcomes
Mixed
Daniel Price, docs team at Neon
AI Workflows for Docs: Putting Devin to WorkCompany blog post, Neon
Neon's docs team uses a Devin playbook to set up the weekly changelog, sends it to work through older docs issues and small UI copy fixes, and has it explain code. A feature rename left awkward edits that took 20+ manual commits, and open-ended tasks often failed silently, so Cursor stays their interactive tool.
"Devin does well when the problem is clearly scoped, but once things get open-ended, it still struggles."
"But its edits leaned heavily on direct find/replace, which led to some awkward constructions like “instant instant restore.” It took another 20+ manual commits to polish the changes."
"But when the task is clear and the scope is right, it’s a genuinely helpful assistant."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability
Mixed
Vikram Sreekanti and Joseph E. Gonzalez, RunLLM
One month of using DevinNewsletter, The AI Frontier (Substack)
Sreekanti and Gonzalez found Devin effective on hour-sized fixes that took 1-5 ACUs (US$2-10). A full-stack task they expected a junior engineer to finish within a day was beyond it, and 2 of the 3 bigger tasks, averaging about 20 ACUs, gave no usable results.
"The 3 bigger tasks we tried averaged about 20 ACUs and 2 of the 3 didn’t yield usable results."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Cost predictability and limits, Adoption and upkeep
Negative
Hamel Husain, Isaac Flath, and Johno Whitaker, Answer.AI
Thoughts On A Month With DevinCompany blog post, Answer.AI blog
Over one month the Answer.AI team gave Devin 20 real tasks: 14 failed, 3 succeeded, 3 were inconclusive, and they could not predict which tasks would work.
"The results were sobering. Out of 20 tasks, we had 14 failures, 3 successes (including our 2 initial ones), and 3 inconclusive results."
Practitioner account, self-described; structured test; counts toward Delivered outcomes, Reliability, Operational control
Discussed without concern, 1
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Counted for Engineering leaders and teams.
Raised as a concern, 3
Mixed
Vikram Sreekanti and Joseph E. Gonzalez, RunLLM
One month of using DevinNewsletter, The AI Frontier (Substack)
Sreekanti and Gonzalez found Devin effective on hour-sized fixes that took 1-5 ACUs (US$2-10). A full-stack task they expected a junior engineer to finish within a day was beyond it, and 2 of the 3 bigger tasks, averaging about 20 ACUs, gave no usable results.
"The 3 bigger tasks we tried averaged about 20 ACUs and 2 of the 3 didn’t yield usable results."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Cost predictability and limits, Adoption and upkeep
Negative
Hamel Husain, Isaac Flath, and Johno Whitaker, Answer.AI
Thoughts On A Month With DevinCompany blog post, Answer.AI blog
Over one month the Answer.AI team gave Devin 20 real tasks: 14 failed, 3 succeeded, 3 were inconclusive, and they could not predict which tasks would work.
"The results were sobering. Out of 20 tasks, we had 14 failures, 3 successes (including our 2 initial ones), and 3 inconclusive results."
Practitioner account, self-described; structured test; counts toward Delivered outcomes, Reliability, Operational control
Mixed
Daniel Price, docs team at Neon
AI Workflows for Docs: Putting Devin to WorkCompany blog post, Neon
Neon's docs team uses a Devin playbook to set up the weekly changelog, sends it to work through older docs issues and small UI copy fixes, and has it explain code. A feature rename left awkward edits that took 20+ manual commits, and open-ended tasks often failed silently, so Cursor stays their interactive tool.
"Devin does well when the problem is clearly scoped, but once things get open-ended, it still struggles."
"But its edits leaned heavily on direct find/replace, which led to some awkward constructions like “instant instant restore.” It took another 20+ manual commits to polish the changes."
"But when the task is clear and the scope is right, it’s a genuinely helpful assistant."
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability
Discussed without concern, 3
Positive
Zachary Proser, Applied AI at WorkOS
Devin AI Has Come a Long WayPersonal blog post, zackproser.com
WorkOS abandoned a 2024 Devin trial with zero completed sessions; by 2026 it became a daily, organically adopted Slack agent shipping reviewable PRs, bug fixes and data queries.
Practitioner account, self-described; direct use; counts toward Delivered outcomes, Reliability, Adoption and upkeep
Positive
Prashant Naikar, Developer at a startup acquired by a UK company
Using Devin AI Daily for 6 Months: What Actually ChangedPersonal blog post, Medium
After six months of daily use, Prashant Naikar's work shifted to reviewing Devin's pull requests and teaching it the product. Devin navigated the codebase well but missed edge cases and coupling.
Practitioner account; direct use; counts toward Delivered outcomes
Positive
Sahil Lavingia, CEO and founder of Gumroad
Gumroad CEO's playbook to 40x his team's productivity with v0, Cursor, and Devin | Sahil LavingiaPodcast episode, How I AI (YouTube)
Lavingia's flow is v0, then Devin, then Cursor: prototype in v0, hand the work to Devin, and open Cursor when Devin fails to completely finish. Ran a US$33,000 competition for whoever merged more Devin PRs than the author in May; the host cites Devin writing 41% of Gumroad's PRs.
"…sort of fails to completely finish then I open it up in cursor. though I did I think last week Devon launched this pairing mode where you can actually like jump in and so I haven't really experimented with that yet but that's presumably I…"
"Yeah, so generally my flow is V0, Devin cursor, is probably how I would say it. Like generally V0 is my prototyping tool of choice. And once I have like a really good prototype that I'm happy with, then I go to Devin and if Devin sort of fails to completely finish then I open it up in cursor."
Practitioner account, self-described; ran the rollout; counts toward Delivered outcomes, Operational control, Adoption and upkeep
GILD's fact checks, which don't count as sources
Checked Oct 12, 2026.Cognition's guidance puts the reliable range at tasks an engineer could finish in about three hours, with tests or CI as the success criteria. It recommends splitting larger work into separate sessions. When to use Devin
Open them in the recordStatements this group's sources agree on, then the ones close to agreement.
Devin performs best on well-scoped tasks with clear success criteria, such as tests or CI, that it can check for itself.
6 supporting sourcesClose to agreement: each needs 6 supporting sources
A working environment per repository and maintained written context, through Knowledge, Skills, playbooks, or AGENTS.md, make Devin's results more reliable.
5 supporting sourcesQuestions the sources split on, with the count on each side.
Evidence remains mixed
Hands-off delegation, 4 sources
Some hand Devin whole tickets or parallel threads and come back to the pull request.
Interactive tools, 4 sources
Others tried Devin and went back to tools such as Cursor or Claude Code, where they steer each step.
Evidence remains mixed
Net time saved, 4 sources
Some report work shipped with minutes of their own attention, or several times more output.
Absorbed by review, 3 sources
Others find review and rework absorb the time saved, or make the work slower than doing it by hand.
The three groups, then every practitioner by the context they work in, and how emphasis changes with scale.
Three groups drawn from the same sources. Choose a group to select whose experience counts. Within that group, each author counts once in the practitioner sentiment, with their latest view. Signals open on Engineering leaders and teams.
28 sources. These accounts focus on delegated throughput, environment setup, written context, usage cost, review load, and what changes when Devin moves from a few engineers to many teams.
35 sources. These accounts focus on whether a single session finishes, how long it takes, what it costs, and how Devin compares with interactive tools for self-directed work.
63 sources. This group gives the broadest read. It combines solo and team settings that can reach different conclusions about Devin.
63 sources from practitioners, by the context they work in. Filled rows count for this group.
Emphasizes Whether a single session finishes and what it costs
Emphasizes Delegating tickets and whether the subscription pays off
Emphasizes Merged pull requests and cost per task
Emphasizes Where to delegate and whether engineers keep using it
Emphasizes Usage limits and access management across many developers
What changes with scale. Individual builders judge Devin on whether a session finishes and what it costs. Team accounts turn to codebase understanding, review load, and whether the time saved survives review.
Where this group's sources were published.
Counted for Engineering leaders and teams, from 28 sources. Change group
49 sources for this group, 21 of them documentation
Older evidence is retained when it still applies. Sources that depend on a changed plan, price, or product version stay in the history, marked Needs a recheck.
See sources by originWho each source is, how it knows, whether it still applies and what it counts toward.
Newest first, on its own page. Every count above opens its sources there.
Read all 84 sourcesAbout this read
A running review of what engineering teams report about Devin, from individual builders to company-wide rollouts. Each finding links to its sources, and each conflict shows both sides.
Counts cover only the sources GILD reviewed.
Choose a group to select whose experience counts. Within that group, each author counts once in the practitioner sentiment, with their latest view. GILD files each source in a group from how the account describes its author. A role or employer marked self-described is what the source states about themselves. Documentation checks facts for every group and never counts toward sentiment.
A source's date and whether it still applies are separate: a recent post can describe an old version, and an old one can still hold.
Flagged for a recheck, of the sources that take a side: leaders and teams 4 of 24, individual builders 10 of 29, all practitioners 14 of 53.
Each row opens its sources for the group you are reading.
| Finding | Engineering leaders and teams | Individual builders | All practitioners | Sources |
|---|---|---|---|---|
| Current readCurrent sentiment | 13 positive, 7 mixed, 4 negative | 17 positive, 4 mixed, 8 negative | 30 positive, 11 mixed, 12 negative | Sources |
| PraiseAsync delegation | 9 of 9 positive | 7 of 7 positive | 16 of 16 positive | Sources |
| PraiseEnd-to-end execution | 7 of 8 positive | 10 of 10 positive | 17 of 18 positive | Sources |
| PraiseCodebase understanding | 11 of 11 positive | 3 of 5 positive | 14 of 16 positive | Sources |
| PraiseMigrations & repetitive changes | 5 of 5 positive | 2 of 2 positive (under the minimum) | 7 of 7 positive | Sources |
| PraiseDeveloper experience | 5 of 7 positive | 3 of 8 positive | 8 of 15 positive | Sources |
| ConcernUnpredictable task success | 3 of 6 raise it | 8 of 11 raise it | 11 of 17 raise it | Sources |
| ConcernUsage and cost | 3 of 4 raise it (under the minimum) | 8 of 14 raise it | 11 of 18 raise it | Sources |
| ConcernRequires strong review | 7 of 8 raise it | 4 of 7 raise it | 11 of 15 raise it | Sources |
| ConcernEnvironment & context setup | 3 of 4 raise it (under the minimum) | 1 of 4 raise it (under the minimum) | 4 of 8 raise it | Sources |
| ConcernSession speed | 1 of 2 raise it (under the minimum) | 2 of 3 raise it (under the minimum) | 3 of 5 raise it | Sources |
| ConcernNeeds close steering | 3 of 3 raise it (under the minimum) | 6 of 7 raise it | 9 of 10 raise it | Sources |
| ConsensusSetup and written context improve results | 5 supporting (below threshold) | 2 supporting (under the minimum) | 7 supporting (below threshold) | Sources |
| ConsensusStrongest on scoped, verifiable tasks | 6 supporting | 2 supporting (under the minimum) | 8 supporting (below threshold) | Sources |
| ConsensusManaged like a junior engineer | 1 supporting (under the minimum) | 3 supporting (under the minimum) | 4 supporting (under the minimum) | Sources |
| ConsensusValue comes from parallel sessions | 0 supporting (under the minimum) | 4 supporting (under the minimum) | 4 supporting (under the minimum) | Sources |
| DisagreementShould Devin work as a hands-off teammate, or do engineers get more from an interactive agent for the same work? | Hands-off delegation 4, Interactive tools 4 | Hands-off delegation 2, Interactive tools 3 | Hands-off delegation 6, Interactive tools 7 | Sources |
| DisagreementOnce review and rework are counted, does Devin reduce total engineering time? | Net time saved 4, Absorbed by review 3 | Net time saved 5, Absorbed by review 2 | Net time saved 9, Absorbed by review 5 | Sources |
| DisagreementHow much work should Devin take on before a human checkpoint? | Broader delegation 1, Tighter steering 1 (under the minimum) | Broader delegation 3, Tighter steering 3 | Broader delegation 4, Tighter steering 4 | Sources |
| Current readEvidence mix | 49 sources | 56 sources | 84 sources | Sources |
GILD's checks of claims against official documentation, kept apart from the source counts.
