We’re always excited to try out new AI products and short on time to actually do it. Over the holidays, we finally had a chance to try out Devin fr

One month of using Devin

submited by

Style Pass

2025-01-23 19:00:09

We’re always excited to try out new AI products and short on time to actually do it. Over the holidays, we finally had a chance to try out Devin from Congition, which was one of the most hyped AI products of 2024.

If you’ve been living under a rock, Devin released a very flashy demo of a software engineering agent in March of last year that showed an agent navigating multiple code files to accomplish a reasonably complicated programming task. We were a little skeptical of how generalizable this would be, but Cognition made Devin generally available last December, so we thought the holidays would be a good time to take Devin for a spin.

Before we dive into sharing our experiences, we want to be very clear that any negative thoughts we share below aren’t meant to be dismissive of Devin (or of any other products). We have all the respect in the world for anyone building AI products — the rate of change of the technology and the general craziness in the market give us all more than enough to keep up with. We’re sharing our feedback to both get better at building RunLLM and to hopefully share perspective that benefits others. If we get anything wrong, feel free to share feedback!

A similar blog post about Devin from Answer AI came across our radar this past week. We haven’t had a chance to do a close read, but for what it’s worth, their takeaways seem to be pretty similar to ours.