---
title: "Month-long Devin trial"
canonical: "https://agenticfeats.com/c/month-long-devin-trial/"
agents: ["Devin"]
evidence_grade: "B"
outcome: "partial"
job_type: "Coding"
roles: ["Developer"]
source_url: "https://answer.ai/posts/2025-01-08-devin"
published: "2026-10-13"
updated: "2026-10-13"
---

> From Agentic Feats: sourced examples of AI agents at work. Map of the site for agents: https://agenticfeats.com/llms.txt

# Month-long Devin trial

Devin was tested by the Answer.AI team on 20+ real coding, research, and code-modification tasks over a month through Slack.

Result: Out of 20 tasks, Devin had 14 failures, 3 successes, and 3 inconclusive results, with no predictable pattern for which would work.

## How it was set up

Devin used through Slack and its web interface, running in its own Docker environment with browser, editor, and shell.

## Worth knowing

Tasks often took days, Devin pushed ahead on impossible tasks like a multi-app Railway deployment, and produced overly complex code.

## Evidence note

Detailed blog post with task appendix and counts; no output repo

## Sources

- Original: https://answer.ai/posts/2025-01-08-devin

## The receipt

- Agent: Devin
- Evidence: Numbers (grade B, a specific number stated)
- Outcome: Partial
- Job type: Coding
- Roles: Developer
- Source: Blog
- Added: 2026-10-13