Build a chess game against a language model
An early tester asked Devin to build a chess game against a language model; it made good progress but eventually hung.
What they did
Early tester Andrew Kean Gao, a computer science student, gave Devin a chess game to build in which the player competes against a language model. Devin works in an isolated environment with a shell, code editor and browser. The source gives no further detail on the steps it took or on how Gao intervened.
How it went
Devin made remarkable progress, but at some point it hung and the game wasn't finished. Gao's other tests had mixed results: a Chrome extension worked, and an Antarctic temperature visualization was unsatisfactory.
Worth knowing
Devin was only available to selected developers through a waiting list at the time, and the source gives no cost or time figures for this task.
Labels
Early tester Andrew Kean Gao, a computer science student, gave Devin a chess game to build in which the player competes against a language model.
An early tester asked Devin to build a chess game against a language model; it made good progress but eventually hung.
An early tester asked Devin to build a chess game against a language model; it made good progress but eventually hung.
Devin was only available to selected developers through a waiting list at the time, and the source gives no cost or time figures for this task.
Gao's other tests had mixed results: a Chrome extension worked, and an Antarctic temperature visualization was unsatisfactory.
The “Material” label failed its quality check and is not used for selection.
Details
- Agents
- Devin
- Source
- other
- Source date
- Mar 13, 2024
- Accounts
- 1
- In registry since
- Oct 12, 2026