Play online math games in agent mode
The author had GPT-5 in ChatGPT agent mode play online versions of Math Games with Bad Drawings, and it mostly worked, unlike earlier rental car and tax form attempts.
What they did
The author pointed GPT-5 in ChatGPT agent mode at online versions of games from Ben Orlin's Math Games with Bad Drawings. The agent clicked around the game sites in its own browser and chose moves, with its reasoning visible. The author played the opposing side and had to type "your turn" after each move, since the agent couldn't tell when it was its turn.
How it went
Basically worked, which beat earlier attempts at rental car booking and tax forms. It played poorly, though. The author beat it easily as both Bob and Alice, and it wrongly claimed it could watch for turn changes.
Worth knowing
The agent can't watch a page for changes, so you have to prompt it every turn. A commenter also noted the games may be in its training data.
Labels
The author played the opposing side and had to type "your turn" after each move, since the agent couldn't tell when it was its turn.
The author played the opposing side and had to type "your turn" after each move, since the agent couldn't tell when it was its turn.
The agent clicked around the game sites in its own browser and chose moves, with its reasoning visible.
The agent clicked around the game sites in its own browser and chose moves, with its reasoning visible.
The author played the opposing side and had to type "your turn" after each move, since the agent couldn't tell when it was its turn.
The “Material” label failed its quality check and is not used for selection.
Details
- Agents
- ChatGPT Agent
- Source
- blog
- Source date
- undated
- Accounts
- 1
- In registry since
- Oct 12, 2026