AI
Claude Proves More Thorough Than ChatGPT in Head-to-Head Developer Tasks
New benchmark tests reveal both AI assistants deliver accurate results, but Claude excels at providing context while ChatGPT prioritizes speed.
The New Stack
Anthropic's recent integration of its Claude chat and Cowork modes into a unified interface mirrors a move OpenAI made earlier this year with its Work mode—both platforms now route requests automatically rather than forcing users to switch between separate tools. As the two systems converge toward feature parity, their real differences lie in accuracy, speed, and how they handle detail.
To see which performs better on practical developer work, I benchmarked Claude against ChatGPT's Work mode across three realistic scenarios: API documentation research, building a command-line tool from specification, and a multi-step handoff task involving file analysis and spreadsheet generation.
API research#
I asked each system to look up four real developer APIs (GitHub, Stripe, Twilio, and OpenAI), compile their rate limits, free-tier availability, and version identifiers, and cite documentation sources.
Both returned completely accurate responses across all twelve graded fields. Claude, however, went further—it included supplementary details like GitHub's separate rate limit for Actions tokens, Twilio's queue window parameters, and OpenAI's tier thresholds. It also flagged one page it couldn't reach. ChatGPT's Work mode completed faster: 1:17 versus Claude's 1:44, outputting 649 tokens compared to Claude's 1,042. Claude read eight pages and listed nine sources, making its additional verbosity tied directly to its deeper investigation.
Building from a specification#
Both systems received the same spec: create a command-line duration parser accepting inputs like "2d 3h 15m" and returning values in seconds, with strict handling of edge cases (out-of-order units, repeated units, invalid formats). Each was tested against a hidden 16-case suite covering these traps.
Both produced code that passed all tests perfectly. ChatGPT finished in 1:17 on 769 output tokens; Claude took 1:45 using 989 tokens. Notably, Claude reported running 35 of its own test cases before delivery, while ChatGPT reported only that its tests had passed. Claude also flagged an unstated judgment in the spec: Python's round() function defaults to banker's rounding for 0.5, which may not match the expected behavior. ChatGPT provided no such caveat.
The handoff task#
The real-world complexity came here. First, I asked which of two stack traces indicated a race condition. Both answered correctly in seconds—the one involving dictionary size changing during iteration. Then, without switching modes, I handed off a multi-step job: pull a CSV log file from Google Drive, compute latency percentiles (p50, p95, p99) and error rates per endpoint, and deliver a spreadsheet with a bar chart.

