Models

DeepSeek V4 Flash Matches Fable 5 in Debugging Test

DeepSeek V4 Flash achieved a perfect score in a private repository debugging benchmark, matching elite models like Fable 5 at nearly one-hundredth of the cost.

AlphaSignal1 day agoModels
Image: AlphaSignal

In a recent independent evaluation, the open-weight DeepSeek V4 Flash model successfully resolved 54 out of 54 debugging tasks across 18 real-world software issues, matching the perfect scores of premium models like Fable 5, Grok 4.5, GPT-5.6 Sol, and Inkling. While Fable 5 required $20.99 to complete the run, V4 Flash cost just $0.21 in total, averaging $0.0039 per fix. This 98.8-fold cost reduction was largely driven by cheap cache-read pricing, which covered roughly 83 percent of the model's token usage.

Though V4 Flash consumed more total tokens than Fable 5—6.46 million compared to 5.03 million—it ranked first overall due to its unmatched cost efficiency. In terms of speed, V4 Flash ran 1.4 times faster than Fable 5, though it was outpaced by Grok 4.5, GPT-5.6 Sol, and Inkling. The 284-billion-parameter model, which activates 13 billion parameters per token and features a one-million-token context window, also reportedly outperforms the V4 Pro Preview on benchmarks like Terminal Bench 2.1, DeepSWE, and NL2Repo.

For software practitioners, these results suggest a highly economical alternative to proprietary models, with former Meta product manager Xiaoyin Qu suggesting it could pull developers away from Claude. However, the model's performance degraded on ambiguous tasks. One complex cross-module bug required 3.4 times more tokens and 2.6 times more time than the average run, and another performance fix resulted in an over-engineered 65-line patch that passed tests but lacked maintainability.

To maximize efficiency, developers should adopt a hybrid routing strategy. The recommended approach is to deploy V4 Flash for bounded, testable bugs, but escalate to a more capable model if token consumption exceeds three times the average or if the patch scope expands beyond expected boundaries.

This is our own summary of reporting by AlphaSignal

More in Models