LiveBench Mathematics — cost vs performance

Best current row per canonical model in the group “average score · variant=Mathematics” (57 models) against ESTIMATED memory at 4-bit, 8K context (GB). The dashed line is the Pareto frontier: no model is both better and cheaper than a point on it.

← Leaderboard

XOutput price Input price Parameters Context Memory (est.)Scalelog linearBubblecontext params none

open / restricted weights closed Pareto frontier (4 models)Estimated

Frontier models 4

Pareto frontier
Model	average score on LiveBench Mathematics	Rank	ESTIMATED memory at 4-bit, 8K context (GB)	Provider	Trust
Z.ai GLM 5.2Z.ai (Zhipu AI) · Open weights	89.8%	27	433.7 GBest.	—	Official board
DeepSeek V4 Flash Vision ExpDeepSeek · Open weights	87.8%	35	175.7 GBest.	—	Official board
DeepSeek V4 Flash (0731)DeepSeek · Open weights	86.8%	39	175.4 GBest.	—	Official board
Qwen3.8 27BQwen · Open weights	86.2%	41	16.5 GBest.	—	Official board

Methodology. Points are the best current row per canonical model in comparability group 'average score · variant=Mathematics'. Price = cheapest current offer across providers (the provider shown). Pareto frontier maximises the score and minimises x; exact ties are all kept. memory_estimate is an estimate (see /methodology). Only the selected comparability group is plotted; points under other configurations are not mixed in. Price = cheapest current offer across providers at the time of the last crawl. Nothing is estimated except where marked.