Skip to content
AI Atlas

LiveBench Instruction Following — cost vs performance

Best current row per canonical model in the group “average score · variant=IF” (57 models) against cheapest current output price (USD / 1M tokens). The dashed line is the Pareto frontier: no model is both better and cheaper than a point on it.

open / restricted weights closed Pareto frontier (4 models)bubble = total parameters

Frontier models 4

Pareto frontier
Modelaverage score on LiveBench Instruction FollowingRankcheapest current output price (USD / 1M tokens)ProviderTrust
Gemini 3.8 FlashGoogle · Closed81.4%1$1.88OpenRouterOfficial board
Qwen3.8 FlashQwen · Open weights77.1%5$0.47OpenRouterOfficial board
DeepSeek V4 Flash Vision ExpDeepSeek · Open weights71.0%23$0.33DeepSeek APIOfficial board
DeepSeek V4 Flash (0731)DeepSeek · Open weights65.5%36$0.08OpenRouterOfficial board

Methodology. Points are the best current row per canonical model in comparability group 'average score · variant=IF'. Price = cheapest current offer across providers (the provider shown). Pareto frontier maximises the score and minimises x; exact ties are all kept. memory_estimate is an estimate (see /methodology). Only the selected comparability group is plotted; points under other configurations are not mixed in. Price = cheapest current offer across providers at the time of the last crawl. Nothing is estimated except where marked.