# coding benchmark

| \# | model | coding | $/task | card | cheapest list | cheapest effective | unit | providers | tokens/week |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | `anthropic/claude-fable-5.1` | 81.6 |  | 10.0 | 10.0 amazon-bedrock | 2.1435 anthropic |  | 4 | 7573541962 |
| 2 | `openai/gpt-5.6-sol` | 78.3 |  | 4.0 | 2.0 openai/flex | 1.2602 azure/us |  | 3 | 10412992133 |
| 3 | `anthropic/claude-opus-5` | 78.0 |  | 5.0 | 5.0 azure/global | 1.1673 anthropic |  | 5 | 9999518143 |
| 4 | `openai/gpt-6-astra` | 76.9 |  | 10.0 | 5.0 openai/flex | 1.0295 openai/flex |  | 3 | 12764530937 |
| 5 | `x-ai/grok-4.6` | 76.8 |  | 2.0 | 2.0 xai/zdr | 0.7725 amazon-bedrock/us-west-2 |  | 2 | 2750565342 |
| 6 | `openai/gpt-5.6-terra` | 76.7 |  | 2.0 | 1.0 openai/flex | 0.4604 azure |  | 3 | 4625799877 |
| 7 | `anthropic/claude-fable-5` | 76.5 |  | 10.0 | 10.0 azure | 3.27 anthropic |  | 5 | 1799948098 |
| 8 | `google/gemini-3.8-flash` | 76.3 |  |  | 0.375 google-vertex/global/flex | 0.1745 google-ai-studio/flex |  | 2 | 66105151093 |
| 9 | `qwen/qwen3.8-max-0902` | 76.2 |  |  | 2.0 alibaba | 0.3589 alibaba |  | 1 | 8757807556 |
| 10 | `moonshotai/kimi-k3` | 76.2 |  | 3.0 | 0.153 wafer/fast | 0.1521 wafer/fast |  | 22 | 59504210550 |
| 11 | `google/gemini-3.7-flash` | 76.1 |  |  | 0.375 google-vertex/global/flex | 0.1294 google-ai-studio/flex |  | 2 | 16485676436 |
| 12 | `meta/muse-spark-1.3` | 75.8 |  | 1.25 | 1.25 google-vertex/global | 0.3469 meta |  | 2 | 3333839173 |
| 13 | `openai/gpt-5.5` | 74.9 |  | 5.0 | 2.5 openai/flex | 0.9605 openai/flex |  | 3 | 2430328494 |
| 14 | `z-ai/glm-5.3` | 74.8 |  | 1.4 | 0.0699 wafer/us | 0.069 wafer/us |  | 39 | 244459012685 |
| 15 | `anthropic/claude-opus-4.8` | 74.3 |  | 5.0 | 5.0 azure/global | 1.1933 amazon-bedrock |  | 5 | 7736756673 |
| 16 | `anthropic/claude-opus-4.7` | 73.6 |  | 5.0 | 5.0 google-vertex/global | 1.5151 anthropic |  | 5 | 874219417 |
| 17 | `x-ai/grok-4.5` | 72.4 |  | 2.0 | 2.0 xai | 0.8273 xai/zdr |  | 1 | 2130481258 |
| 18 | `meta/muse-spark-1.2` | 72.2 |  | 1.25 | 1.25 meta | 0.7251 meta |  | 1 | 82335175 |
| 19 | `qwen/qwen3.8-2.4t-a95b` | 71.9 |  |  | 2.0 alibaba | 0.3546 together |  | 9 | 3375846448 |
| 20 | `z-ai/glm-5.3-flash` | 71.5 |  | 0.15 | 0.0399 relace/fp4 | 0.0204 primeintellect |  | 40 | 806116523144 |
| 21 | `anthropic/claude-sonnet-5` | 71.5 |  | 2.0 | 2.0 amazon-bedrock/global | 0.3115 google-vertex/us |  | 5 | 19785018514 |
| 22 | `openai/gpt-5.6-luna` | 71.4 |  | 0.2 | 0.1 openai/flex | 0.0591 openai/flex |  | 3 | 65706471235 |
| 23 | `meta/muse-spark-1.1` | 71.3 |  | 1.25 | 1.25 meta | 0.7307 meta |  | 1 | 132134718 |
| 24 | `openai/gpt-5.4` | 71.1 |  | 2.5 | 1.25 openai/flex | 0.9545 openai |  | 3 | 1559911228 |
| 25 | `google/gemini-3.5-flash` | 70.1 |  |  | 0.75 google-ai-studio/flex | 0.2479 google-ai-studio/flex |  | 2 | 1763021737 |
| 26 | `google/gemini-3.6-flash` | 69.2 |  |  | 0.375 google-ai-studio/flex | 0.3217 google-ai-studio/flex |  | 2 | 3715265581 |
| 27 | `deepseek/deepseek-v4-flash-0731` | 69.1 |  | 0.44 | 0.03 open-inference/fp4 | 0.0139 streamlake/fp8 |  | 37 | 314513489706 |
| 28 | `qwen/qwen3.8-max` | 68.9 |  |  | 2.0 alibaba | 0.58 alibaba |  | 1 | 3118556904 |
| 29 | `deepseek/deepseek-v4-pro-0813` | 68.8 |  | 1.32 | 0.0999 relace/fp4 | 0.0998 relace/fp4 |  | 24 | 38297722212 |
| 30 | `z-ai/glm-5.2` | 68.8 |  | 1.4 | 0.0066 relace/fp4 | 0.0062 wafer/us |  | 34 | 67682870933 |
| 31 | `google/gemini-3.1-pro-preview` | 68.8 |  |  | 1.0 google-ai-studio/flex | 0.6497 google-ai-studio/flex |  | 2 | 4366256457 |
| 32 | `qwen/qwen3.8-27b` | 68.1 |  |  | 0.035 darkbloom/fp4 | 0.0103 chutes/fp8 |  | 26 | 38376372463 |
| 33 | `qwen/qwen3.7-max` | 66.0 |  |  | 1.475 alibaba | 0.6225 alibaba |  | 1 | 229410698 |
| 34 | `deepseek/deepseek-v4-flash-vision-exp` | 65.0 |  | 0.44 | 0.2156 deepinfra/fp8 | 0.0254 gmicloud/fp8 |  | 7 | 19162881398 |
| 35 | `anthropic/claude-sonnet-4.6` | 63.0 |  | 3.0 | 3.0 google-vertex/global | 1.072 amazon-bedrock/global |  | 5 | 9270256352 |
| 36 | `moonshotai/kimi-k2.6` | 61.8 |  | 0.95 | 0.39 chutes/int4 | 0.2277 chutes/int4 |  | 22 | 4176548547 |
| 37 | `moonshotai/kimi-k2.7-code` | 60.8 |  | 0.95 | 0.6 coreweave/int4 | 0.2388 coreweave/int4 |  | 18 | 1525673246 |
| 38 | `xiaomi/mimo-v2.5-pro` | 60.2 |  | 0.435 | 0.3045 gmicloud/bf16 | 0.0612 xiaomi/fp8 |  | 7 | 17728731871 |
| 39 | `kwaipilot/kat-coder-pro-v2` | 59.5 |  |  | 0.3 atlas-cloud/fp8 | 0.2304 streamlake |  | 2 | 24159049 |
| 40 | `deepseek/deepseek-v4-pro` | 59.4 |  | 0.66 | 0.66 deepseek | 0.1881 streamlake/fp8 |  | 21 | 58724115254 |
| 41 | `nex-agi/nex-n2-pro` | 59.1 |  | 0.25 | 0.25 nex-agi/fp8 | 0.0398 nex-agi/fp8 |  | 2 | 42940716 |
| 42 | `tencent/hy3-preview` | 58.8 |  |  | 0.18 gmicloud/bf16 | 0.1198 gmicloud/bf16 |  | 1 | 106766376 |
| 43 | `minimax/minimax-m3` | 58.6 |  | 0.3 | 0.224 deepinfra/fp8/flex | 0.0623 gmicloud/fp8 |  | 14 | 42355642611 |
| 44 | `inclusionai/ling-3.0-flash-vl` | 57.0 |  |  | 0.06 deepinfra/fp16 | 0.028 deepinfra/fp16 |  | 1 | 144990235 |
| 45 | `xiaomi/mimo-v2.5` | 56.8 |  | 0.14 | 0.119 gmicloud/fp8 | 0.0126 xiaomi/fp8 |  | 7 | 490191247748 |
| 46 | `deepseek/deepseek-v4-flash` | 56.2 |  | 0.22 | 0.05 relace/fp4 | 0.0203 open-inference/fp8 |  | 24 | 264245760211 |
| 47 | `openai/gpt-5.4-nano` | 56.1 |  | 0.2 | 0.1 openai/flex | 0.0491 openai/flex |  | 2 | 2347263828 |
| 48 | `openai/gpt-5.4-mini` | 56.1 |  | 0.75 | 0.375 openai/flex | 0.0599 openai/flex |  | 2 | 3592057033 |
| 49 | `qwen/qwen3.7-plus` | 55.9 |  |  | 0.32 alibaba | 0.1732 alibaba |  | 1 | 2491495658 |
| 50 | `z-ai/glm-5.1` | 55.8 |  | 1.4 | 0.9 chutes/fp8 | 0.3379 chutes/fp8 |  | 18 | 1682206009 |
| 51 | `inclusionai/ling-3.0-flash-fin` | 55.6 |  |  | 0.06 deepinfra/fp4 | 0.0169 deepinfra/fp4 |  | 1 | 264897851 |
| 52 | `qwen/qwen3.6-plus` | 54.5 |  |  | 0.325 alibaba | 0.3084 alibaba |  | 1 | 213958299 |
| 53 | `qwen/qwen3.6-27b` | 53.7 |  |  | 0.25 chutes/fp8 | 0.1004 chutes/fp8 |  | 10 | 1018016186 |
| 54 | `thinkingmachines/inkling-small` | 52.9 |  |  | 0.45 deepinfra/fp8 | 0.1244 baseten/fp8 |  | 3 | 646710202 |
| 55 | `upstage/solar-pro4` | 52.7 |  | 0.15 | 0.15 upstage | 0.0912 upstage/zdr |  | 2 | 12132768535 |
| 56 | `minimax/minimax-m2.7` | 52.6 |  | 0.3 | 0.21 gmicloud/fp8 | 0.0903 deepinfra/fp8 |  | 9 | 4062222361 |
| 57 | `thinkingmachines/inkling` | 52.1 |  |  | 0.95 deepinfra/fp8 | 0.6663 together |  | 3 | 4073704634 |
| 58 | `anthropic/claude-sonnet-4.5` | 52.1 |  | 3.0 | 3.0 google-vertex/global | 0.6022 google-vertex/us-east5 |  | 5 | 2446063053 |
| 59 | `x-ai/grok-build-0.1` | 51.5 |  | 1.0 | 1.0 xai | 0.2185 xai/zdr |  | 1 | 218036192 |
| 60 | `inclusionai/ling-3.0-flash` | 50.6 |  |  | 0.021 novita | 0.0123 novita |  | 2 | 4782103295 |
| 61 | `openai/gpt-5.1` | 49.4 |  | 1.25 | 0.625 openai/flex | 0.2471 openai/flex |  | 2 | 999470698 |
| 62 | `google/gemini-3.5-flash-lite` | 49.3 |  |  | 0.15 google-ai-studio/flex | 0.093 google-vertex/global/flex |  | 2 | 8815470911 |
| 63 | `nvidia/nemotron-3-ultra-550b-a55b` | 49.3 |  |  | 0.4 deepinfra/fp4/flex | 0.1215 deepinfra/fp4/flex |  | 5 | 3907102956 |
| 64 | `meta/muse-glimmer-30b` | 49.0 |  |  | 0.3 deepinfra/bf16 | 0.0604 phala |  | 5 | 1024965298 |
| 65 | `qwen/qwen3.5-397b-a17b` | 48.2 |  |  | 0.39 alibaba | 0.3199 deepinfra/fp8 |  | 11 | 511195664 |
| 66 | `mistralai/mistral-medium-3-5` | 46.9 |  | 1.5 | 1.5 mistral/zdr | 1.4999 mistral |  | 1 | 312198004 |
| 67 | `moonshotai/kimi-k2.5` | 46.8 |  | 0.6 | 0.45 deepinfra/fp4 | 0.1505 moonshotai/int4 |  | 10 | 1480447887 |
| 68 | `z-ai/glm-4.6` | 45.8 |  | 0.6 | 0.4 deepinfra/fp4/flex | 0.163 venice/fp4 |  | 5 | 854974071 |
| 69 | `qwen/qwen3.5-122b-a10b` | 45.7 |  |  | 0.26 alibaba | 0.2597 siliconflow/fp8 |  | 5 | 456557296 |
| 70 | `meituan/longcat-2.0` | 45.3 |  |  | 0.3 atlas-cloud/fp8 | 0.0268 atlas-cloud/fp8 |  | 1 | 615430229 |
| 71 | `z-ai/glm-4.7` | 45.3 |  | 0.6 | 0.32 deepinfra/fp4/flex | 0.2166 deepinfra/fp4/flex |  | 9 | 1793109277 |
| 72 | `deepseek/deepseek-v3.2` | 44.2 |  |  | 0.2088 gmicloud/fp8 | 0.0926 gmicloud/fp8 |  | 15 | 29736505094 |
| 73 | `anthropic/claude-haiku-4.5` | 43.9 |  | 1.0 | 1.0 azure/global | 0.2325 amazon-bedrock/eu-west-1 |  | 4 | 5580791996 |
| 74 | `deepseek/deepseek-v3.1-terminus` | 43.5 |  |  | 0.27 deepinfra/fp4 | 0.2037 atlas-cloud/fp8 |  | 5 | 823280489 |
| 75 | `google/gemma-4-31b-it` | 43.4 |  |  | 0.08 open-inference/bf16 | 0.0798 open-inference/bf16 |  | 22 | 24673261769 |
| 76 | `inclusionai/ring-2.6-1t` | 42.8 |  |  | 0.075 novita | 0.0367 novita |  | 1 | 453776586 |
| 77 | `x-ai/grok-4.3` | 42.2 |  | 1.25 | 1.25 xai | 0.851 xai |  | 1 | 1701166249 |
| 78 | `qwen/qwen3.6-35b-a3b` | 41.9 |  |  | 0.018 primeintellect/fp8 | 0.0127 primeintellect/fp8 |  | 12 | 9059542464 |
| 79 | `openai/o1` | 39.7 |  | 15.0 | 15.0 openai | 10.5977 openai |  | 1 | 1138341 |
| 80 | `stepfun/step-3.7-flash` | 39.6 |  | 0.2 | 0.16 deepinfra | 0.0456 deepinfra |  | 3 | 750713750 |
| 81 | `google/gemma-4-26b-a4b-it` | 39.3 |  |  | 0.01 primeintellect/bf16 | 0.0104 primeintellect/bf16 |  | 15 | 17632526472 |
| 82 | `openai/gpt-5` | 37.8 |  | 1.25 | 1.25 azure | 0.7591 openai/default |  | 2 | 311907360 |
| 83 | `nvidia/nemotron-3-super-120b-a12b` | 37.7 |  |  | 0.075 deepinfra/bf16 | 0.075 deepinfra/bf16 |  | 5 | 340604995 |
| 84 | `anthropic/claude-sonnet-4` | 37.6 |  |  | 3.0 amazon-bedrock | 1.4411 google-vertex/global |  | 2 | 1266922610 |
| 85 | `qwen/qwen3.5-35b-a3b` | 37.0 |  |  | 0.065 darkbloom/fp4 | 0.065 darkbloom/fp4 |  | 9 | 1631869476 |
| 86 | `qwen/qwen3-coder-next` | 36.2 |  |  | 0.12 parasail/bf16 | 0.0733 parasail/bf16 |  | 4 | 1276802354 |
| 87 | `google/gemini-3.1-flash-lite-preview` | 34.7 |  |  | 0.125 google-ai-studio/flex | 0.1205 google-ai-studio/flex |  | 1 | 3003730468 |
| 88 | `google/gemini-2.5-pro` | 33.3 |  |  | 0.625 google-ai-studio/flex | 0.2859 google-ai-studio/flex |  | 2 | 4353720545 |
| 89 | `mistralai/devstral-2512` | 31.3 |  | 0.4 | 0.4 mistral/eu | 0.051 mistral/eu |  | 1 | 265445382 |
| 90 | `inception/mercury-2` | 31.1 |  | 0.25 | 0.25 inception | 0.1713 inception |  | 1 | 146887169 |
| 91 | `openai/gpt-oss-120b` | 30.4 |  |  | 0.03 akashml/fp4 | 0.0204 near-ai/fp4 |  | 24 | 16824607232 |
| 92 | `qwen/qwen3.5-9b` | 28.7 |  |  | 0.053 primeintellect/bf16 | 0.0787 darkbloom/fp4 |  | 7 | 3637842369 |
| 93 | `cohere/command-a-plus` | 27.8 |  | 0.3 | 0.3 cohere/fp8 | 0.3 cohere/fp8 |  | 1 | 143605951 |
| 94 | `cohere/command-a` | 27.8 |  | 2.5 | 2.5 cohere | 2.4997 cohere |  | 1 | 840473 |
| 95 | `nvidia/nemotron-3.5-lightning` | 26.8 |  |  | 0.025 darkbloom/int4 | 0.0175 darkbloom/int4 |  | 8 | 947152601 |
| 96 | `mistralai/mistral-small-2603` | 26.6 |  | 0.15 | 0.15 mistral | 0.0662 mistral/zdr |  | 2 | 1133534667 |
| 97 | `inclusionai/ling-3.0-tiny` | 26.5 |  |  | 0.015 antdigital/fp8 | 0.0073 antdigital/fp8 |  | 1 | 130377541 |
| 98 | `arcee-ai/trinity-large-thinking` | 25.8 |  | 0.25 | 0.22 parasail/fp4 | 0.0515 arcee-ai |  | 2 | 121188704 |
| 99 | `inclusionai/ling-2.6-flash` | 25.3 |  |  | 0.01 novita | 0.0095 novita |  | 1 | 15152642097 |
| 100 | `deepseek/deepseek-r1` | 24.6 |  |  | 0.7 novita/fp8 | 0.6999 novita/fp8 |  | 2 | 133323311 |
| 101 | `openai/gpt-4o-2024-05-13` | 24.2 |  | 5.0 | 5.0 azure | 5.0 azure |  | 2 | 4475376 |
| 102 | `amazon/nova-2-lite-v1` | 23.0 |  |  | 0.3 amazon-bedrock/eu-west-1 | 0.2999 amazon-bedrock |  | 1 | 71041671 |
| 103 | `ibm-granite/granite-4.2-8b` | 22.4 |  |  | 0.06 coreweave/bf16 | 0.0212 coreweave/bf16 |  | 2 | 92131414 |
| 104 | `qwen/qwen3-235b-a22b-thinking-2507` | 22.1 |  |  | 0.23 alibaba | 0.2299 alibaba |  | 4 | 251351864 |
| 105 | `openai/gpt-4-turbo` | 21.5 |  | 10.0 | 10.0 openai | 10.0 openai |  | 1 | 12401087 |
| 106 | `deepseek/deepseek-chat-v3-0324` | 21.2 |  |  | 0.24 deepinfra/fp4 | 0.2182 deepinfra/fp4 |  | 5 | 1547656279 |
| 107 | `moonshotai/kimi-k2-thinking` | 21.0 |  |  | 0.6 google-vertex | 0.3613 novita/bf16 |  | 2 | 101424456 |
| 108 | `openai/gpt-oss-20b` | 20.7 |  |  | 0.018 darkbloom/fp8 | 0.0152 darkbloom/fp8 |  | 15 | 5890505215 |
| 109 | `mistralai/mistral-medium-3.1` | 20.5 |  | 0.4 | 0.4 mistral/zdr | 0.1838 mistral/zdr |  | 1 | 237746482 |
| 110 | `openai/gpt-4.1-mini` | 20.2 |  | 0.4 | 0.4 azure | 0.2386 azure |  | 2 | 4293262180 |
| 111 | `mistralai/mistral-large-2512` | 20.1 |  | 0.5 | 0.5 mistral/zdr | 0.2573 mistral/eu |  | 1 | 339999090 |
| 112 | `qwen/qwen3-next-80b-a3b-thinking` | 17.4 |  |  | 0.15 alibaba | 0.1494 nebius/fp8 |  | 3 | 3394687 |
| 113 | `openai/o3-mini-high` | 16.3 |  | 1.1 | 1.1 openai | 1.0833 openai |  | 1 | 644912 |
| 114 | `meta-llama/llama-4-maverick` | 16.3 |  |  | 0.1875 digitalocean | 0.1872 digitalocean |  | 5 | 1166480972 |
| 115 | `upstage/solar-pro-3` | 16.2 |  | 0.15 | 0.15 upstage | 0.0758 upstage |  | 1 | 1838784 |
| 116 | `openai/gpt-5-mini` | 15.6 |  | 0.25 | 0.125 openai/flex | 0.0405 openai/flex |  | 2 | 2841429611 |
| 117 | `qwen/qwen3-32b` | 15.3 |  |  | 0.08 deepinfra/fp8 | 0.0795 deepinfra/fp8 |  | 5 | 1151022867 |
| 118 | `nvidia/nemotron-3-nano-30b-a3b` | 14.4 |  |  | 0.05 crusoe/fp8 | 0.0295 nebius/fp8 |  | 4 | 795814817 |
| 119 | `mistralai/ministral-14b-2512` | 14.4 |  | 0.2 | 0.2 mistral | 0.1432 mistral/zdr |  | 1 | 295705464 |
| 120 | `qwen/qwen3-14b` | 13.8 |  |  | 0.1 nextbit/int4 | 0.0994 nextbit/int4 |  | 3 | 100754729 |
| 121 | `openai/gpt-4` | 13.1 |  | 30.0 | 30.0 azure | 30.0 openai |  | 2 | 1690668 |
| 122 | `qwen/qwen3-30b-a3b-thinking-2507` | 12.1 |  |  | 0.2 alibaba | 0.1998 alibaba |  | 1 | 11499683 |
| 123 | `meta-llama/llama-3.3-70b-instruct` | 11.9 |  |  | 0.1 deepinfra/turbo | 0.0997 deepinfra/turbo |  | 12 | 1923672456 |
| 124 | `openai/gpt-4o-mini` | 11.4 |  | 0.15 | 0.15 azure | 0.1112 azure |  | 2 | 7411041954 |
| 125 | `openai/gpt-4.1-nano` | 11.1 |  | 0.1 | 0.1 azure | 0.0628 azure/swedencentral |  | 2 | 5749479513 |
| 126 | `openai/gpt-3.5-turbo` | 10.7 |  | 0.5 | 0.5 openai | 0.4998 openai |  | 1 | 34881223 |
| 127 | `google/gemma-3-27b-it` | 10.1 |  |  | 0.08 deepinfra/fp8 | 0.0623 parasail/fp8 |  | 6 | 1451898665 |
| 128 | `mistralai/ministral-8b-2512` | 9.7 |  | 0.15 | 0.15 mistral | 0.1121 mistral/zdr |  | 1 | 330838810 |
| 129 | `ibm-granite/granite-4.1-8b` | 9.5 |  |  | 0.05 coreweave/bf16 | 0.0496 coreweave/bf16 |  | 1 | 27943282 |
| 130 | `qwen/qwen3-8b` | 9.0 |  |  | 0.117 alibaba | 0.1168 alibaba |  | 1 | 227891339 |
| 131 | `meta-llama/llama-4-scout` | 8.2 |  |  | 0.08 deepinfra/fp8/flex | 0.0797 deepinfra/fp8/flex |  | 4 | 553541000 |
| 132 | `liquid/lfm-2.5-2.6b` | 7.7 |  | 0.35 | 0.35 liquid/fp8 | 0.3496 liquid/fp8 |  | 1 | 112082 |
| 133 | `google/gemma-3-12b-it` | 5.8 |  |  | 0.04 deepinfra/bf16/flex | 0.0394 deepinfra/bf16/flex |  | 2 | 348865025 |
| 134 | `meta-llama/llama-3.1-8b-instruct` | 5.4 |  |  | 0.02 deepinfra/fp8 | 0.0194 novita/fp8 |  | 5 | 1886655330 |
| 135 | `mistralai/ministral-3b-2512` | 4.8 |  | 0.1 | 0.1 mistral/zdr | 0.0601 mistral/zdr |  | 1 | 303045039 |
| 136 | `google/gemma-3n-e4b-it` | 3.2 |  |  | 0.06 together | 0.0588 together |  | 1 | 609587514 |
| 137 | `google/gemma-3-4b-it` | 2.7 |  |  | 0.04 parasail/bf16 | 0.0366 parasail/bf16 |  | 2 | 227868747 |