# design-svg benchmark

| \# | model | design-svg | $/task | card | cheapest list | cheapest effective | unit | providers | tokens/week |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| 1 | `google/gemini-4-argon` | 1330.0 |  |  | 1.0 google-ai-studio/flex | 0.4977 google-ai-studio/flex |  | 2 | 33357280151 |
| 2 | `moonshotai/kimi-k3.1-pro` | 1326.0 |  | 2.0 | 0.304 relace/fp4 | 0.2079 relace/fp4 |  | 17 | 127045171781 |
| 3 | `anthropic/claude-opus-5.5` | 1322.0 |  | 4.0 | 4.0 azure/global | 0.3991 google-vertex/europe |  | 5 | 265225848809 |
| 4 | `meta/muse-spark-1.3` | 1321.0 |  | 1.25 | 1.25 google-vertex/global | 0.3469 meta |  | 2 | 3333839173 |
| 5 | `anthropic/claude-opus-5` | 1308.0 |  | 5.0 | 5.0 azure/global | 1.1673 anthropic |  | 5 | 9999518143 |
| 6 | `xiaomi/mimo-v2.6-pro` | 1305.0 |  | 0.435 | 0.3262 gmicloud/bf16 | 0.0284 gmicloud/bf16 |  | 5 | 33262750560 |
| 7 | `anthropic/claude-sonnet-5.5` | 1303.0 |  | 2.0 | 2.0 amazon-bedrock | 0.3958 google-vertex/us |  | 5 | 90350909445 |
| 8 | `moonshotai/kimi-k3` | 1303.0 |  | 3.0 | 0.153 wafer/fast | 0.1521 wafer/fast |  | 22 | 59504210550 |
| 9 | `anthropic/claude-fable-5` | 1298.0 |  | 10.0 | 10.0 azure | 3.27 anthropic |  | 5 | 1799948098 |
| 10 | `anthropic/claude-fable-5.1` | 1296.0 |  | 10.0 | 10.0 amazon-bedrock | 2.1435 anthropic |  | 4 | 7573541962 |
| 11 | `google/gemini-3.8-flash` | 1292.0 |  |  | 0.375 google-vertex/global/flex | 0.1745 google-ai-studio/flex |  | 2 | 66105151093 |
| 12 | `google/gemini-3.7-flash` | 1283.0 |  |  | 0.375 google-vertex/global/flex | 0.1294 google-ai-studio/flex |  | 2 | 16485676436 |
| 13 | `google/gemini-3.1-pro-preview` | 1281.0 |  |  | 1.0 google-ai-studio/flex | 0.6497 google-ai-studio/flex |  | 2 | 4366256457 |
| 14 | `meta/muse-spark-1.2` | 1277.0 |  | 1.25 | 1.25 meta | 0.7251 meta |  | 1 | 82335175 |
| 15 | `z-ai/glm-5.3-flash` | 1275.0 |  | 0.15 | 0.0399 relace/fp4 | 0.0204 primeintellect |  | 40 | 806116523144 |
| 16 | `z-ai/glm-5.3` | 1258.0 |  | 1.4 | 0.0699 wafer/us | 0.069 wafer/us |  | 39 | 244459012685 |
| 17 | `deepseek/deepseek-v4.1-flash-1017` | 1254.0 |  | 0.3 | 0.006 relace/fp4 | 0.0045 deepinfra/fp8/flex |  | 41 | 2701423607321 |
| 18 | `google/gemini-3.5-flash` | 1251.0 |  |  | 0.75 google-ai-studio/flex | 0.2479 google-ai-studio/flex |  | 2 | 1763021737 |
| 19 | `openai/gpt-5.5` | 1232.0 |  | 5.0 | 2.5 openai/flex | 0.9605 openai/flex |  | 3 | 2430328494 |
| 20 | `mistralai/mistral-large-4-0` | 1231.0 |  | 0.77 | 0.7 mistral/zdr | 0.1569 mistral/zdr |  | 1 | 2259958861 |
| 21 | `x-ai/grok-4.6` | 1231.0 |  | 2.0 | 2.0 xai/zdr | 0.7725 amazon-bedrock/us-west-2 |  | 2 | 2750565342 |
| 22 | `meta/muse-spark-1.1` | 1230.0 |  | 1.25 | 1.25 meta | 0.7307 meta |  | 1 | 132134718 |
| 23 | `anthropic/claude-opus-4.6` | 1224.0 |  | 5.0 | 5.0 google-vertex/global | 1.5218 anthropic |  | 5 | 4491236099 |
| 24 | `z-ai/glm-5.1` | 1214.0 |  | 1.4 | 0.9 chutes/fp8 | 0.3379 chutes/fp8 |  | 18 | 1682206009 |
| 25 | `qwen/qwen3.7-max` | 1213.0 |  |  | 1.475 alibaba | 0.6225 alibaba |  | 1 | 229410698 |
| 26 | `qwen/qwen3.7-plus` | 1209.0 |  |  | 0.32 alibaba | 0.1732 alibaba |  | 1 | 2491495658 |
| 27 | `x-ai/grok-4.5` | 1206.0 |  | 2.0 | 2.0 xai | 0.8273 xai/zdr |  | 1 | 2130481258 |
| 28 | `z-ai/glm-5.2` | 1206.0 |  | 1.4 | 0.0066 relace/fp4 | 0.0062 wafer/us |  | 34 | 67682870933 |
| 29 | `z-ai/glm-5-turbo` | 1201.0 |  | 1.2 | 1.2 z-ai | 0.4609 z-ai |  | 1 | 76079758 |
| 30 | `anthropic/claude-haiku-5.5` | 1.2e3 |  | 0.1 | 0.1 anthropic | 0.0425 azure/global |  | 5 | 139788290103 |
| 31 | `nex-agi/nex-n2-pro` | 1193.0 |  | 0.25 | 0.25 nex-agi/fp8 | 0.0398 nex-agi/fp8 |  | 2 | 42940716 |
| 32 | `anthropic/claude-sonnet-4.6` | 1193.0 |  | 3.0 | 3.0 google-vertex/global | 1.072 amazon-bedrock/global |  | 5 | 9270256352 |
| 33 | `anthropic/claude-sonnet-5` | 1192.0 |  | 2.0 | 2.0 amazon-bedrock/global | 0.3115 google-vertex/us |  | 5 | 19785018514 |
| 34 | `openai/gpt-5.4` | 1191.0 |  | 2.5 | 1.25 openai/flex | 0.9545 openai |  | 3 | 1559911228 |
| 35 | `anthropic/claude-opus-4.8` | 1190.0 |  | 5.0 | 5.0 azure/global | 1.1933 amazon-bedrock |  | 5 | 7736756673 |
| 36 | `xiaomi/mimo-v2.5-pro` | 1189.0 |  | 0.435 | 0.3045 gmicloud/bf16 | 0.0612 xiaomi/fp8 |  | 7 | 17728731871 |
| 37 | `openai/gpt-5` | 1185.0 |  | 1.25 | 1.25 azure | 0.7591 openai/default |  | 2 | 311907360 |
| 38 | `xiaomi/mimo-v2.5` | 1181.0 |  | 0.14 | 0.119 gmicloud/fp8 | 0.0126 xiaomi/fp8 |  | 7 | 490191247748 |
| 39 | `deepseek/deepseek-v4-flash-0731` | 1180.0 |  | 0.44 | 0.03 open-inference/fp4 | 0.0139 streamlake/fp8 |  | 37 | 314513489706 |
| 40 | `moonshotai/kimi-k2.6` | 1178.0 |  | 0.95 | 0.39 chutes/int4 | 0.2277 chutes/int4 |  | 22 | 4176548547 |
| 41 | `anthropic/claude-opus-4.5` | 1177.0 |  | 5.0 | 5.0 anthropic/2 | 3.6279 anthropic |  | 5 | 219516097 |
| 42 | `moonshotai/kimi-k2.7-code` | 1172.0 |  | 0.95 | 0.6 coreweave/int4 | 0.2388 coreweave/int4 |  | 18 | 1525673246 |
| 43 | `z-ai/glm-5` | 1165.0 |  | 1.0 | 0.6 streamlake/fp8 | 0.2836 z-ai/fp8 |  | 11 | 1644894669 |
| 44 | `x-ai/grok-4.20` | 1161.0 |  | 1.25 | 1.25 xai/zdr | 0.5985 xai |  | 1 | 1178763615 |
| 45 | `qwen/qwen3.6-plus` | 1158.0 |  |  | 0.325 alibaba | 0.3084 alibaba |  | 1 | 213958299 |
| 46 | `minimax/minimax-m3` | 1156.0 |  | 0.3 | 0.224 deepinfra/fp8/flex | 0.0623 gmicloud/fp8 |  | 14 | 42355642611 |
| 47 | `deepseek/deepseek-v4-flash` | 1152.0 |  | 0.22 | 0.05 relace/fp4 | 0.0203 open-inference/fp8 |  | 24 | 264245760211 |
| 48 | `anthropic/claude-opus-4.1` | 1149.0 |  |  | 15.0 amazon-bedrock | 8.2155 google-vertex/global |  | 2 | 23640724 |
| 49 | `z-ai/glm-5v-turbo` | 1147.0 |  | 1.2 | 1.2 z-ai/fp8 | 0.3663 z-ai/fp8 |  | 1 | 59526296 |
| 50 | `minimax/minimax-m2.5` | 1146.0 |  | 0.3 | 0.22 inceptron/fp8 | 0.0452 siliconflow/fp8 |  | 11 | 2024556517 |
| 51 | `moonshotai/kimi-k2.5` | 1146.0 |  | 0.6 | 0.45 deepinfra/fp4 | 0.1505 moonshotai/int4 |  | 10 | 1480447887 |
| 52 | `openai/gpt-5.1` | 1146.0 |  | 1.25 | 0.625 openai/flex | 0.2471 openai/flex |  | 2 | 999470698 |
| 53 | `z-ai/glm-4.7` | 1139.0 |  | 0.6 | 0.32 deepinfra/fp4/flex | 0.2166 deepinfra/fp4/flex |  | 9 | 1793109277 |
| 54 | `deepseek/deepseek-v4-pro` | 1136.0 |  | 0.66 | 0.66 deepseek | 0.1881 streamlake/fp8 |  | 21 | 58724115254 |
| 55 | `qwen/qwen3.5-397b-a17b` | 1136.0 |  |  | 0.39 alibaba | 0.3199 deepinfra/fp8 |  | 11 | 511195664 |
| 56 | `openai/gpt-5.2` | 1135.0 |  | 1.75 | 0.875 openai/flex | 0.6736 openai/flex |  | 2 | 1003013452 |
| 57 | `minimax/minimax-m2.7` | 1132.0 |  | 0.3 | 0.21 gmicloud/fp8 | 0.0903 deepinfra/fp8 |  | 9 | 4062222361 |
| 58 | `minimax/minimax-m2.1` | 1128.0 |  | 0.3 | 0.3 minimax/fp8 | 0.0952 minimax/fp8 |  | 2 | 300923844 |
| 59 | `openai/gpt-5.3-codex` | 1126.0 |  | 1.75 | 1.75 azure | 0.3165 azure |  | 2 | 457071536 |
| 60 | `anthropic/claude-opus-4` | 1124.0 |  |  | 15.0 google-vertex | 10.5411 google-vertex |  | 1 | 151107033 |
| 61 | `anthropic/claude-sonnet-4.5` | 1111.0 |  | 3.0 | 3.0 google-vertex/global | 0.6022 google-vertex/us-east5 |  | 5 | 2446063053 |
| 62 | `thinkingmachines/inkling` | 1109.0 |  |  | 0.95 deepinfra/fp8 | 0.6663 together |  | 3 | 4073704634 |
| 63 | `z-ai/glm-4.6` | 1105.0 |  | 0.6 | 0.4 deepinfra/fp4/flex | 0.163 venice/fp4 |  | 5 | 854974071 |
| 64 | `qwen/qwen3.5-plus-02-15` | 1104.0 |  |  | 0.26 alibaba | 0.2599 alibaba |  | 1 | 68974786 |
| 65 | `minimax/minimax-m2` | 1096.0 |  | 0.255 | 0.255 minimax/fp8 | 0.255 minimax/fp8 |  | 3 | 60934517 |
| 66 | `z-ai/glm-4.5` | 1093.0 |  | 0.6 | 0.6 z-ai/fp8 | 0.3429 z-ai/fp8 |  | 1 | 39541130 |
| 67 | `openai/gpt-5-mini` | 1088.0 |  | 0.25 | 0.125 openai/flex | 0.0405 openai/flex |  | 2 | 2841429611 |
| 68 | `stepfun/step-3.7-flash` | 1081.0 |  | 0.2 | 0.16 deepinfra | 0.0456 deepinfra |  | 3 | 750713750 |
| 69 | `x-ai/grok-4.3` | 1078.0 |  | 1.25 | 1.25 xai | 0.851 xai |  | 1 | 1701166249 |
| 70 | `anthropic/claude-sonnet-4` | 1075.0 |  |  | 3.0 amazon-bedrock | 1.4411 google-vertex/global |  | 2 | 1266922610 |
| 71 | `z-ai/glm-4.5-air` | 1068.0 |  | 0.2 | 0.13 novita/bf16 | 0.0762 novita/bf16 |  | 3 | 106946576 |
| 72 | `nvidia/nemotron-3-ultra-550b-a55b` | 1066.0 |  |  | 0.4 deepinfra/fp4/flex | 0.1215 deepinfra/fp4/flex |  | 5 | 3907102956 |
| 73 | `deepseek/deepseek-v3.1-terminus` | 1061.0 |  |  | 0.27 deepinfra/fp4 | 0.2037 atlas-cloud/fp8 |  | 5 | 823280489 |
| 74 | `google/gemini-3.1-flash-lite-preview` | 1049.0 |  |  | 0.125 google-ai-studio/flex | 0.1205 google-ai-studio/flex |  | 1 | 3003730468 |
| 75 | `deepseek/deepseek-r1-0528` | 1035.0 |  |  | 0.5 deepinfra/fp4 | 0.4381 deepinfra/fp4 |  | 4 | 426276956 |
| 76 | `z-ai/glm-4.7-flash` | 1034.0 |  |  | 0.06 deepinfra/bf16 | 0.0279 deepinfra/bf16 |  | 4 | 503434086 |
| 77 | `deepseek/deepseek-v3.2` | 1029.0 |  |  | 0.2088 gmicloud/fp8 | 0.0926 gmicloud/fp8 |  | 15 | 29736505094 |
| 78 | `deepseek/deepseek-v3.2-exp` | 1028.0 |  |  | 0.27 atlas-cloud/fp8 | 0.2699 atlas-cloud/fp8 |  | 3 | 1057454921 |
| 79 | `anthropic/claude-haiku-4.5` | 1022.0 |  | 1.0 | 1.0 azure/global | 0.2325 amazon-bedrock/eu-west-1 |  | 4 | 5580791996 |
| 80 | `google/gemini-2.5-flash` | 1016.0 |  |  | 0.15 google-ai-studio/flex | 0.0958 google-ai-studio/flex |  | 2 | 39453554708 |
| 81 | `arcee-ai/trinity-large-thinking` | 1013.0 |  | 0.25 | 0.22 parasail/fp4 | 0.0515 arcee-ai |  | 2 | 121188704 |
| 82 | `qwen/qwen3-max` | 1008.0 |  |  | 0.78 alibaba | 0.6362 alibaba |  | 1 | 45391519 |
| 83 | `inception/mercury-2` | 1002.0 |  | 0.25 | 0.25 inception | 0.1713 inception |  | 1 | 146887169 |
| 84 | `mistralai/mistral-large-2512` | 989.0 |  | 0.5 | 0.5 mistral/zdr | 0.2573 mistral/eu |  | 1 | 339999090 |
| 85 | `mistralai/mistral-medium-3.1` | 989.0 |  | 0.4 | 0.4 mistral/zdr | 0.1838 mistral/zdr |  | 1 | 237746482 |
| 86 | `openai/gpt-5.1-codex-mini` | 974.0 |  |  | 0.25 azure | 0.0719 azure |  | 1 | 13960657 |
| 87 | `deepseek/deepseek-chat` | 973.0 |  |  | 0.256 deepinfra/fp4/flex | 0.2538 deepinfra/fp4/flex |  | 3 | 795313498 |
| 88 | `deepseek/deepseek-chat-v3.1` | 963.0 |  |  | 0.25 deepinfra/fp4 | 0.1968 deepinfra/fp4 |  | 8 | 3439868728 |