Measured performance
Provider & model performance
Measured time-to-first-token, time-to-first-byte, effective throughput, and uptime for every LLM provider and model TrustedRouter routes to — continuously sampled, not vendor-claimed.
Last updated
2026-08-07T00:48:18.187Z
Continuously sampled from TrustedRouter's monitor regions using a
rolling benchmark set of up to 10,000 samples. Time-to-first-token (TTFT),
time-to-first-byte (TTFB), effective throughput, and success rate come from real
streaming requests, not vendor claims. Completion rate shows the end-user result.
Provider availability excludes failures owned by TrustedRouter, customers, or route
configuration, while still reporting those failures under their actual owner.
Capacity acceptance measures requests not rejected for provider overload. Effective throughput is provider-reported
output tokens divided by complete request time, so buffered delivery cannot inflate
the result. Unsupported route and probe-configuration rows are reported separately
and do not count as provider downtime. No prompt or output content is ever stored.
Providers
Ranked by provider-attributed availability, then p50 time-to-first-token across all of a provider's models (43 providers · 2612 availability samples · 234 sustained throughput samples). Providers below the evidence floor remain visible as warming, but do not receive a rank.
| # | Provider | Models | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | Effective throughput | Failure owner | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | deepseek | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 1217 ms | 3702 ms | 115 tok/s | — | — | 228 |
| 2 | friendli | 6 | 100.00% | 100.00% | 98.28% | 100.00% | 1340 ms | 7591 ms | 95 tok/s | — | — | 58 |
| 3 | google-vertex | 9 | 100.00% | 100.00% | 100.00% | 100.00% | 1384 ms | 4850 ms | 58 tok/s | — | — | 54 |
| 4 | cloudflare-workers-ai | 14 | 100.00% | 100.00% | 100.00% | 100.00% | 1407 ms | 4344 ms | 25 tok/s | — | 2 probe_config_error |
31 |
| 5 | grok | 4 | 100.00% | 100.00% | 100.00% | 100.00% | 1454 ms | 3252 ms | 49 tok/s | — | — | 53 |
| 6 | baseten | 12 | 100.00% | 100.00% | 100.00% | 100.00% | 1573 ms | 4034 ms | 83 tok/s | — | — | 61 |
| 7 | mistral | 8 | 100.00% | 100.00% | 98.08% | 100.00% | 1607 ms | 3383 ms | — | — | — | 52 |
| 8 | nebius | 21 | 100.00% | 100.00% | 100.00% | 100.00% | 1720 ms | 5211 ms | 86 tok/s | — | 1 unsupported_route |
46 |
| 9 | kimi | 11 | 100.00% | 100.00% | 100.00% | 100.00% | 1743 ms | 4178 ms | 34 tok/s | — | — | 66 |
| 10 | minimax | 6 | 100.00% | 100.00% | 100.00% | 100.00% | 1753 ms | 3834 ms | 69 tok/s | — | — | 52 |
| 11 | google-ai-studio | 8 | 100.00% | 100.00% | 100.00% | 100.00% | 1784 ms | 4597 ms | 72 tok/s | — | — | 57 |
| 12 | telnyx | 10 | 100.00% | 100.00% | 100.00% | 100.00% | 1797 ms | 3820 ms | 67 tok/s | — | — | 40 |
| 13 | crusoe | 14 | 100.00% | 100.00% | 100.00% | 100.00% | 1815 ms | 5359 ms | 35 tok/s | — | — | 62 |
| 14 | engy | 2 | 100.00% | 100.00% | 100.00% | 100.00% | 1853 ms | 3749 ms | 36 tok/s | — | — | 62 |
| 15 | venice | 12 | 100.00% | 100.00% | 100.00% | 100.00% | 1961 ms | 3770 ms | 55 tok/s | — | — | 61 |
| 16 | wafer | 5 | 100.00% | 100.00% | 100.00% | 100.00% | 2128 ms | 11069 ms | 76 tok/s | — | — | 57 |
| 17 | anthropic | 10 | 100.00% | 100.00% | 100.00% | 100.00% | 2239 ms | 5198 ms | 58 tok/s | — | — | 51 |
| 18 | lightning | 12 | 100.00% | 100.00% | 100.00% | 100.00% | 2249 ms | 6388 ms | 50 tok/s | — | — | 57 |
| 19 | inceptron | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 2330 ms | 7975 ms | — | — | — | 35 |
| 20 | zai | 11 | 100.00% | 100.00% | 98.11% | 100.00% | 2722 ms | 14580 ms | 50 tok/s | — | — | 58 |
| 21 | streamlake | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 2733 ms | 4298 ms | 129 tok/s | — | — | 61 |
| 22 | zero-g | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 2946 ms | 4627 ms | 50 tok/s | — | — | 47 |
| 23 | openai | 20 | 100.00% | 100.00% | 100.00% | 100.00% | 3517 ms | 4289 ms | 51 tok/s | — | — | 221 |
| 24 | fireworks | 11 | 98.55% | 98.55% | 97.10% | 100.00% | 2336 ms | 7775 ms | 48 tok/s | provider 1 |
— | 69 |
| 25 | morph | 8 | 98.39% | 98.39% | 95.16% | 100.00% | 2836 ms | 14958 ms | 65 tok/s | provider 1 |
— | 62 |
| 26 | gmi | 5 | 98.15% | 98.15% | 98.15% | 100.00% | 3449 ms | 6198 ms | 34 tok/s | provider 1 |
— | 54 |
| 27 | deepinfra | 37 | 98.11% | 98.11% | 98.08% | 100.00% | 1511 ms | 10757 ms | 38 tok/s | provider 1 |
— | 53 |
| 28 | xiaomi | 3 | 98.11% | 98.11% | 98.11% | 98.11% | 2614 ms | 6016 ms | 93 tok/s | provider 1 |
— | 53 |
| 29 | atlas-cloud | 46 | 98.08% | 98.08% | 98.00% | 100.00% | 2201 ms | 10213 ms | 54 tok/s | provider 1 |
— | 52 |
| 30 | tinfoil | 4 | 97.83% | 97.83% | 97.83% | 100.00% | 1654 ms | 17042 ms | 31 tok/s | provider 1 |
— | 46 |
| 31 | alibaba | 35 | 97.62% | 97.62% | 97.62% | 100.00% | 1959 ms | 3263 ms | 40 tok/s | provider 1 |
— | 42 |
| 32 | phala | 2 | 96.36% | 96.36% | 92.73% | 100.00% | 4046 ms | 16041 ms | 16 tok/s | provider 2 |
— | 55 |
| 33 | siliconflow | 23 | 96.23% | 96.23% | 96.23% | 98.11% | 2229 ms | 8775 ms | 32 tok/s | provider 2 |
— | 53 |
| 34 | thinkingmachines | 2 | 96.23% | 96.23% | 96.23% | 100.00% | 2373 ms | 5270 ms | 76 tok/s | provider 2 |
— | 53 |
| 35 | digitalocean | 21 | 95.38% | 95.38% | 95.38% | 95.38% | 1682 ms | 5103 ms | 39 tok/s | provider 3 |
— | 65 |
| 36 | together | 16 | 94.59% | 94.59% | 94.59% | 100.00% | 1391 ms | 5161 ms | 44 tok/s | provider 2 |
15 probe_config_error |
37 |
| 37 | neurometric | 6 | 94.12% | 94.12% | 94.12% | 100.00% | 1354 ms | 3174 ms | — | provider 3 |
6 unsupported_route |
51 |
| 38 | parasail | 24 | 94.12% | 94.12% | 91.57% | 95.10% | 2688 ms | 8054 ms | 65 tok/s | provider 6 |
2 probe_config_error |
102 |
| 39 | novita | 43 | 91.11% | 91.11% | 91.11% | 95.56% | 1967 ms | 4327 ms | 41 tok/s | provider 4 |
— | 45 |
| 40 | cerebras | 6 | 90.32% | 90.32% | 89.66% | 91.94% | 1045 ms | 6456 ms | 208 tok/s | provider 6 |
4 provider_error |
62 |
| 41 | chutes | 10 | 90.00% | 90.00% | 90.00% | 91.67% | 2316 ms | 10685 ms | 27 tok/s | provider 6 |
— | 60 |
| — | makora warming | 4 | 100.00% | 100.00% | 100.00% | 100.00% | 1300 ms | 3720 ms | 106 tok/s | — | 14 probe_config_error |
27 |
| — | kling warming | 1 | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | 1 |
Models
Qualified models are ranked by provider-attributed availability, then p50 TTFT. Thin availability and throughput measurements stay visible below the ranked set as warming.
| # | Model | Provider | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | p50 TTFB | p95 TTFB | Effective throughput | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | minimax/minimax-m2.5 | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 861 ms | 3148 ms | 860 ms | 3148 ms | — | — | 14 |
| 2 | z-ai/glm-5.1 | wafer | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1198 ms | 2737 ms | 1198 ms | 2737 ms | — | — | 11 |
| 3 | deepseek/deepseek-v4-flash-0731 | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1217 ms | 3770 ms | 1830 ms | 3394 ms | 136 tok/s warming | — | 184 |
| 4 | z-ai/glm-5.2 | wafer | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1218 ms | 8411 ms | 1218 ms | 8411 ms | — | — | 12 |
| 5 | ibm-granite/granite-4.1-8b | neurometric | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1267 ms | 3170 ms | 1267 ms | 3169 ms | — | — | 15 |
| 6 | x-ai/grok-build-0.1 | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1275 ms | 2766 ms | 1275 ms | 2766 ms | — | — | 16 |
| 7 | z-ai/glm-5.1 | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1340 ms | 4190 ms | 1340 ms | 4190 ms | — | — | 10 |
| 8 | qwen/qwen3-vl-8b-thinking | neurometric | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1354 ms | 3992 ms | 1353 ms | 3991 ms | — | — | 14 |
| 9 | qwen/qwen-2.5-7b-instruct | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1391 ms | 3766 ms | 1391 ms | 3766 ms | — | — | 10 |
| 10 | x-ai/grok-4.20 | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1454 ms | 3002 ms | 1453 ms | 3002 ms | — | — | 11 |
| 11 | deepseek/deepseek-v4-flash | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1524 ms | 3802 ms | 1523 ms | 3802 ms | 115 tok/s warming | — | 21 |
| 12 | x-ai/grok-4.5 | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1616 ms | 3252 ms | 1616 ms | 3252 ms | 49 tok/s warming | — | 14 |
| 13 | moonshotai/kimi-k2.7-code | inceptron | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1635 ms | 3112 ms | 1635 ms | 3112 ms | — | — | 10 |
| 14 | openai/gpt-oss-120b | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1654 ms | 5292 ms | 1653 ms | 5292 ms | 52 tok/s warming | — | 14 |
| 15 | z-ai/glm-5.2 | engy | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1721 ms | 3411 ms | 1720 ms | 3411 ms | 36 tok/s warming | — | 26 |
| 16 | minimax/minimax-m2.7-highspeed | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1753 ms | 3648 ms | 1752 ms | 3648 ms | — | — | 10 |
| 17 | minimax/minimax-m3 | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1753 ms | 4383 ms | 1753 ms | 4383 ms | 69 tok/s warming | — | 13 |
| 18 | z-ai/glm-4.7 | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1835 ms | 3260 ms | 1835 ms | 3260 ms | — | — | 13 |
| 19 | deepseek/deepseek-v4-pro | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1839 ms | 3255 ms | 1839 ms | 3255 ms | 90 tok/s warming | — | 23 |
| 20 | qwen/qwen3.6-35b-a3b | engy | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1853 ms | 3910 ms | 1853 ms | 3909 ms | — | — | 36 |
| 21 | z-ai/glm-5.2 | makora | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1862 ms | 3720 ms | 1862 ms | 3720 ms | — | — | 11 |
| 22 | deepseek/deepseek-v4-pro | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1867 ms | 2994 ms | 1867 ms | 2994 ms | 36 tok/s warming | — | 11 |
| 23 | moonshotai/moonshot-v1-32k | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1940 ms | 3067 ms | 1940 ms | 3067 ms | — | — | 11 |
| 24 | kwaipilot/kat-coder-pro-v2 | streamlake | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1983 ms | 3471 ms | 1983 ms | 3470 ms | — | — | 15 |
| 25 | minimax/minimax-m2.1-highspeed | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2106 ms | 3552 ms | 2106 ms | 3552 ms | — | — | 11 |
| 26 | moonshotai/kimi-k2.6 | wafer | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2128 ms | 11069 ms | 2128 ms | 11069 ms | 34 tok/s warming | — | 11 |
| 27 | qwen/qwen3-235b-a22b-thinking-2507 | chutes | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2181 ms | 4093 ms | 2181 ms | 4093 ms | — | — | 10 |
| 28 | cerebras/gpt-oss-120b | cerebras | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2210 ms | 6456 ms | 1426 ms | 6456 ms | 431 tok/s warming | — | 11 |
| 29 | z-ai/glm-5.1 | gmi | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2239 ms | 4021 ms | 2238 ms | 4021 ms | — | — | 10 |
| 30 | z-ai/glm-5.2 | phala | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2244 ms | 4392 ms | 2244 ms | 4392 ms | 32 tok/s warming | — | 21 |
| 31 | moonshotai/kimi-k2.6 | inceptron | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2330 ms | 11343 ms | 2330 ms | 11343 ms | — | — | 15 |
| 32 | thinkingmachines/inkling-small | thinkingmachines | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2373 ms | 4300 ms | 2373 ms | 4300 ms | 104 tok/s warming | — | 30 |
| 33 | zero-g/0gm-1.0-35b-a3b | zero-g | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2430 ms | 4457 ms | 2430 ms | 4457 ms | — | — | 13 |
| 34 | x-ai/grok-4.3 | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2581 ms | 4317 ms | 2581 ms | 4316 ms | — | — | 12 |
| 35 | xiaomi/mimo-v2.5 | xiaomi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2614 ms | 10042 ms | 2613 ms | 10042 ms | — | — | 19 |
| 36 | kwaipilot/kat-coder-pro-v2.5 | streamlake | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2733 ms | 4082 ms | 2733 ms | 4082 ms | — | — | 21 |
| 37 | z-ai/glm-5.2 | morph | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2836 ms | 4318 ms | 2835 ms | 4318 ms | 28 tok/s warming | — | 11 |
| 38 | google/gemma-4-31b-it | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2875 ms | 7101 ms | 2875 ms | 7101 ms | 31 tok/s warming | — | 14 |
| 39 | z-ai/glm-5.2 | zero-g | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2946 ms | 5285 ms | 2946 ms | 5285 ms | 50 tok/s warming | — | 21 |
| 40 | kwaipilot/kat-coder-air-v2.5 | streamlake | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2952 ms | 5139 ms | 2952 ms | 5139 ms | 129 tok/s warming | — | 25 |
| 41 | xiaomi/mimo-v2.5-pro | xiaomi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3122 ms | 4611 ms | 3122 ms | 4611 ms | 58 tok/s warming | — | 17 |
| 42 | google/gemma-4-31b-it | friendli | 100.00% | 100.00% | 91.67% 20s | 100.00% | 3145 ms | 20976 ms | 3145 ms | 20976 ms | 95 tok/s warming | — | 12 |
| 43 | z-ai/glm-5.2-fast | wafer | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3263 ms | 11483 ms | 3262 ms | 11483 ms | 226 tok/s warming | — | 12 |
| 44 | minimax/minimax-m3 | wafer | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3386 ms | 13116 ms | 3386 ms | 13115 ms | 117 tok/s warming | — | 11 |
| 45 | deepseek/deepseek-v4-pro | gmi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3449 ms | 6117 ms | 3449 ms | 6117 ms | 34 tok/s warming | — | 17 |
| 46 | zero-g/0gm-1.0-35b-a3b-sia | zero-g | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3466 ms | 4418 ms | 3466 ms | 4418 ms | — | — | 13 |
| 47 | z-ai/glm-5.2 | gmi | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3469 ms | 4535 ms | 3468 ms | 4535 ms | 37 tok/s warming | — | 12 |
| 48 | openai/gpt-5-nano | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3517 ms | 4289 ms | 3517 ms | 4289 ms | — | — | 159 |
| 49 | qwen/qwen3.6-27b | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4004 ms | 14958 ms | 4004 ms | 14958 ms | — | — | 10 |
| 50 | google/gemini-2.5-pro | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4229 ms | 6787 ms | 4229 ms | 6787 ms | — | — | 11 |
| 51 | z-ai/glm-5.2 | inceptron | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4519 ms | 7975 ms | 4519 ms | 7974 ms | — | — | 10 |
| 52 | z-ai/glm-5.2 | parasail | 97.50% | 97.50% | 95.24% 45s | 100.00% | 3597 ms | 7445 ms | 1327 ms | 1601 ms | 29 tok/s warming | — | 40 |
| 53 | xiaomi/mimo-v2.5-pro-ultraspeed | xiaomi | 94.12% | 94.12% | 94.12% 20s | 94.12% | 2489 ms | 5787 ms | 2489 ms | 5787 ms | 93 tok/s warming | — | 17 |
| 54 | moonshotai/kimi-k3 | phala | 94.12% | 94.12% | 88.24% 20s | 100.00% | 4046 ms | 24017 ms | 4046 ms | 24017 ms | 16 tok/s warming | — | 34 |
| 55 | qwen/qwen3.5-397b-a17b | morph | 91.67% | 91.67% | 91.67% 20s | 100.00% | 3542 ms | 19289 ms | 3541 ms | 19289 ms | — | — | 12 |
| 56 | thinkingmachines/inkling | thinkingmachines | 91.30% | 91.30% | 91.30% 45s | 100.00% | 2531 ms | 5967 ms | 2531 ms | 5966 ms | 49 tok/s warming | — | 23 |
| 57 | google/gemma-4-31b-it | cerebras | 90.91% | 90.91% | 90.91% 20s | 90.91% | 2226 ms | 10309 ms | 2226 ms | 10309 ms | 27 tok/s warming | — | 11 |
| 58 | moonshotai/kimi-k3 | gmi | 90.91% | 90.91% | 90.91% 20s | 100.00% | 5581 ms | 15425 ms | 5580 ms | 15425 ms | 25 tok/s warming | — | 11 |
| 59 | z-ai/glm-4.7 | cerebras | 85.71% | 85.71% | 85.71% 20s | 85.71% | 890 ms | 5685 ms | 890 ms | 5685 ms | — | — | 14 |
| 60 | cerebras/zai-glm-4.7 | cerebras | 83.33% | 83.33% | 83.33% 15s | 91.67% | 894 ms | 3397 ms | 894 ms | 3397 ms | 38 tok/s warming | 4 provider_error |
12 |
| — | meta-llama/llama-3.3-70b-instruct warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 359 ms | 3627 ms | 358 ms | 3626 ms | — | — | 2 |
| — | qwen/qwen3-14b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 395 ms | 395 ms | 395 ms | 395 ms | — | — | 1 |
| — | qwen/qwen2.5-vl-72b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 537 ms | 4850 ms | 537 ms | 4850 ms | — | — | 2 |
| — | microsoft/phi-4 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 589 ms | 653 ms | 589 ms | 653 ms | — | — | 2 |
| — | meta-llama/llama-4-scout-17b-16e-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 598 ms | 1059 ms | 598 ms | 1059 ms | — | — | 2 |
| — | meta-llama/llama-3.1-8b-instruct-fp8 warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 713 ms | 713 ms | 713 ms | 713 ms | — | — | 1 |
| — | thinkingmachines/inkling-small warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 725 ms | 1153 ms | 725 ms | 1153 ms | 223 tok/s warming | — | 3 |
| — | nvidia/nemotron-3-nano-omni warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 727 ms | 1429 ms | 727 ms | 1428 ms | — | — | 2 |
| — | Qwen/Qwen2.5-VL-72B-Instruct warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 761 ms | 2771 ms | 760 ms | 2771 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 766 ms | 766 ms | 766 ms | 766 ms | 51 tok/s warming | — | 1 |
| — | moonshotai/kimi-k3 warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 768 ms | 3250 ms | 768 ms | 3250 ms | 25 tok/s warming | — | 2 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 813 ms | 2201 ms | 813 ms | 2201 ms | — | — | 2 |
| — | google/gemma-3-27b-it warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 819 ms | 819 ms | 819 ms | 819 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 827 ms | 3435 ms | 827 ms | 3435 ms | 46 tok/s warming | — | 6 |
| — | meta-llama/llama-3.3-70b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 833 ms | 1710 ms | 833 ms | 1710 ms | — | — | 3 |
| — | qwen/qwen3.6-27b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 837 ms | 2866 ms | 836 ms | 2865 ms | — | — | 2 |
| — | google/gemini-3.5-flash-lite warming | google-ai-studio | 100.00% | 100.00% | 100.00% 15s | 100.00% | 850 ms | 2984 ms | 850 ms | 2983 ms | — | — | 9 |
| — | meta-llama/llama-3.1-70b-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 850 ms | 850 ms | 850 ms | 850 ms | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 872 ms | 872 ms | 871 ms | 871 ms | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 892 ms | 2857 ms | 892 ms | 2856 ms | 178 tok/s warming | — | 6 |
| — | openai/gpt-5.6-sol warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 917 ms | 2725 ms | 917 ms | 2725 ms | 73 tok/s warming | — | 2 |
| — | google/gemma-2b-it warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 923 ms | 3148 ms | 922 ms | 3148 ms | — | — | 4 |
| — | google/gemma-3n-e4b-it warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 927 ms | 927 ms | 927 ms | 927 ms | — | — | 1 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | deepinfra | 100.00% | 100.00% | 100.00% 45s | 100.00% | 929 ms | 2772 ms | 929 ms | 2772 ms | — | — | 2 |
| — | google/gemma-4-31b-it warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 949 ms | 1730 ms | 949 ms | 1730 ms | 20 tok/s warming | — | 2 |
| — | google/gemma-4-31b-it warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 952 ms | 7244 ms | 952 ms | 7244 ms | 32 tok/s warming | — | 4 |
| — | openai/gpt-4.1 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 952 ms | 2142 ms | 952 ms | 2142 ms | — | — | 3 |
| — | mistralai/mistral-nemo warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 962 ms | 2634 ms | 962 ms | 2634 ms | — | — | 7 |
| — | deepseek/deepseek-ocr-2 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 966 ms | 966 ms | 966 ms | 966 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 975 ms | 5455 ms | 975 ms | 5455 ms | — | — | 2 |
| — | nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 979 ms | 979 ms | 979 ms | 979 ms | — | — | 1 |
| — | nvidia/nemotron-3-ultra-550b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 981 ms | 981 ms | 980 ms | 980 ms | — | — | 1 |
| — | qwen/qwen3-coder-next warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 982 ms | 982 ms | 982 ms | 982 ms | — | — | 1 |
| — | minimax/minimax-m3 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1022 ms | 1500 ms | 1022 ms | 1500 ms | 22 tok/s warming | — | 3 |
| — | openai/gpt-oss-120b warming | cerebras | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1045 ms | 2629 ms | 1045 ms | 2629 ms | 208 tok/s warming | — | 7 |
| — | openai/gpt-5.6-terra warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1047 ms | 1047 ms | 1046 ms | 1046 ms | 40 tok/s warming | — | 1 |
| — | mistralai/codestral-2508 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1062 ms | 2728 ms | 1062 ms | 2728 ms | — | — | 9 |
| — | x-ai/grok-4.5 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1062 ms | 1062 ms | 1061 ms | 1061 ms | 66 tok/s warming | — | 1 |
| — | moonshotai/kimi-k2-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1070 ms | 1070 ms | 1070 ms | 1070 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | makora | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1077 ms | 3175 ms | 1077 ms | 3174 ms | 106 tok/s warming | 5 probe_config_error |
8 |
| — | moonshotai/kimi-k2.7-code warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1091 ms | 1416 ms | 1091 ms | 1416 ms | 32 tok/s warming | — | 3 |
| — | openai/gpt-oss-120b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1100 ms | 12306 ms | 1100 ms | 12306 ms | 55 tok/s warming | — | 2 |
| — | arcee-ai/trinity-large-thinking warming | parasail | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1138 ms | 1138 ms | 1138 ms | 1138 ms | — | — | 1 |
| — | google/gemini-3.6-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1150 ms | 3648 ms | 1150 ms | 3648 ms | 47 tok/s warming | — | 9 |
| — | thinkingmachines/inkling warming | deepinfra | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1172 ms | 1314 ms | 1172 ms | 1314 ms | 38 tok/s warming | — | 2 |
| — | z-ai/glm-5.2 warming | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1173 ms | 1587 ms | 1173 ms | 1587 ms | 169 tok/s warming | — | 7 |
| — | nvidia/nemotron-3-nano-30b-a3b warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1184 ms | 4025 ms | 1184 ms | 4025 ms | — | — | 6 |
| — | google/gemma-4-26b-a4b-it warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1185 ms | 8900 ms | 1185 ms | 8900 ms | — | — | 8 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1191 ms | 2593 ms | 1190 ms | 2592 ms | 20 tok/s warming | — | 2 |
| — | moonshotai/kimi-k2.5 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1197 ms | 2763 ms | 1197 ms | 2763 ms | — | — | 3 |
| — | mistralai/ministral-3-14b-instruct warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1210 ms | 1394 ms | 1210 ms | 1394 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1212 ms | 1474 ms | 1212 ms | 1474 ms | 34 tok/s warming | — | 3 |
| — | meta-llama/llama-3.3-70b-instruct warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1216 ms | 3266 ms | 1215 ms | 3266 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash-0731 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1222 ms | 1486 ms | 1222 ms | 1486 ms | 86 tok/s warming | — | 2 |
| — | openai/gpt-4 warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1229 ms | 2100 ms | 1229 ms | 2100 ms | — | — | 6 |
| — | minimax/minimax-m3 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1232 ms | 2651 ms | 1231 ms | 2651 ms | 81 tok/s warming | — | 4 |
| — | moonshotai/moonshot-v1-32k-vision-preview warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1233 ms | 3022 ms | 1233 ms | 3022 ms | — | — | 8 |
| — | deepseek/deepseek-r1-distill-llama-70b warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1236 ms | 1236 ms | 1235 ms | 1235 ms | — | — | 1 |
| — | z-ai/glm-4.6v warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1238 ms | 4381 ms | 1237 ms | 4381 ms | — | — | 2 |
| — | meta-llama/llama-3.3-70b-instruct-fp8-fast warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1247 ms | 1247 ms | 1247 ms | 1247 ms | — | — | 1 |
| — | qwen/qwen3.5-397b-a17b warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1254 ms | 1254 ms | 1254 ms | 1254 ms | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1257 ms | 1257 ms | 1257 ms | 1257 ms | 26 tok/s warming | — | 1 |
| — | yutori/n1.5 warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1258 ms | 3816 ms | 1258 ms | 3816 ms | — | — | 6 |
| — | openai/o4-mini warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1266 ms | 3515 ms | 1266 ms | 3514 ms | — | — | 4 |
| — | deepseek/deepseek-v4-pro warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1267 ms | 1754 ms | 1266 ms | 1754 ms | 59 tok/s warming | — | 7 |
| — | bytedance/doubao-seed-1.6-flash-250828 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1268 ms | 1268 ms | 1268 ms | 1268 ms | — | — | 1 |
| — | google/gemini-3-flash-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1271 ms | 3186 ms | 1271 ms | 3186 ms | — | — | 9 |
| — | qwen/qwen3-coder-30b-a3b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1280 ms | 1280 ms | 1280 ms | 1280 ms | — | — | 1 |
| — | z-ai/glm-5.2-fast warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1287 ms | 4190 ms | 1287 ms | 4190 ms | 59 tok/s warming | — | 6 |
| — | google/gemma-4-26b-a4b-it warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1294 ms | 1508 ms | 1294 ms | 1508 ms | — | — | 3 |
| — | z-ai/glm-5.2-nvfp4 warming | makora | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1300 ms | 5169 ms | 1300 ms | 5169 ms | — | — | 8 |
| — | google/gemini-2.5-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1304 ms | 3258 ms | 1304 ms | 3257 ms | — | — | 5 |
| — | openai/gpt-oss-20b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1305 ms | 1414 ms | 1305 ms | 1413 ms | — | — | 5 |
| — | google/gemini-3.5-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1327 ms | 2870 ms | 1327 ms | 2870 ms | 93 tok/s warming | — | 9 |
| — | z-ai/glm-4.7 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1327 ms | 1327 ms | 1327 ms | 1327 ms | — | — | 1 |
| — | google/gemma-4-31b-it warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1328 ms | 2836 ms | 1327 ms | 2836 ms | 63 tok/s warming | — | 3 |
| — | openai/gpt-oss-20b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1331 ms | 2598 ms | 1331 ms | 2597 ms | — | — | 2 |
| — | qwen/qwen3-32b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1338 ms | 3325 ms | 1338 ms | 3325 ms | — | — | 6 |
| — | zai-org/glm-4.5v warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1338 ms | 3107 ms | 1338 ms | 3107 ms | — | — | 2 |
| — | qwen/qwen3.5-397b-a17b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1358 ms | 1358 ms | 1358 ms | 1358 ms | — | — | 1 |
| — | z-ai/glm-4.6 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1364 ms | 2042 ms | 1364 ms | 2042 ms | — | — | 2 |
| — | moonshotai/moonshot-v1-128k-vision-preview warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1373 ms | 2598 ms | 1373 ms | 2597 ms | — | — | 6 |
| — | minimax/minimax-m2 warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1383 ms | 3139 ms | 1383 ms | 3139 ms | — | — | 8 |
| — | google/gemini-2.5-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1384 ms | 1501 ms | 1384 ms | 1501 ms | — | — | 5 |
| — | moonshotai/kimi-k3 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1385 ms | 2155 ms | 1385 ms | 2155 ms | 33 tok/s warming | — | 6 |
| — | mistralai/mistral-large warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1387 ms | 2408 ms | 1387 ms | 2408 ms | — | — | 4 |
| — | meta-llama/llama-4-maverick warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1388 ms | 2735 ms | 1388 ms | 2735 ms | — | — | 4 |
| — | qwen/qwen3.5-35b-a3b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1390 ms | 1390 ms | 1390 ms | 1390 ms | — | — | 1 |
| — | google/gemma-3-4b-it warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1391 ms | 1391 ms | 1391 ms | 1391 ms | — | — | 1 |
| — | qwen/qwen3-coder-flash warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1395 ms | 2668 ms | 1395 ms | 2668 ms | — | — | 2 |
| — | Qwen/Qwen3-32B warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1401 ms | 2133 ms | 1401 ms | 2133 ms | — | — | 4 |
| — | openai/gpt-4 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1401 ms | 3708 ms | 1401 ms | 3708 ms | — | — | 3 |
| — | meta-llama/llama-3.2-3b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1402 ms | 3177 ms | 1402 ms | 3177 ms | — | — | 3 |
| — | ibm-granite/granite-4.0-h-micro warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1407 ms | 3347 ms | 1406 ms | 3347 ms | — | — | 3 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1407 ms | 2957 ms | 1407 ms | 2957 ms | — | — | 4 |
| — | minimax/minimax-m3 warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1409 ms | 1409 ms | 1409 ms | 1409 ms | 38 tok/s warming | 3 probe_config_error |
1 |
| — | openai/gpt-4o-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1415 ms | 1415 ms | 1415 ms | 1415 ms | — | — | 2 |
| — | deepseek-ai/DeepSeek-V4-Pro warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1423 ms | 1524 ms | 1423 ms | 1524 ms | — | — | 2 |
| — | openai/gpt-4.1-nano warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1426 ms | 1564 ms | 1425 ms | 1564 ms | — | — | 14 |
| — | openai/gpt-5.6-luna warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1426 ms | 3043 ms | 1426 ms | 3043 ms | 61 tok/s warming | — | 3 |
| — | qwen/qwen3.6-35b-a3b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1428 ms | 1428 ms | 1428 ms | 1428 ms | — | — | 1 |
| — | nvidia/nemotron-3-120b-a12b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1441 ms | 2540 ms | 1441 ms | 2539 ms | — | — | 3 |
| — | deepseek/deepseek-v4-pro warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1443 ms | 1757 ms | 1443 ms | 1757 ms | 97 tok/s warming | — | 2 |
| — | qwen/qwen3-30b-a3b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1447 ms | 1447 ms | 1446 ms | 1446 ms | — | — | 1 |
| — | openai/gpt-4o warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1455 ms | 2540 ms | 1455 ms | 2540 ms | — | — | 2 |
| — | qwen/qwen3-30b-a3b-fp8 warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1466 ms | 1466 ms | 1465 ms | 1465 ms | — | — | 1 |
| — | z-ai/glm-4.5v warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1466 ms | 3746 ms | 1466 ms | 3745 ms | — | — | 8 |
| — | z-ai/glm-5 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1466 ms | 1466 ms | 1466 ms | 1466 ms | — | — | 1 |
| — | qwen/qwen3.5-9b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1469 ms | 1469 ms | 1469 ms | 1469 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1474 ms | 3602 ms | 1474 ms | 3602 ms | — | — | 6 |
| — | google/gemma-4-e2b-it warming | neurometric | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1478 ms | 3174 ms | 1478 ms | 3173 ms | — | — | 9 |
| — | z-ai/glm-5.1 warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1479 ms | 2685 ms | 1479 ms | 2685 ms | — | — | 4 |
| — | qwen/qwen3.5-35b-a3b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1480 ms | 1633 ms | 1480 ms | 1632 ms | — | — | 2 |
| — | google/gemma-4-12b-it warming | neurometric | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1490 ms | 1512 ms | 1489 ms | 1512 ms | — | — | 3 |
| — | z-ai/glm-4.7-flash warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1490 ms | 3110 ms | 1490 ms | 3110 ms | — | — | 2 |
| — | z-ai/glm-5v-turbo warming | atlas-cloud | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1494 ms | 1494 ms | 1494 ms | 1494 ms | — | — | 1 |
| — | qwen/qwen3-vl-8b-instruct warming | neurometric | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1499 ms | 2937 ms | 1499 ms | 2937 ms | — | — | 7 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1500 ms | 1500 ms | 1499 ms | 1499 ms | — | — | 1 |
| — | z-ai/glm-4.6 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1511 ms | 2834 ms | 1511 ms | 2834 ms | — | — | 2 |
| — | meta-llama/llama-3.3-70b-instruct warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1513 ms | 2926 ms | 1513 ms | 2925 ms | — | — | 3 |
| — | qwen/qwen3.6-35b-a3b warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1514 ms | 1514 ms | 1514 ms | 1514 ms | — | — | 1 |
| — | google/gemini-3.1-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1516 ms | 3049 ms | 1516 ms | 3049 ms | — | — | 6 |
| — | z-ai/glm-5 warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1518 ms | 3144 ms | 1518 ms | 3144 ms | — | — | 4 |
| — | thedrummer/skyfall-36b-v2 warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1521 ms | 3803 ms | 1521 ms | 3803 ms | — | — | 4 |
| — | deepseek/deepseek-v3.1 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1524 ms | 2008 ms | 1524 ms | 2007 ms | — | — | 2 |
| — | openai/gpt-5.1 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1525 ms | 3150 ms | 1525 ms | 3150 ms | — | — | 3 |
| — | kwaipilot/kat-coder-air-v2.5 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1527 ms | 1527 ms | 1526 ms | 1526 ms | — | — | 1 |
| — | openai/gpt-oss-120b warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1532 ms | 3666 ms | 1532 ms | 3665 ms | 66 tok/s warming | — | 4 |
| — | deepseek/deepseek-v4-flash-0731 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1533 ms | 1710 ms | 1533 ms | 1710 ms | 57 tok/s warming | — | 3 |
| — | anthropic/claude-sonnet-4.6 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1537 ms | 2963 ms | 1536 ms | 2962 ms | 44 tok/s warming | — | 4 |
| — | qwen/qwen3.5-9b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1542 ms | 3158 ms | 1542 ms | 3158 ms | — | — | 5 |
| — | moonshotai/moonshot-v1-8k-vision-preview warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1544 ms | 2675 ms | 1543 ms | 2675 ms | — | — | 5 |
| — | moonshotai/moonshot-v1-8k warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1545 ms | 1919 ms | 1545 ms | 1919 ms | — | — | 2 |
| — | qwen/qwen3-max-2025-09-23 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1552 ms | 1552 ms | 1552 ms | 1552 ms | — | — | 1 |
| — | openai/gpt-oss-120b warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1553 ms | 2584 ms | 1553 ms | 2584 ms | 82 tok/s warming | — | 6 |
| — | meta-llama/llama-3.3-70b-instruct warming | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1566 ms | 3669 ms | 1566 ms | 3669 ms | — | — | 9 |
| — | z-ai/glm-4.7 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1573 ms | 2864 ms | 1573 ms | 2864 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash warming | parasail | 100.00% | 100.00% | 50.00% 20s | 100.00% | 1575 ms | 20850 ms | 1575 ms | 20850 ms | 81 tok/s warming | — | 2 |
| — | google/gemma-4-26b-a4b-it warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1576 ms | 4344 ms | 1576 ms | 4344 ms | — | 2 probe_config_error |
4 |
| — | google/gemini-3.6-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1579 ms | 4597 ms | 1579 ms | 4597 ms | — | — | 6 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1581 ms | 2707 ms | 1581 ms | 2707 ms | — | — | 3 |
| — | morph/morph-v3-large warming | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1582 ms | 3748 ms | 1582 ms | 3747 ms | — | — | 6 |
| — | openbmb/MiniCPM-V-4_5 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1585 ms | 2410 ms | 1585 ms | 2409 ms | 87 tok/s warming | — | 3 |
| — | google/gemini-3-flash-preview warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1591 ms | 3408 ms | 1591 ms | 3407 ms | — | — | 5 |
| — | qwen/qwen3.5-plus warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1593 ms | 2716 ms | 1593 ms | 2716 ms | — | — | 3 |
| — | zai-org/glm-4.7 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1603 ms | 1603 ms | 1603 ms | 1603 ms | — | — | 1 |
| — | openai/gpt-oss-20b warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1606 ms | 1869 ms | 1606 ms | 1869 ms | — | — | 3 |
| — | mistralai/mistral-small-2603 warming | mistral | 100.00% | 100.00% | 87.50% 20s | 100.00% | 1607 ms | 22691 ms | 1607 ms | 22691 ms | — | — | 8 |
| — | deepseek/deepseek-v3-0324 warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1608 ms | 4002 ms | 1608 ms | 4001 ms | — | — | 2 |
| — | bytedance/ui-tars-1.5-7b warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1626 ms | 3051 ms | 1625 ms | 3051 ms | — | — | 4 |
| — | deepseek/deepseek-v4-pro warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1627 ms | 10336 ms | 1626 ms | 10336 ms | 77 tok/s warming | — | 6 |
| — | openai/gpt-5.4-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1629 ms | 3071 ms | 1629 ms | 3071 ms | — | — | 2 |
| — | qwen/qwen-plus-character warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1639 ms | 1639 ms | 1639 ms | 1639 ms | 29 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-flash warming | morph | 100.00% | 100.00% | 66.67% 20s | 100.00% | 1646 ms | 22617 ms | 1646 ms | 22617 ms | 65 tok/s warming | — | 6 |
| — | qwen/qwen3-32b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1646 ms | 1646 ms | 1646 ms | 1646 ms | — | — | 1 |
| — | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1649 ms | 2706 ms | 1649 ms | 2706 ms | — | — | 2 |
| — | nvidia/nemotron-3-nano-omni-reasoning-30b-a3b warming | crusoe | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1658 ms | 4209 ms | 1657 ms | 4209 ms | — | — | 3 |
| — | xiaomimimo/mimo-v2.5-pro warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1661 ms | 1661 ms | 1661 ms | 1661 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | together | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1662 ms | 2782 ms | 1662 ms | 2782 ms | — | — | 2 |
| — | moonshotai/Kimi-K2.7-Code warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1665 ms | 4397 ms | 1665 ms | 4397 ms | — | — | 4 |
| — | qwen/qwen3-8b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1665 ms | 1665 ms | 1665 ms | 1665 ms | — | — | 1 |
| — | google/gemma-3-27b-it warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1681 ms | 1681 ms | 1681 ms | 1681 ms | — | — | 1 |
| — | qwen/qwen3.5-397b-a17b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1682 ms | 3993 ms | 1681 ms | 3993 ms | — | — | 6 |
| — | mistralai/mistral-nemo warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1684 ms | 3348 ms | 1684 ms | 3348 ms | — | — | 9 |
| — | minimax/minimax-m3 warming | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1687 ms | 3524 ms | 1687 ms | 3524 ms | — | — | 4 |
| — | qwen/qwen-vl-ocr warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1691 ms | 1691 ms | 1691 ms | 1691 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1700 ms | 2737 ms | 1700 ms | 2736 ms | — | — | 3 |
| — | moonshotai/kimi-k2.5 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1704 ms | 1763 ms | 1704 ms | 1763 ms | — | — | 3 |
| — | sao10k/l3-8b-lunaris warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1708 ms | 1708 ms | 1707 ms | 1707 ms | — | — | 1 |
| — | z-ai/glm-5 warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1709 ms | 3679 ms | 1709 ms | 3678 ms | — | — | 8 |
| — | moonshotai/Kimi-K2.6 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1720 ms | 3951 ms | 1720 ms | 3951 ms | — | — | 2 |
| — | moonshotai/kimi-k2.7-code-highspeed warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1722 ms | 4654 ms | 1722 ms | 4654 ms | — | — | 4 |
| — | z-ai/glm-5-turbo warming | atlas-cloud | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1732 ms | 2910 ms | 1732 ms | 2910 ms | — | — | 2 |
| — | moonshotai/kimi-k2.6 warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1737 ms | 2385 ms | 1737 ms | 2384 ms | 34 tok/s warming | — | 5 |
| — | openai/gpt-5.2 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1737 ms | 2944 ms | 1737 ms | 2944 ms | — | — | 3 |
| — | anthropic/claude-opus-4.8 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1740 ms | 3645 ms | 1740 ms | 3644 ms | 58 tok/s warming | — | 6 |
| — | meta-llama/llama-3.1-70b-instruct warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1742 ms | 2721 ms | 1742 ms | 2721 ms | — | — | 3 |
| — | thinkingmachines/inkling warming | together | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1742 ms | 3507 ms | 1742 ms | 3506 ms | 76 tok/s warming | — | 4 |
| — | moonshotai/moonshot-v1-128k warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1743 ms | 3230 ms | 1742 ms | 3230 ms | — | — | 4 |
| — | qwen/qwen3-vl-8b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1750 ms | 1750 ms | 1749 ms | 1749 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash-0731 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1767 ms | 2630 ms | 1766 ms | 2630 ms | 145 tok/s warming | — | 5 |
| — | deepseek/deepseek-v4-flash warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1773 ms | 3552 ms | 1773 ms | 3552 ms | 35 tok/s warming | — | 3 |
| — | qwen/qwen-mt-lite warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1773 ms | 1773 ms | 1773 ms | 1773 ms | — | — | 1 |
| — | qwen/qwen3.5-27b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1777 ms | 1777 ms | 1776 ms | 1776 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | deepinfra | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1777 ms | 27546 ms | 1777 ms | 27546 ms | 34 tok/s warming | — | 2 |
| — | google/gemini-3.1-flash-image-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1784 ms | 4074 ms | 1784 ms | 4074 ms | — | — | 7 |
| — | qwen/qwen3.7-plus warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1786 ms | 1786 ms | 1786 ms | 1786 ms | — | — | 1 |
| — | zai-org/glm-4.7-flash warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1787 ms | 1787 ms | 1787 ms | 1787 ms | — | — | 1 |
| — | moonshotai/kimi-k2.5 warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1794 ms | 3173 ms | 1794 ms | 3173 ms | — | — | 6 |
| — | z-ai/glm-5.2 warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1797 ms | 2722 ms | 1797 ms | 2722 ms | 157 tok/s warming | — | 4 |
| — | moonshotai/kimi-k3 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1801 ms | 1801 ms | 1801 ms | 1801 ms | 62 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-pro warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1815 ms | 3730 ms | 1815 ms | 3730 ms | 42 tok/s warming | — | 6 |
| — | google/gemini-2.5-flash warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1819 ms | 3203 ms | 1819 ms | 3203 ms | — | — | 7 |
| — | z-ai/glm-5.2 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1820 ms | 2917 ms | 1820 ms | 2917 ms | 31 tok/s warming | — | 3 |
| — | openai/gpt-4.1-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1832 ms | 2026 ms | 1832 ms | 2026 ms | 33 tok/s warming | — | 4 |
| — | qwen/qwen3-coder-flash-2025-07-28 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1845 ms | 1845 ms | 1845 ms | 1845 ms | — | — | 1 |
| — | google/gemma-4-31b-it warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1847 ms | 1847 ms | 1847 ms | 1847 ms | 25 tok/s warming | — | 1 |
| — | qwen/qwen3-coder-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1853 ms | 1934 ms | 1853 ms | 1934 ms | — | — | 2 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1859 ms | 2783 ms | 1859 ms | 2783 ms | 105 tok/s warming | 1 unsupported_route |
3 |
| — | qwen/qwen-mt-plus warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1859 ms | 3072 ms | 1858 ms | 3072 ms | — | — | 2 |
| — | openai/gpt-oss-20b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1874 ms | 1874 ms | 1873 ms | 1873 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1882 ms | 3557 ms | 1882 ms | 3557 ms | — | — | 4 |
| — | google/gemini-2.5-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1888 ms | 3065 ms | 1888 ms | 3065 ms | — | — | 8 |
| — | deepseek/deepseek-v3.2-exp warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1892 ms | 1892 ms | 1892 ms | 1892 ms | — | — | 1 |
| — | openai/gpt-5.6-luna warming | atlas-cloud | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1904 ms | 1904 ms | 1904 ms | 1904 ms | 63 tok/s warming | — | 1 |
| — | qwen/qwen3-30b-a3b-thinking-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1904 ms | 2649 ms | 1904 ms | 2648 ms | — | — | 4 |
| — | mistralai/ministral-14b-2512 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1918 ms | 3375 ms | 1918 ms | 3374 ms | — | — | 7 |
| — | z-ai/glm-5-turbo warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1932 ms | 36306 ms | 1932 ms | 36305 ms | — | — | 4 |
| — | openai/o3-mini warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1933 ms | 3907 ms | 1932 ms | 3907 ms | — | — | 2 |
| — | qwen/qwen3.6-flash-2026-04-16 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1959 ms | 1959 ms | 1958 ms | 1958 ms | — | — | 1 |
| — | z-ai/glm-5v-turbo warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1961 ms | 2817 ms | 1961 ms | 2817 ms | — | — | 3 |
| — | qwen/qwen3.5-122b-a10b warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1965 ms | 3238 ms | 1965 ms | 3238 ms | — | — | 2 |
| — | moonshotai/kimi-k2.5 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1967 ms | 1967 ms | 1967 ms | 1967 ms | — | — | 1 |
| — | qwen/qwen3.7-flash-2026-07-15 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1976 ms | 1976 ms | 1975 ms | 1975 ms | 106 tok/s warming | — | 1 |
| — | minimax/minimax-m2.5-highspeed warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1981 ms | 4199 ms | 1981 ms | 4198 ms | — | — | 5 |
| — | deepseek/deepseek-v3.1-terminus warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1987 ms | 1987 ms | 1987 ms | 1987 ms | — | — | 1 |
| — | google/gemini-3.5-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1997 ms | 3148 ms | 1997 ms | 3148 ms | — | — | 5 |
| — | z-ai/glm-5-turbo warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1998 ms | 2691 ms | 1997 ms | 2691 ms | — | — | 3 |
| — | z-ai/glm-5 warming | gmi | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2025 ms | 2537 ms | 2025 ms | 2537 ms | — | — | 4 |
| — | z-ai/glm-5 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2027 ms | 4368 ms | 2027 ms | 4368 ms | — | — | 7 |
| — | tencent/hy3 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2028 ms | 2455 ms | 2028 ms | 2455 ms | 74 tok/s warming | — | 4 |
| — | qwen/qwen3.5-27b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2040 ms | 2040 ms | 2039 ms | 2039 ms | — | — | 1 |
| — | minimax/minimax-m2.7 warming | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2056 ms | 3899 ms | 2055 ms | 3899 ms | — | — | 5 |
| — | openai/o1 warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2062 ms | 5156 ms | 2062 ms | 5156 ms | — | — | 2 |
| — | qwen/qwen3.5-122b-a10b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2065 ms | 3581 ms | 2065 ms | 3581 ms | — | — | 3 |
| — | deepseek/deepseek-v3.1 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2073 ms | 2847 ms | 2073 ms | 2847 ms | — | — | 2 |
| — | MiniMaxAI/MiniMax-M3 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2078 ms | 2078 ms | 2078 ms | 2078 ms | 86 tok/s warming | — | 1 |
| — | deepseek/deepseek-v3-0324 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2081 ms | 2081 ms | 2081 ms | 2081 ms | — | — | 1 |
| — | anthropic/claude-opus-5 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2092 ms | 4169 ms | 2092 ms | 4169 ms | 76 tok/s warming | — | 7 |
| — | qwen/qwen3.6-27b warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2101 ms | 3481 ms | 2101 ms | 3481 ms | — | — | 7 |
| — | qwen/qwen3.5-122b-a10b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2114 ms | 2114 ms | 2114 ms | 2114 ms | — | — | 1 |
| — | minimax/minimax-m2.7 warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2119 ms | 3834 ms | 2119 ms | 3834 ms | — | — | 5 |
| — | qwen/qwen3.6-plus-2026-04-02 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2119 ms | 2332 ms | 2118 ms | 2332 ms | — | — | 3 |
| — | bytedance/doubao-seed-1.8-251228 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2126 ms | 2149 ms | 2126 ms | 2148 ms | — | — | 2 |
| — | openai/gpt-4-turbo warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2130 ms | 2648 ms | 2130 ms | 2648 ms | — | — | 3 |
| — | openai/gpt-5.4-mini warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2147 ms | 3640 ms | 2147 ms | 3639 ms | — | — | 2 |
| — | moonshotai/kimi-k2.6 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2165 ms | 7592 ms | 2165 ms | 7592 ms | 92 tok/s warming | — | 6 |
| — | google/gemini-3.1-flash-lite-preview warming | lightning | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2168 ms | 3529 ms | 2167 ms | 3529 ms | — | — | 5 |
| — | minimax/minimax-m2.7 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2175 ms | 2428 ms | 2175 ms | 2428 ms | — | — | 2 |
| — | openai/gpt-5.5 warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2180 ms | 3091 ms | 2179 ms | 3091 ms | — | — | 5 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2186 ms | 18060 ms | 2186 ms | 18059 ms | 83 tok/s warming | — | 7 |
| — | qwen/qwen3.5-27b warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2201 ms | 2201 ms | 2201 ms | 2201 ms | — | — | 1 |
| — | qwen/qwen3.6-35b-a3b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2210 ms | 2271 ms | 2210 ms | 2271 ms | — | — | 3 |
| — | z-ai/glm-5.2 warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2210 ms | 4034 ms | 2210 ms | 4034 ms | 49 tok/s warming | — | 8 |
| — | z-ai/glm-4.6 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2211 ms | 3431 ms | 2211 ms | 3431 ms | — | — | 5 |
| — | mistralai/ministral-3b-2512 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2215 ms | 2511 ms | 2214 ms | 2510 ms | — | — | 4 |
| — | qwen/qwen-vl-ocr-2025-11-20 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2215 ms | 3263 ms | 2215 ms | 3263 ms | — | — | 2 |
| — | NousResearch/Hermes-4-405B warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2224 ms | 2253 ms | 2224 ms | 2253 ms | — | — | 2 |
| — | anthropic/claude-sonnet-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2228 ms | 4376 ms | 2228 ms | 4376 ms | — | — | 6 |
| — | qwen/qwen3.5-9b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2229 ms | 4251 ms | 2229 ms | 4251 ms | — | — | 5 |
| — | z-ai/glm-5v-turbo warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2231 ms | 3765 ms | 2231 ms | 3765 ms | — | — | 4 |
| — | deepseek/deepseek-v4-flash warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2236 ms | 2236 ms | 2236 ms | 2236 ms | 72 tok/s warming | — | 1 |
| — | nvidia/Cosmos3-Super-Reasoner warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2236 ms | 2236 ms | 2236 ms | 2236 ms | 54 tok/s warming | — | 1 |
| — | qwen/qwen3-vl-8b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2237 ms | 2237 ms | 2237 ms | 2237 ms | — | — | 1 |
| — | anthropic/claude-opus-4.7 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2239 ms | 4814 ms | 2239 ms | 4814 ms | — | — | 6 |
| — | nvidia/nemotron-nano-12b-v2-vl warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2243 ms | 2243 ms | 2243 ms | 2243 ms | — | — | 1 |
| — | mistralai/ministral-8b-2512 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2244 ms | 2794 ms | 2243 ms | 2794 ms | — | — | 7 |
| — | google/gemini-3.5-flash warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2249 ms | 2421 ms | 2248 ms | 2421 ms | 50 tok/s warming | — | 5 |
| — | qwen/qwen3-coder-480b-a35b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2251 ms | 2251 ms | 2251 ms | 2251 ms | — | — | 1 |
| — | anthropic/claude-opus-4.6 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2260 ms | 3371 ms | 2260 ms | 3370 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2266 ms | 3516 ms | 2266 ms | 3516 ms | 36 tok/s warming | — | 6 |
| — | Qwen/Qwen3-30B-A3B-Instruct-2507 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2281 ms | 5211 ms | 2280 ms | 5211 ms | — | — | 2 |
| — | qwen/qwen3.7-plus-2026-05-26 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2320 ms | 2320 ms | 2320 ms | 2320 ms | — | — | 1 |
| — | openai/gpt-oss-20b warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2336 ms | 2919 ms | 2336 ms | 2919 ms | — | — | 6 |
| — | minimax/minimax-m2.5-highspeed warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2340 ms | 2340 ms | 2340 ms | 2340 ms | — | — | 1 |
| — | moonshotai/kimi-k2.5 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2352 ms | 4245 ms | 2352 ms | 4245 ms | — | — | 7 |
| — | openai/gpt-oss-120b warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2352 ms | 3623 ms | 2352 ms | 3623 ms | 61 tok/s warming | — | 5 |
| — | moonshotai/kimi-k2.7-code warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2362 ms | 2958 ms | 2361 ms | 2958 ms | — | — | 4 |
| — | mistralai/mistral-medium-3-5 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2368 ms | 3383 ms | 2368 ms | 3383 ms | — | — | 6 |
| — | openai/gpt-3.5-turbo warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2375 ms | 3111 ms | 2375 ms | 3111 ms | — | — | 4 |
| — | qwen/qwen3-max-preview warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2382 ms | 2382 ms | 2382 ms | 2382 ms | — | — | 1 |
| — | lgai-exaone/k-exaone-236b-a23b warming | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2392 ms | 3927 ms | 2391 ms | 3927 ms | — | — | 6 |
| — | moonshotai/kimi-k3 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2419 ms | 4248 ms | 2419 ms | 4248 ms | 54 tok/s warming | — | 4 |
| — | moonshotai/kimi-k2.7-code warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2425 ms | 2425 ms | 2425 ms | 2425 ms | 21 tok/s warming | — | 1 |
| — | deepseek/deepseek-ocr warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2429 ms | 2429 ms | 2429 ms | 2429 ms | — | — | 3 |
| — | openai/o3 warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2441 ms | 2820 ms | 2441 ms | 2819 ms | — | — | 4 |
| — | google/gemini-3-flash-preview warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2442 ms | 3835 ms | 2442 ms | 3835 ms | — | — | 3 |
| — | meta-llama/llama-3.1-8b-instruct warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2442 ms | 2496 ms | 2441 ms | 2496 ms | — | — | 3 |
| — | deepseek/deepseek-v3.2 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2453 ms | 3384 ms | 2453 ms | 3384 ms | — | — | 2 |
| — | qwen/qwen3-coder-30b-a3b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2455 ms | 2455 ms | 2455 ms | 2455 ms | — | — | 1 |
| — | google/gemma-4-31b-turbo warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2457 ms | 9581 ms | 2457 ms | 9580 ms | — | — | 5 |
| — | Qwen/Qwen3-235B-A22B-Instruct-2507 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2490 ms | 3802 ms | 2490 ms | 3802 ms | — | — | 3 |
| — | deepseek/deepseek-v3.2 warming | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2492 ms | 5782 ms | 2491 ms | 5781 ms | — | — | 9 |
| — | openai/gpt-3.5-turbo warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2500 ms | 2500 ms | 2500 ms | 2500 ms | — | — | 1 |
| — | meta-llama/Llama-3.3-70B-Instruct warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2509 ms | 15151 ms | 2509 ms | 15151 ms | — | — | 4 |
| — | moonshotai/kimi-k2.6 warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2525 ms | 4843 ms | 2525 ms | 4843 ms | 27 tok/s warming | — | 6 |
| — | z-ai/glm-5.2 warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2558 ms | 3861 ms | 2557 ms | 3860 ms | 69 tok/s warming | — | 5 |
| — | moonshotai/kimi-k3 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2571 ms | 7611 ms | 2571 ms | 7611 ms | 45 tok/s warming | — | 7 |
| — | morph/morph-v3-fast warming | morph | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2592 ms | 2921 ms | 2592 ms | 2921 ms | — | — | 8 |
| — | qwen/qwen-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2608 ms | 3011 ms | 2608 ms | 3011 ms | — | — | 2 |
| — | z-ai/glm-5 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2608 ms | 4413 ms | 2608 ms | 4413 ms | — | — | 2 |
| — | nvidia/nemotron-3-nano-30b-a3b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2625 ms | 3773 ms | 2625 ms | 3772 ms | — | — | 2 |
| — | anthropic/claude-opus-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2636 ms | 3489 ms | 2636 ms | 3488 ms | — | — | 4 |
| — | bytedance/doubao-seed-1.6-251015 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2650 ms | 2650 ms | 2650 ms | 2650 ms | — | — | 1 |
| — | google/gemini-3.1-flash-lite warming | google-ai-studio | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2652 ms | 2999 ms | 2652 ms | 2999 ms | — | — | 4 |
| — | deepseek/deepseek-v4-flash-0731 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2659 ms | 13849 ms | 2659 ms | 13849 ms | 53 tok/s warming | — | 2 |
| — | qwen/qwen3-vl-30b-a3b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2665 ms | 2665 ms | 2665 ms | 2665 ms | — | — | 1 |
| — | z-ai/glm-5v-turbo warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2666 ms | 8971 ms | 2666 ms | 8971 ms | — | — | 2 |
| — | z-ai/glm-5.1 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2670 ms | 4504 ms | 2670 ms | 4504 ms | — | — | 3 |
| — | meta-llama/llama-4-maverick warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2688 ms | 2710 ms | 2687 ms | 2710 ms | — | — | 3 |
| — | qwen/qwen3-vl-8b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2702 ms | 3014 ms | 2702 ms | 3014 ms | — | — | 2 |
| — | deepseek/deepseek-v3.2 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2712 ms | 2712 ms | 2712 ms | 2712 ms | — | — | 1 |
| — | qwen/qwen3.6-27b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2712 ms | 3857 ms | 2712 ms | 3856 ms | — | — | 9 |
| — | z-ai/glm-5.1 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2722 ms | 8138 ms | 2721 ms | 8138 ms | — | — | 8 |
| — | z-ai/glm-4.7-flash warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2723 ms | 6840 ms | 2723 ms | 6840 ms | — | — | 7 |
| — | google/gemini-3-flash-preview warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2724 ms | 10213 ms | 2724 ms | 10213 ms | — | — | 2 |
| — | google/gemma-3-27b-it warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2752 ms | 2752 ms | 2752 ms | 2752 ms | — | — | 1 |
| — | qwen/qwen3.7-max warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2757 ms | 2895 ms | 2757 ms | 2894 ms | — | — | 3 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2760 ms | 2760 ms | 2759 ms | 2759 ms | — | — | 1 |
| — | bytedance/doubao-seed-character-260628 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2781 ms | 2781 ms | 2780 ms | 2780 ms | — | — | 1 |
| — | Qwen/Qwen3-Next-80B-A3B-Thinking warming | nebius | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2792 ms | 2941 ms | 2792 ms | 2941 ms | — | — | 3 |
| — | qwen/qwen3.5-flash warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2805 ms | 2805 ms | 2804 ms | 2804 ms | — | — | 1 |
| — | bytedance/doubao-seed-2.1-pro-260628 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2820 ms | 5744 ms | 2820 ms | 5744 ms | — | — | 2 |
| — | qwen/qwen2.5-coder-32b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2824 ms | 3133 ms | 2824 ms | 3133 ms | — | — | 3 |
| — | thinkingmachines/inkling-1m warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2831 ms | 4090 ms | 2831 ms | 4089 ms | 71 tok/s warming | — | 3 |
| — | minimax/minimax-m2.7 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2842 ms | 2842 ms | 2842 ms | 2842 ms | — | — | 1 |
| — | qwen/qwen3-vl-32b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2865 ms | 2865 ms | 2865 ms | 2865 ms | — | — | 1 |
| — | minimax/minimax-m2.1 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2886 ms | 2886 ms | 2886 ms | 2886 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2887 ms | 2887 ms | 2887 ms | 2887 ms | 74 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-flash-0731 warming | fireworks | 100.00% | 100.00% | 88.89% 20s | 100.00% | 2891 ms | 23396 ms | 2891 ms | 23396 ms | 57 tok/s warming | — | 9 |
| — | google/gemma-4-31b-it warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2915 ms | 5117 ms | 2915 ms | 5117 ms | — | — | 3 |
| — | qwen/qwen3.8-max warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2920 ms | 2920 ms | 2920 ms | 2920 ms | — | — | 1 |
| — | mistralai/mistral-small-24b-instruct-2501 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2949 ms | 2949 ms | 2949 ms | 2949 ms | — | — | 1 |
| — | qwen/qwen3-vl-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2962 ms | 2962 ms | 2961 ms | 2961 ms | — | — | 1 |
| — | qwen/qwen3-coder-plus-2025-07-22 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2968 ms | 2968 ms | 2968 ms | 2968 ms | — | — | 1 |
| — | google/gemini-3.1-flash-lite warming | deepinfra | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2969 ms | 2969 ms | 2969 ms | 2969 ms | — | — | 1 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2989 ms | 2989 ms | 2989 ms | 2989 ms | — | — | 1 |
| — | zai-org/glm-4.6v warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3000 ms | 3000 ms | 3000 ms | 3000 ms | — | — | 1 |
| — | anthropic/claude-haiku-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 15s | 100.00% | 3006 ms | 3098 ms | 3006 ms | 3097 ms | — | — | 3 |
| — | google/gemini-3.5-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3014 ms | 3297 ms | 3013 ms | 3297 ms | 58 tok/s warming | — | 3 |
| — | z-ai/glm-4.5-air warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3024 ms | 4610 ms | 3024 ms | 4610 ms | — | — | 7 |
| — | z-ai/glm-5.2 warming | novita | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3029 ms | 3029 ms | 3028 ms | 3028 ms | 22 tok/s warming | — | 1 |
| — | moonshotai/kimi-k2.6 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3032 ms | 3343 ms | 3032 ms | 3343 ms | — | — | 4 |
| — | z-ai/glm-5.2-fast warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3069 ms | 3069 ms | 3069 ms | 3069 ms | 86 tok/s warming | — | 1 |
| — | anthropic/claude-sonnet-5 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3076 ms | 3888 ms | 3076 ms | 3888 ms | — | — | 7 |
| — | moonshotai/kimi-k3 warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3082 ms | 3082 ms | 3082 ms | 3082 ms | 25 tok/s warming | — | 1 |
| — | google/gemma-4-31b-it warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3093 ms | 3135 ms | 3093 ms | 3134 ms | 23 tok/s warming | — | 3 |
| — | z-ai/glm-5.2 warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3101 ms | 3666 ms | 3101 ms | 3666 ms | 55 tok/s warming | — | 3 |
| — | moonshotai/kimi-k2.7-code warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3226 ms | 4522 ms | 3226 ms | 4522 ms | 35 tok/s warming | — | 8 |
| — | qwen/qwen3.5-27b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3255 ms | 3255 ms | 3254 ms | 3254 ms | — | — | 1 |
| — | qwen/qwen3.5-397b-a17b warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3259 ms | 4367 ms | 3259 ms | 4367 ms | — | — | 7 |
| — | xiaomi/mimo-v2.5-pro warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3269 ms | 3269 ms | 3269 ms | 3269 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3288 ms | 5161 ms | 3288 ms | 5161 ms | — | — | 3 |
| — | deepseek/deepseek-v4-pro warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3305 ms | 3305 ms | 3304 ms | 3304 ms | 97 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-pro warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3312 ms | 5535 ms | 3311 ms | 5535 ms | 40 tok/s warming | — | 3 |
| — | xiaomi/mimo-v2.5-pro warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3318 ms | 5755 ms | 3318 ms | 5754 ms | 66 tok/s warming | — | 3 |
| — | openai/gpt-4.1 warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3322 ms | 5424 ms | 3321 ms | 5424 ms | — | — | 3 |
| — | moonshotai/kimi-k3 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3343 ms | 3343 ms | 3343 ms | 3343 ms | 28 tok/s warming | — | 1 |
| — | google/gemini-3.1-pro-preview warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3346 ms | 4850 ms | 3346 ms | 4850 ms | 82 tok/s warming | — | 6 |
| — | qwen/qwen3-235b-a22b-2507 warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3348 ms | 3750 ms | 3348 ms | 3749 ms | — | — | 5 |
| — | minimax/minimax-m2.7 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3352 ms | 3352 ms | 3351 ms | 3351 ms | — | — | 1 |
| — | moonshotai/kimi-k3 warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3400 ms | 4356 ms | 3400 ms | 4355 ms | 23 tok/s warming | — | 7 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3420 ms | 3420 ms | 3420 ms | 3420 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3423 ms | 5787 ms | 3423 ms | 5787 ms | — | — | 3 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3423 ms | 3423 ms | 3423 ms | 3423 ms | — | — | 1 |
| — | nvidia/nemotron-3-super-120b-a12b warming | crusoe | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3432 ms | 4090 ms | 3432 ms | 4090 ms | — | — | 3 |
| — | NousResearch/Hermes-4-70B warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3437 ms | 3437 ms | 3436 ms | 3436 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3444 ms | 14580 ms | 2829 ms | 3444 ms | 50 tok/s warming | — | 8 |
| — | z-ai/glm-5.2 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3453 ms | 3453 ms | 3453 ms | 3453 ms | — | — | 1 |
| — | qwen/qwen3-vl-30b-a3b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3472 ms | 3472 ms | 3472 ms | 3472 ms | — | — | 1 |
| — | z-ai/glm-4.6 warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3522 ms | 3942 ms | 3521 ms | 3942 ms | — | — | 4 |
| — | deepseek/deepseek-v3.2-exp warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3557 ms | 4662 ms | 3557 ms | 4662 ms | — | — | 3 |
| — | google/gemini-2.5-pro warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3599 ms | 3599 ms | 3599 ms | 3599 ms | — | — | 1 |
| — | google/gemini-3.1-pro-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3619 ms | 7970 ms | 3619 ms | 7970 ms | 72 tok/s warming | — | 9 |
| — | moonshotai/kimi-k2.7-code warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3749 ms | 13806 ms | 3749 ms | 13806 ms | 48 tok/s warming | — | 7 |
| — | qwen/qwen3.6-35b-a3b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3776 ms | 10757 ms | 3775 ms | 10757 ms | — | — | 4 |
| — | deepseek/deepseek-v3.2 warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3783 ms | 5951 ms | 3783 ms | 5951 ms | — | — | 4 |
| — | z-ai/glm-4.5 warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3800 ms | 3996 ms | 3800 ms | 3996 ms | — | — | 2 |
| — | google/gemma-4-31b-it warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3807 ms | 3925 ms | 3807 ms | 3925 ms | 23 tok/s warming | — | 2 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | novita | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3829 ms | 3829 ms | 3829 ms | 3829 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3895 ms | 8775 ms | 3895 ms | 8775 ms | 54 tok/s warming | — | 5 |
| — | z-ai/glm-5.2 warming | crusoe | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3908 ms | 4417 ms | 3908 ms | 4417 ms | — | — | 5 |
| — | google/gemini-2.5-pro warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3939 ms | 6580 ms | 3939 ms | 6580 ms | — | — | 6 |
| — | bytedance/doubao-seed-2.0-pro-260215 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3947 ms | 3947 ms | 3947 ms | 3947 ms | — | — | 1 |
| — | openai/gpt-oss-120b warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3974 ms | 4825 ms | 3974 ms | 4824 ms | 54 tok/s warming | — | 2 |
| — | qwen/qwen3.5-397b-a17b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4019 ms | 4019 ms | 4018 ms | 4018 ms | — | — | 1 |
| — | z-ai/glm-4.5-air warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4036 ms | 4036 ms | 4036 ms | 4036 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4038 ms | 4611 ms | 4037 ms | 4611 ms | 56 tok/s warming | — | 3 |
| — | z-ai/glm-4.7 warming | zai | 100.00% | 100.00% | 75.00% 20s | 100.00% | 4145 ms | 27912 ms | 4145 ms | 27912 ms | — | — | 4 |
| — | openai/gpt-5 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4201 ms | 4965 ms | 4200 ms | 4964 ms | — | — | 3 |
| — | zai-org/GLM-5.1 warming | nebius | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4248 ms | 4248 ms | 4247 ms | 4247 ms | — | — | 1 |
| — | deepseek/deepseek-v3.1-terminus warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4410 ms | 13383 ms | 4410 ms | 13383 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4449 ms | 4541 ms | 4449 ms | 4540 ms | 14 tok/s warming | — | 2 |
| — | qwen/qwen3-omni-30b-a3b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4449 ms | 4449 ms | 4449 ms | 4449 ms | — | — | 1 |
| — | bytedance/doubao-seed-evolving warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4454 ms | 4454 ms | 4454 ms | 4454 ms | — | — | 1 |
| — | google/gemini-3.1-pro-preview warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4579 ms | 9548 ms | 4578 ms | 9548 ms | 43 tok/s warming | — | 5 |
| — | z-ai/glm-4.7-flash warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4655 ms | 4655 ms | 4655 ms | 4655 ms | — | — | 1 |
| — | anthropic/claude-fable-5 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4765 ms | 7311 ms | 4765 ms | 7310 ms | — | — | 6 |
| — | bytedance/doubao-seed-2.1-turbo-260628 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4772 ms | 4772 ms | 4772 ms | 4772 ms | — | — | 1 |
| — | x-ai/grok-build-0.1 warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4804 ms | 4804 ms | 4804 ms | 4804 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4954 ms | 4954 ms | 4954 ms | 4954 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | crusoe | 100.00% | 100.00% | 100.00% 45s | 100.00% | 5106 ms | 5427 ms | 5105 ms | 5427 ms | — | — | 5 |
| — | openai/gpt-oss-120b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5197 ms | 5197 ms | 5197 ms | 5197 ms | 15 tok/s warming | — | 1 |
| — | tencent/hy3 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5790 ms | 5790 ms | 5790 ms | 5790 ms | 47 tok/s warming | — | 1 |
| — | google/gemma-3-27b-it warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6693 ms | 6693 ms | 6693 ms | 6693 ms | — | — | 1 |
| — | mistralai/mistral-small-3.1-24b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 7361 ms | 7361 ms | 7361 ms | 7361 ms | — | — | 1 |
| — | google/gemini-3.5-flash warming | atlas-cloud | 100.00% | 100.00% | 100.00% 20s | 100.00% | 14038 ms | 15679 ms | 14038 ms | 15678 ms | 29 tok/s warming | — | 2 |
| — | qwen/qwen3-32b warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 17002 ms | 17002 ms | 17002 ms | 17002 ms | — | — | 1 |
| — | deepseek/deepseek-v3.2 warming | deepinfra | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | — | 1 |
| — | kling/v3-pro warming | kling | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | — | 1 |
| — | openai/gpt-4o warming | openai | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | — | 1 |
| — | z-ai/glm-5.2 warming | tinfoil | 88.89% | 88.89% | 88.89% 45s | 100.00% | 5771 ms | 21440 ms | 5771 ms | 21439 ms | — | — | 9 |
| — | cerebras/gemma-4-31b warming | cerebras | 85.71% | 85.71% | 85.71% 15s | 85.71% | 2116 ms | 12027 ms | 2116 ms | 12027 ms | — | — | 7 |
| — | z-ai/glm-5.1 warming | chutes | 80.00% | 80.00% | 80.00% 45s | 100.00% | 2316 ms | 14841 ms | 2316 ms | 14841 ms | — | — | 5 |
| — | moonshotai/kimi-k2.6 warming | digitalocean | 75.00% | 75.00% | 75.00% 20s | 75.00% | 1414 ms | 2326 ms | 1414 ms | 2325 ms | 39 tok/s warming | — | 4 |
| — | minimax/minimax-m3 warming | fireworks | 75.00% | 75.00% | 75.00% 20s | 100.00% | 3921 ms | 5114 ms | 3920 ms | 5113 ms | 67 tok/s warming | — | 4 |
| — | nvidia/nemotron-3-super-120b warming | digitalocean | 71.43% | 71.43% | 71.43% 20s | 71.43% | 4043 ms | 12917 ms | 4043 ms | 12917 ms | — | — | 7 |
| — | thedrummer/cydonia-24b-v4.1 warming | parasail | 66.67% | 66.67% | 66.67% 20s | 66.67% | 1347 ms | 3230 ms | 1346 ms | 3230 ms | — | — | 3 |
| — | openai/gpt-5.6-sol-az warming | atlas-cloud | 66.67% | 66.67% | 66.67% 45s | 100.00% | 3403 ms | 4736 ms | 3403 ms | 4736 ms | — | — | 3 |
| — | z-ai/glm-5.1 warming | parasail | 60.00% | 60.00% | 60.00% 45s | 60.00% | 1058 ms | 2990 ms | 1058 ms | 2990 ms | — | — | 5 |
| — | qwen/qwen3.5-27b warming | siliconflow | 50.00% | 50.00% | 50.00% 20s | 100.00% | 1675 ms | 1675 ms | 1674 ms | 1674 ms | — | — | 2 |
| — | qwen/qwen3.5-122b-a10b warming | novita | 50.00% | 50.00% | 50.00% 20s | 50.00% | 4327 ms | 4327 ms | 4327 ms | 4327 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | chutes | 16.67% | 16.67% | 16.67% 45s | 16.67% | 10685 ms | 10685 ms | 10685 ms | 10685 ms | — | — | 6 |
| — | baidu/cobuddy warming | novita | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | alibaba | — | — | — | — | — | — | — | — | 69 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash warming | deepinfra | — | — | — | — | — | — | — | — | 62 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash warming | novita | — | — | — | — | — | — | — | — | 64 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash-0731 warming | atlas-cloud | — | — | — | — | — | — | — | — | 47 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash-0731 warming | together | — | — | — | — | — | — | — | — | 74 tok/s warming | 4 probe_config_error |
0 |
| — | deepseek/deepseek-v4-pro warming | alibaba | — | — | — | — | — | — | — | — | 40 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-pro warming | novita | — | — | — | — | — | — | — | — | 50 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-pro warming | together | — | — | — | — | — | — | — | — | 39 tok/s warming | 4 probe_config_error |
0 |
| — | google/diffusiongemma-26b-a4b-it warming | neurometric | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | — | 6 unsupported_route |
3 |
| — | google/gemini-3.1-pro-preview warming | atlas-cloud | — | — | — | — | — | — | — | — | 58 tok/s warming | — | 0 |
| — | google/gemma-3-12b-it warming | novita | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | — | — | 2 |
| — | google/gemma-4-31b-it warming | together | — | — | — | — | — | — | — | — | 48 tok/s warming | 1 probe_config_error |
0 |
| — | inclusionai/ling-3.0-flash warming | novita | — | — | — | — | — | — | — | — | 141 tok/s warming | — | 0 |
| — | mindai/macaron-v1-venti warming | novita | — | — | — | — | — | — | — | — | 8 tok/s warming | — | 0 |
| — | minimax/minimax-m3 warming | atlas-cloud | — | — | — | — | — | — | — | — | 69 tok/s warming | — | 0 |
| — | minimax/minimax-m3 warming | novita | — | — | — | — | — | — | — | — | 56 tok/s warming | — | 0 |
| — | minimax/minimax-m3 warming | parasail | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | — | — | 1 |
| — | minimax/minimax-m3 warming | siliconflow | — | — | — | — | — | — | — | — | 172 tok/s warming | — | 0 |
| — | moonshotai/kimi-k2.6 warming | deepinfra | — | — | — | — | — | — | — | — | 27 tok/s warming | — | 0 |
| — | moonshotai/kimi-k2.6 warming | novita | — | — | — | — | — | — | — | — | 35 tok/s warming | — | 0 |
| — | moonshotai/kimi-k2.6 warming | siliconflow | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | novita | — | — | — | — | — | — | — | — | 30 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | atlas-cloud | — | — | — | — | — | — | — | — | 23 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | makora | — | — | — | — | — | — | — | — | 74 tok/s warming | 9 probe_config_error |
0 |
| — | moonshotai/kimi-k3 warming | novita | — | — | — | — | — | — | — | — | 12 tok/s warming | — | 0 |
| — | openai/gpt-4.1-mini warming | atlas-cloud | — | — | — | — | — | — | — | — | 39 tok/s warming | — | 0 |
| — | openai/gpt-5.5 warming | atlas-cloud | — | — | — | — | — | — | — | — | 36 tok/s warming | — | 0 |
| — | openai/gpt-5.6-sol warming | atlas-cloud | — | — | — | — | — | — | — | — | 70 tok/s warming | — | 0 |
| — | openai/gpt-5.6-terra warming | atlas-cloud | — | — | — | — | — | — | — | — | 51 tok/s warming | — | 0 |
| — | openai/gpt-oss-120b warming | deepinfra | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 20 tok/s warming | — | 1 |
| — | openai/gpt-oss-120b warming | novita | — | — | — | — | — | — | — | — | 48 tok/s warming | — | 0 |
| — | qwen/qwen3-vl-flash-2026-01-22 warming | alibaba | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | — | — | 1 |
| — | qwen/qwen3.5-35b-a3b warming | parasail | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | — | 2 probe_config_error |
1 |
| — | qwen/qwen3.5-9b warming | together | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | — | 3 probe_config_error |
2 |
| — | qwen/qwen3.7-flash warming | alibaba | — | — | — | — | — | — | — | — | 128 tok/s warming | — | 0 |
| — | qwen/qwen3.8-max warming | atlas-cloud | — | — | — | — | — | — | — | — | 30 tok/s warming | — | 0 |
| — | tencent/hy3 warming | atlas-cloud | — | — | — | — | — | — | — | — | 54 tok/s warming | — | 0 |
| — | tencent/hy3 warming | novita | — | — | — | — | — | — | — | — | 101 tok/s warming | — | 0 |
| — | thinkingmachines/inkling-small warming | deepinfra | — | — | — | — | — | — | — | — | 114 tok/s warming | — | 0 |
| — | z-ai/glm-5.2 warming | alibaba | — | — | — | — | — | — | — | — | 31 tok/s warming | — | 0 |