Measured performance

Provider & model performance

Measured time-to-first-token, time-to-first-byte, effective throughput, and uptime for every LLM provider and model TrustedRouter routes to — continuously sampled, not vendor-claimed.

Last updated 2026-08-07T00:48:18.187Z

Video leaderboard

Continuously sampled from TrustedRouter's monitor regions using a rolling benchmark set of up to 10,000 samples. Time-to-first-token (TTFT), time-to-first-byte (TTFB), effective throughput, and success rate come from real streaming requests, not vendor claims. Completion rate shows the end-user result. Provider availability excludes failures owned by TrustedRouter, customers, or route configuration, while still reporting those failures under their actual owner. Capacity acceptance measures requests not rejected for provider overload. Effective throughput is provider-reported output tokens divided by complete request time, so buffered delivery cannot inflate the result. Unsupported route and probe-configuration rows are reported separately and do not count as provider downtime. No prompt or output content is ever stored.

Providers

Ranked by provider-attributed availability, then p50 time-to-first-token across all of a provider's models (43 providers · 2612 availability samples · 234 sustained throughput samples). Providers below the evidence floor remain visible as warming, but do not receive a rank.

#ProviderModels CompletionProvider availabilityWithin deadline Capacity acceptedp50 TTFTp95 TTFT Effective throughputFailure ownerConfig excludedSamples
1 deepseek 3 100.00% 100.00% 100.00% 100.00% 1217 ms 3702 ms 115 tok/s 228
2 friendli 6 100.00% 100.00% 98.28% 100.00% 1340 ms 7591 ms 95 tok/s 58
3 google-vertex 9 100.00% 100.00% 100.00% 100.00% 1384 ms 4850 ms 58 tok/s 54
4 cloudflare-workers-ai 14 100.00% 100.00% 100.00% 100.00% 1407 ms 4344 ms 25 tok/s 2 probe_config_error 31
5 grok 4 100.00% 100.00% 100.00% 100.00% 1454 ms 3252 ms 49 tok/s 53
6 baseten 12 100.00% 100.00% 100.00% 100.00% 1573 ms 4034 ms 83 tok/s 61
7 mistral 8 100.00% 100.00% 98.08% 100.00% 1607 ms 3383 ms 52
8 nebius 21 100.00% 100.00% 100.00% 100.00% 1720 ms 5211 ms 86 tok/s 1 unsupported_route 46
9 kimi 11 100.00% 100.00% 100.00% 100.00% 1743 ms 4178 ms 34 tok/s 66
10 minimax 6 100.00% 100.00% 100.00% 100.00% 1753 ms 3834 ms 69 tok/s 52
11 google-ai-studio 8 100.00% 100.00% 100.00% 100.00% 1784 ms 4597 ms 72 tok/s 57
12 telnyx 10 100.00% 100.00% 100.00% 100.00% 1797 ms 3820 ms 67 tok/s 40
13 crusoe 14 100.00% 100.00% 100.00% 100.00% 1815 ms 5359 ms 35 tok/s 62
14 engy 2 100.00% 100.00% 100.00% 100.00% 1853 ms 3749 ms 36 tok/s 62
15 venice 12 100.00% 100.00% 100.00% 100.00% 1961 ms 3770 ms 55 tok/s 61
16 wafer 5 100.00% 100.00% 100.00% 100.00% 2128 ms 11069 ms 76 tok/s 57
17 anthropic 10 100.00% 100.00% 100.00% 100.00% 2239 ms 5198 ms 58 tok/s 51
18 lightning 12 100.00% 100.00% 100.00% 100.00% 2249 ms 6388 ms 50 tok/s 57
19 inceptron 3 100.00% 100.00% 100.00% 100.00% 2330 ms 7975 ms 35
20 zai 11 100.00% 100.00% 98.11% 100.00% 2722 ms 14580 ms 50 tok/s 58
21 streamlake 3 100.00% 100.00% 100.00% 100.00% 2733 ms 4298 ms 129 tok/s 61
22 zero-g 3 100.00% 100.00% 100.00% 100.00% 2946 ms 4627 ms 50 tok/s 47
23 openai 20 100.00% 100.00% 100.00% 100.00% 3517 ms 4289 ms 51 tok/s 221
24 fireworks 11 98.55% 98.55% 97.10% 100.00% 2336 ms 7775 ms 48 tok/s provider 1 69
25 morph 8 98.39% 98.39% 95.16% 100.00% 2836 ms 14958 ms 65 tok/s provider 1 62
26 gmi 5 98.15% 98.15% 98.15% 100.00% 3449 ms 6198 ms 34 tok/s provider 1 54
27 deepinfra 37 98.11% 98.11% 98.08% 100.00% 1511 ms 10757 ms 38 tok/s provider 1 53
28 xiaomi 3 98.11% 98.11% 98.11% 98.11% 2614 ms 6016 ms 93 tok/s provider 1 53
29 atlas-cloud 46 98.08% 98.08% 98.00% 100.00% 2201 ms 10213 ms 54 tok/s provider 1 52
30 tinfoil 4 97.83% 97.83% 97.83% 100.00% 1654 ms 17042 ms 31 tok/s provider 1 46
31 alibaba 35 97.62% 97.62% 97.62% 100.00% 1959 ms 3263 ms 40 tok/s provider 1 42
32 phala 2 96.36% 96.36% 92.73% 100.00% 4046 ms 16041 ms 16 tok/s provider 2 55
33 siliconflow 23 96.23% 96.23% 96.23% 98.11% 2229 ms 8775 ms 32 tok/s provider 2 53
34 thinkingmachines 2 96.23% 96.23% 96.23% 100.00% 2373 ms 5270 ms 76 tok/s provider 2 53
35 digitalocean 21 95.38% 95.38% 95.38% 95.38% 1682 ms 5103 ms 39 tok/s provider 3 65
36 together 16 94.59% 94.59% 94.59% 100.00% 1391 ms 5161 ms 44 tok/s provider 2 15 probe_config_error 37
37 neurometric 6 94.12% 94.12% 94.12% 100.00% 1354 ms 3174 ms provider 3 6 unsupported_route 51
38 parasail 24 94.12% 94.12% 91.57% 95.10% 2688 ms 8054 ms 65 tok/s provider 6 2 probe_config_error 102
39 novita 43 91.11% 91.11% 91.11% 95.56% 1967 ms 4327 ms 41 tok/s provider 4 45
40 cerebras 6 90.32% 90.32% 89.66% 91.94% 1045 ms 6456 ms 208 tok/s provider 6 4 provider_error 62
41 chutes 10 90.00% 90.00% 90.00% 91.67% 2316 ms 10685 ms 27 tok/s provider 6 60
makora warming 4 100.00% 100.00% 100.00% 100.00% 1300 ms 3720 ms 106 tok/s 14 probe_config_error 27
kling warming 1 100.00% 100.00% 100.00% 1

Models

Qualified models are ranked by provider-attributed availability, then p50 TTFT. Thin availability and throughput measurements stay visible below the ranked set as warming.

#ModelProvider CompletionProvider availabilityWithin deadlineCapacity accepted p50 TTFTp95 TTFTp50 TTFBp95 TTFB Effective throughputConfig excludedSamples
1 minimax/minimax-m2.5 friendli 100.00% 100.00% 100.00% 20s 100.00% 861 ms 3148 ms 860 ms 3148 ms 14
2 z-ai/glm-5.1 wafer 100.00% 100.00% 100.00% 45s 100.00% 1198 ms 2737 ms 1198 ms 2737 ms 11
3 deepseek/deepseek-v4-flash-0731 deepseek 100.00% 100.00% 100.00% 20s 100.00% 1217 ms 3770 ms 1830 ms 3394 ms 136 tok/s warming 184
4 z-ai/glm-5.2 wafer 100.00% 100.00% 100.00% 45s 100.00% 1218 ms 8411 ms 1218 ms 8411 ms 12
5 ibm-granite/granite-4.1-8b neurometric 100.00% 100.00% 100.00% 20s 100.00% 1267 ms 3170 ms 1267 ms 3169 ms 15
6 x-ai/grok-build-0.1 grok 100.00% 100.00% 100.00% 20s 100.00% 1275 ms 2766 ms 1275 ms 2766 ms 16
7 z-ai/glm-5.1 friendli 100.00% 100.00% 100.00% 45s 100.00% 1340 ms 4190 ms 1340 ms 4190 ms 10
8 qwen/qwen3-vl-8b-thinking neurometric 100.00% 100.00% 100.00% 45s 100.00% 1354 ms 3992 ms 1353 ms 3991 ms 14
9 qwen/qwen-2.5-7b-instruct together 100.00% 100.00% 100.00% 20s 100.00% 1391 ms 3766 ms 1391 ms 3766 ms 10
10 x-ai/grok-4.20 grok 100.00% 100.00% 100.00% 20s 100.00% 1454 ms 3002 ms 1453 ms 3002 ms 11
11 deepseek/deepseek-v4-flash deepseek 100.00% 100.00% 100.00% 20s 100.00% 1524 ms 3802 ms 1523 ms 3802 ms 115 tok/s warming 21
12 x-ai/grok-4.5 grok 100.00% 100.00% 100.00% 20s 100.00% 1616 ms 3252 ms 1616 ms 3252 ms 49 tok/s warming 14
13 moonshotai/kimi-k2.7-code inceptron 100.00% 100.00% 100.00% 20s 100.00% 1635 ms 3112 ms 1635 ms 3112 ms 10
14 openai/gpt-oss-120b tinfoil 100.00% 100.00% 100.00% 20s 100.00% 1654 ms 5292 ms 1653 ms 5292 ms 52 tok/s warming 14
15 z-ai/glm-5.2 engy 100.00% 100.00% 100.00% 45s 100.00% 1721 ms 3411 ms 1720 ms 3411 ms 36 tok/s warming 26
16 minimax/minimax-m2.7-highspeed minimax 100.00% 100.00% 100.00% 20s 100.00% 1753 ms 3648 ms 1752 ms 3648 ms 10
17 minimax/minimax-m3 minimax 100.00% 100.00% 100.00% 20s 100.00% 1753 ms 4383 ms 1753 ms 4383 ms 69 tok/s warming 13
18 z-ai/glm-4.7 venice 100.00% 100.00% 100.00% 20s 100.00% 1835 ms 3260 ms 1835 ms 3260 ms 13
19 deepseek/deepseek-v4-pro deepseek 100.00% 100.00% 100.00% 20s 100.00% 1839 ms 3255 ms 1839 ms 3255 ms 90 tok/s warming 23
20 qwen/qwen3.6-35b-a3b engy 100.00% 100.00% 100.00% 20s 100.00% 1853 ms 3910 ms 1853 ms 3909 ms 36
21 z-ai/glm-5.2 makora 100.00% 100.00% 100.00% 45s 100.00% 1862 ms 3720 ms 1862 ms 3720 ms 11
22 deepseek/deepseek-v4-pro fireworks 100.00% 100.00% 100.00% 20s 100.00% 1867 ms 2994 ms 1867 ms 2994 ms 36 tok/s warming 11
23 moonshotai/moonshot-v1-32k kimi 100.00% 100.00% 100.00% 20s 100.00% 1940 ms 3067 ms 1940 ms 3067 ms 11
24 kwaipilot/kat-coder-pro-v2 streamlake 100.00% 100.00% 100.00% 20s 100.00% 1983 ms 3471 ms 1983 ms 3470 ms 15
25 minimax/minimax-m2.1-highspeed minimax 100.00% 100.00% 100.00% 20s 100.00% 2106 ms 3552 ms 2106 ms 3552 ms 11
26 moonshotai/kimi-k2.6 wafer 100.00% 100.00% 100.00% 20s 100.00% 2128 ms 11069 ms 2128 ms 11069 ms 34 tok/s warming 11
27 qwen/qwen3-235b-a22b-thinking-2507 chutes 100.00% 100.00% 100.00% 45s 100.00% 2181 ms 4093 ms 2181 ms 4093 ms 10
28 cerebras/gpt-oss-120b cerebras 100.00% 100.00% 100.00% 15s 100.00% 2210 ms 6456 ms 1426 ms 6456 ms 431 tok/s warming 11
29 z-ai/glm-5.1 gmi 100.00% 100.00% 100.00% 45s 100.00% 2239 ms 4021 ms 2238 ms 4021 ms 10
30 z-ai/glm-5.2 phala 100.00% 100.00% 100.00% 45s 100.00% 2244 ms 4392 ms 2244 ms 4392 ms 32 tok/s warming 21
31 moonshotai/kimi-k2.6 inceptron 100.00% 100.00% 100.00% 20s 100.00% 2330 ms 11343 ms 2330 ms 11343 ms 15
32 thinkingmachines/inkling-small thinkingmachines 100.00% 100.00% 100.00% 45s 100.00% 2373 ms 4300 ms 2373 ms 4300 ms 104 tok/s warming 30
33 zero-g/0gm-1.0-35b-a3b zero-g 100.00% 100.00% 100.00% 20s 100.00% 2430 ms 4457 ms 2430 ms 4457 ms 13
34 x-ai/grok-4.3 grok 100.00% 100.00% 100.00% 20s 100.00% 2581 ms 4317 ms 2581 ms 4316 ms 12
35 xiaomi/mimo-v2.5 xiaomi 100.00% 100.00% 100.00% 20s 100.00% 2614 ms 10042 ms 2613 ms 10042 ms 19
36 kwaipilot/kat-coder-pro-v2.5 streamlake 100.00% 100.00% 100.00% 20s 100.00% 2733 ms 4082 ms 2733 ms 4082 ms 21
37 z-ai/glm-5.2 morph 100.00% 100.00% 100.00% 45s 100.00% 2836 ms 4318 ms 2835 ms 4318 ms 28 tok/s warming 11
38 google/gemma-4-31b-it tinfoil 100.00% 100.00% 100.00% 20s 100.00% 2875 ms 7101 ms 2875 ms 7101 ms 31 tok/s warming 14
39 z-ai/glm-5.2 zero-g 100.00% 100.00% 100.00% 45s 100.00% 2946 ms 5285 ms 2946 ms 5285 ms 50 tok/s warming 21
40 kwaipilot/kat-coder-air-v2.5 streamlake 100.00% 100.00% 100.00% 20s 100.00% 2952 ms 5139 ms 2952 ms 5139 ms 129 tok/s warming 25
41 xiaomi/mimo-v2.5-pro xiaomi 100.00% 100.00% 100.00% 20s 100.00% 3122 ms 4611 ms 3122 ms 4611 ms 58 tok/s warming 17
42 google/gemma-4-31b-it friendli 100.00% 100.00% 91.67% 20s 100.00% 3145 ms 20976 ms 3145 ms 20976 ms 95 tok/s warming 12
43 z-ai/glm-5.2-fast wafer 100.00% 100.00% 100.00% 45s 100.00% 3263 ms 11483 ms 3262 ms 11483 ms 226 tok/s warming 12
44 minimax/minimax-m3 wafer 100.00% 100.00% 100.00% 20s 100.00% 3386 ms 13116 ms 3386 ms 13115 ms 117 tok/s warming 11
45 deepseek/deepseek-v4-pro gmi 100.00% 100.00% 100.00% 20s 100.00% 3449 ms 6117 ms 3449 ms 6117 ms 34 tok/s warming 17
46 zero-g/0gm-1.0-35b-a3b-sia zero-g 100.00% 100.00% 100.00% 20s 100.00% 3466 ms 4418 ms 3466 ms 4418 ms 13
47 z-ai/glm-5.2 gmi 100.00% 100.00% 100.00% 45s 100.00% 3469 ms 4535 ms 3468 ms 4535 ms 37 tok/s warming 12
48 openai/gpt-5-nano openai 100.00% 100.00% 100.00% 20s 100.00% 3517 ms 4289 ms 3517 ms 4289 ms 159
49 qwen/qwen3.6-27b morph 100.00% 100.00% 100.00% 20s 100.00% 4004 ms 14958 ms 4004 ms 14958 ms 10
50 google/gemini-2.5-pro lightning 100.00% 100.00% 100.00% 20s 100.00% 4229 ms 6787 ms 4229 ms 6787 ms 11
51 z-ai/glm-5.2 inceptron 100.00% 100.00% 100.00% 45s 100.00% 4519 ms 7975 ms 4519 ms 7974 ms 10
52 z-ai/glm-5.2 parasail 97.50% 97.50% 95.24% 45s 100.00% 3597 ms 7445 ms 1327 ms 1601 ms 29 tok/s warming 40
53 xiaomi/mimo-v2.5-pro-ultraspeed xiaomi 94.12% 94.12% 94.12% 20s 94.12% 2489 ms 5787 ms 2489 ms 5787 ms 93 tok/s warming 17
54 moonshotai/kimi-k3 phala 94.12% 94.12% 88.24% 20s 100.00% 4046 ms 24017 ms 4046 ms 24017 ms 16 tok/s warming 34
55 qwen/qwen3.5-397b-a17b morph 91.67% 91.67% 91.67% 20s 100.00% 3542 ms 19289 ms 3541 ms 19289 ms 12
56 thinkingmachines/inkling thinkingmachines 91.30% 91.30% 91.30% 45s 100.00% 2531 ms 5967 ms 2531 ms 5966 ms 49 tok/s warming 23
57 google/gemma-4-31b-it cerebras 90.91% 90.91% 90.91% 20s 90.91% 2226 ms 10309 ms 2226 ms 10309 ms 27 tok/s warming 11
58 moonshotai/kimi-k3 gmi 90.91% 90.91% 90.91% 20s 100.00% 5581 ms 15425 ms 5580 ms 15425 ms 25 tok/s warming 11
59 z-ai/glm-4.7 cerebras 85.71% 85.71% 85.71% 20s 85.71% 890 ms 5685 ms 890 ms 5685 ms 14
60 cerebras/zai-glm-4.7 cerebras 83.33% 83.33% 83.33% 15s 91.67% 894 ms 3397 ms 894 ms 3397 ms 38 tok/s warming 4 provider_error 12
meta-llama/llama-3.3-70b-instruct warming together 100.00% 100.00% 100.00% 20s 100.00% 359 ms 3627 ms 358 ms 3626 ms 2
qwen/qwen3-14b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 395 ms 395 ms 395 ms 395 ms 1
qwen/qwen2.5-vl-72b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 537 ms 4850 ms 537 ms 4850 ms 2
microsoft/phi-4 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 589 ms 653 ms 589 ms 653 ms 2
meta-llama/llama-4-scout-17b-16e-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 598 ms 1059 ms 598 ms 1059 ms 2
meta-llama/llama-3.1-8b-instruct-fp8 warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 713 ms 713 ms 713 ms 713 ms 1
thinkingmachines/inkling-small warming baseten 100.00% 100.00% 100.00% 45s 100.00% 725 ms 1153 ms 725 ms 1153 ms 223 tok/s warming 3
nvidia/nemotron-3-nano-omni warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 727 ms 1429 ms 727 ms 1428 ms 2
Qwen/Qwen2.5-VL-72B-Instruct warming nebius 100.00% 100.00% 100.00% 20s 100.00% 761 ms 2771 ms 760 ms 2771 ms 2
openai/gpt-oss-120b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 766 ms 766 ms 766 ms 766 ms 51 tok/s warming 1
moonshotai/kimi-k3 warming together 100.00% 100.00% 100.00% 20s 100.00% 768 ms 3250 ms 768 ms 3250 ms 25 tok/s warming 2
qwen/qwen3-235b-a22b-instruct-2507 warming novita 100.00% 100.00% 100.00% 20s 100.00% 813 ms 2201 ms 813 ms 2201 ms 2
google/gemma-3-27b-it warming nebius 100.00% 100.00% 100.00% 20s 100.00% 819 ms 819 ms 819 ms 819 ms 1
moonshotai/kimi-k2.6 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 827 ms 3435 ms 827 ms 3435 ms 46 tok/s warming 6
meta-llama/llama-3.3-70b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 833 ms 1710 ms 833 ms 1710 ms 3
qwen/qwen3.6-27b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 837 ms 2866 ms 836 ms 2865 ms 2
google/gemini-3.5-flash-lite warming google-ai-studio 100.00% 100.00% 100.00% 15s 100.00% 850 ms 2984 ms 850 ms 2983 ms 9
meta-llama/llama-3.1-70b-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 850 ms 850 ms 850 ms 850 ms 1
moonshotai/kimi-k2.7-code warming parasail 100.00% 100.00% 100.00% 20s 100.00% 872 ms 872 ms 871 ms 871 ms 1
moonshotai/kimi-k2.7-code warming baseten 100.00% 100.00% 100.00% 20s 100.00% 892 ms 2857 ms 892 ms 2856 ms 178 tok/s warming 6
openai/gpt-5.6-sol warming openai 100.00% 100.00% 100.00% 45s 100.00% 917 ms 2725 ms 917 ms 2725 ms 73 tok/s warming 2
google/gemma-2b-it warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 923 ms 3148 ms 922 ms 3148 ms 4
google/gemma-3n-e4b-it warming together 100.00% 100.00% 100.00% 20s 100.00% 927 ms 927 ms 927 ms 927 ms 1
qwen/qwen3-235b-a22b-thinking-2507 warming deepinfra 100.00% 100.00% 100.00% 45s 100.00% 929 ms 2772 ms 929 ms 2772 ms 2
google/gemma-4-31b-it warming novita 100.00% 100.00% 100.00% 20s 100.00% 949 ms 1730 ms 949 ms 1730 ms 20 tok/s warming 2
google/gemma-4-31b-it warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 952 ms 7244 ms 952 ms 7244 ms 32 tok/s warming 4
openai/gpt-4.1 warming openai 100.00% 100.00% 100.00% 20s 100.00% 952 ms 2142 ms 952 ms 2142 ms 3
mistralai/mistral-nemo warming mistral 100.00% 100.00% 100.00% 20s 100.00% 962 ms 2634 ms 962 ms 2634 ms 7
deepseek/deepseek-ocr-2 warming novita 100.00% 100.00% 100.00% 20s 100.00% 966 ms 966 ms 966 ms 966 ms 1
moonshotai/kimi-k2.6 warming parasail 100.00% 100.00% 100.00% 20s 100.00% 975 ms 5455 ms 975 ms 5455 ms 2
nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 979 ms 979 ms 979 ms 979 ms 1
nvidia/nemotron-3-ultra-550b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 981 ms 981 ms 980 ms 980 ms 1
qwen/qwen3-coder-next warming parasail 100.00% 100.00% 100.00% 20s 100.00% 982 ms 982 ms 982 ms 982 ms 1
minimax/minimax-m3 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1022 ms 1500 ms 1022 ms 1500 ms 22 tok/s warming 3
openai/gpt-oss-120b warming cerebras 100.00% 100.00% 100.00% 20s 100.00% 1045 ms 2629 ms 1045 ms 2629 ms 208 tok/s warming 7
openai/gpt-5.6-terra warming openai 100.00% 100.00% 100.00% 45s 100.00% 1047 ms 1047 ms 1046 ms 1046 ms 40 tok/s warming 1
mistralai/codestral-2508 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1062 ms 2728 ms 1062 ms 2728 ms 9
x-ai/grok-4.5 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1062 ms 1062 ms 1061 ms 1061 ms 66 tok/s warming 1
moonshotai/kimi-k2-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 1070 ms 1070 ms 1070 ms 1070 ms 1
deepseek/deepseek-v4-flash warming makora 100.00% 100.00% 100.00% 20s 100.00% 1077 ms 3175 ms 1077 ms 3174 ms 106 tok/s warming 5 probe_config_error 8
moonshotai/kimi-k2.7-code warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1091 ms 1416 ms 1091 ms 1416 ms 32 tok/s warming 3
openai/gpt-oss-120b warming together 100.00% 100.00% 100.00% 20s 100.00% 1100 ms 12306 ms 1100 ms 12306 ms 55 tok/s warming 2
arcee-ai/trinity-large-thinking warming parasail 100.00% 100.00% 100.00% 45s 100.00% 1138 ms 1138 ms 1138 ms 1138 ms 1
google/gemini-3.6-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1150 ms 3648 ms 1150 ms 3648 ms 47 tok/s warming 9
thinkingmachines/inkling warming deepinfra 100.00% 100.00% 100.00% 45s 100.00% 1172 ms 1314 ms 1172 ms 1314 ms 38 tok/s warming 2
z-ai/glm-5.2 warming friendli 100.00% 100.00% 100.00% 45s 100.00% 1173 ms 1587 ms 1173 ms 1587 ms 169 tok/s warming 7
nvidia/nemotron-3-nano-30b-a3b warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1184 ms 4025 ms 1184 ms 4025 ms 6
google/gemma-4-26b-a4b-it warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1185 ms 8900 ms 1185 ms 8900 ms 8
nvidia/nemotron-3-ultra-550b-a55b warming together 100.00% 100.00% 100.00% 20s 100.00% 1191 ms 2593 ms 1190 ms 2592 ms 20 tok/s warming 2
moonshotai/kimi-k2.5 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1197 ms 2763 ms 1197 ms 2763 ms 3
mistralai/ministral-3-14b-instruct warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1210 ms 1394 ms 1210 ms 1394 ms 2
openai/gpt-oss-120b warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1212 ms 1474 ms 1212 ms 1474 ms 34 tok/s warming 3
meta-llama/llama-3.3-70b-instruct warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1216 ms 3266 ms 1215 ms 3266 ms 2
deepseek/deepseek-v4-flash-0731 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1222 ms 1486 ms 1222 ms 1486 ms 86 tok/s warming 2
openai/gpt-4 warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1229 ms 2100 ms 1229 ms 2100 ms 6
minimax/minimax-m3 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1232 ms 2651 ms 1231 ms 2651 ms 81 tok/s warming 4
moonshotai/moonshot-v1-32k-vision-preview warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1233 ms 3022 ms 1233 ms 3022 ms 8
deepseek/deepseek-r1-distill-llama-70b warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 1236 ms 1236 ms 1235 ms 1235 ms 1
z-ai/glm-4.6v warming zai 100.00% 100.00% 100.00% 20s 100.00% 1238 ms 4381 ms 1237 ms 4381 ms 2
meta-llama/llama-3.3-70b-instruct-fp8-fast warming cloudflare-workers-ai 100.00% 100.00% 100.00% 15s 100.00% 1247 ms 1247 ms 1247 ms 1247 ms 1
qwen/qwen3.5-397b-a17b warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1254 ms 1254 ms 1254 ms 1254 ms 1
moonshotai/kimi-k2.7-code warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1257 ms 1257 ms 1257 ms 1257 ms 26 tok/s warming 1
yutori/n1.5 warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1258 ms 3816 ms 1258 ms 3816 ms 6
openai/o4-mini warming openai 100.00% 100.00% 100.00% 45s 100.00% 1266 ms 3515 ms 1266 ms 3514 ms 4
deepseek/deepseek-v4-pro warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1267 ms 1754 ms 1266 ms 1754 ms 59 tok/s warming 7
bytedance/doubao-seed-1.6-flash-250828 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1268 ms 1268 ms 1268 ms 1268 ms 1
google/gemini-3-flash-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1271 ms 3186 ms 1271 ms 3186 ms 9
qwen/qwen3-coder-30b-a3b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1280 ms 1280 ms 1280 ms 1280 ms 1
z-ai/glm-5.2-fast warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 1287 ms 4190 ms 1287 ms 4190 ms 59 tok/s warming 6
google/gemma-4-26b-a4b-it warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1294 ms 1508 ms 1294 ms 1508 ms 3
z-ai/glm-5.2-nvfp4 warming makora 100.00% 100.00% 100.00% 45s 100.00% 1300 ms 5169 ms 1300 ms 5169 ms 8
google/gemini-2.5-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 1304 ms 3258 ms 1304 ms 3257 ms 5
openai/gpt-oss-20b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1305 ms 1414 ms 1305 ms 1413 ms 5
google/gemini-3.5-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 1327 ms 2870 ms 1327 ms 2870 ms 93 tok/s warming 9
z-ai/glm-4.7 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1327 ms 1327 ms 1327 ms 1327 ms 1
google/gemma-4-31b-it warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1328 ms 2836 ms 1327 ms 2836 ms 63 tok/s warming 3
openai/gpt-oss-20b warming together 100.00% 100.00% 100.00% 20s 100.00% 1331 ms 2598 ms 1331 ms 2597 ms 2
qwen/qwen3-32b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1338 ms 3325 ms 1338 ms 3325 ms 6
zai-org/glm-4.5v warming novita 100.00% 100.00% 100.00% 20s 100.00% 1338 ms 3107 ms 1338 ms 3107 ms 2
qwen/qwen3.5-397b-a17b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1358 ms 1358 ms 1358 ms 1358 ms 1
z-ai/glm-4.6 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1364 ms 2042 ms 1364 ms 2042 ms 2
moonshotai/moonshot-v1-128k-vision-preview warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1373 ms 2598 ms 1373 ms 2597 ms 6
minimax/minimax-m2 warming minimax 100.00% 100.00% 100.00% 20s 100.00% 1383 ms 3139 ms 1383 ms 3139 ms 8
google/gemini-2.5-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1384 ms 1501 ms 1384 ms 1501 ms 5
moonshotai/kimi-k3 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1385 ms 2155 ms 1385 ms 2155 ms 33 tok/s warming 6
mistralai/mistral-large warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1387 ms 2408 ms 1387 ms 2408 ms 4
meta-llama/llama-4-maverick warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1388 ms 2735 ms 1388 ms 2735 ms 4
qwen/qwen3.5-35b-a3b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1390 ms 1390 ms 1390 ms 1390 ms 1
google/gemma-3-4b-it warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1391 ms 1391 ms 1391 ms 1391 ms 1
qwen/qwen3-coder-flash warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1395 ms 2668 ms 1395 ms 2668 ms 2
Qwen/Qwen3-32B warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1401 ms 2133 ms 1401 ms 2133 ms 4
openai/gpt-4 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1401 ms 3708 ms 1401 ms 3708 ms 3
meta-llama/llama-3.2-3b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1402 ms 3177 ms 1402 ms 3177 ms 3
ibm-granite/granite-4.0-h-micro warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1407 ms 3347 ms 1406 ms 3347 ms 3
qwen/qwen3-235b-a22b-thinking-2507 warming venice 100.00% 100.00% 100.00% 45s 100.00% 1407 ms 2957 ms 1407 ms 2957 ms 4
minimax/minimax-m3 warming together 100.00% 100.00% 100.00% 20s 100.00% 1409 ms 1409 ms 1409 ms 1409 ms 38 tok/s warming 3 probe_config_error 1
openai/gpt-4o-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 1415 ms 1415 ms 1415 ms 1415 ms 2
deepseek-ai/DeepSeek-V4-Pro warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1423 ms 1524 ms 1423 ms 1524 ms 2
openai/gpt-4.1-nano warming openai 100.00% 100.00% 100.00% 20s 100.00% 1426 ms 1564 ms 1425 ms 1564 ms 14
openai/gpt-5.6-luna warming openai 100.00% 100.00% 100.00% 45s 100.00% 1426 ms 3043 ms 1426 ms 3043 ms 61 tok/s warming 3
qwen/qwen3.6-35b-a3b warming novita 100.00% 100.00% 100.00% 20s 100.00% 1428 ms 1428 ms 1428 ms 1428 ms 1
nvidia/nemotron-3-120b-a12b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1441 ms 2540 ms 1441 ms 2539 ms 3
deepseek/deepseek-v4-pro warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1443 ms 1757 ms 1443 ms 1757 ms 97 tok/s warming 2
qwen/qwen3-30b-a3b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1447 ms 1447 ms 1446 ms 1446 ms 1
openai/gpt-4o warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1455 ms 2540 ms 1455 ms 2540 ms 2
qwen/qwen3-30b-a3b-fp8 warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1466 ms 1466 ms 1465 ms 1465 ms 1
z-ai/glm-4.5v warming zai 100.00% 100.00% 100.00% 20s 100.00% 1466 ms 3746 ms 1466 ms 3745 ms 8
z-ai/glm-5 warming atlas-cloud 100.00% 100.00% 100.00% 45s 100.00% 1466 ms 1466 ms 1466 ms 1466 ms 1
qwen/qwen3.5-9b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1469 ms 1469 ms 1469 ms 1469 ms 1
meta-llama/llama-3.3-70b-instruct warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1474 ms 3602 ms 1474 ms 3602 ms 6
google/gemma-4-e2b-it warming neurometric 100.00% 100.00% 100.00% 20s 100.00% 1478 ms 3174 ms 1478 ms 3173 ms 9
z-ai/glm-5.1 warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 1479 ms 2685 ms 1479 ms 2685 ms 4
qwen/qwen3.5-35b-a3b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1480 ms 1633 ms 1480 ms 1632 ms 2
google/gemma-4-12b-it warming neurometric 100.00% 100.00% 100.00% 20s 100.00% 1490 ms 1512 ms 1489 ms 1512 ms 3
z-ai/glm-4.7-flash warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1490 ms 3110 ms 1490 ms 3110 ms 2
z-ai/glm-5v-turbo warming atlas-cloud 100.00% 100.00% 100.00% 45s 100.00% 1494 ms 1494 ms 1494 ms 1494 ms 1
qwen/qwen3-vl-8b-instruct warming neurometric 100.00% 100.00% 100.00% 20s 100.00% 1499 ms 2937 ms 1499 ms 2937 ms 7
qwen/qwen3-vl-235b-a22b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1500 ms 1500 ms 1499 ms 1499 ms 1
z-ai/glm-4.6 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1511 ms 2834 ms 1511 ms 2834 ms 2
meta-llama/llama-3.3-70b-instruct warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1513 ms 2926 ms 1513 ms 2925 ms 3
qwen/qwen3.6-35b-a3b warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1514 ms 1514 ms 1514 ms 1514 ms 1
google/gemini-3.1-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 1516 ms 3049 ms 1516 ms 3049 ms 6
z-ai/glm-5 warming venice 100.00% 100.00% 100.00% 45s 100.00% 1518 ms 3144 ms 1518 ms 3144 ms 4
thedrummer/skyfall-36b-v2 warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1521 ms 3803 ms 1521 ms 3803 ms 4
deepseek/deepseek-v3.1 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1524 ms 2008 ms 1524 ms 2007 ms 2
openai/gpt-5.1 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1525 ms 3150 ms 1525 ms 3150 ms 3
kwaipilot/kat-coder-air-v2.5 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1527 ms 1527 ms 1526 ms 1526 ms 1
openai/gpt-oss-120b warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 1532 ms 3666 ms 1532 ms 3665 ms 66 tok/s warming 4
deepseek/deepseek-v4-flash-0731 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1533 ms 1710 ms 1533 ms 1710 ms 57 tok/s warming 3
anthropic/claude-sonnet-4.6 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 1537 ms 2963 ms 1536 ms 2962 ms 44 tok/s warming 4
qwen/qwen3.5-9b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1542 ms 3158 ms 1542 ms 3158 ms 5
moonshotai/moonshot-v1-8k-vision-preview warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1544 ms 2675 ms 1543 ms 2675 ms 5
moonshotai/moonshot-v1-8k warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1545 ms 1919 ms 1545 ms 1919 ms 2
qwen/qwen3-max-2025-09-23 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1552 ms 1552 ms 1552 ms 1552 ms 1
openai/gpt-oss-120b warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1553 ms 2584 ms 1553 ms 2584 ms 82 tok/s warming 6
meta-llama/llama-3.3-70b-instruct warming tinfoil 100.00% 100.00% 100.00% 20s 100.00% 1566 ms 3669 ms 1566 ms 3669 ms 9
z-ai/glm-4.7 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1573 ms 2864 ms 1573 ms 2864 ms 3
deepseek/deepseek-v4-flash warming parasail 100.00% 100.00% 50.00% 20s 100.00% 1575 ms 20850 ms 1575 ms 20850 ms 81 tok/s warming 2
google/gemma-4-26b-a4b-it warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1576 ms 4344 ms 1576 ms 4344 ms 2 probe_config_error 4
google/gemini-3.6-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1579 ms 4597 ms 1579 ms 4597 ms 6
qwen/qwen3-next-80b-a3b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1581 ms 2707 ms 1581 ms 2707 ms 3
morph/morph-v3-large warming morph 100.00% 100.00% 100.00% 20s 100.00% 1582 ms 3748 ms 1582 ms 3747 ms 6
openbmb/MiniCPM-V-4_5 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1585 ms 2410 ms 1585 ms 2409 ms 87 tok/s warming 3
google/gemini-3-flash-preview warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1591 ms 3408 ms 1591 ms 3407 ms 5
qwen/qwen3.5-plus warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1593 ms 2716 ms 1593 ms 2716 ms 3
zai-org/glm-4.7 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1603 ms 1603 ms 1603 ms 1603 ms 1
openai/gpt-oss-20b warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1606 ms 1869 ms 1606 ms 1869 ms 3
mistralai/mistral-small-2603 warming mistral 100.00% 100.00% 87.50% 20s 100.00% 1607 ms 22691 ms 1607 ms 22691 ms 8
deepseek/deepseek-v3-0324 warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1608 ms 4002 ms 1608 ms 4001 ms 2
bytedance/ui-tars-1.5-7b warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1626 ms 3051 ms 1625 ms 3051 ms 4
deepseek/deepseek-v4-pro warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1627 ms 10336 ms 1626 ms 10336 ms 77 tok/s warming 6
openai/gpt-5.4-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 1629 ms 3071 ms 1629 ms 3071 ms 2
qwen/qwen-plus-character warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1639 ms 1639 ms 1639 ms 1639 ms 29 tok/s warming 1
deepseek/deepseek-v4-flash warming morph 100.00% 100.00% 66.67% 20s 100.00% 1646 ms 22617 ms 1646 ms 22617 ms 65 tok/s warming 6
qwen/qwen3-32b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1646 ms 1646 ms 1646 ms 1646 ms 1
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1649 ms 2706 ms 1649 ms 2706 ms 2
nvidia/nemotron-3-nano-omni-reasoning-30b-a3b warming crusoe 100.00% 100.00% 100.00% 45s 100.00% 1658 ms 4209 ms 1657 ms 4209 ms 3
xiaomimimo/mimo-v2.5-pro warming novita 100.00% 100.00% 100.00% 20s 100.00% 1661 ms 1661 ms 1661 ms 1661 ms 1
z-ai/glm-5.2 warming together 100.00% 100.00% 100.00% 45s 100.00% 1662 ms 2782 ms 1662 ms 2782 ms 2
moonshotai/Kimi-K2.7-Code warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1665 ms 4397 ms 1665 ms 4397 ms 4
qwen/qwen3-8b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1665 ms 1665 ms 1665 ms 1665 ms 1
google/gemma-3-27b-it warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1681 ms 1681 ms 1681 ms 1681 ms 1
qwen/qwen3.5-397b-a17b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1682 ms 3993 ms 1681 ms 3993 ms 6
mistralai/mistral-nemo warming chutes 100.00% 100.00% 100.00% 20s 100.00% 1684 ms 3348 ms 1684 ms 3348 ms 9
minimax/minimax-m3 warming morph 100.00% 100.00% 100.00% 20s 100.00% 1687 ms 3524 ms 1687 ms 3524 ms 4
qwen/qwen-vl-ocr warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1691 ms 1691 ms 1691 ms 1691 ms 1
meta-llama/llama-3.3-70b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1700 ms 2737 ms 1700 ms 2736 ms 3
moonshotai/kimi-k2.5 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1704 ms 1763 ms 1704 ms 1763 ms 3
sao10k/l3-8b-lunaris warming novita 100.00% 100.00% 100.00% 20s 100.00% 1708 ms 1708 ms 1707 ms 1707 ms 1
z-ai/glm-5 warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 1709 ms 3679 ms 1709 ms 3678 ms 8
moonshotai/Kimi-K2.6 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1720 ms 3951 ms 1720 ms 3951 ms 2
moonshotai/kimi-k2.7-code-highspeed warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1722 ms 4654 ms 1722 ms 4654 ms 4
z-ai/glm-5-turbo warming atlas-cloud 100.00% 100.00% 100.00% 45s 100.00% 1732 ms 2910 ms 1732 ms 2910 ms 2
moonshotai/kimi-k2.6 warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1737 ms 2385 ms 1737 ms 2384 ms 34 tok/s warming 5
openai/gpt-5.2 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1737 ms 2944 ms 1737 ms 2944 ms 3
anthropic/claude-opus-4.8 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 1740 ms 3645 ms 1740 ms 3644 ms 58 tok/s warming 6
meta-llama/llama-3.1-70b-instruct warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1742 ms 2721 ms 1742 ms 2721 ms 3
thinkingmachines/inkling warming together 100.00% 100.00% 100.00% 45s 100.00% 1742 ms 3507 ms 1742 ms 3506 ms 76 tok/s warming 4
moonshotai/moonshot-v1-128k warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1743 ms 3230 ms 1742 ms 3230 ms 4
qwen/qwen3-vl-8b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 1750 ms 1750 ms 1749 ms 1749 ms 1
deepseek/deepseek-v4-flash-0731 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1767 ms 2630 ms 1766 ms 2630 ms 145 tok/s warming 5
deepseek/deepseek-v4-flash warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1773 ms 3552 ms 1773 ms 3552 ms 35 tok/s warming 3
qwen/qwen-mt-lite warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1773 ms 1773 ms 1773 ms 1773 ms 1
qwen/qwen3.5-27b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1777 ms 1777 ms 1776 ms 1776 ms 1
z-ai/glm-5.2 warming deepinfra 100.00% 100.00% 100.00% 45s 100.00% 1777 ms 27546 ms 1777 ms 27546 ms 34 tok/s warming 2
google/gemini-3.1-flash-image-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1784 ms 4074 ms 1784 ms 4074 ms 7
qwen/qwen3.7-plus warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1786 ms 1786 ms 1786 ms 1786 ms 1
zai-org/glm-4.7-flash warming novita 100.00% 100.00% 100.00% 20s 100.00% 1787 ms 1787 ms 1787 ms 1787 ms 1
moonshotai/kimi-k2.5 warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1794 ms 3173 ms 1794 ms 3173 ms 6
z-ai/glm-5.2 warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 1797 ms 2722 ms 1797 ms 2722 ms 157 tok/s warming 4
moonshotai/kimi-k3 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1801 ms 1801 ms 1801 ms 1801 ms 62 tok/s warming 1
deepseek/deepseek-v4-pro warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 1815 ms 3730 ms 1815 ms 3730 ms 42 tok/s warming 6
google/gemini-2.5-flash warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1819 ms 3203 ms 1819 ms 3203 ms 7
z-ai/glm-5.2 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 1820 ms 2917 ms 1820 ms 2917 ms 31 tok/s warming 3
openai/gpt-4.1-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 1832 ms 2026 ms 1832 ms 2026 ms 33 tok/s warming 4
qwen/qwen3-coder-flash-2025-07-28 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1845 ms 1845 ms 1845 ms 1845 ms 1
google/gemma-4-31b-it warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1847 ms 1847 ms 1847 ms 1847 ms 25 tok/s warming 1
qwen/qwen3-coder-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1853 ms 1934 ms 1853 ms 1934 ms 2
nvidia/nemotron-3-ultra-550b-a55b warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1859 ms 2783 ms 1859 ms 2783 ms 105 tok/s warming 1 unsupported_route 3
qwen/qwen-mt-plus warming novita 100.00% 100.00% 100.00% 20s 100.00% 1859 ms 3072 ms 1858 ms 3072 ms 2
openai/gpt-oss-20b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1874 ms 1874 ms 1873 ms 1873 ms 1
z-ai/glm-5.1 warming venice 100.00% 100.00% 100.00% 45s 100.00% 1882 ms 3557 ms 1882 ms 3557 ms 4
google/gemini-2.5-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1888 ms 3065 ms 1888 ms 3065 ms 8
deepseek/deepseek-v3.2-exp warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1892 ms 1892 ms 1892 ms 1892 ms 1
openai/gpt-5.6-luna warming atlas-cloud 100.00% 100.00% 100.00% 45s 100.00% 1904 ms 1904 ms 1904 ms 1904 ms 63 tok/s warming 1
qwen/qwen3-30b-a3b-thinking-2507 warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 1904 ms 2649 ms 1904 ms 2648 ms 4
mistralai/ministral-14b-2512 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1918 ms 3375 ms 1918 ms 3374 ms 7
z-ai/glm-5-turbo warming zai 100.00% 100.00% 100.00% 45s 100.00% 1932 ms 36306 ms 1932 ms 36305 ms 4
openai/o3-mini warming openai 100.00% 100.00% 100.00% 45s 100.00% 1933 ms 3907 ms 1932 ms 3907 ms 2
qwen/qwen3.6-flash-2026-04-16 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1959 ms 1959 ms 1958 ms 1958 ms 1
z-ai/glm-5v-turbo warming venice 100.00% 100.00% 100.00% 45s 100.00% 1961 ms 2817 ms 1961 ms 2817 ms 3
qwen/qwen3.5-122b-a10b warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 1965 ms 3238 ms 1965 ms 3238 ms 2
moonshotai/kimi-k2.5 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1967 ms 1967 ms 1967 ms 1967 ms 1
qwen/qwen3.7-flash-2026-07-15 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1976 ms 1976 ms 1975 ms 1975 ms 106 tok/s warming 1
minimax/minimax-m2.5-highspeed warming minimax 100.00% 100.00% 100.00% 20s 100.00% 1981 ms 4199 ms 1981 ms 4198 ms 5
deepseek/deepseek-v3.1-terminus warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1987 ms 1987 ms 1987 ms 1987 ms 1
google/gemini-3.5-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1997 ms 3148 ms 1997 ms 3148 ms 5
z-ai/glm-5-turbo warming venice 100.00% 100.00% 100.00% 45s 100.00% 1998 ms 2691 ms 1997 ms 2691 ms 3
z-ai/glm-5 warming gmi 100.00% 100.00% 100.00% 45s 100.00% 2025 ms 2537 ms 2025 ms 2537 ms 4
z-ai/glm-5 warming zai 100.00% 100.00% 100.00% 45s 100.00% 2027 ms 4368 ms 2027 ms 4368 ms 7
tencent/hy3 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2028 ms 2455 ms 2028 ms 2455 ms 74 tok/s warming 4
qwen/qwen3.5-27b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2040 ms 2040 ms 2039 ms 2039 ms 1
minimax/minimax-m2.7 warming morph 100.00% 100.00% 100.00% 20s 100.00% 2056 ms 3899 ms 2055 ms 3899 ms 5
openai/o1 warming openai 100.00% 100.00% 100.00% 45s 100.00% 2062 ms 5156 ms 2062 ms 5156 ms 2
qwen/qwen3.5-122b-a10b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2065 ms 3581 ms 2065 ms 3581 ms 3
deepseek/deepseek-v3.1 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2073 ms 2847 ms 2073 ms 2847 ms 2
MiniMaxAI/MiniMax-M3 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2078 ms 2078 ms 2078 ms 2078 ms 86 tok/s warming 1
deepseek/deepseek-v3-0324 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2081 ms 2081 ms 2081 ms 2081 ms 1
anthropic/claude-opus-5 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2092 ms 4169 ms 2092 ms 4169 ms 76 tok/s warming 7
qwen/qwen3.6-27b warming chutes 100.00% 100.00% 100.00% 20s 100.00% 2101 ms 3481 ms 2101 ms 3481 ms 7
qwen/qwen3.5-122b-a10b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2114 ms 2114 ms 2114 ms 2114 ms 1
minimax/minimax-m2.7 warming minimax 100.00% 100.00% 100.00% 20s 100.00% 2119 ms 3834 ms 2119 ms 3834 ms 5
qwen/qwen3.6-plus-2026-04-02 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2119 ms 2332 ms 2118 ms 2332 ms 3
bytedance/doubao-seed-1.8-251228 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2126 ms 2149 ms 2126 ms 2148 ms 2
openai/gpt-4-turbo warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2130 ms 2648 ms 2130 ms 2648 ms 3
openai/gpt-5.4-mini warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2147 ms 3640 ms 2147 ms 3639 ms 2
moonshotai/kimi-k2.6 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 2165 ms 7592 ms 2165 ms 7592 ms 92 tok/s warming 6
google/gemini-3.1-flash-lite-preview warming lightning 100.00% 100.00% 100.00% 15s 100.00% 2168 ms 3529 ms 2167 ms 3529 ms 5
minimax/minimax-m2.7 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2175 ms 2428 ms 2175 ms 2428 ms 2
openai/gpt-5.5 warming openai 100.00% 100.00% 100.00% 45s 100.00% 2180 ms 3091 ms 2179 ms 3091 ms 5
nvidia/nemotron-3-ultra-550b-a55b warming baseten 100.00% 100.00% 100.00% 20s 100.00% 2186 ms 18060 ms 2186 ms 18059 ms 83 tok/s warming 7
qwen/qwen3.5-27b warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2201 ms 2201 ms 2201 ms 2201 ms 1
qwen/qwen3.6-35b-a3b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2210 ms 2271 ms 2210 ms 2271 ms 3
z-ai/glm-5.2 warming baseten 100.00% 100.00% 100.00% 45s 100.00% 2210 ms 4034 ms 2210 ms 4034 ms 49 tok/s warming 8
z-ai/glm-4.6 warming venice 100.00% 100.00% 100.00% 20s 100.00% 2211 ms 3431 ms 2211 ms 3431 ms 5
mistralai/ministral-3b-2512 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 2215 ms 2511 ms 2214 ms 2510 ms 4
qwen/qwen-vl-ocr-2025-11-20 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2215 ms 3263 ms 2215 ms 3263 ms 2
NousResearch/Hermes-4-405B warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2224 ms 2253 ms 2224 ms 2253 ms 2
anthropic/claude-sonnet-4.5 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 2228 ms 4376 ms 2228 ms 4376 ms 6
qwen/qwen3.5-9b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2229 ms 4251 ms 2229 ms 4251 ms 5
z-ai/glm-5v-turbo warming zai 100.00% 100.00% 100.00% 45s 100.00% 2231 ms 3765 ms 2231 ms 3765 ms 4
deepseek/deepseek-v4-flash warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2236 ms 2236 ms 2236 ms 2236 ms 72 tok/s warming 1
nvidia/Cosmos3-Super-Reasoner warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2236 ms 2236 ms 2236 ms 2236 ms 54 tok/s warming 1
qwen/qwen3-vl-8b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2237 ms 2237 ms 2237 ms 2237 ms 1
anthropic/claude-opus-4.7 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2239 ms 4814 ms 2239 ms 4814 ms 6
nvidia/nemotron-nano-12b-v2-vl warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2243 ms 2243 ms 2243 ms 2243 ms 1
mistralai/ministral-8b-2512 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 2244 ms 2794 ms 2243 ms 2794 ms 7
google/gemini-3.5-flash warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2249 ms 2421 ms 2248 ms 2421 ms 50 tok/s warming 5
qwen/qwen3-coder-480b-a35b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2251 ms 2251 ms 2251 ms 2251 ms 1
anthropic/claude-opus-4.6 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2260 ms 3371 ms 2260 ms 3370 ms 2
z-ai/glm-5.2 warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 2266 ms 3516 ms 2266 ms 3516 ms 36 tok/s warming 6
Qwen/Qwen3-30B-A3B-Instruct-2507 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2281 ms 5211 ms 2280 ms 5211 ms 2
qwen/qwen3.7-plus-2026-05-26 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2320 ms 2320 ms 2320 ms 2320 ms 1
openai/gpt-oss-20b warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 2336 ms 2919 ms 2336 ms 2919 ms 6
minimax/minimax-m2.5-highspeed warming novita 100.00% 100.00% 100.00% 20s 100.00% 2340 ms 2340 ms 2340 ms 2340 ms 1
moonshotai/kimi-k2.5 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 2352 ms 4245 ms 2352 ms 4245 ms 7
openai/gpt-oss-120b warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 2352 ms 3623 ms 2352 ms 3623 ms 61 tok/s warming 5
moonshotai/kimi-k2.7-code warming together 100.00% 100.00% 100.00% 20s 100.00% 2362 ms 2958 ms 2361 ms 2958 ms 4
mistralai/mistral-medium-3-5 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 2368 ms 3383 ms 2368 ms 3383 ms 6
openai/gpt-3.5-turbo warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2375 ms 3111 ms 2375 ms 3111 ms 4
qwen/qwen3-max-preview warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2382 ms 2382 ms 2382 ms 2382 ms 1
lgai-exaone/k-exaone-236b-a23b warming friendli 100.00% 100.00% 100.00% 20s 100.00% 2392 ms 3927 ms 2391 ms 3927 ms 6
moonshotai/kimi-k3 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 2419 ms 4248 ms 2419 ms 4248 ms 54 tok/s warming 4
moonshotai/kimi-k2.7-code warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2425 ms 2425 ms 2425 ms 2425 ms 21 tok/s warming 1
deepseek/deepseek-ocr warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2429 ms 2429 ms 2429 ms 2429 ms 3
openai/o3 warming openai 100.00% 100.00% 100.00% 45s 100.00% 2441 ms 2820 ms 2441 ms 2819 ms 4
google/gemini-3-flash-preview warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2442 ms 3835 ms 2442 ms 3835 ms 3
meta-llama/llama-3.1-8b-instruct warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 2442 ms 2496 ms 2441 ms 2496 ms 3
deepseek/deepseek-v3.2 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2453 ms 3384 ms 2453 ms 3384 ms 2
qwen/qwen3-coder-30b-a3b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 2455 ms 2455 ms 2455 ms 2455 ms 1
google/gemma-4-31b-turbo warming chutes 100.00% 100.00% 100.00% 20s 100.00% 2457 ms 9581 ms 2457 ms 9580 ms 5
Qwen/Qwen3-235B-A22B-Instruct-2507 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2490 ms 3802 ms 2490 ms 3802 ms 3
deepseek/deepseek-v3.2 warming friendli 100.00% 100.00% 100.00% 20s 100.00% 2492 ms 5782 ms 2491 ms 5781 ms 9
openai/gpt-3.5-turbo warming openai 100.00% 100.00% 100.00% 20s 100.00% 2500 ms 2500 ms 2500 ms 2500 ms 1
meta-llama/Llama-3.3-70B-Instruct warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2509 ms 15151 ms 2509 ms 15151 ms 4
moonshotai/kimi-k2.6 warming chutes 100.00% 100.00% 100.00% 20s 100.00% 2525 ms 4843 ms 2525 ms 4843 ms 27 tok/s warming 6
z-ai/glm-5.2 warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 2558 ms 3861 ms 2557 ms 3860 ms 69 tok/s warming 5
moonshotai/kimi-k3 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 2571 ms 7611 ms 2571 ms 7611 ms 45 tok/s warming 7
morph/morph-v3-fast warming morph 100.00% 100.00% 100.00% 15s 100.00% 2592 ms 2921 ms 2592 ms 2921 ms 8
qwen/qwen-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2608 ms 3011 ms 2608 ms 3011 ms 2
z-ai/glm-5 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 2608 ms 4413 ms 2608 ms 4413 ms 2
nvidia/nemotron-3-nano-30b-a3b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2625 ms 3773 ms 2625 ms 3772 ms 2
anthropic/claude-opus-4.5 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2636 ms 3489 ms 2636 ms 3488 ms 4
bytedance/doubao-seed-1.6-251015 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2650 ms 2650 ms 2650 ms 2650 ms 1
google/gemini-3.1-flash-lite warming google-ai-studio 100.00% 100.00% 100.00% 15s 100.00% 2652 ms 2999 ms 2652 ms 2999 ms 4
deepseek/deepseek-v4-flash-0731 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2659 ms 13849 ms 2659 ms 13849 ms 53 tok/s warming 2
qwen/qwen3-vl-30b-a3b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 2665 ms 2665 ms 2665 ms 2665 ms 1
z-ai/glm-5v-turbo warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 2666 ms 8971 ms 2666 ms 8971 ms 2
z-ai/glm-5.1 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 2670 ms 4504 ms 2670 ms 4504 ms 3
meta-llama/llama-4-maverick warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2688 ms 2710 ms 2687 ms 2710 ms 3
qwen/qwen3-vl-8b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2702 ms 3014 ms 2702 ms 3014 ms 2
deepseek/deepseek-v3.2 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2712 ms 2712 ms 2712 ms 2712 ms 1
qwen/qwen3.6-27b warming venice 100.00% 100.00% 100.00% 20s 100.00% 2712 ms 3857 ms 2712 ms 3856 ms 9
z-ai/glm-5.1 warming zai 100.00% 100.00% 100.00% 45s 100.00% 2722 ms 8138 ms 2721 ms 8138 ms 8
z-ai/glm-4.7-flash warming venice 100.00% 100.00% 100.00% 20s 100.00% 2723 ms 6840 ms 2723 ms 6840 ms 7
google/gemini-3-flash-preview warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2724 ms 10213 ms 2724 ms 10213 ms 2
google/gemma-3-27b-it warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2752 ms 2752 ms 2752 ms 2752 ms 1
qwen/qwen3.7-max warming novita 100.00% 100.00% 100.00% 20s 100.00% 2757 ms 2895 ms 2757 ms 2894 ms 3
qwen/qwen3-next-80b-a3b-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2760 ms 2760 ms 2759 ms 2759 ms 1
bytedance/doubao-seed-character-260628 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2781 ms 2781 ms 2780 ms 2780 ms 1
Qwen/Qwen3-Next-80B-A3B-Thinking warming nebius 100.00% 100.00% 100.00% 45s 100.00% 2792 ms 2941 ms 2792 ms 2941 ms 3
qwen/qwen3.5-flash warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2805 ms 2805 ms 2804 ms 2804 ms 1
bytedance/doubao-seed-2.1-pro-260628 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2820 ms 5744 ms 2820 ms 5744 ms 2
qwen/qwen2.5-coder-32b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 2824 ms 3133 ms 2824 ms 3133 ms 3
thinkingmachines/inkling-1m warming baseten 100.00% 100.00% 100.00% 45s 100.00% 2831 ms 4090 ms 2831 ms 4089 ms 71 tok/s warming 3
minimax/minimax-m2.7 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2842 ms 2842 ms 2842 ms 2842 ms 1
qwen/qwen3-vl-32b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 2865 ms 2865 ms 2865 ms 2865 ms 1
minimax/minimax-m2.1 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2886 ms 2886 ms 2886 ms 2886 ms 1
deepseek/deepseek-v4-flash warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 2887 ms 2887 ms 2887 ms 2887 ms 74 tok/s warming 1
deepseek/deepseek-v4-flash-0731 warming fireworks 100.00% 100.00% 88.89% 20s 100.00% 2891 ms 23396 ms 2891 ms 23396 ms 57 tok/s warming 9
google/gemma-4-31b-it warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2915 ms 5117 ms 2915 ms 5117 ms 3
qwen/qwen3.8-max warming novita 100.00% 100.00% 100.00% 20s 100.00% 2920 ms 2920 ms 2920 ms 2920 ms 1
mistralai/mistral-small-24b-instruct-2501 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2949 ms 2949 ms 2949 ms 2949 ms 1
qwen/qwen3-vl-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2962 ms 2962 ms 2961 ms 2961 ms 1
qwen/qwen3-coder-plus-2025-07-22 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2968 ms 2968 ms 2968 ms 2968 ms 1
google/gemini-3.1-flash-lite warming deepinfra 100.00% 100.00% 100.00% 15s 100.00% 2969 ms 2969 ms 2969 ms 2969 ms 1
qwen/qwen3-vl-235b-a22b-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2989 ms 2989 ms 2989 ms 2989 ms 1
zai-org/glm-4.6v warming novita 100.00% 100.00% 100.00% 20s 100.00% 3000 ms 3000 ms 3000 ms 3000 ms 1
anthropic/claude-haiku-4.5 warming anthropic 100.00% 100.00% 100.00% 15s 100.00% 3006 ms 3098 ms 3006 ms 3097 ms 3
google/gemini-3.5-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 3014 ms 3297 ms 3013 ms 3297 ms 58 tok/s warming 3
z-ai/glm-4.5-air warming zai 100.00% 100.00% 100.00% 20s 100.00% 3024 ms 4610 ms 3024 ms 4610 ms 7
z-ai/glm-5.2 warming novita 100.00% 100.00% 100.00% 45s 100.00% 3029 ms 3029 ms 3028 ms 3028 ms 22 tok/s warming 1
moonshotai/kimi-k2.6 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 3032 ms 3343 ms 3032 ms 3343 ms 4
z-ai/glm-5.2-fast warming baseten 100.00% 100.00% 100.00% 45s 100.00% 3069 ms 3069 ms 3069 ms 3069 ms 86 tok/s warming 1
anthropic/claude-sonnet-5 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 3076 ms 3888 ms 3076 ms 3888 ms 7
moonshotai/kimi-k3 warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 3082 ms 3082 ms 3082 ms 3082 ms 25 tok/s warming 1
google/gemma-4-31b-it warming parasail 100.00% 100.00% 100.00% 20s 100.00% 3093 ms 3135 ms 3093 ms 3134 ms 23 tok/s warming 3
z-ai/glm-5.2 warming venice 100.00% 100.00% 100.00% 45s 100.00% 3101 ms 3666 ms 3101 ms 3666 ms 55 tok/s warming 3
moonshotai/kimi-k2.7-code warming kimi 100.00% 100.00% 100.00% 20s 100.00% 3226 ms 4522 ms 3226 ms 4522 ms 35 tok/s warming 8
qwen/qwen3.5-27b warming novita 100.00% 100.00% 100.00% 20s 100.00% 3255 ms 3255 ms 3254 ms 3254 ms 1
qwen/qwen3.5-397b-a17b warming chutes 100.00% 100.00% 100.00% 20s 100.00% 3259 ms 4367 ms 3259 ms 4367 ms 7
xiaomi/mimo-v2.5-pro warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 3269 ms 3269 ms 3269 ms 3269 ms 1
moonshotai/kimi-k2.6 warming together 100.00% 100.00% 100.00% 20s 100.00% 3288 ms 5161 ms 3288 ms 5161 ms 3
deepseek/deepseek-v4-pro warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 3305 ms 3305 ms 3304 ms 3304 ms 97 tok/s warming 1
deepseek/deepseek-v4-pro warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 3312 ms 5535 ms 3311 ms 5535 ms 40 tok/s warming 3
xiaomi/mimo-v2.5-pro warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 3318 ms 5755 ms 3318 ms 5754 ms 66 tok/s warming 3
openai/gpt-4.1 warming lightning 100.00% 100.00% 100.00% 20s 100.00% 3322 ms 5424 ms 3321 ms 5424 ms 3
moonshotai/kimi-k3 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3343 ms 3343 ms 3343 ms 3343 ms 28 tok/s warming 1
google/gemini-3.1-pro-preview warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 3346 ms 4850 ms 3346 ms 4850 ms 82 tok/s warming 6
qwen/qwen3-235b-a22b-2507 warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 3348 ms 3750 ms 3348 ms 3749 ms 5
minimax/minimax-m2.7 warming novita 100.00% 100.00% 100.00% 20s 100.00% 3352 ms 3352 ms 3351 ms 3351 ms 1
moonshotai/kimi-k3 warming kimi 100.00% 100.00% 100.00% 20s 100.00% 3400 ms 4356 ms 3400 ms 4355 ms 23 tok/s warming 7
qwen/qwen3-vl-235b-a22b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 3420 ms 3420 ms 3420 ms 3420 ms 1
moonshotai/kimi-k2.6 warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 3423 ms 5787 ms 3423 ms 5787 ms 3
qwen/qwen3-235b-a22b-instruct-2507 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 3423 ms 3423 ms 3423 ms 3423 ms 1
nvidia/nemotron-3-super-120b-a12b warming crusoe 100.00% 100.00% 100.00% 20s 100.00% 3432 ms 4090 ms 3432 ms 4090 ms 3
NousResearch/Hermes-4-70B warming nebius 100.00% 100.00% 100.00% 20s 100.00% 3437 ms 3437 ms 3436 ms 3436 ms 1
z-ai/glm-5.2 warming zai 100.00% 100.00% 100.00% 45s 100.00% 3444 ms 14580 ms 2829 ms 3444 ms 50 tok/s warming 8
z-ai/glm-5.2 warming atlas-cloud 100.00% 100.00% 100.00% 45s 100.00% 3453 ms 3453 ms 3453 ms 3453 ms 1
qwen/qwen3-vl-30b-a3b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 3472 ms 3472 ms 3472 ms 3472 ms 1
z-ai/glm-4.6 warming zai 100.00% 100.00% 100.00% 20s 100.00% 3522 ms 3942 ms 3521 ms 3942 ms 4
deepseek/deepseek-v3.2-exp warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3557 ms 4662 ms 3557 ms 4662 ms 3
google/gemini-2.5-pro warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 3599 ms 3599 ms 3599 ms 3599 ms 1
google/gemini-3.1-pro-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 3619 ms 7970 ms 3619 ms 7970 ms 72 tok/s warming 9
moonshotai/kimi-k2.7-code warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 3749 ms 13806 ms 3749 ms 13806 ms 48 tok/s warming 7
qwen/qwen3.6-35b-a3b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 3776 ms 10757 ms 3775 ms 10757 ms 4
deepseek/deepseek-v3.2 warming chutes 100.00% 100.00% 100.00% 20s 100.00% 3783 ms 5951 ms 3783 ms 5951 ms 4
z-ai/glm-4.5 warming zai 100.00% 100.00% 100.00% 20s 100.00% 3800 ms 3996 ms 3800 ms 3996 ms 2
google/gemma-4-31b-it warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 3807 ms 3925 ms 3807 ms 3925 ms 23 tok/s warming 2
qwen/qwen3-235b-a22b-thinking-2507 warming novita 100.00% 100.00% 100.00% 45s 100.00% 3829 ms 3829 ms 3829 ms 3829 ms 1
deepseek/deepseek-v4-pro warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3895 ms 8775 ms 3895 ms 8775 ms 54 tok/s warming 5
z-ai/glm-5.2 warming crusoe 100.00% 100.00% 100.00% 45s 100.00% 3908 ms 4417 ms 3908 ms 4417 ms 5
google/gemini-2.5-pro warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 3939 ms 6580 ms 3939 ms 6580 ms 6
bytedance/doubao-seed-2.0-pro-260215 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 3947 ms 3947 ms 3947 ms 3947 ms 1
openai/gpt-oss-120b warming parasail 100.00% 100.00% 100.00% 20s 100.00% 3974 ms 4825 ms 3974 ms 4824 ms 54 tok/s warming 2
qwen/qwen3.5-397b-a17b warming venice 100.00% 100.00% 100.00% 20s 100.00% 4019 ms 4019 ms 4018 ms 4018 ms 1
z-ai/glm-4.5-air warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 4036 ms 4036 ms 4036 ms 4036 ms 1
deepseek/deepseek-v4-flash warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 4038 ms 4611 ms 4037 ms 4611 ms 56 tok/s warming 3
z-ai/glm-4.7 warming zai 100.00% 100.00% 75.00% 20s 100.00% 4145 ms 27912 ms 4145 ms 27912 ms 4
openai/gpt-5 warming openai 100.00% 100.00% 100.00% 20s 100.00% 4201 ms 4965 ms 4200 ms 4964 ms 3
zai-org/GLM-5.1 warming nebius 100.00% 100.00% 100.00% 45s 100.00% 4248 ms 4248 ms 4247 ms 4247 ms 1
deepseek/deepseek-v3.1-terminus warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 4410 ms 13383 ms 4410 ms 13383 ms 3
deepseek/deepseek-v4-flash warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 4449 ms 4541 ms 4449 ms 4540 ms 14 tok/s warming 2
qwen/qwen3-omni-30b-a3b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 4449 ms 4449 ms 4449 ms 4449 ms 1
bytedance/doubao-seed-evolving warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 4454 ms 4454 ms 4454 ms 4454 ms 1
google/gemini-3.1-pro-preview warming lightning 100.00% 100.00% 100.00% 20s 100.00% 4579 ms 9548 ms 4578 ms 9548 ms 43 tok/s warming 5
z-ai/glm-4.7-flash warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 4655 ms 4655 ms 4655 ms 4655 ms 1
anthropic/claude-fable-5 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 4765 ms 7311 ms 4765 ms 7310 ms 6
bytedance/doubao-seed-2.1-turbo-260628 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 4772 ms 4772 ms 4772 ms 4772 ms 1
x-ai/grok-build-0.1 warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 4804 ms 4804 ms 4804 ms 4804 ms 1
z-ai/glm-5.1 warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 4954 ms 4954 ms 4954 ms 4954 ms 1
z-ai/glm-5.1 warming crusoe 100.00% 100.00% 100.00% 45s 100.00% 5106 ms 5427 ms 5105 ms 5427 ms 5
openai/gpt-oss-120b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 5197 ms 5197 ms 5197 ms 5197 ms 15 tok/s warming 1
tencent/hy3 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 5790 ms 5790 ms 5790 ms 5790 ms 47 tok/s warming 1
google/gemma-3-27b-it warming novita 100.00% 100.00% 100.00% 20s 100.00% 6693 ms 6693 ms 6693 ms 6693 ms 1
mistralai/mistral-small-3.1-24b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 7361 ms 7361 ms 7361 ms 7361 ms 1
google/gemini-3.5-flash warming atlas-cloud 100.00% 100.00% 100.00% 20s 100.00% 14038 ms 15679 ms 14038 ms 15678 ms 29 tok/s warming 2
qwen/qwen3-32b warming chutes 100.00% 100.00% 100.00% 20s 100.00% 17002 ms 17002 ms 17002 ms 17002 ms 1
deepseek/deepseek-v3.2 warming deepinfra 100.00% 100.00% 100.00% 1
kling/v3-pro warming kling 100.00% 100.00% 100.00% 1
openai/gpt-4o warming openai 100.00% 100.00% 100.00% 1
z-ai/glm-5.2 warming tinfoil 88.89% 88.89% 88.89% 45s 100.00% 5771 ms 21440 ms 5771 ms 21439 ms 9
cerebras/gemma-4-31b warming cerebras 85.71% 85.71% 85.71% 15s 85.71% 2116 ms 12027 ms 2116 ms 12027 ms 7
z-ai/glm-5.1 warming chutes 80.00% 80.00% 80.00% 45s 100.00% 2316 ms 14841 ms 2316 ms 14841 ms 5
moonshotai/kimi-k2.6 warming digitalocean 75.00% 75.00% 75.00% 20s 75.00% 1414 ms 2326 ms 1414 ms 2325 ms 39 tok/s warming 4
minimax/minimax-m3 warming fireworks 75.00% 75.00% 75.00% 20s 100.00% 3921 ms 5114 ms 3920 ms 5113 ms 67 tok/s warming 4
nvidia/nemotron-3-super-120b warming digitalocean 71.43% 71.43% 71.43% 20s 71.43% 4043 ms 12917 ms 4043 ms 12917 ms 7
thedrummer/cydonia-24b-v4.1 warming parasail 66.67% 66.67% 66.67% 20s 66.67% 1347 ms 3230 ms 1346 ms 3230 ms 3
openai/gpt-5.6-sol-az warming atlas-cloud 66.67% 66.67% 66.67% 45s 100.00% 3403 ms 4736 ms 3403 ms 4736 ms 3
z-ai/glm-5.1 warming parasail 60.00% 60.00% 60.00% 45s 60.00% 1058 ms 2990 ms 1058 ms 2990 ms 5
qwen/qwen3.5-27b warming siliconflow 50.00% 50.00% 50.00% 20s 100.00% 1675 ms 1675 ms 1674 ms 1674 ms 2
qwen/qwen3.5-122b-a10b warming novita 50.00% 50.00% 50.00% 20s 50.00% 4327 ms 4327 ms 4327 ms 4327 ms 2
z-ai/glm-5.2 warming chutes 16.67% 16.67% 16.67% 45s 16.67% 10685 ms 10685 ms 10685 ms 10685 ms 6
baidu/cobuddy warming novita 0.00% 0.00% 0.00% 20s 0.00% 1
deepseek/deepseek-v4-flash warming alibaba 69 tok/s warming 0
deepseek/deepseek-v4-flash warming deepinfra 62 tok/s warming 0
deepseek/deepseek-v4-flash warming novita 64 tok/s warming 0
deepseek/deepseek-v4-flash-0731 warming atlas-cloud 47 tok/s warming 0
deepseek/deepseek-v4-flash-0731 warming together 74 tok/s warming 4 probe_config_error 0
deepseek/deepseek-v4-pro warming alibaba 40 tok/s warming 0
deepseek/deepseek-v4-pro warming novita 50 tok/s warming 0
deepseek/deepseek-v4-pro warming together 39 tok/s warming 4 probe_config_error 0
google/diffusiongemma-26b-a4b-it warming neurometric 0.00% 0.00% 0.00% 20s 100.00% 6 unsupported_route 3
google/gemini-3.1-pro-preview warming atlas-cloud 58 tok/s warming 0
google/gemma-3-12b-it warming novita 0.00% 0.00% 0.00% 20s 100.00% 2
google/gemma-4-31b-it warming together 48 tok/s warming 1 probe_config_error 0
inclusionai/ling-3.0-flash warming novita 141 tok/s warming 0
mindai/macaron-v1-venti warming novita 8 tok/s warming 0
minimax/minimax-m3 warming atlas-cloud 69 tok/s warming 0
minimax/minimax-m3 warming novita 56 tok/s warming 0
minimax/minimax-m3 warming parasail 0.00% 0.00% 0.00% 20s 0.00% 1
minimax/minimax-m3 warming siliconflow 172 tok/s warming 0
moonshotai/kimi-k2.6 warming deepinfra 27 tok/s warming 0
moonshotai/kimi-k2.6 warming novita 35 tok/s warming 0
moonshotai/kimi-k2.6 warming siliconflow 0.00% 0.00% 0.00% 20s 0.00% 1
moonshotai/kimi-k2.7-code warming novita 30 tok/s warming 0
moonshotai/kimi-k3 warming atlas-cloud 23 tok/s warming 0
moonshotai/kimi-k3 warming makora 74 tok/s warming 9 probe_config_error 0
moonshotai/kimi-k3 warming novita 12 tok/s warming 0
openai/gpt-4.1-mini warming atlas-cloud 39 tok/s warming 0
openai/gpt-5.5 warming atlas-cloud 36 tok/s warming 0
openai/gpt-5.6-sol warming atlas-cloud 70 tok/s warming 0
openai/gpt-5.6-terra warming atlas-cloud 51 tok/s warming 0
openai/gpt-oss-120b warming deepinfra 0.00% 0.00% 0.00% 20s 100.00% 20 tok/s warming 1
openai/gpt-oss-120b warming novita 48 tok/s warming 0
qwen/qwen3-vl-flash-2026-01-22 warming alibaba 0.00% 0.00% 0.00% 20s 100.00% 1
qwen/qwen3.5-35b-a3b warming parasail 0.00% 0.00% 0.00% 20s 0.00% 2 probe_config_error 1
qwen/qwen3.5-9b warming together 0.00% 0.00% 0.00% 20s 100.00% 3 probe_config_error 2
qwen/qwen3.7-flash warming alibaba 128 tok/s warming 0
qwen/qwen3.8-max warming atlas-cloud 30 tok/s warming 0
tencent/hy3 warming atlas-cloud 54 tok/s warming 0
tencent/hy3 warming novita 101 tok/s warming 0
thinkingmachines/inkling-small warming deepinfra 114 tok/s warming 0
z-ai/glm-5.2 warming alibaba 31 tok/s warming 0
Workspace access

Sign in

Choose a sign in method to access your TrustedRouter workspace.

By signing in you agree to the terms of service and privacy policy.