Google: Gemma 4 31B Performance
Compare measured TTFT, TTFB, throughput, uptime, and route health for Google: Gemma 4 31B across TrustedRouter providers using metadata-only production probes.
google/gemma-4-31b-it
Measured performance
Continuously sampled p50/p95 time-to-first-token (TTFT), time-to-first-byte (TTFB), effective throughput, and success rate for Google: Gemma 4 31B. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime, and no prompt or output content is stored.
| Provider | p50 TTFT | p95 TTFT | p50 TTFB | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|---|---|
| novita | 949 ms | 1730 ms | 949 ms | 12 tok/s n=1 | 100.00% | — | 2 |
| crusoe | 952 ms | 7244 ms | 952 ms | 26 tok/s n=1 | 100.00% | — | 6 |
| lightning | 1328 ms | 2836 ms | 1327 ms | 63 tok/s n=1 | 100.00% | — | 3 |
| siliconflow | 1847 ms | 1847 ms | 1847 ms | 12 tok/s n=1 | 100.00% | — | 1 |
| digitalocean | 2915 ms | 5117 ms | 2915 ms | — | 100.00% | — | 3 |
| parasail | 3093 ms | 3135 ms | 3093 ms | 22 tok/s n=1 | 100.00% | — | 3 |
| friendli | 3145 ms | 20976 ms | 3145 ms | 47 tok/s n=1 | 100.00% | — | 13 |
| deepinfra | 3807 ms | 3925 ms | 3807 ms | 14 tok/s n=1 | 100.00% | — | 2 |
| tinfoil | 2875 ms | 7101 ms | 2875 ms | 40 tok/s n=1 | 93.75% | — | 16 |
| cerebras | 2226 ms | 10309 ms | 2226 ms | 27 tok/s n=1 | 90.00% | — | 10 |
| together | — | — | — | 57 tok/s n=1 | — | 2 probe_config_error |
0 |
Full provider & model leaderboard.
23 routes.
More routes give the auto router more room to fail over around provider 429 and 5xx responses.
Gateway overhead is measured separately.
Public status separates TLS/health overhead from full model latency so slow LLMs do not inflate the router metric.
Metadata rollups.
Status samples store latency, outcome, provider, model, route, cost, and region metadata only.
View public status or inspect provider routes.