Baseten
Explore Baseten models on TrustedRouter with current routes, token pricing, policy sources, privacy posture, regional availability, and API support.
Basetenbaseten
ZDR
These privacy labels describe Baseten, the upstream model provider. ZDR is a retention policy; verified confidential inference additionally requires attested provider compute and end-to-end encryption.
| Provider | Baseten |
|---|---|
| Routing status | Active |
| Provider website | https://www.baseten.co/ |
| Models | 17 public models |
| Credits routes | 17 |
| Zero data retention | yes All routes |
| Verified confidential inference | Not verified |
| Policy note | Baseten states that it does not store synchronous Model API inputs or outputs by default. TrustedRouter uses the synchronous Model API path; Baseten documents separate temporary input storage for async inference. Policy source |
Measured performance
494 samplesContinuously sampled across Baseten's routed models: p50 TTFT, effective throughput, and success rate. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.
| p50 TTFT | 2164 ms |
|---|---|
| Effective throughput | 254 tok/s n=2 |
| Uptime | 99.60% |
| Model | p50 TTFT | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|
| deepseek/deepseek-v4-flash-0731 | 2164 ms | — | 99.66% | — | 293 |
| z-ai/glm-5.3-fast | 850 ms | — | 100.00% | — | 3 |
| moonshotai/kimi-k2.7-code | 958 ms | 356 tok/s n=1 | 100.00% | — | 7 |
| z-ai/glm-5.3 | 1321 ms | — | 100.00% | — | 2 |
| thinkingmachines/inkling-1m | 1438 ms | — | 100.00% | — | 1 |
| deepseek/deepseek-v4-pro-0813 | 1743 ms | — | 99.12% | — | 113 |
| moonshotai/kimi-k2.6 | 1813 ms | — | 100.00% | — | 2 |
| deepseek/deepseek-v4.1-flash | 4055 ms | — | 100.00% | — | 1 |
| z-ai/glm-5.2 | 4944 ms | — | 100.00% | — | 42 |
| moonshotai/kimi-k3 | — | — | 100.00% | — | 30 |
| openai/gpt-oss-120b | — | 152 tok/s n=1 | — | — | 0 |
Baseten performance history · Full provider & model leaderboard.
Models served by Baseten.
Each row links to pricing, provider, benchmark, and API pages for the model.
| Model | AI IQ | Context | Input | Cached input | Output |
|---|---|---|---|---|---|
deepseek/deepseek-v4-flash-0731DeepSeek: DeepSeek V4 Flash 0731 |
— | 1,048,576 | $0.13715/1M | $0.02954/1M | $0.2743/1M |
deepseek/deepseek-v4-proDeepSeek: DeepSeek V4 Pro 0423 |
IQ 114#47 | 1,048,576 | $1.8357/1M | $0.152975/1M | $3.6714/1M |
deepseek/deepseek-v4-pro-0813DeepSeek V4 Pro 0813 |
— | 1,048,576 | $1.3926/1M | $0.13926/1M | $4.1778/1M |
deepseek/deepseek-v4.1-flashDeepSeek: DeepSeek V4.1 Flash |
IQ 116#38 | 1,048,576 | $0.3165/1M | $0.03165/1M | $1.266/1M |
moonshotai/kimi-k2.6MoonshotAI: Kimi K2.6 |
IQ 118#35 | 262,144 | $1.00225/1M | $0.1688/1M | $4.22/1M |
moonshotai/kimi-k2.7-codeMoonshotAI: Kimi K2.7 Code |
IQ 108#66 | 262,144 | $1.00225/1M | $0.1688/1M | $4.22/1M |
moonshotai/kimi-k3MoonshotAI: Kimi K3 |
IQ 121#27 | 1,048,576 | $3.165/1M | $0.3165/1M | $15.825/1M |
nvidia/nemotron-3-ultra-550b-a55bNVIDIA: Nemotron 3 Ultra |
— | 262,144 | $0.633/1M | $0.1266/1M | $2.532/1M |
openai/gpt-oss-120bOpenAI: gpt-oss-120b |
IQ 98#99 | 131,072 | $0.1055/1M | $0.1055/1M | $0.5275/1M |
thinkingmachines/inkling-1mInkling |
— | 1,048,576 | $1.055/1M | $0.17935/1M | $4.27275/1M |
thinkingmachines/inkling-smallThinking Machines: Inkling Small |
IQ 107#71 | 524,288 | $0.5275/1M | $0.1055/1M | $1.266/1M |
z-ai/glm-4.7Z.ai: GLM 4.7 |
IQ 103#81 | 202,752 | $0.633/1M | $0.1266/1M | $2.321/1M |
z-ai/glm-5.2Z.ai: GLM 5.2 |
IQ 120#28 | 1,048,576 | $1.477/1M | $0.1477/1M | $4.642/1M |
z-ai/glm-5.2-fastGLM 5.2 Fast on Fireworks |
— | 1,048,576 | $2.2155/1M | $0.22155/1M | $6.963/1M |
z-ai/glm-5.3Z.ai: GLM 5.3 |
IQ 123#18 | 1,048,576 | $1.477/1M | $0.1477/1M | $4.642/1M |
z-ai/glm-5.3-fastGLM 5.3 Fast on Fireworks |
— | 1,048,576 | $2.2155/1M | $0.22155/1M | $6.963/1M |
z-ai/glm-5.3-flashZ.ai: GLM 5.3 Flash |
IQ 116#40 | 1,048,576 | $0.15825/1M | $0.03165/1M | $0.5275/1M |
Questions
Does Baseten have zero data retention?
TrustedRouter records Baseten as supporting provider-level zero data retention based on the policy source linked on this page. This is a provider policy claim, separate from TrustedRouter's content-stateless real-time gateway and from end-to-end confidential compute.
Is Baseten end-to-end encrypted?
TrustedRouter does not currently mark Baseten as end-to-end encrypted at the provider boundary. The TrustedRouter gateway is still attested, but the selected provider normally receives the request in order to run the model. Use trustedrouter/e2e for the stronger route requirement.
Which Baseten models are available through TrustedRouter?
This page currently lists 17 public Baseten models, with live pricing, route count, context length, measured performance when available, and links to each model's provider and benchmark pages.