Baseten models
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
| Model | Context | Input | Output | Latency | Throughput | Cache | Search | Capabilities | ZDR | No Training | Regional Inference | Free AI Gateway Credit | Released |
|---|
| 1M | $0.60/M | $2.40/M | — | — | Read$0.01/M | — | +2 | US | 09/29/2026 | ||||
| 1M | $0.30/M+1 more | $1.20/M+1 more | 0.5 s | 204 tps | Read$0.007/M | — | +2 | US | 09/08/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | +1 | US | 09/02/2026 | ||||
| 1M | $0.15/M | $0.50/M | 0.8 s | 91 tps | Read$0.03/M | — | +2 | US | 08/26/2026 | ||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 2.2 s | 73 tps | Read$0.14/M | — | +1 | US | 08/18/2026 | ||||
| 1M | $1.32/M | $3.96/M | 0.5 s | 98 tps | Read$0.13/M | — | +1 | US | 08/12/2026 | ||||
| 1M | $0.13/M | $0.26/M | 0.8 s | 244 tps | Read$0.03/M | — | +1 | US | 07/31/2026 | ||||
| 1M | $3/M | $15/M | 2.8 s | 144 tps | Read$0.30/M | — | +2 | US | 07/16/2026 | ||||
| 1M | $2.10/M | $6.60/M | — | — | Read$0.21/M | — | +1 | US | 06/23/2026 | ||||
| 1M | $1.40/M+1 more | $4.40/M+1 more | 1.6 s | 110 tps | Read$0.14/M | — | +1 | US | 06/16/2026 | ||||
| 1M | $0.60/M | $2.40/M | 0.8 s | 290 tps | Read$0.12/M | — | US | 06/04/2026 | |||||
| 1M | $1.32/M | $3.96/M | 0.4 s | 98 tps | Read$0.13/M | — | US | 04/23/2026 | |||||
| 1M | $0.13/M | $0.26/M | 0.7 s | 225 tps | Read$0.03/M | — | US | 04/23/2026 | |||||
| 131K | $0.10/M | $0.50/M | 0.6 s | 211 tps | Read$0.10/M | — | US | 08/05/2025 |