Inference platform for deploying AI models in production
EU-resident inference API for open-weight language models
Stage
Established
MVP
Founded
2019
Not given
Based in
Not given
ES
Pricing model
Paid
Contact for pricing
Pricing
Baseten offers three pricing tiers: Basic (pay-as-you-go starting at $0/month), Pro (with volume discounts available), and Enterprise (with custom SLAs and volume discounts). Compute pricing varies by GPU type, ranging from $0.00058/minute for CPU instances to $0.16633/minute for B200 GPUs. Model AP
Not given
Key features
Dedicated inference deployments
Pre-optimized model APIs
Multi-cloud deployment
Self-hosted and hybrid options
Training infrastructure with Loops SDK
Baseten Chains for compound AI
Advanced caching and decoding techniques
Baseten Embeddings Inference (BEI)
Forward-deployed engineering support
HIPAA and SOC 2 Type II compliance
OpenAI-compatible Responses and Chat Completions endpoints
Streaming with Server-Sent Events
Function calling and tool use
Structured JSON output with schema validation
Audio transcription with file and live WebSocket modes
Text-to-speech with built-in and customizable voices
Speech-to-speech translation
Time series forecasting up to 1,000 periods
Per-key usage tracking and limits
Servers owned and operated by NPAW in EU
What makes it different
99.99% uptime with cross-cloud high availability
Fastest embeddings with 2x higher throughput
Pay only for compute in use, not idle time
Optimized inference stack with custom kernels and latest decoding techniques
Data residency in EU with no US sub-processor in the data path
OpenAI-compatible API so teams can keep existing integrations
Three capability levels—Z Ultra, Z Pro, Z Fast—on the same API
Operated by NPAW, which has run its own data infrastructure since 2008
ISO 27001, ISO 27701, ISO 42001 and ENS High certified
Zarx