European AI Gateway for accessing 700+ models through one API
Stage
Established
Not given
Founded
Not given
2023
Based in
US
SE
Pricing model
Not given
Freemium
Pricing
Not given
Free models available at signup with no credit card required. Gateway plan: 3% platform fee on credits. Control Plane plan: 5.5% platform fee on credits plus flat-rate per-check billing for LLM checks. Token rates are provider rates with no markup. No minimums, no lock-in. Enterprise plans include v
Key features
GroqMetal: dedicated bare-metal infrastructure tuned for speed and reliability
GroqCore: production-ready inference stack with no infrastructure expertise required
GroqAssured: enterprise-grade governance, auditability, and control
256 LPUs per rack with 40 PB/s SRAM bandwidth
1,000 tokens per second per user throughput
128 GB on-chip SRAM per rack
315 PFLOPS of FP8 inference compute
13 globally distributed data centers across four continents
Access to 700+ models from 50+ providers
Spend limits and cost controls by project, role, user or key
Zero data retention by default with customizable trace storage
OpenAI SDK compatible with streaming and tool calling
Model routing with fallback options
LLM checks for flagging, redacting, blocking or scoring
Management API for infrastructure-as-code
SSO/SAML and role-based access control
JevMan Pac-Man benchmark for decision models
AI Roundtable for multi-model reasoning comparison
What makes it different
Fast inference at scale without sacrificing affordability
LPU pioneered technology integrated with NVIDIA GPUs
Fully integrated platform combining infrastructure, inference, and control
No token markup: provider rates passed through unchanged
Zero data retention by default with flexible options
Opper