Fast, affordable AI inference API with pay-per-token pricing and dedicated GPU compute
Stage
Established
Not given
Founded
Not given
Not given
Based in
US
US
Pricing model
Not given
Paid
Pricing
Not given
Inference API: DeepSeek V4.1 Flash from $0.1275/M input tokens and $0.51/M output tokens. DeepSeek V4 Flash from $0.14/M input and $0.28/M output. DeepSeek V4 Pro 0813 from $0.561/M input and $1.683/M output. MiniMax M3 from $0.255/M input and $1.02/M output. GLM-5.3 from $1.19/M input and $3.74/M o
Key features
GroqMetal: dedicated bare-metal infrastructure tuned for speed and reliability
GroqCore: production-ready inference stack with no infrastructure expertise required
GroqAssured: enterprise-grade governance, auditability, and control
256 LPUs per rack with 40 PB/s SRAM bandwidth
1,000 tokens per second per user throughput
128 GB on-chip SRAM per rack
315 PFLOPS of FP8 inference compute
13 globally distributed data centers across four continents
Pay-per-token pricing with no subscriptions or minimums
Access to 10+ frontier open-source models including DeepSeek, MiniMax, GLM, Kimi and MiMo
OpenAI-compatible API for drop-in integration
NVIDIA B200 and B300 GPUs with speculative decoding
Multi-region deployment for low-latency responses
Zero cold start times with always-warm inference
SOC/2 approved infrastructure with zero data retention
Dedicated 8-GPU HGX nodes available prepaid for 12-36 months
Compatible with 20+ coding tools including Cursor and Claude Code
Vision analysis, web search and native tool calling built-in
What makes it different
Fast inference at scale without sacrificing affordability
LPU pioneered technology integrated with NVIDIA GPUs
Fully integrated platform combining infrastructure, inference, and control
Industry-leading inference speed: 489 tokens per second on DeepSeek V4.1 Flash
Dramatically lower costs than competitors: $0.51 per million output tokens vs $10.00 for GPT-4o
First to deploy DeepSeek R1 at scale with 351 tokens per second
Enterprise-grade security with SOC/2, GDPR compliance and zero data retention