AI API pricing is per generation or per token depending on modality. Image generation ranges from $0.003 to multiple dollars per image depending on model and resolution. Video costs from $0.02 to $0.157 per second. LLM pricing ranges from $0.10 to $10.00 per 1M tokens. Audio generation from $0.00000
Key features
GroqMetal: dedicated bare-metal infrastructure tuned for speed and reliability
GroqCore: production-ready inference stack with no infrastructure expertise required
GroqAssured: enterprise-grade governance, auditability, and control
256 LPUs per rack with 40 PB/s SRAM bandwidth
1,000 tokens per second per user throughput
128 GB on-chip SRAM per rack
315 PFLOPS of FP8 inference compute
13 globally distributed data centers across four continents
Unified API for 400K+ models with single auth and billing
Batch multiple modalities in a single request
REST and WebSockets support with per-task webhooks
Serverless GPU compute billed by the second
Reserved GPU capacity on Sonic Pods
Custom model uploads with LoRAs and ControlNets
Sonic Inference Engine for optimized performance
MCP server, CLI and Skills for agent integration
Enterprise features including Zero Data Retention
ISO 27001 and SOC 2 certified with GDPR compliance
What makes it different
Fast inference at scale without sacrificing affordability
LPU pioneered technology integrated with NVIDIA GPUs
Fully integrated platform combining infrastructure, inference, and control
Up to 10x lower cost per generation than market rates
Complete end-to-end infrastructure owned and operated by Runware
Renewable power with zero water consumption in data centers
Models preloaded across regions for instant delivery
Seamless upgrade path from serverless to dedicated clusters