Free plan with 10,000 monthly credits; Starter at $50/month with 40,000 credits; Pro at $500/month with 400,000 credits; Enterprise with custom pricing. Additional pay-as-you-go credits available. Pricing based on a credit system where 1,000 credits equals $1.25.
Key features
GroqMetal: dedicated bare-metal infrastructure tuned for speed and reliability
GroqCore: production-ready inference stack with no infrastructure expertise required
GroqAssured: enterprise-grade governance, auditability, and control
256 LPUs per rack with 40 PB/s SRAM bandwidth
1,000 tokens per second per user throughput
128 GB on-chip SRAM per rack
315 PFLOPS of FP8 inference compute
13 globally distributed data centers across four continents
Agentic OCR parsing with semantic understanding for complex document layouts
Support for 130+ file formats including PDFs, Office docs, images, and spreadsheets
Structured data extraction with schema-based, LLM-powered agents
Document classification and splitting based on natural language rules
Enterprise-grade RAG indexing and retrieval pipeline
Handwritten text parsing and structured extraction
Table and chart extraction with structured row and column relationships
Cloud SaaS or VPC deployment with flexible data residency options
What makes it different
Fast inference at scale without sacrificing affordability
LPU pioneered technology integrated with NVIDIA GPUs
Fully integrated platform combining infrastructure, inference, and control
4x cheaper than frontier labs, 5x more accurate than other APIs
Auto-correction loops with recursive checks that detect and fix errors automatically
Task-specific specialist agents that route content to the right expert
HIPAA, GDPR, and SOC2 compliant with enterprise-grade security