Proxy API: 15% of savings on provider bill. Models API: $0.40 per 1M tokens removed (Helene 1.1), $0.90 per 1M tokens removed (Adeline 1). Free tier available with Condense Lite (approximately 20% compression).
Key features
GroqMetal: dedicated bare-metal infrastructure tuned for speed and reliability
GroqCore: production-ready inference stack with no infrastructure expertise required
GroqAssured: enterprise-grade governance, auditability, and control
256 LPUs per rack with 40 PB/s SRAM bandwidth
1,000 tokens per second per user throughput
128 GB on-chip SRAM per rack
315 PFLOPS of FP8 inference compute
13 globally distributed data centers across four continents
Proxy API for seamless integration requiring only one base URL and header change
Maintains 98.6% cache hit rate
Preserves instructions, questions, answers, code and error messages
Direct billing from provider with no stored API keys
SOC 2 Type II and ISO 27001 compliance in progress
Zero data retention with GDPR export and erasure support
What makes it different
Fast inference at scale without sacrificing affordability
LPU pioneered technology integrated with NVIDIA GPUs
Fully integrated platform combining infrastructure, inference, and control
Removes 37.3% of bills on average sessions and 66-72% on sessions over 800k tokens
Pay only 15% of savings on Proxy API with no fee if no savings occur
Built around cache architecture rather than against it
Public benchmark allowing comparison with alternatives before purchase
Operates transparently with audit logs and ability to inspect rewritten requests
condense