Per-token billing for text models and per-image/second for media models, with all models priced 20% below official provider rates. Free trial with test credits, no credit card required. Credits roll over indefinitely.
Free during beta. Self-hosted is free under Apache 2.0 license. Enterprise options available on request.
Key features
OpenAI-compatible API
Unified billing and credentials
Real-time usage analytics
Budget alerts and cost control
Model comparison tools
Playground for testing
Enterprise-grade security
99.9% service uptime
Sub-400ms average latency
Prompt versioning with named aliases and diffs
Server-side prompt templating with conditionals and loops
OpenAI-compatible AI gateway with automatic model fallbacks
Virtual keys, budgets and per-key rate limits
LLM tracing through the gateway or over OpenTelemetry
Versioned tool catalog for function calling
Offline experiments and online evaluation rules
Prompt optimization with candidate rewrites
Team-wide audit trail of every change
MCP server for Claude Code, Claude Desktop, Cursor
What makes it different
20-40% lower pricing than direct provider rates
Single API key replaces multiple vendor accounts
Zero vendor lock-in with instant model switching
No code refactoring required
Change prompts without a deploy by moving production alias
CometAPI
AcruxCore