OpenAI-compatible inference API with 92 models at discounted prices
Stage
MVP
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Open source
Paid
Pricing
Free during beta. Self-hosted is free under Apache 2.0 license. Enterprise options available on request.
Pay as you go prepaid credit starting at $5 minimum top-up. Free $0.05 credit with no card required. Claude Opus 5.5: $1.00 input / $5.00 output per 1M tokens. Claude Sonnet 5.5: $0.50 input / $2.50 output per 1M tokens. Claude Haiku 5.5: $0.025 input / $0.125 output per 1M tokens. GPT-6.1 Sol: $2.0
Key features
Prompt versioning with named aliases and diffs
Server-side prompt templating with conditionals and loops
OpenAI-compatible AI gateway with automatic model fallbacks
Virtual keys, budgets and per-key rate limits
LLM tracing through the gateway or over OpenTelemetry
Versioned tool catalog for function calling
Offline experiments and online evaluation rules
Prompt optimization with candidate rewrites
Team-wide audit trail of every change
MCP server for Claude Code, Claude Desktop, Cursor
92 models from multiple providers
OpenAI-compatible endpoint
Streaming, tool calling, structured output
CLI for remote machine management
Scoped API keys for machine access
Free trial with $0.05 credit
JSON output and exit codes
Local MCP tools for agents
Private cloud machines with agent integration
Billing per minute with pause functionality
What makes it different
Change prompts without a deploy by moving production alias