Run AI models on your own hardware with automatic optimization and a single endpoint
OpenAI-compatible API gateway priced below OpenRouter
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Open source
Paid
Pricing
Not given
Pay-as-you-go with no subscription. Models priced per 1M tokens in USD. For example, GPT-6 Luna: input $0.001, cache read $0.0001, output $0.005 per 1M tokens.
Key features
Automatic model loading from Hugging Face and other sources
Hardware-aware model optimization for VRAM and context length
OpenAI-compatible endpoint
Support for multiple inference engines
Single unified endpoint for all models and machines
Distributed compute across multiple machines
Built-in app catalog with chat UIs and RAG tools
Integration with cloud providers
Unified API for multiple models with single base URL