Run AI models on your own hardware with automatic optimization and a single endpoint
Fine-tune and batch open models on GPUs without managing infrastructure
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Open source
Paid
Pricing
Not given
Fine-tuning from $0.15 per 1M training tokens (minimum $0.50 per job). Batch inference from $0.029 per 1M input tokens and $0.049 per 1M output tokens (minimum $0.20 per batch). Credit packs: Pack 1 ($10 for 10 credits), Pack 2 ($25 for 25 credits), Pack 3 ($100 for 100 credits). Custom amounts from
Key features
Automatic model loading from Hugging Face and other sources
Hardware-aware model optimization for VRAM and context length
OpenAI-compatible endpoint
Support for multiple inference engines
Single unified endpoint for all models and machines
Distributed compute across multiple machines
Built-in app catalog with chat UIs and RAG tools
Integration with cloud providers
Fine-tune open models with LoRA, QLoRA or DPO methods
Run batch inference on base and fine-tuned models
Evaluate models against their base with custom graders
Download fine-tuned model adapters
Export merged weights of fine-tuned models
MCP server integration for Claude and other clients
OpenAI-compatible HTTP API
Real-time cost quotes before job execution
Per-token pricing with job minimums
What makes it different
No manual engine configuration needed
Automatic workload-based tuning
One endpoint covers local and cloud models
Built on trusted community engines
No GPU or infrastructure to manage; agents call the same API you would
Cost quotes before execution; no hidden charges beyond the quote
Download fine-tuned adapters; no hosting fees or endpoints to maintain
Works with Claude Code, Claude Desktop and any HTTP client without MCP dependency
Per-token pricing with no subscription or minimum contract