Serverless inference with per-token pricing (pay for output, input, and cached tokens). Training pricing from $0.50 to $10.00 per 1M training tokens depending on model size and fine-tuning type. On-demand deployments at $0.134 to $0.334 per minute ($8 to $20 per hour) for various GPU types.
Not given
Key features
Guided training runs
Configuration-led training
Custom training logic
Serverless inference
On-demand dedicated deployments
Reserved capacity
OpenAI compatible API
Model library with latest open models
Reinforcement learning support
Multi-region deployments
Search passages that match a query with scores and file references
Manage collections and add or remove documents over HTTP or web interface
Share vaults and partitions for search-only access
API keys with read, write or admin access levels
Web interface for search and administration
User account management with three access levels
Full-text and vector search indexes
Runs locally on 127.0.0.1 with no outgoing connections
SHA-256 hashed API keys and scrypt hashed passwords
Limit lists restrict collections and vaults per user or API key
What makes it different
Drop-in replacement for closed-model APIs with cost savings of 50-75%
Instant production deployment from any training checkpoint in seconds
Optimized inference engine for industry-leading throughput and latency
Elastic and global RL inference scaling
Own the complete learning loop for specialized intelligence
Runs entirely locally on your computer with no outgoing connections
Free and open source with MIT license
Does not write answers or contain a language model
Shared vaults and partitions are search-only and cannot be modified