Starter plan is free with $30/month compute credits. Team plan is $250/month plus compute. Enterprise plan is custom. Compute is billed per second for CPU, GPU, and memory with no charges for idle time.
Not given
Key features
Serve LLMs, image, video, and audio models
Isolated environments for coding agents and RL rollouts
Fine-tune and train models on GPUs
Autoscale compute from zero to thousands of GPUs
Distributed storage for models and weights
Global capacity across 20+ clouds
Serverless functions with HTTPS endpoints
Out-of-the-box observability and logs
Search passages that match a query with scores and file references
Manage collections and add or remove documents over HTTP or web interface
Share vaults and partitions for search-only access
API keys with read, write or admin access levels
Web interface for search and administration
User account management with three access levels
Full-text and vector search indexes
Runs locally on 127.0.0.1 with no outgoing connections
SHA-256 hashed API keys and scrypt hashed passwords
Limit lists restrict collections and vaults per user or API key
What makes it different
Custom infrastructure built for AI including container runtime, storage, and scheduler
Sub-second container startup times for GPU workloads
Pay only by the second with no idle charges
Programmatically create millions of concurrent sandboxes
Runs entirely locally on your computer with no outgoing connections
Free and open source with MIT license
Does not write answers or contain a language model
Shared vaults and partitions are search-only and cannot be modified