Run and fine-tune models. Deploy custom models. All with one line of code.
An HTTP document search API for your apps
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
US
Pricing model
Paid
Open source
Pricing
Most models billed by time based on hardware used (CPU $0.000100/sec, T4 GPU $0.000225/sec, L40S GPU $0.000975/sec). Some models billed by input/output tokens or generated items. Private custom models billed for all uptime; fast-booting fine-tunes billed only for active processing.
Not given
Key features
Run thousands of community-contributed open-source models
Fine-tune models with custom data to create specialized versions
Deploy custom models using Cog, an open-source packaging tool
Automatic scaling based on demand
Pay only for compute time used
Image generation from text
Search passages that match a query with scores and file references
Manage collections and add or remove documents over HTTP or web interface
Share vaults and partitions for search-only access
API keys with read, write or admin access levels
Web interface for search and administration
User account management with three access levels
Full-text and vector search indexes
Runs locally on 127.0.0.1 with no outgoing connections
SHA-256 hashed API keys and scrypt hashed passwords
Limit lists restrict collections and vaults per user or API key
What makes it different
One-line code interface for running models without ML expertise
Automatic infrastructure scaling without manual management
Open-source community with thousands of production-ready models
Fine-tuning capability to customize models for specific tasks
Runs entirely locally on your computer with no outgoing connections
Free and open source with MIT license
Does not write answers or contain a language model
Shared vaults and partitions are search-only and cannot be modified