Production control plane for AI agents with model gateway, stateful runtime, and observability
Stage
Not given
Not given
Founded
Not given
Not given
Based in
US
Not given
Pricing model
Paid
Paid
Pricing
Usage-based pay-as-you-go pricing with hourly compute charges; committed contracts available for volume discounts. Hosted option with Anyscale-managed infrastructure or Bring Your Own Cloud deployment available.
Relay: usage by model through API. Loop: base + usage for agent runtime capacity and managed runs. Lens: base + usage for observability retention and recorded events. Build Agent Service: custom scoped professional service. WebSearch API: $0.01 per successful simple/reader request, $0.08 per success
Key features
Multimodal data curation at scale
Distributed model training with elastic scaling
Batch embedding generation at scale
Multi-cloud deployment and orchestration
Cluster-backed development environments
Workload-specific observability and debugging
Production-grade managed Ray clusters
Access control and governance
GPU budget controls and cost attribution
Post-training with SkyRL and veRL support
Model protocol translation for OpenAI, Anthropic, and Gemini SDKs
Policy routing and approval gates for model calls
Stateful agent runtime with session management
Managed tool attachment and control
Decision replay and audit trails
WebSearch API with multiple query types
Full request traceability from model to outcome
SDK compatibility without code changes
What makes it different
Built by creators of Ray, the world's most widely adopted AI compute engine
Multi-cloud deployment without code changes
Feels local but runs distributed
Unified GPU pooling across clouds and regions
Three coordinated products (Relay, Loop, Lens) in one control plane versus stitching together separate tools
SDK-compatible: change the base URL, not your code
Decisions remain observable, replayable, and auditable without page turns
Full evidence bundle exports with every decision
Unified LLM gateway eliminates key sprawl and model switching without code changes