Pantry is free and open source. The rest of the AI stack (Iron, Butter, Syrup, Whisk, Waffle) is in private early access with pricing to be determined.
Key features
Multi-model optimization on any hardware within days
Agent swarms for inference optimization
Pantry: free, open-source vulnerability scanner for macOS and Linux
Iron: GPU kernels optimized for Apple silicon, NVIDIA CUDA, and AMD ROCm
Butter: multi-modal inference engine for text, vision and audio
Whisk: memory and context management to mix documents and context into requests
Syrup: control plane for monitoring, telemetry, access control and cost per GPU
Waffle: agent harness for building assistants
Runs on Apple silicon, NVIDIA RTX, H100, H200, B100, B200 and AMD ROCm
Local execution keeps data on your hardware by default
What makes it different
Reaches near-silicon performance limits on existing GPU hardware
Works on any model and any hardware without replacement
Rapid deployment within days rather than weeks or months
Built for lower cost per token through efficiency optimization
Private by default; data stays on your hardware
Supports multiple hardware platforms with write-once kernels
Pantry offers free, open-source vulnerability scanning and patching
Enables AI on commodity hardware people already own