ML Infrastructure. Slothfully Simple.
What can you do with MLOX?
Infrastructure
- ✓ Manage servers: add, remove, tag, and name
- ✓ Choose your runtime: Native, Docker, or Kubernetes
- ✓ Spin up Kubernetes: single node or multi‑node clusters
Services
- ✓ Install, update, and remove services without fuss
- ✓ Centralized secrets and configuration, ready to use
- ✓ Secure Docker services: MLflow, Airflow, LiteLLM, Ollama, InfluxDB, Redis, and more
- ✓ Kubernetes add‑ons: Dashboard, Helm, Headlamp
- ✓ Import GitHub repositories — public or private — with ease
GCP Integrations
Use GCP integrations in your code:
- ✓ BigQuery
- ✓ Secret Manager
- ✓ Cloud Storage
- ✓ Sheets
Why Choose MLOX?
Open Source & Community Driven
Fully open-source under the MIT license, built by the community for the community. We believe in transparency and collaboration.
Cost-Effective MLOps
Cloud MLOps solutions can cost thousands per month. MLOX runs on your infrastructure, giving you production-grade MLOps without vendor lock-in.
Sloth-Paced Philosophy
We believe in thoughtful, calm systems over rushed chaos. Move fast by moving deliberately, with sensible defaults and clear documentation.
Production-Ready
Built for production from day one. Secure by default, scalable by design, and maintainable for the long haul. No prototypes—just solid infrastructure.
See MLOX in Action
Experience the power of MLOX through our intuitive interface and comprehensive tooling
Infrastructure Control
Manage servers and clusters with ease
Service Management
Deploy and manage ML services effortlessly
Git & Cloud Integrations
Seamless integration with Git and Cloud Platforms
Real-time Monitoring
Track performance and metrics in real-time
Terminal UI
Low bandwidth configuration management
CLI
Build for automation.
Get Started
Sloth-Friendly Setup
Easing into MLOX should feel like a lazy stretch on a sunny branch
Install Task
Install Task — our go-powered task runner
# Visit https://taskfile.dev/installation/ for installation instructions 💡 Note: Task is a modern task runner / build tool that aims to be simpler and easier to use than GNU Make
Clone the Repository
Get the MLOX source code
git clone https://github.com/BusySloths/mlox.git Run First Steps
Mosey into the project and run the setup
task first:steps 💡 Note: This unhurried command crafts a conda environment and gathers every dependency for you
Want the Big Picture?
Check out our comprehensive guides
💡 Note: For a more detailed guide, check out our Installation Guide. You can also view our MLOX – State of the Union — a short slide overview of what MLOX is, what problem it solves, and where it's heading.
Big Thanks to our Sponsors and Supporters