Sovereign AI Infrastructure. Open by Design. Slothfully Simple.
WHY TEAMS PICK MLOX
Calm Operations for Serious ML Systems
Build AI infrastructure you can trust and verify.
MLOX helps you deploy and operate AI systems on sovereign infrastructure, using open-source components and inspectable configurations.
Instead of opaque cloud platforms and brittle YAML jungles, MLOX offers a calm, reproducible way to run production-grade ML, on your own servers or hybrid, with full control.
Designed for teams that need transparency, long-term maintainability, and independence. Slothfully simple. Open by design.
Own Your Stack
Run on your own infrastructure with inspectable configs and no black boxes.
Operational Clarity
Web UI, TUI, and CLI stay aligned so teams can deploy and debug faster.
Built To Evolve
Open-source foundations designed for long-term maintainability and adaptation.
UI + TUI + CLI
One Unified Control Surface
Open Source
Transparent By Default
Hybrid Ready
On-Prem Or Mixed Cloud
What can you do with MLOX?
Infrastructure
- ✓ Manage servers: administrate and secure
- ✓ Choose your runtime: Native, Docker, or Kubernetes
- ✓ Spin up and connect cluster: single node or multi‑node
Services
- ✓ Install, update, and remove services without fuss
- ✓ Centralized secrets and configuration, at your disposal
- ✓ Ready-to-be-used services: MLflow, Airflow, LiteLLM, Ollama, InfluxDB, Redis, and many more
- ✓ Import GitHub repositories-public or private-with ease
- ✓ Connect services and deploy models with ease
- ✓ Security included
Integrations
Integrate existing solutions or seamlessly connect to your code:
- ✓ GCP: BigQuery, Secret Manager, Cloud Storage, Sheets, and more
- ✓ Monitoring: WebUI, TUI, NewRelic, or GrafanaLabs (soon)
- ✓ Python: access your infrastructure, secrets and services with the busysloths-mlox library
Why Choose MLOX?
Open Source & Community Driven
Fully open-source under the MIT license, built by the community for the community. We believe in transparency and collaboration.
Cost-Effective MLOps
Cloud MLOps solutions can cost thousands per month. MLOX runs on your infrastructure, giving you production-grade MLOps without vendor lock-in.
Sloth-Paced Philosophy
We believe in thoughtful, calm systems over rushed chaos. Move fast by moving deliberately, with sensible defaults and clear documentation.
Designed for Long-Term Use
Built with stability, transparency, and maintainability in mind. MLOX evolves with real-world usage and community guidance.
MLOX is under active development. Features and workflows continue to evolve. We welcome contributors and feedback.
See MLOX in Action
Experience the power of MLOX through our intuitive interface and comprehensive tooling
Infrastructure Control
Manage servers and clusters with ease
Service Management
Deploy and manage ML services effortlessly
Git & Cloud Integrations
Seamless integration with Git and Cloud Platforms
Real-time Monitoring
Track performance and metrics in real-time
Terminal UI
Low bandwidth configuration management
CLI
Build for automation.
Get Started
Sloth-Friendly Setup
Easing into MLOX should feel like a lazy stretch on a sunny branch
Install Task
Install Task — our go-powered task runner
# Visit https://taskfile.dev/installation/ for installation instructions💡 Note: Task is a modern task runner / build tool that aims to be simpler and easier to use than GNU Make
Clone the Repository
Get the MLOX source code
git clone https://github.com/BusySloths/mlox.gitRun First Steps
Mosey into the project and run the setup
task first:steps💡 Note: This unhurried command crafts a conda environment and gathers every dependency for you
Want the Big Picture?
Check out our comprehensive guides
💡 Note: For a more detailed guide, check out our Installation Guide. You can also view our MLOX – State of the Union — a short slide overview of what MLOX is, what problem it solves, and where it's heading.
Big Thanks to our Sponsors and Supporters
