Freedom251 › ML Experiment Tracking Software
MLXP

What MLXP is
MLXP is a free, open-source Python framework for managing machine-learning experiments from job launch through result analysis. A decorator on the main task function works with Hydra hierarchical configurations to launch several jobs using different option values. Each run receives a unique directory containing metrics, artifacts, checkpoints, metadata, and configuration options. MLXP can create a deployment version of the code from the latest Git commit and submit jobs to clusters through schedulers including SLURM, OAR, TORQUE, SGE, MWM, and LSF. After runs complete, its Reader can read, query, group, aggregate, and compare outputs across jobs. The MLXP DataFrame can delay loading metric files and artifacts until their fields are accessed. Settings for the logger, version manager, scheduler, and interactive mode are stored in an automatically created mlxp.yaml file. It supports API and SDK access and self-hosted deployment. Installation uses pip in a virtualenv or Conda environment with `pip install MLXP`.
Who it suits
MLXP suits Python teams running multiple machine-learning jobs that need organized experiment records, scheduler submission, and cross-run analysis. It is also suitable for users who want self-hosted, open-source tooling.
What it does well
- Launches jobs with Hydra configurations
- Records metrics, artifacts, and checkpoints
- Supports cluster scheduler integrations
- Queries, groups, and aggregates runs
- MIT-licensed and self-hosted
What to know first
- Requires a Python environment and listed dependencies
- Cluster use depends on supported schedulers
- Self-hosted deployment requires user administration
Verdict
MLXP covers launching, recording, versioning, and analyzing machine-learning experiments in one Python framework. Its scheduler support, lazy loading, and run comparison are useful for multi-job workflows.
Facts from MLXP's own pages
- Cluster jobs
- It can submit jobs to a cluster using a job scheduler. · github.com, 4 Oct 2026
- Code versioning
- Its Git based version manager can generate a deployment version of code based on the latest Git commit. · github.com, 9 Oct 2026
- Configuration
- Logger, version manager, scheduler, and interactive mode settings can be adjusted in an automatically created mlxp.yaml file. · inria-thoth.github.io, 9 Oct 2026
- Dependencies
- Documented requirements include Hydra Core, OmegaConf, TinyDB, PyYAML, pandas, dill, and GitPython. · inria-thoth.github.io, 9 Oct 2026
- Documentation
- The repository links to a quick start guide, a tutorial, and detailed documentation on the project website. · github.com, 4 Oct 2026
- Experiment launching
- A decorator and Hydra hierarchical configurations let users launch several jobs with different option values. · github.com, 9 Oct 2026
- Experiment records
- It logs metrics, artifacts, checkpoints, metadata, and configuration options in a uniquely assigned job directory. · github.com, 4 Oct 2026
- Installation
- The project documents installation with pip from PyPI or by cloning the GitHub repository. · inria-thoth.github.io, 9 Oct 2026
- Job launching
- It can launch several jobs automatically using Hydra and hierarchical configs, with a decorator on the main task function. · github.com, 4 Oct 2026
- Lazy loading
- The MLXP DataFrame can defer loading metric files and artifacts until their fields are accessed. · inria-thoth.github.io, 9 Oct 2026
- License
- The project says MLXP is distributed under the MIT license. · github.com, 9 Oct 2026
- Logging
- Runs can log metrics, artifacts, checkpoints, metadata, and configuration options in uniquely assigned directories. · github.com, 9 Oct 2026
- Purpose
- MLXP is an open-source Python framework for managing experiments from launching and logging through querying results. · github.com, 4 Oct 2026
- Result analysis
- The Reader supports querying, grouping, and aggregating results across runs. · inria-thoth.github.io, 9 Oct 2026
- Results
- It supports reading, querying, grouping, and aggregating outputs from multiple jobs. · github.com, 4 Oct 2026
- Scheduler integrations
- The documentation lists SLURM, OAR, TORQUE, SGE, MWM, and LSF as supported job schedulers. · inria-thoth.github.io, 9 Oct 2026
- What it does
- MLXP is an open-source Python framework for managing machine learning experiments from launch and logging through querying results. · github.com, 9 Oct 2026
Where MLXP stands on Freedom251
- ML Experiment Tracking Software#34 of 39
- Experiment Tracking#20 of 22