MLOps & Testing
modeltest
[ Open Source ][ Beta ]
Unit tests for machine learning models — like pytest, but for your model
modeltest is a testing framework for machine learning models: define contracts for quality, robustness, fairness, and data invariants, and run them automatically in your CI/CD pipeline. Works with scikit-learn, PyTorch, and Keras/TensorFlow out of the box.
// Features
- Declarative YAML suites — define your model's contract without writing code
- `modeltest validate` CLI with JUnit XML output, ready to report in CI
- Per-suite prediction caching: every test reuses results instead of re-running the model
- Fairness and drift tests: equal opportunity, statistical parity, data drift
- Multi-framework support: scikit-learn, PyTorch, Keras/TensorFlow, or your own adapter
// Technologies
Pythonscikit-learnPyTorch