Kaleidophon/deep-significance
Enabling easy statistical significance testing for deep neural networks.
Provides implementations of specialized statistical tests including Almost Stochastic Order (ASO), bootstrap, and permutation-randomization methods designed to handle the stochastic nature of neural network training across multiple runs and hyperparameter settings. Works directly with PyTorch tensors, TensorFlow tensors, NumPy arrays, and JAX arrays without conversion overhead. Includes Bonferroni correction for multiple comparisons across datasets and bootstrap power analysis for determining adequate sample sizes.
339 stars. No commits in the last 6 months.
Stars
339
Forks
20
Language
Python
License
GPL-3.0
Category
Last pushed
Jul 01, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Kaleidophon/deep-significance"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
GAA-UAM/scikit-fda
Functional Data Analysis Python package
mlr-org/mlr3
mlr3: Machine Learning in R - next generation
mlr-org/mlr3book
Online version of Bischl, B., Sonabend, R., Kotthoff, L., & Lang, M. (Eds.). (2024). "Applied...
mlr-org/mlr3extralearners
Extra learners for use in mlr3.
mlr-org/mlr3learners
Recommended learners for mlr3