Kaleidophon/deep-significance

Enabling easy statistical significance testing for deep neural networks.

38
/ 100
Emerging

Provides implementations of specialized statistical tests including Almost Stochastic Order (ASO), bootstrap, and permutation-randomization methods designed to handle the stochastic nature of neural network training across multiple runs and hyperparameter settings. Works directly with PyTorch tensors, TensorFlow tensors, NumPy arrays, and JAX arrays without conversion overhead. Includes Bonferroni correction for multiple comparisons across datasets and bootstrap power analysis for determining adequate sample sizes.

339 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 12 / 25

How are scores calculated?

Stars

339

Forks

20

Language

Python

License

GPL-3.0

Category

mlr3-ecosystem

Last pushed

Jul 01, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Kaleidophon/deep-significance"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.