thuml/LogME
Code release for "LogME: Practical Assessment of Pre-trained Models for Transfer Learning" (ICML 2021) and Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs (JMLR 2022)
LogME computes a lightweight transferability metric by fitting a Gaussian-naive-Bayes classifier to frozen pre-trained features, enabling model selection without fine-tuning hyperparameters. Beyond ranking models, it includes B-Tuning for ensemble-based adaptation across multiple heterogeneous pre-trained models, and provides implementations of comparative baselines (LEEP, NCE) with corrected algorithms. The library offers a scikit-learn compatible API supporting classification, multi-label, and regression tasks across standard vision model hubs.
211 stars. No commits in the last 6 months.
Stars
211
Forks
18
Language
Python
License
MIT
Category
Last pushed
Oct 06, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/thuml/LogME"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
limix-ldm-ai/LimiX
LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence...
XXO47OXX/layer-scan
Automated LLM layer duplication config scanner — find the optimal (i,j) for any model + task
tatsu-lab/stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
google-research/plur
PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets...
Kakz/prometheus-llm
PrometheusLLM is a unique transformer architecture inspired by dignity and recursion. This...