jongwooko/CR-ILD

About Code for the paper "Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective" (EACL 2023 Findings)

10
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 2 / 25
Maturity 8 / 25
Community 0 / 25

How are scores calculated?

Stars

2

Forks

—

Language

Python

License

—

Category

llm-implementation-from-scratch

Last pushed

Jul 07, 2023

Commits (30d)

0

GitHub
LLM Implementation From Scratch · 52 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/jongwooko/CR-ILD"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

66

facebookresearch/LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

52

FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

52

kmeng01/rome

Locating and editing factual associations in GPT (NeurIPS 2022)

51

datawhalechina/llms-from-scratch-cn

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

48

Explore Transformer Models

All categories Trending Transformer directory Insights