IAAR-Shanghai/Awesome-Attention-Heads

Provides a curated research platform with a peer-reviewed survey paper accepted by *Patterns* (Cell Press) that organizes attention head studies using a four-stage cognitive framework—Knowledge Recalling, In-Context Identification, Latent Reasoning, and Expression Preparation—to systematize mechanistic interpretability research. Includes structured paper taxonomy with experimental methodology classifications and causal analysis techniques (path patching, attribution heads, mediation analysis) for isolating functional circuits within transformer attention mechanisms across diverse LLM tasks.

400 stars. No commits in the last 6 months.