neulab/knn-transformers

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

40
/ 100
Emerging

286 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 14 / 25

How are scores calculated?

Stars

286

Forks

23

Language

Python

License

MIT

Category

transformer-architecture-tutorials

Last pushed

Oct 20, 2022

Commits (30d)

0

GitHub
Transformer Architecture Tutorials · 266 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/neulab/knn-transformers"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

lucidrains/x-transformers

A concise but complete full-attention transformer with a set of promising experimental features...

79

kanishkamisra/minicons

Utility for behavioral and representational analyses of Language Models

70

lucidrains/dreamer4

Implementation of Danijar's latest iteration for his Dreamer line of work

68

lucidrains/simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

65

lucidrains/locoformer

LocoFormer - Generalist Locomotion via Long-Context Adaptation

59

Explore Transformer Models

All categories Trending Transformer directory Insights