RobertCsordas/transformer_generalization
The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.
No commits in the last 6 months.
Stars
66
Forks
14
Language
Python
License
MIT
Category
Last pushed
Dec 16, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/RobertCsordas/transformer_generalization"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
transformerlab/transformerlab-app
The open source research environment for AI researchers to seamlessly train, evaluate, and scale...
naru-project/naru
Neural Relation Understanding: neural cardinality estimators for tabular data
danielzuegner/code-transformer
Implementation of the paper "Language-agnostic representation learning of source code from...
neurocard/neurocard
State-of-the-art neural cardinality estimators for join queries
salesforce/CodeTF
CodeTF: One-stop Transformer Library for State-of-the-art Code LLM