fkodom/yet-another-retnet

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)

42
/ 100
Emerging

106 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 9 / 25
Maturity 16 / 25
Community 17 / 25

How are scores calculated?

Stars

106

Forks

17

Language

Python

License

MIT

Category

vision-transformer-optimization

Last pushed

Nov 24, 2023

Commits (30d)

0

GitHub
Vision Transformer Optimization · 109 frameworks

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/fkodom/yet-another-retnet"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

zhanghang1989/ResNeSt

ResNeSt: Split-Attention Networks

67

berniwal/swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.

63

Jittor/jittor

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.

59

NVlabs/FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with...

54

ViTAE-Transformer/ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose...

53

Explore ML Frameworks

All categories Trending ML Framework directory Insights