kyegomez/GPT3
An implementation of the base GPT-3 Model architecture from the paper by OPENAI "Language Models are Few-Shot Learners"
This project offers a foundational implementation of the GPT-3 language model architecture, enabling you to build powerful language understanding and generation systems. It takes in raw text or numerical representations of text and produces contextually relevant text outputs. Researchers and engineers working with large language models would use this to experiment with few-shot learning capabilities for various NLP tasks.
No commits in the last 6 months.
Use this if you are an AI researcher or machine learning engineer looking to understand, replicate, or build upon the core GPT-3 architecture for advanced natural language processing tasks.
Not ideal if you are a practitioner looking for a ready-to-use, pre-trained GPT-3 model for immediate application without deep technical setup or customization.
Stars
20
Forks
3
Language
Python
License
MIT
Category
Last pushed
Jun 29, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/kyegomez/GPT3"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jingyaogong/minimind
🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!
kyegomez/TeraGPT
Train a production grade GPT in less than 400 lines of code. Better than Karpathy's verison and GIGAGPT
theosorus/GPT2-Hasktorch
GPT2 implementation in Haskell with the Hasktorch library, inspired by Andrej Karpathy's Pytorch...
noah-hein/mazeGPT
AI model for making mazes that extends OpenAIs GPT2 model
RohitPawar001/GPT-2-Implementation
This repository contains the implementation of OpenAI's GPT-2 with LORA, QLORA, RLHF, PPO,GRPO,...