shankezh/LLMScratchs
This repository contains a comprehensive implementation of the full lifecycle of Large Language Model (LLM大模型) development and application, covering Pretraining (预训练), Supervised Fine-Tuning (SFT全参), Direct Preference Optimization (DPO偏好优化), Inference(推理) and Deployment. It supports frameworks such as PyTorch, HuggingFace, and DeepSpeed.
No commits in the last 6 months.
Stars
3
Forks
—
Language
Python
License
—
Category
Last pushed
Jan 08, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/shankezh/LLMScratchs"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
liangyuwang/Tiny-DeepSpeed
Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
catherinesyeh/attention-viz
Visualizing query-key interactions in language + vision transformers (VIS 2023)
microsoft/Text2Grad
🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...
huangjia2019/llm-gpt
From classic NLP to modern LLMs: building language models step by step. 异步图书：《 GPT图解 大模型是怎样构建的》-...