fabiantoh98/llm-preference-learning
End-to-end LLM preference learning pipeline: training, evaluation, and comparison of DPO, ORPO, KTO, and RLHF with 4-bit quantization, LoRA, and memory-efficient training on a single 8GB GPU.
Stars
—
Forks
—
Language
Python
License
—
Category
Last pushed
Feb 11, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/fabiantoh98/llm-preference-learning"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
agentscope-ai/Trinity-RFT
Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement...
OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO &...
huggingface/alignment-handbook
Robust recipes to align language models with human and AI preferences
zjunlp/EasyEdit
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
hyunwoongko/nanoRLHF
nanoRLHF: from-scratch journey into how LLMs and RLHF really work.