aws-samples/fine-tuning-llm-with-domain-knowledge
This repo walks you through how to use transfer learning to fine tune a LLM (large language model) using UK Supreme Court case law as the domain specific training dataset. The model being fine-tuned is the HuggingFace GPTJ-6B model.
No commits in the last 6 months.
Stars
42
Forks
6
Language
Jupyter Notebook
License
MIT-0
Category
Last pushed
Aug 08, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/aws-samples/fine-tuning-llm-with-domain-knowledge"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
adithya-s-k/AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
jax-ml/jax-llm-examples
Minimal yet performant LLM examples in pure JAX
young-geng/scalax
A simple library for scaling up JAX programs
MaximeRobeyns/bayesian_lora
Bayesian Low-Rank Adaptation for Large Language Models