alinourian/Fine-tuning-Mistral-7b-QA
Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)
This project helps AI developers fine-tune the Mistral-7B language model for question-answering tasks. It takes a pre-trained Mistral-7B model and a dataset of multi-turn conversations, like the Puffin dataset, to produce a more specialized and accurate QA model. This tool is designed for machine learning engineers and researchers looking to adapt large language models for specific conversational applications.
No commits in the last 6 months.
Use this if you are an AI developer who needs to customize Mistral-7B for better performance on question-answering in conversational contexts.
Not ideal if you are looking for a ready-to-use chatbot or a tool that doesn't require machine learning expertise.
Stars
13
Forks
—
Language
Jupyter Notebook
License
—
Category
Last pushed
Nov 23, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/alinourian/Fine-tuning-Mistral-7b-QA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
adithya-s-k/AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
jax-ml/jax-llm-examples
Minimal yet performant LLM examples in pure JAX
young-geng/scalax
A simple library for scaling up JAX programs
riyanshibohra/TuneKit
Upload your data → Get a fine-tuned SLM. Free.