dvmazur/mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
2,327 stars. No commits in the last 6 months.
Stars
2,327
Forks
234
Language
Python
License
MIT
Category
Last pushed
Apr 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/dvmazur/mixtral-offloading"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mistralai/mistral-inference
Official inference library for Mistral models
open-compass/MixtralKit
A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
vicuna-tools/vicuna-installation-guide
The "vicuna-installation-guide" provides step-by-step instructions for installing and...
pleisto/yuren-13b
Yuren 13B is an information synthesis large language model that has been continuously trained...
hkproj/mistral-llm-notes
Notes on the Mistral AI model