GusLovesMath/Local_LLM_Training_Apple_Silicon
Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.
This project offers a specialized chatbot designed to solve complex math word problems. You provide a detailed math problem in plain English, and the chatbot delivers a clear, concise solution. It's ideal for students, educators, or anyone needing quick, private assistance with verbose mathematical reasoning, running directly on your Apple device.
No commits in the last 6 months.
Use this if you need a privacy-preserving tool that can accurately interpret and solve lengthy, multi-step math word problems without sending your data to external servers.
Not ideal if you are looking for a general-purpose AI assistant or need to solve mathematical equations that are not presented as word problems.
Stars
26
Forks
5
Language
Python
License
—
Category
Last pushed
May 29, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/GusLovesMath/Local_LLM_Training_Apple_Silicon"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Blaizzy/mlx-vlm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac...
waybarrios/vllm-mlx
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models...
b4rtaz/distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM...
petrukha-ivan/mlx-swift-structured
Structured output generation in Swift
armbues/SiLLM
SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple...