groloch/LocalLlm
Drop-in and advanced solutions to experiment with open source LLM !
This project helps developers easily set up and experiment with AI chat assistants similar to ChatGPT using open-source Large Language Models (LLMs). It takes a GGUF format model file as input and provides either a local chat interface or an API host for building applications. It's designed for developers looking to integrate self-hosted AI assistants into their projects.
No commits in the last 6 months.
Use this if you are a developer who wants to quickly deploy a local, self-hosted chat assistant or an LLM-powered API for your applications.
Not ideal if you are an end-user looking for a ready-to-use AI assistant without any coding or technical setup.
Stars
8
Forks
—
Language
Python
License
MIT
Category
Last pushed
Feb 18, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/groloch/LocalLlm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NX-AI/xlstm
Official repository of the xLSTM.
sinanuozdemir/oreilly-hands-on-gpt-llm
Mastering the Art of Scalable and Efficient AI Model Deployment
DashyDashOrg/pandas-llm
Pandas-LLM
wxhcore/bumblecore
An LLM training framework built from the ground up, featuring a custom BumbleBee architecture...
MiniMax-AI/MiniMax-01
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model &...