andrewginns/LocalLLM
Configurations for a locally hosted LLM and applications leveraging it
21
/ 100
Experimental
No commits in the last 6 months.
No License
Stale 6m
No Package
No Dependents
Maintenance
0 / 25
Adoption
1 / 25
Maturity
8 / 25
Community
12 / 25
Stars
1
Forks
1
Language
Makefile
License
—
Category
Last pushed
Nov 14, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/andrewginns/LocalLLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
beehive-lab/GPULlama3.java
GPU-accelerated Llama3.java inference in pure Java using TornadoVM.
51
gitkaz/mlx_gguf_server
This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously...
50
srgtuszy/llama-cpp-swift
Swift bindings for llama-cpp library
44
JackZeng0208/llama.cpp-android-tutorial
llama.cpp tutorial on Android phone
40
awinml/llama-cpp-python-bindings
Run fast LLM Inference using Llama.cpp in Python
37