AbhinaavRamesh/ollama-local-serve

Local LLM infrastructure for distributed AI applications. Serve Ollama-powered models across your network

32
/ 100
Emerging

Used by 1 other package. Available on PyPI.

Maintenance 6 / 25
Adoption 4 / 25
Maturity 22 / 25
Community 0 / 25

How are scores calculated?

Stars

4

Forks

—

Language

Python

License

MIT

Category

llm-docker-deployments

Last pushed

Jan 03, 2026

Commits (30d)

0

Dependencies

4

Reverse dependents

1

GitHub PyPI
Llm Docker Deployments · 20 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/AbhinaavRamesh/ollama-local-serve"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

beehive-lab/GPULlama3.java

GPU-accelerated Llama3.java inference in pure Java using TornadoVM.

51

gitkaz/mlx_gguf_server

This is a FastAPI based LLM server. Load multiple LLM models (MLX or llama.cpp) simultaneously...

50

srgtuszy/llama-cpp-swift

Swift bindings for llama-cpp library

44

JackZeng0208/llama.cpp-android-tutorial

llama.cpp tutorial on Android phone

40

awinml/llama-cpp-python-bindings

Run fast LLM Inference using Llama.cpp in Python

37

Explore Transformer Models

All categories Trending Transformer directory Insights