daslearning-org/OnLLM

OnLLM is the platform to run LLM or SLM models using OnnxRuntime directly on low-end devices like low power computers, mobile phones etc. It is cross-platform using Kivy & open-source.

16
/ 100
Experimental
No Package No Dependents
Maintenance 6 / 25
Adoption 1 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Python

License

Apache-2.0

Category

llm-inference-serving

Last pushed

Dec 16, 2025

Commits (30d)

0

GitHub
LLM Inference Serving · 72 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/daslearning-org/OnLLM"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency,...

85

sophgo/LLM-TPU

Run generative AI models in sophgo BM1684X/BM1688

60

NotPunchnox/rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning...

60

Deep-Spark/DeepSparkHub

DeepSparkHub selects hundreds of application algorithms and models, covering various fields of...

56

tomdyson/microllama

The smallest possible LLM API

52

Explore LLM Tools

All categories Trending LLM Tool directory Insights