SxryxnshS5/onenm_local_llm
onenm_local_llm is a Flutter plugin that simplifies on-device language model inference on Android using llama.cpp. It removes the complexity of setting up native runtimes, model loading, and inference pipelines, so developers can integrate local AI into their apps through a simple API.
Stars
5
Forks
1
Language
C++
License
MIT
Category
Last pushed
Mar 19, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/SxryxnshS5/onenm_local_llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
nobodywho-ooo/nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Chevey339/kelivo
A Flutter LLM Chat Client. Support Mobile & Desktop.
rikkahub/rikkahub
RikkaHub is an Android APP that supports for multiple LLM providers.
Taewan-P/gpt_mobile
Chat app for Android that supports answers from multiple LLMs at once. Bring your own API key AI...
TOM88812/xiaozhi-android-client
一个基于小智、xiaozhi-server的Android、IOS语音对话应用,支持实时语音交互和文字对话。现在是flutter版本，打通IOS、Android端。请同志们动动小手，点点小星星，予以鼓励。