Siddhesh2377/ToolNeuron

On-device AI for Android — LLM chat (GGUF/llama.cpp), vision models (VLM), image generation (Stable Diffusion), tool calling, AI personas, RAG knowledge packs, TTS/STT. Fully offline, zero subscriptions, open-source.

51
/ 100
Established

Implements a hybrid RAG pipeline combining FTS4 BM25, vector search, and Reciprocal Rank Fusion across PDFs, docs, and chat history, with grammar-constrained JSON for function calling. Built on llama.cpp for inference, LocalDream for Stable Diffusion, and a custom Unified Memory System (UMS) for efficient binary storage, with AES-256-GCM encryption backed by Android KeyStore and hardware TEE where available. Includes 7 callable plugins (web search, file ops, calculator) and adaptive hardware tuning that auto-detects CPU topology to optimize thread allocation and context windows.

272 stars.

No Package No Dependents
Maintenance 13 / 25
Adoption 10 / 25
Maturity 15 / 25
Community 13 / 25

How are scores calculated?

Stars

272

Forks

20

Language

Kotlin

License

Apache-2.0

Last pushed

Mar 10, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/rag/Siddhesh2377/ToolNeuron"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.