Siddhesh2377/ToolNeuron
On-device AI for Android — LLM chat (GGUF/llama.cpp), vision models (VLM), image generation (Stable Diffusion), tool calling, AI personas, RAG knowledge packs, TTS/STT. Fully offline, zero subscriptions, open-source.
Implements a hybrid RAG pipeline combining FTS4 BM25, vector search, and Reciprocal Rank Fusion across PDFs, docs, and chat history, with grammar-constrained JSON for function calling. Built on llama.cpp for inference, LocalDream for Stable Diffusion, and a custom Unified Memory System (UMS) for efficient binary storage, with AES-256-GCM encryption backed by Android KeyStore and hardware TEE where available. Includes 7 callable plugins (web search, file ops, calculator) and adaptive hardware tuning that auto-detects CPU topology to optimize thread allocation and context windows.
272 stars.
Stars
272
Forks
20
Language
Kotlin
License
Apache-2.0
Category
Last pushed
Mar 10, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/Siddhesh2377/ToolNeuron"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
langbot-app/LangBot
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台. 提供 Agent、知识库编排、插件系统 /...
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
cactus-compute/cactus
Low-latency AI engine for mobile devices & wearables
rudrankriyam/Foundation-Models-Framework-Example
Example apps for Foundation Models Framework in iOS 26 and macOS 26
sigoden/aichat
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with...