ferranpons/Llamatik
True on-device AI for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM, Speech-to-Text and Image Generation — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
Based on the README, here's the technical summary: Wraps **llama.cpp**, **whisper.cpp**, and **stable-diffusion.cpp** behind a unified Kotlin API with **schema-constrained JSON generation** and streaming support for LLMs. Native C++ integration via Kotlin/Native (iOS frameworks) and JNI (Android/Desktop) enables true offline inference without Python dependencies. Supports hybrid operation—seamlessly switch between on-device and HTTP-based remote inference with identical API calls, backed by an optional `llamatik-backend` server.
Stars
76
Forks
12
Language
HTML
License
MIT
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/ferranpons/Llamatik"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Higher-rated alternatives
langbot-app/LangBot
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台. 提供 Agent、知识库编排、插件系统 /...
open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
cactus-compute/cactus
Low-latency AI engine for mobile devices & wearables
sigoden/aichat
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with...
rudrankriyam/Foundation-Models-Framework-Example
Example apps for Foundation Models Framework in iOS 26 and macOS 26