BrutalCoding/aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
Leverages llama.cpp to run GGUF-format models locally without server dependency, with token-level streaming callbacks for real-time text generation. Built as a Flutter/Dart package with cross-platform support (iOS, Android, macOS, Windows, Linux) and modular architecture designed for future AI capabilities beyond text generation. Includes pre-defined prompt templates like ChatML and allows users to download any GGUF model from HuggingFace directly into their app.
311 stars. No commits in the last 6 months.
Stars
311
Forks
28
Language
Dart
License
AGPL-3.0
Category
Last pushed
Apr 27, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/generative-ai/BrutalCoding/aub.ai"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
FirebaseExtended/compass-ai-travel-planning-sample-flutter
This is a travel demo built in Flutter using Firebase Data Connect and Firebase Genkit to find...
mhmzdev/draftwing
An agentic app that helps you draft articles before publishing.
sv6095/InnerEcho
InnerEcho(Mental Health App)is a Flutter and Spring Boot-based application focused on providing...
gerfalcon/offline_menu_translator
Flutter app demonstrating on-device AI with Gemma 3N
justsandip/sudoku
A Sudoku puzzle application made with Flutter, Genkit (Powered by Gemini), and Firebase.