ramanujammv1988/edge-veda
On-device AI SDK for Flutter — LLM inference, vision, STT, TTS, image generation, embeddings, RAG, and function calling. Metal GPU on iOS/macOS.
Implements a **supervised runtime with persistent workers** that manages thermal throttling, memory pressure, and session stability through a central scheduler and adaptive compute budgets—enabling 28+ minute sessions without crashes or reloads. Provides end-to-end AI capabilities (inference, vision, STT, TTS, image generation, embeddings, RAG) integrated via pull-based streaming and grammar-constrained generation, with structured observability through JSONL performance tracing and validation telemetry for debugging production failures.
Stars
74
Forks
5
Language
Dart
License
Apache-2.0
Category
Last pushed
Mar 09, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/ramanujammv1988/edge-veda"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lfnovo/esperanto
A unified interface for various AI model providers
apocas/restai
RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex &...
sbhjt-gr/InferrLM
On-device AI for iOS & Android
baidubce/bce-qianfan-sdk
Provide best practices for LMOps, as well as elegant and convenient access to the features of...
solygambas/python-openai-projects
13 projects using ChatGPT API, Whisper, Embeddings, and DALL-E with Python.