Meridius-Labs/apple-on-device-ai
Apple foundation model bindings for NodeJS (supports Vercel AI SDK)
Provides streaming text generation, structured object generation with Zod schemas, and tool/function calling—all executable entirely on Apple Silicon devices without external API calls. Implements dual APIs: a native interface for direct Apple Intelligence access and a Vercel AI SDK provider for framework integration across React, Next.js, and Node.js environments. Requires macOS 26+ with Apple Intelligence enabled and at least 4GB storage for on-device model files.
148 stars and 319 monthly downloads. No commits in the last 6 months. Available on npm.
Stars
148
Forks
11
Language
TypeScript
License
MIT
Category
Last pushed
Aug 10, 2025
Monthly downloads
319
Commits (30d)
0
Dependencies
7
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Meridius-Labs/apple-on-device-ai"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
IvanCampos/Foundation-Models-Playgrounds
Playground examples to demonstrate Foundation Models Framework
blacktop/go-foundationmodels
Pure Go wrapper for Apple's Foundation Models
Arthur-Ficial/apfel
Apple Intelligence from the command line. On-device LLM via FoundationModels framework. No API...
timokoethe/Localight
A SwiftUI-based iOS 26 app featuring a fully local chatbot powered by Apple’s Foundation Models....
codybrom/tsfm
TypeScript/Node.js bindings for Apple's on-device Foundation Models (macOS 26+ only)