ggml-org/whisper.cpp

Optimized for resource-constrained environments through integer quantization, mixed-precision inference (F16/F32), and zero runtime memory allocations, enabling on-device ASR on mobile and embedded platforms. Leverages the GGML inference library with multi-platform GPU acceleration via Metal, Vulkan, CUDA, and Core ML, alongside CPU-optimized SIMD paths for ARM NEON, AVX, and POWER VSX architectures. Provides a minimal C API and supports deployment across iOS, Android, WebAssembly, Raspberry Pi, and standard desktop/server platforms.

47,665 stars. Actively maintained with 160 commits in the last 30 days.