undreamai/LlamaLib

Cross-Platform High-Level LLM Library

48
/ 100
Emerging

Provides C++ and C# bindings built on llama.cpp with runtime hardware detection that automatically selects optimal backends (NVIDIA/AMD/Metal GPU or CPU with instruction set optimization) across desktop, mobile, and VR platforms. Embeds directly in applications with zero external dependencies and supports both local inference and client-server architectures with built-in SSL/authentication for production deployments.

No Package No Dependents
Maintenance 13 / 25
Adoption 8 / 25
Maturity 16 / 25
Community 11 / 25

How are scores calculated?

Stars

55

Forks

6

Language

C++

License

Apache-2.0

Last pushed

Mar 08, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/undreamai/LlamaLib"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.