0xhappydev/openai-compatible-llm-server

Unified on-device multimodal inference for MLX and GGUF-based LLMs/VLMs.

/ 100

Experimental

No Package No Dependents

Maintenance 6 / 25

Adoption 0 / 25

Maturity 9 / 25

Community 0 / 25

Stars

—

Forks

—

Language

Python

License

MIT

Category

Last pushed

Oct 21, 2025

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/agents/0xhappydev/openai-compatible-llm-server"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

InfinitiBit/graphbit

GraphBit is the world’s first enterprise-grade Agentic AI framework, built on a Rust core with a...

autogluon/autogluon-assistant

Multi-Agent System Powered by LLMs for End-to-end Multimodal ML Automation

samholt/L2MAC

🚀 The LLM Automatic Computer Framework: L2MAC

pguso/agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no...

wjayesh/mahilo

mahilo: Multi-Agent Human-in-the-Loop Framework is a flexible framework for creating multi-agent...