ziozzang/Mac_mlx_phi-2_server

Test server code for Phi-2 model. support OpenAI API spec

/ 100

Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 6 / 25

Maturity 9 / 25

Community 9 / 25

Stars

Forks

Language

Python

License

MIT

Category

Last pushed

Dec 15, 2023

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ziozzang/Mac_mlx_phi-2_server"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the...

waybarrios/vllm-mlx

OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models...

jordanhubbard/nanolang

A tiny experimental language designed to be targeted by coding LLMs

josStorer/RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface...

akivasolutions/tightwad

Pool your CUDA + ROCm GPUs into one OpenAI-compatible API. Speculative decoding proxy gives you...