shaharia-lab/ferrox

Ferrox - High-performance, stateless LLM API gateway written in Rust. Sits in front of LLM provider APIs (Anthropic, OpenAI, Google Gemini, AWS Bedrock) and exposes a single OpenAI-compatible HTTP API surface. Inspired by nginx/envoy proxy design — stateless, lock-free, horizontally scalable.

23
/ 100
Experimental
No Package No Dependents
Maintenance 13 / 25
Adoption 1 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Rust

License

MIT

Last pushed

Apr 05, 2026

Commits (30d)

0

GitHub

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/shaharia-lab/ferrox"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

openai/openai-python

The official Python library for the OpenAI API

96

pydantic/pydantic

Data validation using Python type hints

93

mistralai/client-python

Python client library for Mistral AI platform

88

campfirein/byterover-cli

ByteRover CLI (brv) - The portable memory layer for autonomous coding agents (formerly Cipher)

88

cohere-ai/cohere-python

Python Library for Accessing the Cohere API

86

Explore LLM Tools

All categories Trending LLM Tool directory Insights