ghoshsoham71/tokentaxi

tokentaxi is a lightweight Python library that sits between your application and your LLM providers. It intelligently routes every request based on real-time provider health, rate-limit headroom, latency, and request priority - with zero network hops and no external dependencies beyond an optional Redis connection.