aurelio-labs/semantic-router

Routes queries to predefined decision paths using semantic vector embeddings rather than LLM inference, eliminating latency for intent classification. Supports multiple encoder backends (Cohere, OpenAI, Hugging Face, FastEmbed) with optional vector database persistence via Pinecone or Qdrant, and enables dynamic routes for parameter extraction and function calling. Integrates with LangChain agents and supports fully local execution with quantized models.

3,347 stars. Actively maintained with 4 commits in the last 30 days.