OpenGenerativeAI/llm-colosseum

Supports both text-based and vision-based LLM agents through a real-time game loop that evaluates decision-making under time pressure and incomplete information. The framework integrates with multiple LLM providers (OpenAI, Anthropic, Mistral, Ollama) via a unified API abstraction, uses DIAMBRA for Street Fighter III emulation, and ranks models with an ELO scoring system across 546+ completed matches. Agents receive either text descriptions or raw game screenshots, forcing them to balance strategic planning with low-latency responses in a competitive multiplayer environment.

1,467 stars. No commits in the last 6 months.