ServiceNow/AgentLab
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
Built on **BrowserGym** for standardized web task environments, AgentLab provides large-scale parallel experiment execution via Ray with unified LLM API support across OpenAI, Azure, OpenRouter, and self-hosted TGI backends. It supports 12+ benchmarks including WebArena, WorkArena, and VisualWebArena with configurable reproducibility features like task seeding and deterministic execution, enabling systematic ablation studies and agent comparisons across thousands of tasks.
530 stars and 460 monthly downloads. Actively maintained with 1 commit in the last 30 days. Available on PyPI.
Stars
530
Forks
108
Language
Python
License
—
Category
Last pushed
Feb 10, 2026
Monthly downloads
460
Commits (30d)
1
Dependencies
24
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/ServiceNow/AgentLab"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related agents
openai/openai-agents-python
A lightweight, powerful framework for multi-agent workflows
camel-ai/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents....
BrainBlend-AI/atomic-agents
Building AI agents, atomically
openagents-org/openagents
OpenAgents - AI Agent Networks for Open Collaboration
vamplabAI/sgr-agent-core
Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community