Tool overview
BrowserGym is listed under AI Infrastructure & MLOps AI tools.
What is BrowserGym?
BrowserGym is an Apache-2.0 research framework from ServiceNow for implementing, testing, and evaluating browser agents. It provides a common environment API, Playwright-based browser control, reusable tasks, and benchmark packages including MiniWoB, WebArena, VisualWebArena, WorkArena, AssistantBench, WebLINX, OpenApps, and TimeWarp.
Best for
Researchers and engineers evaluating autonomous web agents under reproducible tasks
Who is it for?
Decision note
Accepted for Preview after independent V411 official-source verification. Apply only after failures = 0, warnings = 0, unmapped = 0, Arabic v2 parity is valid, the logo result is reviewed, and all controlled fields, explicit clears, outreach evidence, affiliate evidence, rebrand status, and source notes are visually confirmed.
Key features
Unified browser-agent environment API
Playwright-based actions and observations
Multiple packaged web-agent benchmarks
Extensible task and benchmark interfaces
Use cases
Benchmarking autonomous browser agents
Comparing web-navigation policies
Reproducing browser-agent research
Creating custom browser tasks
Pros
- Apache-2.0 open-source implementation
- Standardizes several established benchmarks
- Current signed PyPI release is available
Limitations
BrowserGym explicitly warns that it is not a consumer product. Benchmark performance does not guarantee safe or compliant operation on live websites. Researchers must isolate accounts, respect website terms, constrain actions, protect secrets, and validate production-specific reliability separately.
Pricing details
Billing options
Free open-source software
Pricing note
BrowserGym is free open-source software under Apache-2.0. There is no paid product plan or trial for the framework. Users pay separately for model providers, compute, benchmark infrastructure, and any websites or services used during experiments.
Supported languages
- English
Integrations
Playwright
MiniWoB
WebArena
VisualWebArena
WorkArena
AssistantBench
WebLINX
OpenApps
Please log in to join the discussion.