BrowserGym

Open-source environments and benchmarks for developing and evaluating web agents

Visit official website
PricingFree
Starting price$0 software
Free planYes
Free trialYes
APIYes
Open sourceYes
DeploymentLocal
Last verifiedAugust 3, 2026
Overview

Tool overview

BrowserGym is listed under AI Infrastructure & MLOps AI tools.

Summary

What is BrowserGym?

BrowserGym is an Apache-2.0 research framework from ServiceNow for implementing, testing, and evaluating browser agents. It provides a common environment API, Playwright-based browser control, reusable tasks, and benchmark packages including MiniWoB, WebArena, VisualWebArena, WorkArena, AssistantBench, WebLINX, OpenApps, and TimeWarp.

Best fit

Best for

Researchers and engineers evaluating autonomous web agents under reproducible tasks

Audience

Who is it for?

Web-agent researchersAI evaluation teamsResearch engineersBenchmark developers
Recommendation

Decision note

Accepted for Preview after independent V411 official-source verification. Apply only after failures = 0, warnings = 0, unmapped = 0, Arabic v2 parity is valid, the logo result is reviewed, and all controlled fields, explicit clears, outreach evidence, affiliate evidence, rebrand status, and source notes are visually confirmed.

Capabilities

Key features

Unified browser-agent environment API

Playwright-based actions and observations

Multiple packaged web-agent benchmarks

Extensible task and benchmark interfaces

Workflows

Use cases

Benchmarking autonomous browser agents

Comparing web-navigation policies

Reproducing browser-agent research

Creating custom browser tasks

Strengths

Pros

  • Apache-2.0 open-source implementation
  • Standardizes several established benchmarks
  • Current signed PyPI release is available
Considerations

Limitations

BrowserGym explicitly warns that it is not a consumer product. Benchmark performance does not guarantee safe or compliant operation on live websites. Researchers must isolate accounts, respect website terms, constrain actions, protect secrets, and validate production-specific reliability separately.

Cost

Pricing details

Pricing modelFree
Starting price$0 software
Free planYes
Free trialYes
Pricing context

Billing options

Free open-source software

Pricing context

Pricing note

BrowserGym is free open-source software under Apache-2.0. There is no paid product plan or trial for the framework. Users pay separately for model providers, compute, benchmark infrastructure, and any websites or services used during experiments.

View official pricing
Compatibility

Supported languages

  • English
Connectivity

Integrations

Playwright

MiniWoB

WebArena

VisualWebArena

WorkArena

AssistantBench

WebLINX

OpenApps

Specs

Technical details

PlatformsWeb
Multilingual supportUnknown
Login requiredNo
Open sourceYes
LicenseApache-2.0
DeploymentLocal
CompanyServiceNow Research
Current version0.14.3
Editions / plansbrowsergym browsergym-core browsergym-experiments benchmark packages
Data confidenceHigh
Last verifiedAugust 3, 2026
Decision hub

Finish your evaluation of BrowserGym

Move between similar tools, comparison cards, quick answers, user reviews, and open discussion without leaving the page.

Tools, comparisons & answers

Explore the best next step before choosing BrowserGym

Browse similar tools, open focused comparison cards, and answer the most common buying questions.

Answers

Frequently asked questions

BrowserGym is an Apache-2.0 research framework from ServiceNow for implementing, testing, and evaluating browser agents. It provides a common environment API, Playwright-based browser control, reusable tasks, and benchmark packages including MiniWoB, WebArena, VisualWebArena, WorkArena, AssistantBench, WebLINX, OpenApps, and TimeWarp.
Researchers and engineers evaluating autonomous web agents under reproducible tasks
The listed pricing model for BrowserGym is free. Pricing can change, so users should verify the latest plan details on the official website.
Yes. The current profile indicates that a free trial is available.
Community proof

User reviews

Real user feedback helps others understand strengths, limitations, and the best-fit workflows before choosing this tool.

No reviews Average rating
0 Total reviews
No reviews yet

Be the first to review BrowserGym

Share what worked, what did not, who this AI tool is best for, and what buyers should verify before choosing it.

Ask in discussion
Tool discussion

Ask or discuss this tool

Ask questions, share workflows, or discuss your experience with this AI tool.

ReplyContinue threads
EditUpdate your posts
ReportKeep it useful
0Total messages
0Threads
0Replies
Start a useful threadAsk, compare workflows, or reply to reviews

Keep it specific and helpful. You can edit or delete your own messages after posting.

Please log in to join the discussion.

Live discussion

Community messages

Reply to messages and keep the discussion useful. Use Report for abuse or spam. Your own posts can be edited or deleted.

No discussion yetBe the first to ask a question or share a useful workflow.