Claude Skill

Benchmark browser agents on repeatable Playwright web tasks with Bananalyzer

Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests.

LLM Mart · 0 points · 0 0 0

Virus-scanned Reviewed automatically before listing.

Full trust report

Download agentskillexchange-skills-skills_benchmark-browser-agents-on-repeatable-playwright-web-tasks-with-bananalyzer-07beb56.zip · 1 KB

agentskillexchange/skills 45 57 forks MIT Updated 1d ago

Part of agentskillexchange/skills — 249 skills

Install

skills CLI

npx skills add https://github.com/agentskillexchange/skills/tree/main/skills/benchmark-browser-agents-on-repeatable-playwright-web-tasks-with-bananalyzer

Claude Code

claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install agentskillexchange-skills@llmmart

Git git clone https://github.com/agentskillexchange/skills.git

The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole agentskillexchange/skills collection as a plugin from our marketplace. Git is the plain clone.

Skill manifest

Benchmark browser agents on repeatable Playwright web tasks with Bananalyzer

Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests.

Prerequisites

Python environment, Playwright browser runtime, pytest-based test execution, a custom AgentRunner implementation, example web task snapshots

Installation

Requirements and caveats from upstream:

individual website. For an agent to best generalize, we require building a diverse dataset of websites across
In the future we will support more complex evaluation methods and examples that require multiple steps to complete. The

Basic usage or getting-started notes:

Banana-lyzer is a CLI tool that runs a set of evaluations against a set of example websites.
The CLI tool will sequentially run examples against a user defined agent by dynamically constructing a pytest test suite
AgentRunner exposes the example, and a playwright browser context to use.
Source: https://github.com/reworkd/bananalyzer
Extracted from upstream docs: https://raw.githubusercontent.com/reworkd/bananalyzer/HEAD/README.md

Documentation

https://github.com/reworkd/bananalyzer

Source

Agent Skill Exchange

Files (skills)

SKILL.md 2.1 KB

---
name: "Benchmark browser agents on repeatable Playwright web tasks with Bananalyzer"
slug: "benchmark-browser-agents-on-repeatable-playwright-web-tasks-with-bananalyzer"
description: "Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests."
github_stars: 327
verification: "security_reviewed"
source: "https://github.com/reworkd/bananalyzer"
author: "Reworkd"
publisher_type: "organization"
category: "Browser Automation"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "reworkd/bananalyzer"
  github_stars: 327
---

# Benchmark browser agents on repeatable Playwright web tasks with Bananalyzer

Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests.

## Prerequisites

Python environment, Playwright browser runtime, pytest-based test execution, a custom AgentRunner implementation, example web task snapshots

## Installation

Requirements and caveats from upstream:
- <img alt="Python" src="https://img.shields.io/badge/python-3670A0?style=for-the-badge&logo=python&logoColor=ffdd54" />
- individual website. For an agent to best generalize, we require building a diverse dataset of websites across
- In the future we will support more complex evaluation methods and examples that require multiple steps to complete. The

Basic usage or getting-started notes:
- Banana-lyzer is a CLI tool that runs a set of evaluations against a set of example websites.
- The CLI tool will sequentially run examples against a user defined agent by dynamically constructing a pytest test suite
- AgentRunner exposes the example, and a playwright browser context to use.

- Source: https://github.com/reworkd/bananalyzer
- Extracted from upstream docs: https://raw.githubusercontent.com/reworkd/bananalyzer/HEAD/README.md

## Documentation

- https://github.com/reworkd/bananalyzer

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/benchmark-browser-agents-on-repeatable-playwright-web-tasks-with-bananalyzer/)