agent-evals-and-observability
Provides framework- and vendor-neutral methods for evaluating AI agents, reviewing trajectories, analyzing regressions, setting release gates, and designing privacy-aware producti…
Enables agents to author, run, debug, and triage Playwright end-to-end tests, integrate suites with CI, perform headless browsing and scraping, and check accessibility snapshots.
Operate Playwright for browser automation end to end: author and debug E2E test suites (robust locators, network interception and mocking, parallel workers, accessibility snapshot checks), wire them into CI, and drive headless browsing and scraping with an extract -> validate -> save loop. Use when writing, running, fixing, or scraping with Playwright, when a Playwright CI failure or JSON report needs triage, or when the bundled pwrun script should analyze a run. Do not use for QA strategy or test framework selection (route to qa-methodology), for frontend component or architecture design (route to frontend-engineering), or for Cloudflare/DDoS-GUARD challenge bypass (use flaresolverr).
evals/evals.json
JSON
Other
README.md
Markdown
Other
templates/accessibility.spec.ts
TypeScript
Other
templates/example.spec.ts
TypeScript
Other
templates/playwright.config.ts
TypeScript
Other
tests/fixtures/sample-report.json
JSON
Other
tests/test_pwrun.py
Python
Reference
references/00-source-index.md
Markdown
Reference
references/01-e2e-authoring.md
Markdown
Reference
references/02-selectors.md
Markdown
Reference
references/03-network-interception-and-mocking.md
Markdown
Reference
references/04-parallel-workers-and-sharding.md
Markdown
Reference
references/05-ci-integration.md
Markdown
Reference
references/06-scraping-and-headless.md
Markdown
Reference
references/07-accessibility-and-debugging.md
Markdown
Script
scripts/pwrun
SKILL.md
SKILL.md
Markdown
Provides framework- and vendor-neutral methods for evaluating AI agents, reviewing trajectories, analyzing regressions, setting release gates, and designing privacy-aware producti…
Provides software teams with guidance, templates, references, and Python scripts for test strategy, regression, risk-based testing, CI triage, quality gates, exploratory testing, …
Guides agents through pass/fail verification using explicit criteria, direct source-faithful evidence, reproducible checks, and structured verdicts before declaring work complete.
Audits iOS and macOS projects for permission requests made at launch or before meaningful user interaction, identifying likely App Store Guideline 5.1.1(ii) violations.
Audits iOS and macOS projects for misuse of background execution modes, including silent audio, location, VoIP, and unregistered background tasks under Apple Guideline 2.5.4.
Checks iOS and macOS projects for missing or incomplete PrivacyInfo.xcprivacy files and required-reason API declarations before App Store submission.
Audits iOS and macOS projects for missing or noncompliant Sign in with Apple implementation when third-party authentication is present, using static file and dependency searches.
Audits iOS source code for fixed fonts, fixed-height text containers, and other patterns that prevent text from scaling with Dynamic Type.