agent-evals-and-observability
Provides framework- and vendor-neutral methods for evaluating AI agents, reviewing trajectories, analyzing regressions, setting release gates, and designing privacy-aware producti…
Guides agents through pass/fail verification using explicit criteria, direct source-faithful evidence, reproducible checks, and structured verdicts before declaring work complete.
Verify work against explicit criteria using direct, source-faithful evidence, reproducible checks, and clear verdicts. Use before declaring an artifact, implementation, or claim complete; do not use for exploratory research without pass/fail criteria.
Provides framework- and vendor-neutral methods for evaluating AI agents, reviewing trajectories, analyzing regressions, setting release gates, and designing privacy-aware producti…
Enables agents to author, run, debug, and triage Playwright end-to-end tests, integrate suites with CI, perform headless browsing and scraping, and check accessibility snapshots.
Provides software teams with guidance, templates, references, and Python scripts for test strategy, regression, risk-based testing, CI triage, quality gates, exploratory testing, …
Audits iOS and macOS projects for permission requests made at launch or before meaningful user interaction, identifying likely App Store Guideline 5.1.1(ii) violations.
Audits iOS and macOS projects for misuse of background execution modes, including silent audio, location, VoIP, and unregistered background tasks under Apple Guideline 2.5.4.
Checks iOS and macOS projects for missing or incomplete PrivacyInfo.xcprivacy files and required-reason API declarations before App Store submission.
Audits iOS and macOS projects for missing or noncompliant Sign in with Apple implementation when third-party authentication is present, using static file and dependency searches.
Audits iOS source code for fixed fonts, fixed-height text containers, and other patterns that prevent text from scaling with Dynamic Type.