More screenshots

    Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+21 more

    Flaky Test Triage System

    1

    Classify flaky tests by cause, quarantine safely, and fix in an order that restores trust in CI.

    $5

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned
    Flaky Test Triage System

    Flaky Test Triage System

    Example session with this skill installed

    Apply the skill to a small test input and produce its core output. The script computes flake rates from run counts only; it cannot tell why a test flakes, which is what the distinguishing tests in the skill are for.

    • Read your context and instructions
    • Compiled the flaky test triage

    A suite of 1,800 tests had a 12 percent build failure rate, and developers had started merging on rerun until green. Rerun evidence confirmed 23 flaky tests, not the 60 developers suspected; the rest were real failures masked by rerun culture. Scoring put a payment-path test first despite a low failure rate, because it blocked releases. Pattern classification found 9 of the 23 shared a test-database reset problem, and fixing that pattern cleared 9 tests at once. Quarantine held 14 tests with owners and deadlines, and after six weeks the flake rate fell to 2 percent and rerun-until-green merges stopped, because the suite was trusted again. The register, not the reruns, was what restored trust.

    Script demo (verified): running python3 scripts/flaky_triage.py on a test file printed test_a at flake rate 0.3 as high-flake quarantine first, test_c at 0.05 as rare-flake watch, and test_b at 0.0 as stable.

    This is a worked example produced by applying the skill, not a claim about a live customer outcome.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    A complete triage system for flaky tests: detect flakiness with rerun evidence, classify by cause pattern, quarantine without hiding failures, and work the fix list in an order that rebuilds confidence in the suite. The skill provides a step-by-step protocol with decision points, a decision table, a fill-in template, a checklist, and a scoring rubric, plus a runnable script (flaky_triage.py) that reads a test-run csv and computes flake rates with a cause-pattern classification. It focuses on finding the bottleneck first and fixing in an order backed by evidence, rather than applying generic advice.

    Quarantine is a holding pattern, not a fix; quarantined tests still need owners and deadlines. Some flakes need production-like conditions to reproduce and will resist local diagnosis.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before any payment.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scan

    Security scan passed 23 days ago

    Permissions

    Terminal / Shell
    Listed23 days ago
    Updated21 days ago

    What's inside

    Frequently Asked Questions

    No. It organises evidence and decisions so judgement is applied to the right question, with a record of why.

    Longer than a generic checklist, because measurement comes first. Later uses are faster once templates and scripts are in place.

    Yes, by narrowing scope explicitly and recording what was skipped. The quality gate still applies to the narrowed work.

    New in Testing & Debugging