Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+21 more

    Training Pipeline Failure Forensics

    1

    Rank evidence-backed causes of ML training crashes or silent degradation, then design the cheapest discriminating test and minimal reproduction.

    $19.99

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned
    Training Pipeline Failure Forensics

    Training Pipeline Failure Forensics

    Example session with this skill installed

    A nightly training job still completes, but validation MAE increased from about 6.2 to 9.8 after a warehouse schema migration. Join-step row counts doubled for one day, dependencies are loosely pinned, and the last code merge was three weeks earlier. Build an evidence-ranked RCA and the smallest test that separates the leading causes.

    • Read your context and instructions
    • Compiled the training pipeline failure

    ARTIFACT: TRAINING-FAILURE-RCA
    MODE: FORENSICS
    SURFACE: SILENT DEGRADATION

    1. Data contract / leakage — Highly likely
      Evidence: one-day join fan-out aligned with the schema migration; duplicates may persist in the rolling training window.
      Cheapest test: count duplicate trip IDs in the affected join output.

    2. Dependency drift — Weak signal
      Evidence: loose version pins keep it possible; timing is weaker.
      Cheapest test: diff the last-good and current environment locks.

    MINIMAL REPRODUCTION
    Check the affected partition, deduplicate the window, retrain once with the same seed, and compare MAE.

    BOUNDARY
    The cause remains unconfirmed until a discriminating test passes.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    Turn a failed training run into a ranked investigation

    Training failures appear in two forms: loud crashes and silent degradation. This skill separates the symptom from the cause, timelines what changed since the last good run, and tests six failure classes against supplied evidence.

    What it produces

    • A loud-versus-silent failure classification
    • A change-set timeline across data, code, dependencies, infrastructure, configuration, and orchestration
    • Ranked hypotheses with evidence for and against each one
    • A confidence label and cheapest discriminating test per hypothesis
    • A minimal reproduction path for the leading hypothesis
    • A prevention line that can become a pipeline gate

    Failure classes covered

    Data-contract breaks, leakage, environment or dependency drift, resource and numerical failures, code defects, and orchestration faults.

    Best for

    • Training jobs that crash with partial logs
    • Runs that complete but produce worse metrics
    • Teams comparing the last good run with a failed one
    • Reviewers who need a minimal test before authorizing a rerun

    Boundaries

    The skill ranks hypotheses; it does not prove causality, execute SQL or training jobs, repair code, access infrastructure, or guarantee that the leading hypothesis is correct. Confirmation requires the named discriminating test.

    Ranks hypotheses from supplied evidence and does not prove causality, execute diagnostic commands, access infrastructure, rerun training, repair code, or guarantee recovery. Missing logs and artifacts remain explicit unknowns. Runtime routing was not executed during package validation.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before any payment.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scan

    Security scan passed 3 months ago

    Permissions

    No special permissions declared or detected

    Listed3 months ago

    What's inside

    Frequently Asked Questions

    This skill automates the post-mortem process for ML training by analyzing logs and change-sets to rank likely causes—such as data leakage or numerical instability—and providing a minimal reproduction path to save on compute costs.

    The skill is designed to be platform-agnostic; it works with any AI agent capable of processing text-based logs, configuration files, and git diffs from frameworks like PyTorch, TensorFlow, or JAX.

    You receive the logic and structured workflow required to analyze failure patterns, including the classification framework for the six major failure classes and the template for generating discriminating tests.

    No, this skill is a diagnostic tool that ranks hypotheses based on evidence; it does not require direct access to your infrastructure or the ability to execute code.

    Simply provide your agent with the failure logs from the current run, the configuration from the last successful run, and a list of recent changes to your data or code repository.

    Unlike standard debuggers, this skill specializes in 'silent degradation' where a model finishes training but performs poorly, using comparative analysis to pinpoint subtle drift or data-contract breaks.

    New in Agents & Orchestration