Backtest-Validator

    1

    Stop trusting overfit backtests. One honest verdict: PASS / FAIL / INCONCLUSIVE.

    $5

    Secure checkout via Stripe

    30-day refund guarantee

    Converts to your local currency at checkout

    0 installsSecurity scanned

    Works with the AI tools you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIGitHub CopilotGitHub CopilotGemini CLIGemini CLI+20 more

    Backtest-Validator

    Example session with this skill installed

    Analyze the trade logs in strategy_v4_backtest.csv. I tested about 12 different parameter sets before picking this one, and my broker charges 1.5 bps per round-trip.

    • Read your context and instructions
    • Compiled the backtest-validator

    Backtest Verdict: FAIL

    • Reason: Failed Multiple-Testing Correction (Sidak).
    • Edge Probability: 62% (below 95% threshold).
    • Break-even Cost: 0.8 bps.

    Analysis: Your real cost (1.5 bps) exceeds the break-even. The 'best' variant you found is likely a result of luck among 12 trials.

    Connects securely to your tools. The creator never sees your data.

    What you get

    Identify if a strategy's performance is statistically indistinguishable from luck.Calculate the maximum trade cost a strategy can handle before becoming unprofitable.Correct for cherry-picking bias when multiple strategy variants were tested.Determine if a trade log has a sufficient sample size for reliable deployment.

    About this skill

    Validates whether a trading strategy has a real, tradeable edge by running the four checks most backtests skip: sample-size/power, realistic costs with break-even, luck (10k bootstrap), and multiple-testing (Sidak + PSR). Feed it a trades CSV; get a verdict plus the break-even cost, the level where the edge dies. For traders tired of strategies that look great and lose live.

    How to install

    Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.

    ~30 seconds
    1. 1

      Download the ZIP

      Free skills download straight away. Paid skills unlock right after purchase.

    2. 2

      Unzip into your skills folder

      Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.

    3. 3

      Ask your agent to use it

      Restart the agent if it was already running. It picks the skill up automatically - no config needed.

    Skills folder by agent

    Click the path to copy it. Create the folder if it does not exist yet.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    30-day refund

    Not a fit? Get your money back

    Trust & safety

    Security scanned

    Verified clean 3 months ago

    • Passed all security checks, Safe to install

    Listed3 months ago

    What's inside

    Frequently Asked Questions