- Home
- Skills
- Testing & Debugging
- LLM Retry & Duplicate Cost Evidence Pack
More screenshots
Works with the AI tools you already use
LLM Retry & Duplicate Cost Evidence Pack
Turn supplied LLM attempt logs into retry-chain evidence for duplicate successes, payload drift, retry storms, weak backoff and ambiguous completion.
$7
LLM Retry & Duplicate Cost Evidence Pack
Example session with this skill installed
Run the included sample attempt log through the local retry evidence pack using the supplied policy. Show duplicate successes, backoff problems and ambiguous retries. Do not send or retry any API request.
- Read your context and instructions
- Compiled the llm retry
- Generated the data export
LLM Retry & Duplicate Cost Evidence — included sample
Status
DISCREPANCY. The supplied log contains 4 attempts grouped into 2 explicit operations. There is 1 discrepancy finding, 2 manual-review findings and USD 0.100000 of observed extra-success cost from the supplied values.
| Operation | Attempt chain | Finding | Review |
|---|---|---|---|
| invoice-001 | timeout → success | BACKOFF_VIOLATION: 1000 ms before a-2 versus 2000 ms minimum | Retry after timeout lacks a stable idempotency key |
| invoice-002 | success → success | MULTIPLE_SUCCESSES: 2 successes | Supplied extra-success cost USD 0.100000 |
The generated packet includes result.json, operation-matrix.csv, anomalies.jsonl, manual-review.jsonl, RETRY_EVIDENCE.md and a SHA-256 receipt. Before rerunning work, review invoice-001’s key and backoff policy and investigate invoice-002’s two successful attempts. The tool groups only by explicit operation_id and does not contact the provider, retry anything or determine a billing fault.
llm-retry-duplicate-cost-evidence-pack.csv
CSV · data export
Example file from a real run - the skill writes it into your workspace.
Connects securely to your tools. The creator never sees your data.
What you get
About this skill
This downloadable local package turns authorized JSON or JSONL attempt evidence into a fixed, reproducible retry review packet. It includes an installable Python CLI, a local stdio MCP adapter and a companion Agent Skill. One run creates result.json, operation-matrix.csv, anomalies.jsonl, manual-review.jsonl, RETRY_EVIDENCE.md and a SHA-256 receipt. It groups attempts only by explicit operation_id, identifies measurable duplicate-success costs, weak backoff and ambiguous retry chains, and gives operators a reviewable handoff. The deterministic core rejects unsafe paths and malformed JSON, never overwrites an existing packet, escapes formula-active CSV cells and binds inputs and outputs with SHA-256. It runs locally with no API key, login, upload, telemetry or live provider action. Useful for developers investigating extra LLM spend after timeouts, automation agencies reviewing idempotency before reruns and teams documenting incidents. Requires Windows 11, Python 3.11–3.14 and buyer-supplied files in documented schemas; optional local MCP adapter uses mcp==2.2.0. Limitations: the tool never sends or retries a request. Duplicate-success cost uses supplied values; it does not establish provider billing fault.
How to install
Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.
- 1
Download the ZIP
Free skills download straight away. Paid skills unlock right after purchase.
- 2
Unzip into your skills folder
Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.
- 3
Ask your agent to use it
Restart the agent if it was already running. It picks the skill up automatically - no config needed.
Skills folder by agent
Click the path to copy it. Create the folder if it does not exist yet.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill passes our trust checks below.
Security scanned
Passed our 8-point scan before listing
Fresh listing
Recently published to Agensi
30-day refund
Not a fit? Get your money back
Trust & safety
Security scanned
Verified clean 16 days ago
- Passed all security checks, Safe to install