- Home
- Skills
- Data & Databases
- Data Pipeline Backfill Rescue
More screenshots
Works with the AI Agents you already use
Data Pipeline Backfill Rescue
Rebuild missing pipeline data safely, in order, with proof it matches.
$5
Data Pipeline Backfill Rescue
Example session with this skill installed
Apply the skill to this case: An analytics pipeline missed three days of events after a job failed silently. Dashboards showed a dip, then recovered, but totals for the month were wrong.
- Read your context and instructions
- Compiled the data pipeline backfill
Situation: An analytics pipeline missed three days of events after a job failed silently. Dashboards showed a dip, then recovered, but totals for the month were wrong. Evidence: Source logs showed events present for October 2 to 4, while the target table had zero rows for those dates and partial rows for October 5. The loader was not idempotent for that table. Decision: Snapshot the target for October 2 to 5, rebuild in one-day chunks in order, reconcile each day, and re-run only the affected monthly aggregate. Outcome: All three days reconciled exactly, the monthly total matched the source within the quarantined 41 events, and the team added a daily count alert so a silent gap cannot last three days again.
Connects securely to your tools. The creator never sees your data.
About this skill
Backfills go wrong in predictable ways: they run out of order, double-count, overwrite good data, or finish with no proof of completeness. The pressure to restore data quickly makes teams skip the checks that would catch those errors. This skill scopes the gap exactly, snapshots what exists, rebuilds in idempotent chunks, and reconciles every chunk before declaring the backfill done. This skill gives you a counted diagnosis, a decision table, a fill-in template, a checklist, and a scoring rubric, plus a runnable script (backfill_planner.py) that Plans dated chunks for a gap range and writes a reconciliation checklist with one row per chunk (with --out), and rejects reversed ranges and zero-day chunks instead of silently producing an empty plan. It is built for the bottleneck moment: when the usual quick fix has already failed, or when a silent failure is worse than a loud one. Follow the protocol in order, record numbers rather than impressions, and use the quality gate before you call the work done.
Results depend on the quality of your evidence set: missing source totals, no snapshot, or a gap whose source data is gone will limit the diagnosis, and the skill says so rather than filling gaps with guesses. The script is a helper for counting and reporting; it does not replace judgement about safety, permission, or whether a fix is correct. Thresholds are starting points to adapt to your context, not universal constants.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 23 days ago