dsg production evidence auditor
Audit AI-agent production evidence bundles for integrity and requirement coverage using an offline, hash-based verifier.
$19
Works with the AI Agents you already use
dsg production evidence auditor
Example session with this skill installed
Audit my AI-agent Production E2E evidence bundle in ./dist/release-v1.2/ using the manifest.json found there. Provide a readiness summary.
- Read your context and instructions
- Compiled the dsg production evidence
I have audited the production evidence bundle located in ./dist/release-v1.2/. The integrity check processed 4 artifacts against the provided manifest.json.
Production Evidence Audit Report
| Requirement | Local Check | Independent Proof State | Next Fix |
|---|---|---|---|
| Source Integrity | LOCAL_INTEGRITY_MATCH | SOURCE_FOUND | None: SHA-256 matches commit a1b2c3d |
| CI Test Logs | LOCAL_INTEGRITY_MATCH | CI_TESTED | None: Verified 100% pass rate in artifact |
| Security Scan | UNVERIFIED | PENDING | Attach trivy-report.json to bundle |
| Owner Approval | FAIL | UNVERIFIED | Digest mismatch for approval.sig; recapture signature |
Readiness Recommendation: NO-GO
The audit failed due to a digest mismatch on the approval signature and missing security scan evidence. Even if these are fixed, the operator must independently verify Auth0 MFA events and AWS isolation postconditions as per references/e2e-checklist.md.
Next steps
- Recapture the
approval.sigfrom the trusted release vault and update the manifest. - Include the missing
trivy-report.jsonin the./dist/release-v1.2/directory. - Perform manual verification of provider-side account isolation before re-running the audit.
Connects securely to your tools. The creator never sees your data.
About this skill
AI agent deployments often lack verifiable proof of testing, approval, and artifact integrity, leading to risky production releases. This skill provides a read-only, offline auditing workflow to validate local evidence bundles against expected hashes before a GO/NO-GO decision.
What it does
- Integrity validation checks local artifact SHA-256 digests against supplied expected hashes.
- Requirement mapping scans manifest files to identify gaps in approvals, CI runs, and isolation checks.
- Path sanitization enforces security boundaries by rejecting absolute paths, symlinks, and parent directory traversal.
- Status reporting generates structured findings distinguishing between local integrity matches and unverified live conditions.
- Readiness assessment produces remediation steps and deployment recommendations based on evidence completeness.
How it works
- Scope definition requires the user to provide a directory containing local evidence files and a
manifest.json. - Manifest inspection uses the
audit_evidence.pyscript to parse artifacts and verify file-level integrity. - Report generation interprets exit codes and JSON outputs to categorize requirements as
LOCAL_INTEGRITY_MATCH,UNVERIFIED, orFAIL. - Manual verification prompts the operator to perform independent runtime and provider postcondition checks.
Frameworks & tools
This tool uses Python 3.9+ (Python 3.10+ recommended) and standard library modules. It relies on a specific manifest.json schema and local file system access for SHA-256 hash comparison.
Why this beats prompting it yourself
Writing prompts to check files often results in hallucinated hashes or missed security vulnerabilities like symlink attacks. This skill provides a hardened, executable Python script and a formal schema that ensures every artifact is accounted for without network-based hallucinations.
Use cases
- Pre-flight auditing of agent production E2E evidence bundles before launch.
- CI artifact validation to ensure exported builds match the verified source.
- Release blocking analysis to identify which specific approvals or receipts are missing.
- Security review of evidence bundles to detect tampered files or unsafe path structures.
Known limitations
This is an offline utility that cannot verify live provider postconditions, signatures, or MFA events. It requires a pre-configured manifest and does not perform live network calls or deployments.
Offline only. Cannot verify live signatures, MFA, or provider states. Requires Python 3.9+. No support for absolute paths or symlinks.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 22 days ago