- Home
- Skills
- Testing & Debugging
- CI Test Scope Audit
CI Test Scope Audit
See which files your Vitest settings include or exclude, trace a CI job’s test command, and get a report with source references and clear unknowns. Includes a limited Jest mode.
$9
Works with the AI Agents you already use
CI Test Scope Audit
Example session with this skill installed
Review the scripts/ test declarations in Mini Diarium v0.7.4 at revision eed457f5650c7a94c0b6a474882abde15e274fab.
Use Vitest and this CI context
- Event: pull_request
- Base branch: master
- Workflow: .github/workflows/ci.yml
- Job: test
- Platform: ubuntu-latest
- Matrix: none
Report declared configuration exclusions and CI command routes separately from anything you cannot establish about effective execution.
Write the generated Markdown report outside the audited source directory. Do not run project tests or change source.
Source
https://github.com/fjrevoredo/mini-diarium/tree/eed457f5650c7a94c0b6a474882abde15e274fab
- Read your context and instructions
- Compiled the ci test scope
Declared exclusions; effective selection unresolved
Supported omitted declarations: 0.
Declared configuration exclusions: 5. Rule facts, not additional omissions.
Scope: {"base_branch": "master", "event": "pull_request", "job": "test", "matrix": {}, "platform": "ubuntu-latest", "workflow": ".github/workflows/ci.yml"}.
Requested revision: eed457f5650c7a94c0b6a474882abde15e274fab. Caller label, not authenticated history.
Intended prefixes: scripts/. Caller authority.
Other jobs/workflows are outside this claim. No assertion of never executed.
Source snapshot SHA-256: 6de5afef3e23a845411adf712b51ce05a8a9fefc11c9a6dbc788d7a6f66e352a.
| Source | Selection | Declared config / route | Evidence and cause | Observation |
|---|---|---|---|---|
| scripts/enrich-winget-manifest.test.mjs:10 | unknown | excluded / selected | scripts/enrich-winget-manifest.test.mjs:10, vitest.config.ts:16, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; declared vitest.config.ts rule: excluded: scripts/**; effective selection unresolved | not supplied |
| scripts/enrich-winget-manifest.test.mjs:30 | unknown | excluded / selected | scripts/enrich-winget-manifest.test.mjs:30, vitest.config.ts:16, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; declared vitest.config.ts rule: excluded: scripts/**; effective selection unresolved | not supplied |
| scripts/enrich-winget-manifest.test.mjs:42 | unknown | excluded / selected | scripts/enrich-winget-manifest.test.mjs:42, vitest.config.ts:16, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; declared vitest.config.ts rule: excluded: scripts/**; effective selection unresolved | not supplied |
| scripts/enrich-winget-manifest.test.mjs:56 | unknown | excluded / selected | scripts/enrich-winget-manifest.test.mjs:56, vitest.config.ts:16, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; declared vitest.config.ts rule: excluded: scripts/**; effective selection unresolved | not supplied |
| scripts/enrich-winget-manifest.test.mjs:75 | unknown | excluded / selected | scripts/enrich-winget-manifest.test.mjs:75, vitest.config.ts:16, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; declared vitest.config.ts rule: excluded: scripts/**; effective selection unresolved | not supplied |
| uno.config.test.ts:6 | outside-intended-scope | included / selected | uno.config.test.ts:6, vitest.config.ts:1, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; outside approved prefixes | not supplied |
| vite.config.test.ts:5 | outside-intended-scope | included / selected | vite.config.test.ts:5, vitest.config.ts:1, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; outside approved prefixes | not supplied |
| vite.config.test.ts:23 | outside-intended-scope | included / selected | vite.config.test.ts:23, vitest.config.ts:1, .github/workflows/ci.yml:144, .github/workflows/ci.yml:186, package.json:20, .github/workflows/ci.yml:201, package.json:48; outside approved prefixes | not supplied |
| playwright.config.ts:? | unknown | unknown / unknown | playwright.config.ts:1; scanner error; inventory incomplete | unknown |
| scripts/fingerprint-website-assets.test.mjs:? | unknown | unknown / unknown | scripts/fingerprint-website-assets.test.mjs:1; node:test import present; alternate discovery unverified | unknown |
| scripts/install-hooks.test.js:? | unknown | unknown / unknown | scripts/install-hooks.test.js:1; node:test import present; alternate discovery unverified | unknown |
| scripts/sync-skills.test.js:? | unknown | unknown / unknown | scripts/sync-skills.test.js:1; node:test import present; alternate discovery unverified | unknown |
| scripts/website-generator-utils.test.mjs:? | unknown | unknown / unknown | scripts/website-generator-utils.test.mjs:1; node:test import present; alternate discovery unverified | unknown |
Declared command routes (execution unverified):
- .github/workflows/ci.yml:144 bun install --frozen-lockfile (unresolved)
- .github/workflows/ci.yml:186 vitest run --coverage (vitest)
- .github/workflows/ci.yml:201 playwright test --config playwright.config.ts (unresolved)
Proposed corrections (not applied):
- No selection change proposed.
Limits and missing facts
- not supplied; execution unverified
- Checked Vitest semantics: 5.0.1; defaults/priority: references/practical.md.
- Static declarations, not runtime cases. No target execution/changes, CI query or execution proof.
- Trust: caller scope, stable source, scanner 0.10.1, standard runner executable and checkout/setup-node infrastructure.
- Broad JS/TS discovery excludes dependency/build/vendor/git/cache directories. Mixed-framework errors remain incomplete inventory.
- Declared rules/routes remain facts when effects are unresolved. Do not treat their combination as effective selection.
- unresolved imported module effects
- unresolved imported module effects
- plugins/resolve may alter effective configuration; declared rules only
- opaque configuration expression effects unresolved
- setupFiles effects unverified: ['./src/test/setup.ts']
- environment effects unverified: jsdom
- coverage reporter effects unverified
- action effects unverified: oven-sh/setup-bun@0c5077e51419868618aeaa5fe8019c62421857d6
- action effects unverified: dtolnay/rust-toolchain@4be7066ada62dd38de10e7b70166bc74ed198c30
- action effects unverified: actions/cache@v6.1.0
- action effects unverified: Swatinem/rust-cache@f0d9c3887740aee45f6153b24b3a6b815192ec16
- action effects unverified: awalsh128/cache-apt-pkgs-action@681749ae568c81c2037cb9185e38b709b261bd2f
- unresolved command effects/alternate ownership: bun install --frozen-lockfile
- action effects unverified: actions/cache@v6.1.0
- unresolved condition: steps.cache-playwright.outputs.cache-hit != 'true'
- action effects unverified: actions/cache@v6.1.0
- unresolved condition: steps.cache-nextest.outputs.cache-hit != 'true'
- action effects unverified: actions/cache@v6.1.0
- unresolved condition: steps.cache-llvm-cov.outputs.cache-hit != 'true'
- step execution settings unresolved at 189
- unresolved command effects/alternate ownership: playwright test --config playwright.config.ts
- action effects unverified: codecov/codecov-action@303a32d7a59b442fa8d48b6a1cc6825c09c847a5
- action effects unverified: codecov/codecov-action@303a32d7a59b442fa8d48b6a1cc6825c09c847a5
- scanner errors; affected inventory incomplete
Connects securely to your tools. The creator never sees your data.
About this skill
Understand how your test settings and CI commands select test files.
CI Test Scope Audit brings test configuration, package scripts and a selected GitHub Actions job into one source-linked Markdown report. Use it when reviewing configuration changes, inheriting a repository or checking runner ownership before a release.
What you get
- Declared inclusions and exclusions, with file and line references.
- A trace from a scoped CI command to its test-runner invocation.
- Clear explanations of unresolved configuration and execution effects.
- A generated report file you can retain and review.
Supported scope The practical mode supports documented Vitest configuration forms and one explicit GitHub Actions job/matrix context. A separate, more limited Jest mode supports simple literal configurations and workflows.
Important limits An exclusion from one runner may belong to another runner. Plugins, setup hooks, arbitrary commands and incomplete inventory can leave effective selection unresolved.
The skill does not run project tests, modify repository source, enable disabled tests or apply fixes automatically. It does not establish which tests actually ran historically or whether CI passed.
Requires an existing trusted test-inventory CLI, Python, Node.js and an agent with local terminal and file access. The skill does not install its prerequisites.
Requires Node 22.18+, Python 3.11+, and test-inventory CLI 0.10.1. Does not measure test quality or runtime success. Unsupported plugins lead to unknown selection status.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 6 days ago
Requires
Permissions
File Scopes
Reads the authorised source-only audit directory and trusted scanner. Creates temporary helper files and the requested report outside the target. Does not modify repository source or query cloud CI.