- Home
- Skills
- Research & Analysis
- bibcheck verify
bibcheck verify
Verify scientific bibliographies against Crossref and OpenAlex to detect hallucinated or incorrect citations.
Free
Works with the AI Agents you already use
bibcheck verify
Example session with this skill installed
Check the references in my manuscript draft references.txt and flag any that look like AI hallucinations.
- Read your context and instructions
- Compiled the bibcheck verify
I have analyzed the bibliography in references.txt using metadata extracted from the file and verified it against Crossref and OpenAlex databases.
Bibliography Verification Report
The verification process is complete. I processed 12 citations and identified 2 entries that require manual intervention.
| Reference ID | Status | Issue |
|---|---|---|
| 0 | verified | Matches found in Crossref and OpenAlex |
| 1 | verified | Matches found in Crossref |
| 2 | suspected_hallucination | No matching records found in academic databases |
| 3 | verified | Matches found in OpenAlex |
| 4 | low_confidence | Title matches but author list differs significantly |
| 5 | verified | Matches found in Crossref and OpenAlex |
| 6 | verified | Matches found in Crossref |
| 7 | verified | Matches found in OpenAlex |
| 8 | verified | Matches found in Crossref and OpenAlex |
| 9 | verified | Matches found in Crossref |
| 10 | verified | Matches found in OpenAlex |
| 11 | verified | Matches found in Crossref and OpenAlex |
The results have been saved to the output directory. Reference
ID 2 shows no indexed record for the provided title and author combination, suggesting it may be fabricated or contains significant typos. Reference
ID 4 returned a partial match but the metadata confidence is below the threshold for automatic verification.
Next steps
- Manually verify the existence of the paper at ID 2 using a search engine.
- Review the metadata for ID 4 to ensure the DOI and author names are correctly formatted.
- Update the
references.txtfile with the correct details for flagged entries and re-run the check.
Connects securely to your tools. The creator never sees your data.
About this skill
Scientific papers and technical reports often contain fabricated or hallucinated citations that are difficult to spot manually. This skill automates the verification of bibliographies by cross-referencing metadata against Crossref and OpenAlex databases. It converts raw citations from PDFs, Markdown, or BibTeX into structured queries and flags high-risk entries for manual review.
What it does
- Multi-format extraction identifies citation metadata from PDF, Markdown, text, or BibTeX files.
- Automated verification cross-references extracted titles, authors, and DOIs with Crossref and OpenAlex.
- Hallucination detection flags references that cannot be found in major academic indexes.
- Triage reporting generates a summary of verified, low-confidence, and suspected-hallucination citations.
- Metadata normalization structures fragmented citation data into a standardized JSON format for processing.
How it works
- The agent reads the source bibliography and extracts metadata for every citation, preserving the original order.
- It generates a temporary JSON file containing structured titles, authors, years, and search queries.
- The
bibcheck-verifyutility runs against the original file using the structured metadata as a reference. - The skill parses the resulting triage report to identify which citations require human verification.
Frameworks & tools
This skill requires Python 3.11+ or the uv package manager. It utilizes the bibcheck-verify Python package and connects to the Crossref and OpenAlex public APIs via HTTPS.
Why this beats prompting it yourself
LLMs are prone to confirming their own hallucinations when asked to verify text. This skill forces the agent to check external, authoritative academic databases, providing evidence-based verification rather than probabilistic guesses.
Use cases
- Peer review to verify that a submitted manuscript contains legitimate and accurately cited references.
- Academic writing to ensure your own bibliography lacks accidental hallucinations or broken DOIs.
- Technical due diligence to validate the sources cited in whitepapers or technical reports.
Known limitations
Requires outbound HTTPS access to api.crossref.org and api.openalex.org. Triage labels like "suspected_hallucination" are not definitive proof of fabrication and always require human review.
Requires Python 3.11+ and outbound HTTPS to Crossref and OpenAlex APIs. Only supports metadata fields for title, authors, year, doi, and venue.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
1 use
Times used to date
Free forever
No account required to browse
Trust & safety
Security scan
Security scan passed 1 month ago
- Free with an Agensi account
Requires