Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+21 more

    RAG Knowledge Base Design and QA Suite

    1

    Design optimized chunking strategies, metadata schemas, and hallucination-proof QA suites for production RAG pipelines.

    $5

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned
    RAG Knowledge Base Design and QA Suite

    RAG Knowledge Base Design and QA Suite

    Example session with this skill installed

    I'm building a RAG bot for our internal HR policies (PDFs). The retrieval is messy and it keeps making up vacation rules. Design a chunking strategy and a QA suite to fix this.

    • Read your context and instructions
    • Compiled the rag knowledge base
    • Generated the document

    I have designed a RAG architecture and evaluation suite tailored for HR policy documents to ensure retrieval precision and eliminate hallucinations.

    RAG Knowledge-Base QA Report

    🏗️ Chunking & Metadata Strategy

    • Chunk Size: 512 tokens (optimal for granular policy clauses).
    • Overlap: 15% (approx 75 tokens) to maintain context across paragraph breaks.

    Metadata Schema: {"policy_type": "string", "effective_date": "date", "department": "string", "source_file": "string", "page_number": "int"}. This allows filtering by department to prevent cross-office policy confusion.

    🔍 Retrieval Test Cases (Golden Queries)

    Query TypeQuery ExampleExpected Top Chunk
    Simple Factual"What is the annual leave entitlement for senior managers?"Chunk from vacation_policy.pdf containing the grade-based entitlement table.
    Complex Multi-hop"Can I carry over unused leave if I joined after July?"Intersection of accrual_rules.pdf and prorated_benefits_clause.pdf.
    Negative/Out-of-Scope"What is the company's stock price today?"Zero relevant chunks / No HR policy matches.

    🛡️ Hallucination & Citation System Prompt

    CRITICAL: You must answer ONLY using the provided context. If the answer is not explicitly in the context, reply exactly with: 'I cannot find this information in the provided HR documents.' You MUST include inline citations for every claim in the format [Source: source_file, Page: page_number].
    

    ⚡ Optimization Notes

    • Metadata Filtering: Always filter by department before similarity search to narrow the vector space.

    Reranking: Implement a Cross-Encoder reranker (like Cohere or BGE-Reranker) to evaluate the top 10 retrieved chunks before passing the top 3 to the LLM.

    Next steps

    1. Update your ingestion script with the 512/15% chunking parameters.
    2. Implement the metadata schema in your vector database index.
    3. Run the Golden Queries through your retrieval pipeline to calculate Hit Rate and MRR.

    vacation_policy.pdf

    PDF · document

    Generated

    Example file from a real run - the skill writes it into your workspace.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    The problem

    RAG pipelines often fail due to poor retrieval, lack of citations, and unpredictable hallucinations. Standard "just feed the context" prompts frequently lead to the AI making up information when the database returns irrelevant chunks.

    What it does

    • Defines precise chunk sizes and overlap percentages based on specific document types.
    • Structures metadata schemas to enable efficient hybrid search and filtering.
    • Generates "Golden Query" test cases including multi-hop and negative queries to audit vector DB performance.
    • Drafts strict system prompt snippets for context-only answering and mandatory inline citations.
    • Recommends reranking and filtering strategies to reduce token waste and latency.

    Frameworks & tools

    Works with vector databases like Pinecone, Weaviate, Milvus, and ChromaDB. Applicable to RAG frameworks including LangChain, LlamaIndex, and Haystack.

    Why this beats prompting it yourself

    Generic prompts don't solve underlying data architecture issues. This skill provides the technical specifications for the data layer and the evaluation framework needed to prove your RAG pipeline actually works before you hit production.

    Use cases

    • Designing the chunking strategy for a massive corpus of technical PDF manuals.
    • Reducing hallucination rates in a customer support bot by enforcing context-only rules.
    • Benchmarking retrieval accuracy for a new vector database implementation.
    • Optimizing token costs by refining metadata filters and context window usage.

    Requires manual implementation of the suggested strategies within your specific RAG framework. Does not perform the actual document embedding or database upserts.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before any payment.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scan

    Security scan passed 1 month ago

    Permissions

    No special permissions declared or detected

    Listed1 month ago

    What's inside

    Frequently Asked Questions

    This skill provides a comprehensive architecture blueprint, including optimized chunking strategies, metadata schemas, and a "Golden Query" testing suite to ensure high retrieval accuracy and zero hallucinations in your RAG pipeline.

    It is designed for use with popular frameworks like LangChain, LlamaIndex, and Haystack, and is compatible with major vector databases including Pinecone, Weaviate, Milvus, and ChromaDB.

    You will receive a technical implementation guide, pre-configured testing protocols for negative and multi-hop queries, and optimized system prompt snippets tailored for strict context-only answering.

    Yes, the skill includes specialized logic for defining chunk sizes and overlap percentages tailored to complex document types like technical manuals, legal contracts, and dense PDFs.

    Implementation is straightforward; once imported into your agent environment, you can apply the provided architectural specifications directly to your data ingestion and retrieval workflows.

    Buyers receive lifetime access to the current version of the suite, including any performance optimizations or framework compatibility updates released for this specific product.

    New in LLM Ops