RAG Eval Kit: Did Your Change Really Help?
by Swini
Build a test set from your own documents, score your RAG system's answers deterministically (no LLM judge), and learn with a paired significance test whether version B really beats A. Labels checked against the source, 95% intervals on every number. Runs locally, nothing to install.