Your Bench

YourBench is an open-source framework for generating zero-shot benchmarks from your own documents. It helps you test language models on custom domains using automated pipelines for ingestion, summarization, and question generation.

• 📚 Build benchmarks from PDFs, HTML, or text files
• 🧠 Generate both single-hop and multi-hop questions
• 🔍 Evaluate top models and deploy leaderboards instantly
• 🛠️ Fully configurable via a single YAML file

Built with 🤗 by the OpenEvals team — GitHub