RULER
by NVIDIA
What is RULER? RULER is a rag & retrieval eval made by NVIDIA. Generates synthetic long-context tests at whatever length you choose, with 13 tasks in 4 categories that go beyond finding a single needle in a haystack. Its results compare each model's advertised context length with the length at which it still performs well.
Editor note
Generates synthetic long-context tests at whatever length you choose, with 13 tasks in 4 categories that go beyond finding a single needle in a haystack. Its results compare each model's advertised context length with the length at which it still performs well.
- What it tests
- How much of a long context window a model can really use.
- Original source
- github.com/NVIDIA/RULER
- Last updated
- Repo last commit 2026-07-22
- License
- Apache-2.0
Reviews
No reviews yet.
Reviews from practitioners who sign in with GitHub open soon.
Related rag & retrieval evals
- Ragas — Faithfulness, relevance and retrieval quality of your own RAG system.
- BEIR — Zero-shot retrieval across diverse domains.
- MTEB Leaderboard — Embedding model quality for search and RAG.
- CRAG — End-to-end RAG answer correctness and hallucination.