Rubric libraries & frameworks

Jev (TypeSafe AI)

by TypeSafe AI

Editor note

A commercial model API built for structured judgments rather than text: you send a state plus typed questions (pick a choice, score against a rubric, true/false likelihood) and get back typed answers with probabilities and confidence. Version 1.14.0 (announced 14 Oct 2026) adds experimental image inputs, a bounding-box answer type and longer context behind opt-in flags. Made by a vendor; paid API.

What it tests
Not a benchmark: a tool for AI-judge / LLM-as-judge style scoring in your own evals.
Original source
docs.typesafe.ai/
Last updated
Jev 1.14.0 announced 2026-10-14
License
Not checked yet — see source

Facts come only from the linked source (checked 15 Oct 2026). Credit belongs to the creators.

Reviews

No reviews yet.

Reviews from practitioners who sign in with GitHub open soon.