---
format: "aidr-story-markdown/v1"
id: "8eed4925d1c0d15a465a5d1ee6276111fdcad5fcaa2aae5a0c0ab1ed893889e3"
canonical_url: "https://aidr.today/8eed4925?lang=en"
title: "Jev-as-a-Judge for RAG Claim Verification: Confidence-Gated Cascading Between a Non-Generative Verifier and a Frontier LLM"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-10-16T04:00:00.000Z"
category: "Data"
topics: ["llm","data-engineering"]
source_urls: ["https://arxiv.org/abs/2610.20634"]
summary: "A non-generative decision model called Jev was compared against a frontier LLM for verifying whether evidence supports claims, using 495 human-labeled claims from LLM-AggreFact. The two systems showed a statistically indistinguishable difference of -0.56 points on the conventional metric, but disagreed on 15.2% of claims, with Jev admitting 23.2% of unsupported claims versus the frontier model's 14.1%. The cheaper system costs 187 times less to run than the frontier LLM."
---

# Jev\-as\-a\-Judge for RAG Claim Verification: Confidence\-Gated Cascading Between a Non\-Generative Verifier and a Frontier LLM

> [Open the canonical story](<https://aidr.today/8eed4925?lang=en>)

**Published:** 2026-10-16T04:00:00.000Z
**Category:** Data
**Topics:** llm, data\-engineering

## Summary

A non\-generative decision model called Jev was compared against a frontier LLM for verifying whether evidence supports claims, using 495 human\-labeled claims from LLM\-AggreFact\. The two systems showed a statistically indistinguishable difference of \-0\.56 points on the conventional metric, but disagreed on 15\.2% of claims, with Jev admitting 23\.2% of unsupported claims versus the frontier model's 14\.1%\. The cheaper system costs 187 times less to run than the frontier LLM\.

## Sources

- [Story source](<https://arxiv.org/abs/2610.20634>)