---
format: "aidr-story-markdown/v1"
id: "5728c436a7598b96a221958e9aa58fbfcffa603952368f6713c396d941f2a1cc"
canonical_url: "https://aidr.today/5728c436?lang=en"
title: "When LLM judges agree, should we believe them?"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-09-14T16:29:30.000Z"
category: "Research"
topics: ["llm","agent","reasoning","safety"]
source_urls: ["https://www.amazon.science/blog/when-llm-judges-agree-should-we-believe-them","https://news.ycombinator.com/item?id=49699590"]
summary: "Discounting the opinions of LLM judges with highly correlated outputs ensures that panels of judges reflect a true diversity of perspectives."
---

# When LLM judges agree, should we believe them?

> [Open the canonical story](<https://aidr.today/5728c436?lang=en>)

**Published:** 2026-09-14T16:29:30.000Z
**Category:** Research
**Topics:** llm, agent, reasoning, safety

## Summary

Discounting the opinions of LLM judges with highly correlated outputs ensures that panels of judges reflect a true diversity of perspectives\.

## Sources

- [Story source](<https://www.amazon.science/blog/when-llm-judges-agree-should-we-believe-them>)
- [Discussion](<https://news.ycombinator.com/item?id=49699590>)