External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing

Source facts

The preprint presents a hidden-state method for identifying the onset and continuation of hallucinated spans rather than making only token-level binary judgments. It proposes an external observer model that probes the generator's internal representations and reports that a smaller observer can match or exceed the generator's own self-detection in the tested settings.

Analysis

The external-observer framing is relevant to scalable oversight and runtime reliability: monitoring need not be limited to the model that generated the answer. Span-level localization could also make review and intervention more targeted than whole-response labels.

Uncertainty/Doubt

• This is an arXiv preprint. The hidden-state access assumptions, cross-model transfer, and precision-recall results were not independently reproduced here.