When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

Source facts

The paper proposes Chain-of-Self-Questioning, a prompt-only framework that makes answer commitment conditional on an explicit assessment of whether the model has enough information. The abstract reports evaluations on TruthfulQA with eleven model families and a secondary Natural Questions evaluation.

Analysis

The concept is a tunable answer-or-abstain layer that treats referral or review as an acceptable outcome when unsupported commitment is costly. It may be relevant to agent handoffs and confidence-aware deployment, but the reported results remain preprint evidence.

Uncertainty/Doubt

• The quantitative findings are author-reported in an unreviewed preprint and were not independently reproduced here.