The Sethi Ledger

People · Practice · Possibility

Independent research for education leaders

Author manuscript: controlled human study

Explanations that help users find errors

From the early edition, with research available through September 12, 2026 (UTC).

Participants preferred plans and decomposed explanations, but simpler step-by-step traces often better supported verification. Some preferred formats increased false alarms or encouraged trust without corresponding willingness to check.

Why it matters for leaders

Test whether students can locate and explain a flaw in an AI answer. Treat satisfaction with an explanation as a separate measure from successful checking.

The evidence

Fifty adult students completed a controlled comparison of six formats, using 27 selected problems and deliberately inserted reasoning errors. Assignment and presentation order were randomized.

Who was studied

University adults: indirect K-12 implications

What the evidence cannot tell us

One university sample, selected benchmark problems, and artificial errors limit classroom generalization. The study measures immediate evaluation, not lasting critical-thinking gains or authentic internal model reasoning.

Read the original sources

Summary and leadership analysis from the September 6–13, 2026 brief. The edition’s selection notes explain source access and evidence limitations.

Download the complete edition

Continue reading

← Back to this edition