Permitting AI in reading preparation did not produce clear gains
Does permission to use AI improve preparation for a reading lesson? At a Japanese university, 83 students experienced English-reading preparation with and without AI access. Researchers found no statistically significant differences in quizzes, final examinations, preparation time or perceived understanding. Usage records help explain the pattern: students mostly requested vocabulary, sentence meanings and grammatical explanations, while checking their own interpretations was less common. AI therefore often served as a local language aid rather than a prompt for deeper reflection. The study does not show that AI is ineffective; it shows that permitting access alone did not produce clear gains on the outcomes measured in this setting.
Why it matters for leaders
For a reading pilot, require an initial interpretation before assistance and a short explanation of any revision afterward. Ask teachers to distinguish vocabulary help from interpretation supplied by the tool. Assess comprehension on a new passage without AI, alongside preparation time and students' confidence.
The evidence
Complete paired records covered 64 quizzes and 75 examinations. Researchers also examined questionnaires, interaction records and student reflections.
Who was studied
Japanese undergraduates who were not English majors.
What the evidence cannot tell us
One university, different texts, missing records and varied tools limit inference. A non-significant result establishes neither equivalence nor safety.
Read the original sources
Summary and leadership analysis from the Week ending 2026-09-18 brief. The edition’s selection notes explain source access and evidence limitations.