AI Insight
This study validated the UDig Reading Test, a purpose-built diagnostic tool for assessing English reading skills among Chinese university students learning English as a foreign language. Researchers used cognitive diagnostic modeling, expert judgments, and think-aloud protocols with 642 test-takers to confirm that the test accurately measures predefined reading subskills. The analysis revealed that understanding passage structure and cohesion was the most challenging subskill for learners, and unexpectedly confirmed that search reading was an important component in expeditious reading tasks.
Why it matters
This research demonstrates that building diagnostic assessments from the ground up produces more accurate results than retrofitting existing tests, enabling educators to identify specific reading skill gaps and provide targeted instruction. The validated approach offers a model for developing future diagnostic assessments that can precisely pinpoint learner weaknesses and inform personalized remediation strategies.
Understand the Science
IntroductionDiagnostic assessment, which aims to identify the strengths and weaknesses of learners’ cognitive abilities for targeted remediation, has gained momentum in recent years. This study applied a cognitive diagnostic approach to validate the UDig Reading Test, designed to diagnose the reading skills of tertiary-level English as a foreign language (EFL) learners in China.MethodsUsing a mixed-methods design, test-takers’ think-aloud protocols, expert judgments, and cognitive diagnostic modeling were integrated to examine the accuracy of the predefined item-subskill associations. Large-scale performance data from 642 test-takers were analyzed to estimate their reading subskill mastery patterns.ResultsResults showed that the predefined item-subskill associations were generally supported by empirical evidence. In particular, search reading was empirically confirmed as a targeted subskill in the expeditious reading section, despite its absence from the initial test specifications. Subskill prevalence analysis identified the subskill of understanding the structure and cohesion of a passage as the most challenging one, providing evidence that may inform targeted instructional support.DiscussionThis study responds to persistent calls for research into truly diagnostic assessments rather than retrofitting existing tests and demonstrates the value of the cognitive diagnostic approach in enhancing the diagnostic precision of reading assessment. It also outlines a research agenda for developing cognitive diagnostic assessment from inception so as to fully realize its diagnostic potential.