英语听力动态评估多选题外加干扰项的构建及验证  

The construction and validation of English listening multiple choice question's added distractors in dynamic assessment

作　　者：耿雪 孟亚茹[1] Geng Xue;Meng Yaru

机构地区：[1]西安交通大学外国语学院 [2]西安邮电大学人文与外国语学院

出　　处：《外语教学》2024年第3期59-65,共7页Foreign Language Education

基　　金：陕西省教师教育改革与教师发展研究重点项目“混合式教学下教师形成性评价素养的诊断与提升路径”(项目编号:SJS2023ZD028);西安交通大学教改基金项目“基于认知诊断的大学英语水平测试试题质量历时研究”(项目编号:2245Y)的阶段性研究成果。

摘　　要：动态评估融合评估与干预,能为被试提供实时、渐进的干预指导。基于多项选择题的动态评估干预频次与干扰项的数目相关。为最大限度地增加动态评估的干预频次,已有研究通常为原四选项外加一个干扰项,但对其构建的科学性缺乏严谨论证会直接影响其干扰性和基于此的动态干预效果。鉴于此,本研究首先确立干扰项构建准则,并据此为55个托福听力题添加干扰项,之后借助称名反应模型(NRM)验证其质量。研究结果发现外加的干扰项整体上符合干扰项构建准则,选项特征曲线也表明其干扰度较好。本文为外加干扰项的构建及论证提供了测试学理论和统计学操作方面的证据,对提升动态评估的干预质量具有重要意义。Dynamic assessment integrates assessment and mediation,providing real-time and progressive guidance for learners.The frequency of mediation in dynamic assessment based on multiple choice questions is related to the number of distractors.To maximize the possible mediation frequency,researchers usually add one extra distractor to the original four-options.However,lack of rigorous construction principles and validation processes directly affects its potency,and in turn,the effectiveness of mediation.To address this gap,this study constructs and validates the added distractors for 55 TOEFL English listening items based on distractor construction principles and then applies Nominal Response Model(NRM)analysis for their appropriateness.Research findings show that the added distractors in general conform to the principles of distractor design and show decent distraction power.This study provides evidence for the added distractor construction and validation,which is significant for promoting the quality of the future dynamic assessment mediation.

关 键 词：英语听力 动态评估 多项选择题 外加干扰项 

分 类 号：H319[语言文字—英语]