认知诊断评价中的被试拟合研究  

Person-Fit in Cognitive Diagnostic Assessment

作　　者：喻晓锋[1] 唐茜 秦春影 李喻骏 Yu Xiaofeng;Tang Qian;Qin Chunying;Li Yujun(School of Psychology,Jiangxi Normal University,Nanchang330022;School of Mathematics and Information Science,Nanchang Normal University,Nanchang330032)

机构地区：[1]江西师范大学心理学院,南昌330022 [2]南昌师范学院数学与信息科学学院,南昌330032

出　　处：《心理科学》2024年第3期744-751,共8页Journal of Psychological Science

基　　金：教育部教育考试院‘十四五’规划支撑专项课题“高考实施过程中的科目跨年分数的转换研究(NEEA2021050)”;国家自然科学基金项目(32360208,62341207)的资助。

摘　　要：通常情况下,认知诊断需要通过认知诊断模型对被试进行诊断评价。认知诊断模型所生成诊断结果的有效性依赖于被试作答反应是否与所选用的模型拟合。因此,在对诊断结果进行评估的时候,需要通过被试拟合分析来对被试个体的作答反应与模型的拟合情况进行检验,以避免错误或无效的补救措施。本研究基于加权的得分残差,提出认知诊断评价中新的被试拟合指标R。模拟研究结果表明,R指标的一类错误率有较好的稳定性,对随机作答、疲劳、睡眠和创造性作答四种异常被试类型均有较高的统计检验力。并将R指标应用于分数减法实证数据,展示指标在实际测验中的使用过程。Cognitive Diagnostic Assessment(CDA)is a widely used educational assessment.It can provide guidance for further study and teaching by analyzing whether the test-takers have acquired knowledge points or skills.<br/>In psychometrics,statistical methods for assessing the fit of an examinee’s item responses to a postulated psychometric model are often called person-fit statistic.The person-fit analysis can help to verify diagnostic results,and is mainly used to distinguish the abnormal examinees from the normal ones.The abnormal response patterns include“sleeping”behavior,fatigue,cheating,creative responding,random guessing responses and cheating with randomness,all of which can affect the deviation of examinee’s ability estimation.The person-fit analysis can help researchers identify the abnormal response patterns more accurately,so as to delete the abnormal responding examinees and improve the validity of the test.In the past,most of the person fit researches were mainly carried out under the Item Response Theory(IRT)framework,while only few papers have been published dealing with person-fit under the CDM framework.This study attempts to fill a gap in the literature by introducing new methods.In this study,a new person fit index(R)was proposed.<br/>In order to verify the validity of the newly developed person fit index,this study explores the type I error and statistical test power of R index under different item length,item discrimination and different misfit types of respondent,and compares it with existing methods RCI and lz.Type I error rate was defined as the proportion of flagged abnormal response patterns by a person fit statistic out of 1,000 generated normal response patterns from the DINA model.The control variables of this study include:the number of subjects is controlled to 1000,the cognitive diagnosis model is chosen as DINA model,the attributes are 6,and the Q matrix is fixed.Finally,to reflect the value of person fit index in practical application,the R index is applied to the empirical data

关 键 词：认知诊断 被试拟合DINA模型 异常反应作答 

分 类 号：B842.1[哲学宗教—基础心理学]