非参数认知诊断方法下诊断结果的概率化表征  

A Probabilistic Representation Approach for the Nonparametric Classification Method to Cognitive Diagnosis

作　　者：汪文义[1] 宋丽红 丁树良[1] 汪腾[1] 熊建 Wang Wenyi;Song Lihong;Ding Shuliang;Wang Teng;Xiong Jian(School of Computer and Information Engineering,Jiangxi Normal University,Nanchang,330022;School of Education,Jiangxi Normal University,Nanchang,330022)

机构地区：[1]江西师范大学计算机信息工程学院,南昌330022 [2]江西师范大学教育学院,南昌330022

出　　处：《心理科学》2021年第5期1249-1258,共10页Journal of Psychological Science

基　　金：国家自然科学基金(62067005,61967009);江西省社科规划项目(17JY10);江西师范大学教学改革研究课题(JXSDJG1848)的资助。

摘　　要：非参数认知诊断分类方法非常适合课堂评估,其诊断结果采用0-1形式而缺乏概率化表征,不能精细地区分被试属性掌握程度的差异或变化,还缺乏可用于评价真实测验分类结果的信度和效度指标。要刻画被试属性掌握程度的差异,首要的问题是要为非参数认知诊断方法提供一种可以量化属性掌握概率的方法。针对此问题,基于二项分布和玻尔兹曼分布提出非参数认知诊断方法下诊断结果的概率化表征方法,并用于构建分类准确性和分类一致性指标。模拟研究与实测数据分析结果显示:概率化表征方法与非参数认知诊断方法的分类结果高度一致;概率化表征方法与认知诊断模型所得的属性掌握概率十分接近;概率化表征方法所得的属性(模式)掌握概率可用于计算属性(模式)分类准确性和分类一致性指标,在实际测验情景下可作为信度和效度指标,评价诊断结果的重测一致率和判准率。Cognitive diagnostic assessment(CDA)can be regarded as a kind of formative assessments because it is intended to promote assessment for learning in classrooms by providing the diagnostic information about students’cognitive strengths and weaknesses.CDA has received increasing attention in recent years.Statistical pattern recognition and classification methodology are two critical parts in CDA.Q-matrix corresponding to feature generation is of paramount importance in CDA.Therefore,Q-matrix becomes a popular research area in the field of CDA.Beside of the study of Q-matrix,many of the studies have focused on cognitive diagnostic models(CDMs).CDMs required a large sample size for calibrating item parameters.Therefore,the nonparametric classification method has become a popular method for classroom assessments.It is very suitable for classroom assessments,because it does rely on a large sample size for the calibration of item parameters.However,classification results for nonparametric classification method are often expressed as the form of 0-1 vector.The classification results lack a probabilistic representation,and cannot finely distinguish the differences in the degree of mastery of attributes among the subjects.At the same time,it lacks the reliability and validity indicators for evaluating the quality of classification results.To solve this problem,a probabilistic representation based approach for the nonparametric classification method to cognitive diagnosis is proposed based on binomial distribution and Boltzmann distribution.The probabilistic representation method handles attributes mastery status at a probability level.A simulation study was conducted to investigate the performance of the probabilistic representation method under three factors(slip parameter,guessing parameter,and two CDMs).Five independent attributes and the reduced Q-matrix as a test Q-matrix were considered in the simulation study.Item response data was generated by the deterministic inputs,noisy"and"gate(DINA)model or the deterministic

关 键 词：认知诊断 非参数方法 属性掌握概率 分类准确性 分类一致性 

分 类 号：B842.1[哲学宗教—基础心理学]