无需先验信息的两步项目功能差异检验方法  

Two-Step Differential Item Functioning Detection Procedures without A Priori Information

作　　者：韩雨婷 袁克海 刘红云 Han Yuting;Yuan Kehai;Liu Hongyun(School of Psychology,Beijing Language and Culture University,Beijing 100083;School of Science of Nanjing University of Posts and Telecommunications,Nanjing 210023;Department of Psychology,University of Notre Dame,IN 46556;Faculty of Psychology,Beijing Normal University,Beijing 100875;Beijing Key Laboratory of Applied Experimental Psychology,National Demonstration Center for Experimental Psychology Education(Beijing Normal University),Beijing 100875)

机构地区：[1]北京语言大学心理学院,北京100083 [2]南京邮电大学理学院,南京210023 [3]美国圣母大学心理系,印第安纳州46556 [4]北京师范大学心理学部,北京100875 [5]应用实验心理北京市重点实验室,心理学国家级实验教学示范中心(北京师范大学)北京100875

出　　处：《心理科学》2024年第3期734-743,共10页Journal of Psychological Science

基　　金：北京市社会科学基金项目(23JYC019)的资助。

摘　　要：传统的项目功能差异检验方法依赖先验信息设定锚题,误设锚题可能产生误导性结果。研究提出以数据驱动的难度差异QQ图(D-QQ图)选择锚题,再结合传统方法检验DIF的两步DIF检验法。两个实证研究说明了新方法在实际测验公平性检验中的适用性及可视化优势。模拟研究进一步表明当测验中有一半试题存在DIF时,若DIF试题仅偏向一组,则两步法兼具高统计检验力和低I类错误的优势;若DIF试题分别有利于两组,则其在I类错误控制上优于RCD方法。Differential item functioning(DIF)analysis plays a crucial role in determining the fairness and validity of educational assessments.Most traditional DIF analysis techniques rely on pre-defined anchor items that are assumed to be DIF-free.Unfortunately,if these anchor items themselves exhibit DIF,the results may be biased or even misleading.To address this issue,this article proposes a novel two-step DIF detection process inspired by the DIF detection method without prior information proposed by Yuan et al.(2021).The difficulty-difference quantile-quantile(D-QQ)plot is a scatterplot that depicts the actual difference in difficulty between two groups of test items on the vertical axis against the theoretical difference in difficulty obtained by Monte Carlo methods under the null hypothesis(that there are no DIF items in the test)on the horizontal axis.If the test does not contain DIF,then the observed differences in difficulty between the items in the reference and target groups should match these of the Monte Carlo.Then the D-QQ plot will fall on a line.In the first step,the items that fall on the line of the D-QQ plot are selected as anchor items.In the second step,these anchor items are combined with traditional DIF methods for the actual analysis.The two-step DIF detection method proposed in this article includes a number of methods,including combining the anchor items selected in the first step with the MH method,known as the two-step MH method,and combining them with the Wald method,known as the two-step Wald method.Two empirical studies were conducted using these DIF detection methods to analyze the datasets from the 2012 Program for International Student Assessment(PISA)math test and a language proficiency test for first grade middle school students in a certain region of China,demonstrating the practical application of the two-step DIF detection procedures.A Monte Carlo simulation study was conducted to compare five DIF detection methods.They are the two-step MH method,the two-step Wald method,the original

关 键 词：项目功能差异 D-QQ图 图形检验 两步DIF检验法 

分 类 号：B841[哲学宗教—基础心理学]