OR法在DIF检验中的应用——以英语学业能力测验为例  

An Application of the Odds Ratios Method in Differential Item Functioning:An Illustration with an English Test

作　　者：刘楚铜 金如意 何颖 张敏强 高方昕[1] Liu Chutong;Jin Ruyi;He Ying;Zhang Minqiang;Gao Fangxin(School of Psychology,South China Normal University,Guangzhou,510631;Key Laboratory of Brain,Cognition and Education Sciences,South China Normal University,Ministry of Education,Guangzhou,510631;Center for Studies of Psychological Application,South China Normal University,Guangzhou,510631;Guangdong Key Laboratory of Mental Health and Cognitive Science,South China Normal University,Guangzhou,510631)

机构地区：[1]华南师范大学心理学院,广州510631 [2]华南师范大学脑认知与教育科学教育部重点实验室,广州510631 [3]华南师范大学心理应用研究中心,广州510631 [4]华南师范大学广东省心理健康与认知科学重点实验室,广州510631

出　　处：《心理科学》2023年第2期470-477,共8页Journal of Psychological Science

摘　　要：本文将比值比方法(odds ratios method,OR)这一DIF检验方法应用到某英语测验的DIF检验中,介绍OR法进行DIF检验的完整流程,并将其检验结果与应用较为广泛的Wald χ^(2)检验和似然比检验(likelihood ratio test,LRT)的检验结果进行比较,以进一步验证OR法在实证研究中的适用性。研究结果显示,OR法与LRT法结果差异较小且OR法步骤更简便,说明OR法与LRT法在DIF检验中的表现相似,LRT法适用于实证研究中,因此OR法同样适用于实证研究的DIF检验。The detection of differential item functioning(DIF)is an essential step for increasing the validity of a test among groups.A common feature of the conventional DIF approaches is that different groups of examinees are placed on the same metric based on a matching variable.However,contaminated matching variable would make the DIF detection biased.Some investigators developed the odds ratios(OR)method,which does not require matching variables.The OR method is easy to understand and simple for practitioners.However,all previous studies about the OR method are simulation studies,and the application of OR method in the DIF detecting of the academic achievement test needs further investigation.Previous studies indicated that the IRT-based approaches performed well in the DIF detecting of the academic achievement test.The Wald test and likelihood ratio test(LRT)are widely used in DIF detection as IRT-based approaches.It is helpful to compare the performance and the operating procedure of OR method with the Wald test and the LRT method.The current study aimed to introduce the operating procedure of the OR methods in the DIF detecting of the academic achievement test,and demonstrated that the OR method was a better method in DIF detecting by comparing the performance and the operating procedure among the OR method,the Wald test,and the LRT method.An empirical study was conducted,and the data was selected from an English test.Valid data from 3241 senior high school students,including 1427 males(44.03%)were analyzed.The DIF detection was conducted on 35 dichotomous items from the English examination.The difficulty of the 35 dichotomous items were acceptable(from.20 to.80).Besides,the Cronbach’s alphas of the 35 items were.86.The DIF detection results of the OR method,the Wald test,and the LRT method on English test would be testified and compared.The empirical study found that 16 items were detected as DIF items by the OR method,including both 8 items favoring females and males respectively.14 items were detected as DIF it

关 键 词：比值比方法 项目功能差异 方法应用 

分 类 号：H319.3[语言文字—英语]