不同评分情境和不同语言背景的评分员对大学生英语口语评分信度和效度的影响研究  

The Impact of Raters' Rating Context and Language Background on the Reliability and Validity in the Assessment of University Students' Spoken English

作　　者：孙美华 展素贤[1] 

机构地区：[1]天津科技大学,天津300457

出　　处：《考试与评价》2021年第5期77-84,共8页TESTING AND EVALUATION

摘　　要：为探究不同评分情境和不同语言背景的两组评分员是否对英语口语测评信度和效度有影响,本研究邀请了我国5名高校英语教师和5名英语本族语外籍教师作为两组评分员,在两个不同评分情境,分别对30份英语专业学生的期末英语口语测试样本进行了评分,并采用概化理论,对英语口语样本进行了口语测试的信度和效度检验。研究结果表明:不同评分情境对两组评分员的口语评分的信度和效度影响甚微;具有不同语言背景的两组评分员对口语评分的信度和效度有显著性影响。为保障英语口语测试的信度和效度以及教育公平,在未来英语口语测试中,建议邀请英语本族语外籍教师参与英语口语测评、增加评分员数量以及对我国英语教师进行语言测评素养培训。The study aimed to explore whether rating contexts and language background of raters influenced the reliability and validity of oral English assessment.In this study,five Chinese English language teachers and five overseas teachers were invited as two groups of raters to rate 30 oral English samples from university students in the final English examination in two different rating contexts,and Generalizability theory was used to verify the reliability and validity of these oral English samples of oral English assessment.The results showed that the different rating contexts had no significant influence on the raters'rating reliability and validity,while the raters'language background had significant influence on the rating reliability and validity.Therefore,it is suggested that in the process of oral English assessment in the future,overseas teachers should be invited as raters,the number of raters should be increased and Chinese English teachers should be trained of their language assessment literacy in order to improve the rating validity and reliability of the oral English assessment.

关 键 词：英语口语测试 评分员 信度与效度 评分情境 语言背景 

分 类 号：H31[语言文字—英语]