智能教育场景下的算法歧视:潜在风险、成因剖析与治理策略  

Algorithmic Discrimination in Artificial Intelligence in Education:Potential Risks,Cause Analysis,and Governance Strategies

作　　者：倪琴[1,2] 刘志 郝煜佳[2] 贺樑 Ni Qin;Liu Zhi;Hao Yujia;He Liang(Institute of artificial intelligence on education,Shanghai Normal University,Shanghai 200234;Institute of AI education SH,East China Normal University,Shanghai 200062;School of Computer Science and Technology,East China Normal University,Shanghai 200062)

机构地区：[1]上海师范大学人工智能教育研究院,上海200234 [2]华东师范大学上海智能教育研究院,上海200062 [3]华东师范大学计算机科学与技术学院,上海200062

出　　处：《中国电化教育》2022年第12期93-100,共8页China Educational Technology

基　　金：国家自然科学基金“基于深度强化学习的自适应学习路径推荐研究”(项目编号:6210020445);国家社会科学基金重大项目“面向未成年人的人工智能技术规范研究”(项目编号:21&ZD238)阶段性研究成果。

摘　　要：随着人工智能在教育场景中应用的不断深化,智能教育以其个性化、定制化等独有优势改变了当下的教育格局,但智能教育也面临着算法歧视的潜在风险,如教育结果的单一化、加剧教育不公平、学习结果两极分化、人机交互加深偏见等。同时,在智能教育系统的开发与应用过程中,设计团队存在思维定势、机器学习的偏差、交互式决策的危机等问题使算法歧视的成因更为多样化。而解决对智能教育系统中存在的算法歧视问题,需从促进多主体共同参与,构建多元评价标准,以及通过技术赋能等三方面落实治理策略。具体到技术治理,可根据时间维度划分为三阶段治理,即在事前加强数据歧视检测,在事中建立可解释、可审查的算法优化机制,在事后坚持学生在教育教学活动中的主体性。With the in-depth development of artificial intelligence in education,intelligent education has reshaped the current education with the unique advantages such as personalization and customization.However,intelligent education also faces the potential risks of algorithmic discrimination,such as the simplification of educational outcomes,the intensification of educational inequities,the polarization of learning outcomes,and the deepening of prejudice in human-computer interaction.Meanwhile,in the development and application process of the intelligent education system,the mindset of design team,the bias of machine learning and the crisis of interactive decision-making make the causes of algorithmic discrimination more diverse.In order to solve the problem of algorithmic discrimination in the intelligent education system,it is necessary to implement governance strategies from three aspects:promoting the multi-agent participation,constructing multiple assessment criterion,and accelerating technology enabled educational governance.In terms of technology enabled educational governance,it can be divided into three stages according to the time dimension:strengthening data discrimination detection before the event,establishing the explainable and reviewable algorithm optimization mechanism during the event,and insisting on the subjectivity of students in educational teaching activities after the event.

关 键 词：智能教育 算法歧视 教育公平 风险治理 

分 类 号：G434[文化科学—教育学]