伦理智能体及其设计:现状和展望  

Artificial Moral Agents and Their Design Methodology:Retrospect and Prospect

作　　者：古天龙 李龙[1,2] GU Tian-Long;LI Long(College of Information Science and Technology/College of Cyber Security,Jinan University,Guangzhou 510632;Guangxi Key Laboratory of Trusted Software,Guilin University of Electronic Technology,Guilin,Guangxi541004)

机构地区：[1]暨南大学信息科学技术学院/网络空间安全学院,广州510632 [2]桂林电子科技大学广西可信软件重点实验室,广西桂林541004

出　　处：《计算机学报》2021年第3期632-651,共20页Chinese Journal of Computers

基　　金：国家自然科学基金(U1711263,U1811264,61966009);广西自然科学基金(2019GXNSFBA245049)资助。

摘　　要：智能体一直是人工智能的主要研究领域之一,任何独立的能够同环境交互并自主决策的实体都可以抽象为智能体.随着人工智能从计算智能到感知智能,再到认知智能的发展,智能体已逐步渗透到无人驾驶、服务机器人、智能家居、智慧医疗、战争武器等人类生活密切相关的领域.这些应用中,智能体与环境、尤其是与人类和社会的交互愈来愈突出,其中的伦理和道德问题日益凸显.人工智能应用的伦理风险和挑战引起了人们的普遍关注,伦理智能体是人工智能伦理的重要研究内容.本文从人工智能伦理的工程设计与实现角度,对伦理智能体及图灵测试、伦理智能体的设计范式、伦理智能体的逻辑程序设计、伦理智能体的形式化验证、伦理困境及分析等进行了介绍和讨论.同时,对伦理智能体及设计所面临的挑战和进一步研究方向进行了述评和展望.Artificial agents have always been one of the main research fields of artificial intelligence.Any independent entity that can interact with the environment and make decisions autonomously can be abstracted as an agent.With the development of artificial intelligence from computational intelligence to perceptual intelligence,and then to cognitive intelligence,artificial agents have gradually penetrated into many fields closely related to our human life,such as unmanned driving cars,service robots,smart households,voice assistants,intelligent medical care and war weapons.In these applications,the interactions between agents and among agents and the environment,especially humans and society,are becoming more and more prominent,and the interactions of agents with humans and society inevitably resulting in ethical threats and moral attentions.Issues regarding artificial moral agents are important research contents of ethical artificial intelligence.The ethical risks and challenges in the application of artificial intelligence have aroused more and more public concerns.The ethical issues of artificial intelligence belong to the interdisciplinary research of social science,philosophy,psychology,cognitive science,computer,artificial intelligence,etc.On the one hand,philosophy and humanistic social scientists focus on the moral subjects of artificial intelligence,the effects of artificial intelligence on the human society,the ethical norms and moral codes of artificial intelligence and so on.On the other hand,researchers in the engineering fields such as computer,cognitive science and artificial intelligence are interested in the embedded ethical decision design,the implementation of moral artificial intelligence,the ethical supervision and control of artificial intelligence and others.In the framework of ethically aligned design,realization and deployment of moral artificial intelligence,this paper reviews the design methodology of artificial moral agents in the following aspects.Firstly,the concepts of artificial moral a

关 键 词：伦理智能体 人工智能伦理 伦理设计 逻辑程序设计 形式化验证 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]