面向虚实融合的人机交互  

Human-computer interaction for virtual-real fusion

作　　者：陶建华 龚江涛[2] 高楠 傅四维 梁山[5] 喻纯[3] Tao Jianhua;Gong Jiangtao;Gao Nan;Fu Siwei;Liang Shan;Yu Chun(Department of Automation,Tsinghua University,Beijing 100084,China;Institute for AI Industry Research,Tsinghua University,Beijing 100084,China;Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China;Zhejiang Laboratory,Hangzhou 311121,China;Institute of Automation,Chinese Academy of Science,Beijing 100190,China)

机构地区：[1]清华大学自动化系,北京100084 [2]清华大学智能产业研究院,北京100084 [3]清华大学计算机科学与技术系,北京100084 [4]之江实验室,杭州311121 [5]中国科学院自动化研究所,北京100190

出　　处：《中国图象图形学报》2023年第6期1513-1542,共30页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61971419,62006223,62002331)。

摘　　要：面向虚实融合的人机交互涉及计算机科学、认知心理学、人机工程学、多媒体技术和虚拟现实等领域,旨在提高人机交互的效率,同时响应人类认知与情感的需求,在办公教育、机器人和虚拟/增强现实设备中都有广泛应用。本文从人机交互涉及感知计算、人与机器人交互及协同、个性化人机对话和数据可视化等4个维度系统阐述面向虚实融合人机交互的发展现状。对国内外研究现状进行对比,展望未来的发展趋势。本文认为兼具可迁移与个性化的感知计算、具备用户行为深度理解的人机协同、用户自适应的对话系统等是本领域的重要研究方向。Virtual-real human-computer interaction(VR-HCI) is an interdisciplinary field that encompasses human and computer interactions to address human-related cognitive and emotional needs.This interdisciplinary knowledge integrates domains such as computer science,cognitive psychology,ergonomics,multimedia technology,and virtual reality.With the advancement of big data and artificial intelligence,VR-HCI benefits industries like education,healthcare,robotics,and entertainment,and is increasingly recognized as a key supporting technology for metaverse-related development.In recent years,machine learning-based human cognitive and emotional analysis has evolved,particularly in applications like robotics and wearable interaction devices.As a result,VR-HCI has focused on the challenging issue of creating “intelligent” and “anthropomorphic” interaction systems.This literature review examines the growth of VR-HCI from four aspects:perceptual computing,human-machine interaction and coordination,human-computer dialogue interaction,and data visualization.Perceptual computing aims to model human daily life behavior,cognitive processes,and emotional contexts for personalized and efficient human-computer interactions.This discussion covers three perceptual aspects related to pathways,objects,and scenes.Human-machine interaction scenarios involve virtual and real-world integration and perceptual pathways,which are divided into primary perception types:visual-based,sensor-based,and wireless non-contact.Object-based perception is subdivided into personal and group contexts,while scene-based perception is subdivided into physical behavior and cognitive contexts.Human-machine interaction primarily encompasses technical disciplines such as mechanical and electrical engineering,computer and control science,artificial intelligence,and other related arts or humanistic disciplines like psychology and design.Human-robot interaction can be categorized by functional mechanisms into 1) collaborative operation robots,2) service and assista

关 键 词：人机交互(HCI) 感知计算 人机协同 对话系统 数据可视化 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]