基于高真实度昆曲交互表演系统设计与应用  

Design and Application of Kunqu Interactive Performance System Based on High Reality

作　　者：张进[1] 方珂 韩悦 ZHANG Jin;FANG Ke;HAN Yue(Nanjing University of Aeronautics and Astronautics,Nanjing Jiangsu 211106,China)

机构地区：[1]南京航空航天大学,江苏南京211106

出　　处：《计算机仿真》2022年第12期311-316,共6页Computer Simulation

基　　金：江苏省教育科学十四五规划重点项目(T-a/2021/13);江苏省文旅厅文物科研课题(2021SK06);中央高校基本科研业务费专项资金资助NO.ND2022009。

摘　　要：通过利用虚拟现实技术,构建了一种高真实度的虚拟昆曲表演场景以及高仿真昆曲人物模型、进而搭建出一套沉浸式的昆曲交互表演系统,从而能够让虚拟现实技术在昆曲教学以及传播方面发挥很大的优势。首先利用Unity3D平台来设计出虚拟的昆曲人物模型以及昆曲演出场景模型,同时对场景模型进行一些细致的优化处理;然后采用Kinect设备来采集昆曲真实表演者的深度、彩色和骨骼关节点的信息;最后利用动态库在Unity脚本中调用Kinect设备采集的数据并进行绑定,达到实时更新昆曲表演者关节信息的目的,进而结合面部识别技术来细腻化呈现出昆曲角色的面部表情。实验证明,上述系统能够快速应用于多元化的昆曲表演场景当中,同时在扩大受众范围和数字化昆曲教学与传播方面都具有很强的理论和实践应用价值。Through virtual reality technology, a highly realistic virtual kunqu performance scene and a high simulation kunqu character model were realized, thus building an immersive kunqu interactive performance system and highlighting the innovative advantages of virtual reality technology in the teaching and dissemination of kunqu.The virtual character and scene model were built on Unity3D platform, and the necessary optimization process was carried out for the scene model. Then Kinect device was used to collect the depth, color and bone joint point information of real Kunqu performers. Finally, the dynamic library was used to call the data collected by Kinect device in the Unity script and bind them to achieve the purpose of updating the joint information of Kunqu performers in real time, and then the facial recognition technology was combined to present the facial expressions of Kunqu characters in detail. It has been proved that the above system can effectively adapt to the diversification of kunqu performance scenes, expand the radiation range of kunqu audiences, develop kunqu body teaching, and digitally disseminate kunqu classical repertoire, which has strong practical application value.

关 键 词：高真实度 昆曲表演 人机交互 虚拟现实 

分 类 号：TP391.9[自动化与计算机技术—计算机应用技术]