Humanoid Intelligent Display Platform for Audiovisual Interaction and Sound Identification  

作　　者：Yang Wang Wenli Gao Shuo Yang Qiaolin Chen Chao Ye Hao Wang Qiang Zhang Jing Ren Zhijun Ning Xin Chen Zhengzhong Shao Jian Li Yifan Liu Shengjie Ling 

机构地区：[1]School of Physical Science and Technology,ShanghaiTech University,393 Middle Huaxia Road,Shanghai 201210,People’s Republic of China [2]State Key Laboratory of Molecular Engineering of Polymers,Department of Macromolecular Science,Laboratory of Advanced Materials,Fudan University,Shanghai 200433,People’s Republic of China [3]School of Textile and Clothing,Yancheng Institute of Technology,Jiangsu 224051,People’s Republic of China [4]School of Textile Science and Engineering,Wuhan Textile University,Wuhan 430200,People’s Republic of China [5]Shanghai Clinical Research and Trial Center,201210 Shanghai,People’s Republic of China

出　　处：《Nano-Micro Letters》2023年第12期82-98,共17页纳微快报（英文版）

基　　金：supported by the National Natural Science Foundation of China (Nos. 21935002, 51973116, 52003156);the starting grant of ShanghaiTech University;the Double First-Class Initiative Fund of ShanghaiTech University

摘　　要：This study proposes a rational strategy for the design,fabrication and system integration of the humanoid intelligent display platform(HIDP)to meet the requirements of highly humanized mechanical properties and intelligence for human-machine interfaces.The platform’s sandwich structure comprises a middle lightemitting layer and surface electrodes,which consists of silicon elastomer embedded with phosphor and silk fibroin ionoelastomer,respectively.Both materials are highly stretchable and resilient,endowing the HIDP with skin-like mechanical properties and applicability in various extreme environments and complex mechanical stimulations.Furthermore,by establishing the numerical correlation between the amplitude change of animal sounds and the brightness variation,the HIDP realizes audiovisual interaction and successful identification of animal species with the aid of Internet of Things(IoT)and machine learning techniques.The accuracy of species identification reaches about 100%for 200 rounds of random testing.Additionally,the HIDP can recognize animal species and their corresponding frequencies by analyzing sound characteristics,displaying real-time results with an accuracy of approximately 99%and 93%,respectively.In sum,this study offers a rational route to designing intelligent display devices for audiovisual interaction,which can expedite the application of smart display devices in human-machine interaction,soft robotics,wearable sound-vision system and medical devices for hearing-impaired patients.

关 键 词：Silk fibroin Ionoelastomer Luminescent display Machine learning Audiovisual interaction 

分 类 号：TB34[一般工业技术—材料科学与工程] TN873[电子电信—信息与通信工程] TN912.34