Bimodal Coupling Haptic Perceptron for Accurate Contactless Gesture Perception and Material Identification  

作　　者：Guomin Ye Qiang Wu Yi Chen Xueke Wang Zhimin Xiang Jingyan Duan Yanfen Wan Peng Yang 

机构地区：[1]National Centre for International Research on Photoelectric and Energy Materials,Yunnan Key Laboratory for Micro/Nano Materials and Technology,Yunnan Key Laboratory of Electromagnetic Materials and Devices,School of Materials and Energy,Yunnan University,Kunming 650091,People’s Republic of China

出　　处：《Advanced Fiber Materials》2024年第6期1874-1886,共13页先进纤维材料（英文）

基　　金：financially supported by the National Natural Science Foundation of China(No.52271241 and 52071282);the Applied Basic Research Key Project of Yunnan(202001BB050046);the Scientific Research Fund of Education Department of Yunnan Province(No.2024Y041);the National Training Programs of Innovation and Entrepreneurship for Undergraduates(No.202210673002 and 202307004).

摘　　要：A bimodal coupled multifunctional tactile perceptron for contactless gesture recognition and material identification is pro-posed to address the challenges posed by limited functionality,signal interference from multimodal collaborative work,and the high power consumption of traditional tactile sensors.This perceptron integrates a capacitive sensor and a triboelectric sensor symmetrically,employing an energy complementarity strategy to reduce power consumption and implementing symmetrical distribution of two sensors for physical isolation to prevent signal interference.The capacitive sensor detects external pressure,providing information on material properties such as hardness,softness,and deformation,with a wide linear response range of 0-745.3 kPa.The triboelectric sensor captures the electron affinity of measured object.Further,by utilising machine learning algorithms,a system for contactless gesture recognition and material identification is engineered.This system demonstrates a remarkable accuracy rate of 98.5%when recognising 5 gestures,and achieves a perfect identi-fication(100%)of 10 different materials aided by incorporating capacitive and triboelectric response.These results greatly advance the progress of tactile perceptrons with high integration,low power consumption,and multifunctionality,enhancing their effectiveness and reliability in smart device applications.

关 键 词：Haptic perceptron Capacitive and triboelectric mechanism Contactless gesture perception Material recognition 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]