Bioinspired sensing-memory-computing integrated vision systems:biomimetic mechanisms,design principles,and applications  

作　　者：Yujie HUANG Yinlong TAN Yan KANG Yabo CHEN Yuhua TANG Tian JIANG 

机构地区：[1]Institute for Quantum Information and State Key Laboratory of High Performance Computing,College of Computer,National University of Defense Technology,Changsha 410073,China [2]College of Advanced Interdisciplinary Studies,National University of Defense Technology,Changsha 410073,China [3]Institute for Quantum Science and Technology,College of Science,National University of Defense Technology,Changsha 410073,China

出　　处：《Science China(Information Sciences)》2024年第5期1-23,共23页中国科学（信息科学）（英文版）

基　　金：supported by National Natural Science Foundation of China(Grant Nos.52103311,62075240);Scientific Researches Foundation of National University of Defense Technology(Grant No.ZK18-01-03);National Key Research and Development Program of China(Grant No.2020YFB2205804).

摘　　要：With the explosion of sensory data in the Internet of Things(IoT)era,conventional machine vision systems are becoming increasingly difficult to meet the requirements of high efficiency,low energy consumption,and low latency due to their inherent shortcomings of separate sensing,memory,and computing units.Inspired by the retina and neuromorphic computing,the sensing-memory-computing integrated vision system(SMCVS)that features low power consumption,low latency,and high parallelism has been considered a promising technology to surpass the von Neumann architecture and realize strong artificial intelligence.Meanwhile,novel materials like two-dimensional semiconductors and quantum dots with novel optoelectronic performance provide hardware carriers for implementing integrated sensing-memory-computing architectures,attracting considerable attention.This paper reviews the recent research progress in bioinspired vision systems in terms of biomimetic mechanisms,design principles,computational architectures,and applications.Firstly,the biomimetic mechanisms are illustrated to guide the design of high-performance artificial visual perception systems.Then the research progress of optoelectronic-synapse-based bioinspired vision systems in the device principles and applications including image filtering,color recognition,visual adaptation,and motion detection are summarized.Finally,the challenges and future developing directions of the SMCVS are provided regarding bionic application,architecture design,and device fabrication.

关 键 词：sensing-memory-computing architecture neuromorphic computing retinomorphic device image recognition visual system 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TB17[自动化与计算机技术—计算机科学与技术]