Image format pipeline and instrument diagram recognition method based on deep learning  

作　　者：Guanqun Su Shuai Zhao Tao Li Shengyong Liu Yaqi Li Guanglong Zhao Zhongtao Li 

机构地区：[1]Shandong Qingniao IIoT Co.,ltd.,Jinan 250014,China [2]Jinan Housing and Urban-Rural Development Bureau,Jinan 250012,China [3]State Grid Shandong Electric Extrahigh Voltage Company,Jinan 250018,China [4]School of Information Science and Engineering,University of Jinan,Jinan 250022,China

出　　处：《Biomimetic Intelligence & Robotics》2024年第1期36-44,共9页仿生智能与机器人（英文）

摘　　要：In this study,we proposed a recognition method based on deep artificial neural networks to identify various elements in pipelines and instrumentation diagrams(P&ID)in image formats,such as symbols,texts,and pipelines.Presently,the P&ID image format is recognized manually,and there is a problem with a high recognition error rate;therefore,automation of the above process is an important issue in the processing plant industry.The China National Offshore Petrochemical Engineering Co.provided the image set used in this study,which contains 51 P&ID drawings in the PDF.We converted the PDF P&ID drawings to PNG P&IDs with an image size of 8410×5940.In addition,we used labeling software to annotate the images,divided the dataset into training and test sets in a 3:1 ratio,and deployed a deep neural network for recognition.The method proposed in this study is divided into three steps.The first step segments the images and recognizes symbols using YOLOv5+SE.The second step determines text regions using character region awareness for text detection,and performs character recognition within the text region using the optical character recognition technique.The third step is pipeline recognition using YOLOv5+SE.The symbol recognition accuracy was 94.52%,and the recall rate was 93.27%.The recognition accuracy in the text positioning stage was 97.26%and the recall rate was 90.27%.The recognition accuracy in the character recognition stage was 90.03%and the recall rate was 91.87%.The pipeline identification accuracy was 92.9%,and the recall rate was 90.36%.

关 键 词：Deep learning Image processing Piping and instrumentation Object recognition Pipeline recognition 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]