基于高光谱图像技术与迁移学习的水晶梨早期损伤检测  

Early Bruise Detection of Crystal Pear Based on Hyperspectral Imaging Technology and Transfer Learning

作　　者：王广来 王恩凤 王聪聪 刘大洋 WANG Guang-lai;WANG En-feng;WANG Cong-cong;LIU Da-yang(College of Mechanical and Electrical Engineering,Northeast Forestry University,Harbin 150000,China)

机构地区：[1]东北林业大学机电工程学院,黑龙江哈尔滨150000

出　　处：《光谱学与光谱分析》2022年第11期3626-3630,共5页Spectroscopy and Spectral Analysis

基　　金：中国博士后基金面上项目(2021M690573);中央高校基本科研业务费专项资金项目(2572020BF05)资助。

摘　　要：梨在储藏、包装和运输等过程中均可能发生不同程度的机械损伤,若不及时剔除损伤梨,损伤可能会逐渐严重而演变成腐烂,造成严重的经济损失。为建立一种梨早期损伤检测及损伤时间评估的快速、无损检测方法,采用高光谱图像结合迁移学习模型对损伤早期水晶梨进行识别。以无损伤、挤压损伤24 h和挤压损伤48 h的水晶梨为研究对象,应用高光谱成像系统采集样品的高光谱图像,共获取无损伤、挤压损伤24 h和挤压损伤48 h的水晶梨高光谱图像各80帧。对高光谱图像进行主成分分析,选择主成分图像4, 5, 6(PC4, PC5, PC6)作为检测水晶梨损伤的特征图像,将3个主成分图像拼接后进行数据扩充共得到无损伤、挤压损伤24 h和挤压损伤48 h的特征图像各160帧。按照9∶1比例划分样本训练集和测试集后,分别建立了支持向量机(SVM)、 k-近邻(k-NN)和基于ResNet50网络的迁移学习损伤识别模型。SVM、 k-NN和基于ResNet50网络的迁移学习模型对测试集样本总体识别准确率分别为83.33%, 85.42%和93.75%,基于ResNet50网络的迁移学习模型识别效果最佳,其对测试集中无损伤、挤压损伤24 h和挤压损伤48 h的样本正确识别率分别达到100%, 83%和95%。该研究结果表明,高光谱图像技术结合基于ResNet50网络的迁移学习模型可实现水晶梨早期损伤检测,并对损伤时间有较好的预测效果,且损伤时间越长,识别准确率越高。Pear in storage, packaging and transportation processes may occur in different degrees of mechanical damage. If not removed in time, the damage may gradually become serious and rot, resulting in serious economic losses. In order to establish a rapid and non-destructive detection method for early bruise detection and bruise time assessment of pears, hyperspectral imaging technology combined with a transfer learning model was used to identify crystal pears with an early bruise. The hyperspectral images of crystal pears with no bruise, crush bruise at 24 h and crush bruise at 48 h were acquired by the hyperspectral imaging system, and 80 hyperspectral images of crystal pears with no bruise, crush bruise at 24 h and crush bruise at 48 h were obtained. Principal component analysis was performed on the hyperspectral images, and principal component images 4, 5 and 6(PC4, PC5 and PC6) were selected as the feature images for detecting crystal pear bruises. After the data expansion of the stitched images with three principal components, 160 images of crystal pears with no bruise, crush bruise at 24 h and crush bruise at 48 h were obtained. The training sample set and test sample set were divided according to the ratio of 9∶1, Support Vector Machine(SVM), k-Nearest Neighbor(k-NN), and transfer learning bruise recognition models based on the ResNet50 network were established, respectively. The results showed that the overall recognition accuracy of SVM, k-NN and ResNet50 network-based transfer learning models for the test set was 83.33%, 85.42% and 93.75%, respectively. The transfer learning model based on the ResNet50 network had the best recognition results, and its correct recognition rates for the test set of crystal pears with no bruise, crush bruise at 24 h and crush bruise at 48 h reached 100%, 83% and 95%, respectively. The results of this study indicate that hyperspectral imaging technology combined with the transfer learning method based on the ResNet50 network can achieve early bruise detection of crystal pears

关 键 词：高光谱图像 迁移学习 水晶梨 损伤检测 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]