CNN-LSTM在日本鲭捕捞渔船行为提取中的应用  

Extracting the behavior of Scomber japonicus fishing vessel using CNN-LSTM

作　　者：王书献 张胜茂[2] 唐峰华[2] 石永闯 范秀梅[2] 樊伟[2] 孙宇 Wang Shuxian;Zhang Shengmao;Tang Fenghua;Shi Yongchuang;Fan Xiumei;Fan Wei;Sun Yu(School of Navigation and Naval Architecture,Dalian Ocean University,Dalian 116023,China;Key Laboratory of Fisheries Remote Sensing,Ministry of Agriculture and Rural Affairs,East China Sea Fisheries Research Institute,Chinese Academy of Fishery Sciences,Shanghai 200090,China)

机构地区：[1]大连海洋大学航海与船舶工程学院,大连116023 [2]农业农村部渔业遥感重点试验室,中国水产科学研究院东海水产研究所,上海200090

出　　处：《农业工程学报》2022年第7期200-209,共10页Transactions of the Chinese Society of Agricultural Engineering

基　　金：国家自然科学基金项目(61936014);中国水产科学研究院基本科研业务费(2020TD82);浙江省海洋渔业资源可持续利用技术研究重点试验室开放课题(2020KF001)。

摘　　要：目前,国内外部分自动化程度较高的捕捞渔船逐渐开始采用人类观察员与电子观察员相结合的捕捞监控方式。为简化电子监控系统数据处理流程、提高电子监控系统自动化程度、增强相关渔业公司及政府部门的管理效率,该研究提出将卷积神经网络(Convolutional Neural Network, CNN)与长短期记忆模块(Long Short Term Memory, LSTM)应用在传统电子监控系统数据中,用于灯光渔业日本鲭捕捞渔船行为提取。根据日本鲭捕捞渔船工作特点,划分出放网、收网、进鱼、转载等9种捕捞作业行为。设计4组平行试验,分别对比3层卷积神经网络、带有LSTM模块的3层卷积神经网络、8层卷积神经网络、带有LSTM模块的8层卷积神经网络在日本鲭捕捞渔船行为提取中的表现。试验结果显示,在测试集中该4种神经网络训练得到的模型综合评价指标F1分数分别达到了0.794、0.799,0.966及0.972,在配备NVIDIA Tesla V100 32GB高性能GPU的超算环境下5 000组数据平均每次检测耗时分别为34.66、34.50、37.41、37.61 ms。在一定范围内,网络深度的增加会显著提升模型的效果,但检测耗时也会有明显增加;LSTM模块的加入对网络模型效果有一定程度的提升,且不会显著影响检测耗时。因此,CNN-LSTM模块在电子监控系统高实时性、高精度场景下均有较大的应用前景,能够提高电子监控系统自动化程度,提高相关部门的管理效率。Fishing vessels have been ever-increasing to adopt the monitoring system for the combination of human and electronic observers,particularly with a high level of automation in the world.The data processing has required a simple configuration in the electronic monitoring system at present.It is urgent to improve the automation degree of the electronic monitoring system and the management efficiency of relevant fishing.In this study,the combined Convolutional Neural Network(CNN) with the Long Short Term Memory module(LSTM) was used to apply to the traditional electronic monitoring systems for the data extraction from the fishing vessel behavior of Japanese mackerel fishing in the light fishery.Nine types of fishing operations were divided,including sailing,putting net,waiting,pulling net,waiting for fish,organizing fish box,fish in,fish picking and reprinting,according to the operational characteristics of Japanese mackerel fishing boats.Four groups of parallel experiments were designed to compare the performance of a 3-layer CNN,a 3-layer CNN with an LSTM module(3-layer CNN-LSTM),an 8-layer CNN,and an 8-layer CNN with an LSTM module(8-layer CNN-LSTM) in a Japanese mackerel fishing boat during behavior extraction.Both CNN with LSTM modules were designed before the fully connected layers.The behaviors of nine fishing vessels presented the specific time characteristics,such as “pulling net” and “putting net”.Therefore,the 100 consecutive frames were then stitched horizontally to design the dataset during data processing.The frames per second of the video data was 25,and 100 was determined as the length of each dataset.The reason was that the human eye was normally observed the EM video data for 2-4 s to distinguish the two behaviors.Each data sample also contained certain time dimension information in the LSTM module.The test results show that the comprehensive evaluation index,the F1 score of the models that trained by the 3-layer CNN,3-layer CNN-LSTM,8-layer CNN,and 8-layer CNN-LSTM in the test set reached 0

关 键 词：电子监控系统 卷积神经网络 长短期记忆 日本鲭 捕捞行为 

分 类 号：S973[农业科学—捕捞与储运]