Monitoring and Early Warning of New Cyber-Telecom Crime Platform Based on BERT Migration Learning  

作　　者：Shengli Zhou Xin Wang Zerui Yang 

机构地区：[1]Information Department of Zhejiang Police College,Hangzhou 310053,China [2]International School of Zhejiang Police College,Hangzhou 310053,China

出　　处：《China Communications》2020年第3期140-148,共9页中国通信（英文版）

基　　金：supported in part by the Basic Public Welfare Research Program of Zhejiang Province under Grant LGF20G030001.

摘　　要：The network is a major platform for implementing new cyber-telecom crimes.Therefore,it is important to carry out monitoring and early warning research on new cyber-telecom crime platforms,which will lay the foundation for the establishment of prevention and control systems to protect citizens’property.However,the deep-learning methods applied in the monitoring and early warning of new cyber-telecom crime platforms have some apparent drawbacks.For instance,the methods suffer from data-distribution differences and tremendous manual efforts spent on data labeling.Therefore,a monitoring and early warning method for new cyber-telecom crime platforms based on the BERT migration learning model is proposed.This method first identifies the text data and their tags,and then performs migration training based on a pre-training model.Finally,the method uses the fine-tuned model to predict and classify new cyber-telecom crimes.Experimental analysis on the crime data collected by public security organizations shows that higher classification accuracy can be achieved using the proposed method,compared with the deep-learning method.The network is a major platform for implementing new cyber-telecom crimes. Therefore, it is important to carry out monitoring and early warning research on new cyber-telecom crime platforms, which will lay the foundation for the establishment of prevention and control systems to protect citizens’ property. However, the deep-learning methods applied in the monitoring and early warning of new cyber-telecom crime platforms have some apparent drawbacks. For instance, the methods suffer from data-distribution differences and tremendous manual efforts spent on data labeling. Therefore, a monitoring and early warning method for new cyber-telecom crime platforms based on the BERT migration learning model is proposed. This method first identifies the text data and their tags, and then performs migration training based on a pre-training model. Finally, the method uses the fine-tuned model to predict and classify new cyber-telecom crimes. Experimental analysis on the crime data collected by public security organizations shows that higher classification accuracy can be achieved using the proposed method, compared with the deep-learning method.

关 键 词：NEW cyber-telecom CRIME BERT model deep LEARNING monitoring and WARNING text analysis 

分 类 号：D924.3[政治法律—刑法学] TP181[政治法律—法学]