基于NoSQL数据库的高密度数据采集系统设计  

Design of high density data acquisition system based on NoSQL database

作　　者：张洪亮 ZHANG Hongliang(China Coal Technology and Engineering Group Shenyang Research Institute,Fushun 113122,China;State Key Laboratory of Coal Mine Safety Technology,Fushun 113122,China)

机构地区：[1]中煤科工集团沈阳研究院有限公司,辽宁抚顺113122 [2]煤矿安全技术国家重点实验室,辽宁抚顺113122

出　　处：《煤矿安全》2023年第8期223-227,共5页Safety in Coal Mines

基　　金：中煤科工集团沈阳研究院有限公司重点资助项目(SYZD-2023-03)。

摘　　要：针对目前大部分工矿企业都在数字化转型,数字化后的安全生产监控数据具有实时性强,数据体量庞大等特点,部分系统的数据量如钢丝绳探伤系统每秒钟高达几十万条,常用的SQL数据库已经无法胜任如此庞大的数据存储、分析任务。研究通过NoSQL数据库、负载均衡、多线程、SOCKET等技术体系,构建基于NoSQL的具备高并发、高密度数据处理能力的高密度数据采集系统;实现工矿企业安全生产相关数据的高密度接入,满足高密度数据采样周期的硬性需求。In view of the fact that most industrial and mining enterprises are in digital transformation at present,the digitized safety production monitoring data has the characteristics of strong real-time and huge data volume.The data volume of some systems,such as steel wire rope flaw detection system,is up to several hundred thousand pieces per second.The commonly used SQL database has been unable to cope with such a huge data storage and analysis task.A high-density data acquisition system with high concurrency and high density data processing capability based on NoSQL is constructed through NoSQL database,load balancing,multithreading,SOCKET and other technical systems.The system realizes the high-density access of safety production related data of industrial and mining enterprises,and meets the hard demand of high-density data sampling cycle.

关 键 词：NOSQL SOCKET 高密度 高并发 负载均衡 多线程 监控数据 

分 类 号：TD679[矿业工程—矿山机电]