电磁大数据优化管理与可视化设计  

Design of Optimization Management and Visualization for Electromagnetic Big Data

作　　者：董浩然 郑晓诗 偏卫东 闫翾 王永志 李志鹏 Dong Haoran;Zheng Xiaoshi;Pian Weidong;Yan Xuan;Wang Yongzhi;Li Zhipeng(College of Geo-exploration Science and Technology,Jilin University,Changchun 130026,China;Institute of Integrated Information for Mineral Resources Prediction,Jilin University,Changchun 130026,China)

机构地区：[1]吉林大学地球探测科学与技术学院,吉林长春130026 [2]吉林大学综合信息矿产预测研究所,吉林长春130026

出　　处：《科学技术创新》2022年第23期67-70,共4页Scientific and Technological Innovation

基　　金：国家重点研发计划(2021YFC2901801)资助。

摘　　要：为了解决传统方法处理电磁大数据时内存溢出、速度慢等问题,本文提出了采用索引、GIS等方法对电磁大数据进行优化管理与可视化方法,采用索引提升查询与提取速度,通过零值过滤、空间域滤波、改进的垂距限值算法等数据预处理方法有效提升数据处理效果,并设计了双缓冲技术提高一维动态成图速度方法。基于ArcGIS Engine、面向对象程序设计语言C#等编程实现了电磁大数据管理系统,可完成数据的快速读取、过滤、抽稀、可视化等。实验结果表明,本文设计的方法非常有效。In order to solve the problems of memory overflow and slow speed when dealing with electromagnetic big data in traditional methods,this paper proposes a method for optimal management and visualization of electromagnetic big data by using indexes,GIS and other methods.The software uses indexes to improve the query and extraction speed,data preprocessing methods such as zero-value filtering,spatial domain filtering,and improved vertical limit algorithm to effectively improve the data processing effect,and design double buffering technology to improve the speed of one-dimensional dynamic mapping.Based on ArcGIS Engine,object-oriented programming language C#and other programming,the electromagnetic big data management system is implemented,which can complete the fast reading,filtering,thinning and visualization of data.The experimental results show that the method designed in this paper is very effective.

关 键 词：大数据 索引 双缓冲 地理信息系统 

分 类 号：TP311.1[自动化与计算机技术—计算机软件与理论]