土壤大数据体系构建及应用  

Soil Big Data Architecture:Construction and Practical Applications

作　　者：刘杰[1] 郏梦思 王昌昆[1,2] 郭志英 孙维维[1] 马海艺 袁自然 潘贤章 LIU Jie;JIA Mengsi;WANG Changkun;GUO Zhiying;SUN Weiwei;MA Haiyi;YUAN Ziran;PAN Xianzhang(Key Laboratory of Soil and Sustainable Agriculture,Chinese Academy of Sciences,Nanjing 211135,China;University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]土壤与农业可持续发展重点实验室(中国科学院),南京211135 [2]中国科学院大学,北京100049

出　　处：《土壤》2024年第6期1156-1164,共9页Soils

基　　金：国家重点研发计划项目(2020YFC1807401);国家科技基础资源调查专项项目(2021FY100703);中国科学院网信专项项目(CAS-WX2022SF-0201)资助。

摘　　要：中国已经积累了大量结构化、半结构化和非结构化土壤数据资源,但它们往往来源多样、结构各异、组织无序且存储分散,亟待进行体系化整合及高效管理,以适应大数据人工智能时代对土壤数据的挖掘与应用。基于大数据、数据湖和数据仓库等理念和前沿技术,本文提出了土壤大数据体系框架及其构建流程和方法,重点论述了土壤数据采集预处理、非结构化数据识别、算法模型等关键技术和湖仓一体存储架构,以及数据共享服务方案,列举了其在土壤数据共享服务、污染场地智能化管控和土壤生态规律挖掘等方面的应用案例,并探讨了其在第三次全国土壤普查土壤数据资源库建设方面的潜力,以及数据驱动的土壤研究的应用前景。Plenty of structured,unstructured and semi-structured soil-related data have been accumulated in China,but they are from multiple sources with varied structures and stored dispersedly and disorderly.In the age of big data and artificial intelligence,in order to satisfy with the requirements of soil data mining and application,it is urgent to construct soil big data architecture.In this study,based on concepts and cutting-edge technologies of big data,data lake and data warehouse,the approaches to construct soil big data architecture were proposed,including technologies on soil-related data acquisition and preprocessing,unstructured data processing,algorithms and models.Then,soil data storage scheme was built through data lake and warehouse,and soil data sharing and serving schemes were realized with the support of data catalog management.Meanwhile,soil big data have been used in soil data service,intelligent control of contaminated sites and mining soil ecological patterns.Finally,the potentials of soil big data were discussed in the usage of construction of the database of third national soil census and prospects for the application in data-driven soil researches.

关 键 词：土壤大数据 大数据体系 湖仓一体化 全国土壤三普 土壤污染 

分 类 号：S159.2[农业科学—土壤学] TP399[农业科学—农业基础科学]