大数据基础理论与系统关键技术浅析  

A Brief Review of Theory and System Technologies for Big Data

作　　者：华强胜 郑志高 胡振宇 钟芷漫 林昌富 赵峰 金海[1,2,3,4] 石宣化 Hua Qiangsheng;Zheng Zhigao;Hu Zhenyu;Zhong Zhiman;Lin Changfu;Zhao Feng;Jin Hai;Shi Xuanhua(National Engineering Research Center for Big Data Technology and System,Wuhan,Hubei 430074,China;Services Computing Technology and System Lab,Wuhan,Hubei 430074,China;Cluster and Grid Computing Lab,Wuhan,Hubei 430074,China;School of Computer Science and Technology,Huazhong University of Science and Technology,Wuhan,Hubei 430074,China)

机构地区：[1]大数据技术与系统国家地方联合工程研究中心,湖北武汉430074 [2]服务计算技术与系统教育部重点实验室,湖北武汉430074 [3]集群与网格计算湖北省重点实验室,湖北武汉430074 [4]华中科技大学计算机科学与技术学院,湖北武汉430074

出　　处：《数据与计算发展前沿》2019年第1期22-34,共13页Frontiers of Data & Computing

基　　金：国家重点研发计划云计算与大数据重点专项(2018YFB1003203);国家自然科学基金面上项目(61572216)。

摘　　要：【目的】本文主要就大数据基础理论及系统相关研究背景、技术架构和关键技术展开介绍,并结合技术发展趋势提出未来研究和技术发展方向。【方法】本文在简要介绍大数据处理基础理论的基础上,从面向数据并行的大数据处理技术、RDF(Resource Description Framework)图数据的查询与匹配、大数据分析技术三个方面简要介绍了大数据系统的关键技术。【结果】未来数据产生的速度将进一步提高,在这种应用背景下,如何在设备端进行快速的数据处理成为一种趋势。【结论】未来,我们将在继续关注大数据基础理论与系统关键技术的基础上,引入边缘计算、雾计算等场景,研究物联网环境下的大数据处理。[Objective]The article mainly gives a brief review for big data theory and systems,including the research background,the technical architecture and the key technologies following by estimating future research directions.[Method]On the basis of the brief introduction of the big data processing theory,this paper introduces the key technologies for big data systems by the three aspects:the data parallel processing methods,the Resource Description Framework(RDF)graph data query and matching,and the big data analysis technologies.[Results]The speed of data generation will be accelerated further more in near future,thus how to quickly process the data on the edge side would lead a research trend.[Conclusion]In future,we will continue to focus on the basic theory and system technologies of big data.At the same time,we will also try to introduce some new research directions,such as edge computing,fog computing,and big data processing in the Internet of Things.

关 键 词：低复杂度算法 数据并行 QoS机制技术 图數据处理 语言模型 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]