基于大数据BI技术的智慧工地数据可视化平台的设计与研究--以某大型建筑工程集团为例  

Design and Research of a Smart Construction Site Data Visualization Platform Based on Big Data BI Technology:Taking a Large Construction Engineering Group as an Example

作　　者：谭晖涛 谢赞福 陆小霞 钟山 TAN Huitao;XIE Zanfu;LU Xiaoxia;ZHONG Shan(College of Information Engineering,Guangzhou Huaxia Vocational College,Guangzhou Guangdong 510090;Guangdong Basic Engineering Group Co.,Ltd.,Guangzhou Guangdong 510620)

机构地区：[1]广州华夏职业学院信息工程学院,广东广州510090 [2]广东省基础工程集团有限公司,广东广州510620

出　　处：《软件》2024年第2期28-33,43,共7页Software

基　　金：广州华夏职业学院校级科研项目(ZK20230207)。

摘　　要：大数据BI(Business Intelligence)技术在数据挖掘、数据分析、数据可视化等方面的功能实现较成熟,已广泛应用在制造业、零售业等行业。将大数据BI技术融入智慧工地,建立数据可视化平台,可以解决智慧工地存在的局部“数据孤岛”等问题,让智慧工地的海量数据得到最大价值体现。文章以某大型市政特级资质建筑工程集团为例,采用基于Hadoop+Spark的技术架构,以在建的大型地铁市政工程项目为实践,主要论述数据可视化平台架构选型、建立数据仓库、数据ETL、数据可视、Spark引擎框架与MapReduce在数据处理性能方面的对比等。构建基于大数据BI技术的智慧工地可视化数据平台,能有效推进智慧工地的开展,提升对工程项目在质量安全、绿色施工、成本管控等方面的管理。The big data BI(Business Intelligence)technology has mature functions in data mining,data analysis,data visualization,etc.,and has been widely applied in industries such as manufacturing and retail.Integrating big data BI technology into smart construction sites and establishing a data visualization platform can solve the problems of local"data silos"in smart construction sites,and maximize the value of the massive data in smart construction sites,The article takes a large municipal super qualified construction engineering group as an example,adopts a Hadoop+Spark technology architecture,and takes a large subway municipal engineering project under construction as a practice.The main discussion is on the selection of data visualization platform architecture,establishment of data warehouse,data ETL,data visualization,comparison of Spark engine framework and MapReduce in data processing performance.Building a smart construction site visualization data platform based on big data BI technology can effectively promote the development of smart construction sites and enhance the management of engineering projects in terms of quality and safety,green construction,cost control,and other aspects.

关 键 词：智慧工地 Extract-Transform-Load(ETL) 大数据BI(Business Intelligence) Spark 数据可视化 

分 类 号：TP311.56[自动化与计算机技术—计算机软件与理论]