基于云计算的大数据处理与存储系统的设计与实现  

Design and Implementation of Big Data Processing and Storage System Based on Cloud Computing

作　　者：董威振 DONG Weizhen(Yuncheng County People̓s Court,Heze,Shandong 274700,China)

机构地区：[1]郓城县人民法院,山东菏泽274700

出　　处：《移动信息》2024年第5期289-291,共3页MOBILE INFORMATION

摘　　要：随着大数据时代的到来,高效处理和存储海量数据成为云计算领域的重要挑战。针对数据处理效率较低和存储成本较高的问题,文中提出了一种基于云计算的大数据处理与存储系统。该系统由3个核心模块构成,分别是数据收集模块、数据处理模块和数据存储模块。通过集成数据管道优化、分布式计算和先进的存储技术,该系统显著提高了数据处理速度,降低了存储成本,并增强了数据的安全性和可访问性。实验结果表明,相较于传统方法,该系统在处理大规模数据集时,不仅将处理速度提高了约40%,存储效率也提高了约30%,为大数据时代下的高效数据处理和存储提供了一种创新且实用的解决方案。With the advent of the era of big data,efficient processing and storage of massive data has become an important challenge in the field of cloud computing.Aiming at the problems of low data processing efficiency and high storage cost,this paper proposes a big data processing and storage system based on cloud computing.The system consists of 3 core modules,namely data collection module,data processing module and data storage module.By integrating data pipeline optimization,distributed computing and advanced storage technologies,the system significantly improves data processing speed,reduces storage costs,and enhances data security and accessibility.The experimental results show that,compared with traditional methods,the system not only increases the processing speed by about 40%,but also the storage efficiency by about 30%when processing large-scale datasets,providing an innovative and practical solution for efficient data processing and storage in the era of big data.

关 键 词：云计算 大数据处理 数据存储系统 

分 类 号：TP311.5[自动化与计算机技术—计算机软件与理论]