基于SQL语义的流式数据总线行列级数据访问控制研究  

Research on row-level data access control of streaming data bus based on SQL semantics

作　　者：禹熹 方亚超 洪丁节 YU Xi;FANG Yachao;HONG Dingjie(China UnionPay Technology Development Center,Shanghai 201201,China)

机构地区：[1]中国银联技术开发中心,上海201201

出　　处：《计算机应用文摘》2022年第22期87-89,共3页Chinese Journal of Computer Application

摘　　要：企业内应用快速增长、数据急剧膨胀,如何高效、安全地实现企业内各应用数据的便捷访问,避免数据孤岛效应,成为企业数据平台的巨大挑战。基于OLAP关系型数据率的数据仓库及基于Hadoop技术的大数据平台,在企业内广泛应用,通过批量归集源系统数据,实现了对T-1日历史数据的集中存放,并提供安全可控的数据访问服务。但是,提供当日实时数据流水订阅的流式数据总线缺少相应的数据安全控制,无法提供基于数据内容的“最小化”的数据访问,未能满足企业内数据安全需求。文章提出了一种基于SQL语义的流式数据总线行列级数据访问控制方式,提供细粒度化实时数据访问机制,在满足实时数据快速访问的同时保障数据的安全性,并基于业界流行的高吞吐开源消息中间件Kafka提出了系统的实现方式。With the rapid growth of applications and the rapid expansion of data in enterprises,how to efficiently and safely realize the convenient access of each application data in enterprises and avoid data islands has become a huge challenge for enterprise data platform.The data warehouse based on OLAP relational database and the big data platform based on Hadoop technology are widely used in the enterprise.By collecting the source system data in batches,it realizes the centralized storage of T-1 day historical data and provides secure and controllable data access service.However,the streaming data bus that provides daily real-time data streaming subscription lacks corresponding data security control and cannot provide“minimal”data acess based on data content to meet the data security requirements in enterprises.In this paper,a row-level data access control method for streaming data bus based on SQL semantics is proposed,which provides fine grained real-time data access mechanism and ensures the security of real-time data while satisfying the fast access of real-time data.The implementation method of the system is proposed based on the popular high-througbput open source messaging middleware Kafka.

关 键 词：流式数据总线 数据安全 访问控制 数据视图 SQL 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]