DOP:一种数据开放框架及其应用  

DOP: A Simple Open Data Framework and Its Application

作　　者：莫城为 范冰冰[1] MO Cheng-wei;FAN Bing-bing(School of Computer,South China Normal University,Guangzhou 510631,China)

机构地区：[1]华南师范大学计算机学院,广东广州510631

出　　处：《计算机与现代化》2018年第7期6-10,共5页Computer and Modernization

基　　金：广东省重大科技专项(2016B030305003)

摘　　要：数据开放是大数据时代的趋势,而通用工程化的开放数据平台的实施是当前面临的主要问题。本文基于元数据管理和大数据存储,提出数据开放池(Data-Open-Pool,DOP)框架和"目录—数据集—发布"(Catalog-Dataset-Distribution,CDD)数据描述模型,实现数据从采集发布到最终开放的业务逻辑及数据资源在3个层次的描述与管理,最后通过DOP和CDD分层描述模型实现简便的数据开放应用案例,并讨论该框架存在的若干问题。Open-data is the trend of the era of big data,thus to carry out open-data platform through general engineering approaches is the main problem.Referring to the ideas of the metadata management and the big-data storage,the paper proposes the DOP（Data-Open-Pool）framework and CDD（Catalog-Dataset-Distribution）data description model,which realizes the service logic from publishing a dataset after collecting data to opening to the public finally,as well as the description and management of data resources in the three levels,and finally implements an easy open-data application with the DOP and CDD hierarchical description model,gives the general algorithm to release the standard dataset from unordered data sources,as well as the discussion on some problems of the framework.

关 键 词：大数据 数据开放 元数据 数据描述 数据存储 

分 类 号：TP311.13[自动化与计算机技术—计算机软件与理论]