人在回路的数据准备技术研究进展  

Progress on human-in-the-loop data preparation

作　　者：范举 陈跃国[1,2] 杜小勇[1,2] FAN Ju;CHEN Yueguo;DU Xiaoyong(DEKE Lab&Information School,Renmnin University of China,Beijing 100872,China;School of Information,Renmnin University of China,Beijing 100872,China)

机构地区：[1]中国人民大学数据工程与知识工程教育部重点实验室,北京100872 [2]中国人民大学信息学院,北京100872

出　　处：《大数据》2019年第6期1-18,共18页Big Data Research

基　　金：国家自然科学基金资助项目(No.61602488,No.61632016,No.U1711261)~~

摘　　要：随着数据分析技术的迅猛发展,数据准备越来越成为一个瓶颈性问题。以真实的数据分析场景为背景,分析了数据准备的两大核心挑战:人力成本高与时间周期长。在此基础上,介绍了人在回路数据准备技术的研究进展。交互式数据准备技术面向终端用户,通过与用户的交互预测其意图,并通过有效的预测算法来节省数据准备的时间。基于众包的数据准备技术引入互联网上的海量用户作为众包工人扩展计算能力,从而支持数据准备的基本任务,并研究如何对众包做质量控制与成本优化。最后,对人在回路的数据准备做出总结并探讨未来的挑战性问题。With the rapid development of data analytics,data preparation has become a major bottleneck.The two essential challenges for data preparation on cost and time were analyzed.To address the challenges,the research progress on human-in-the-loop data preparation was reviewed.Firstly,interactive data preparation was reviewed,which aimed to reduce the time for data preparation by predictively interacting with the end users.Then,crowdsourced data preparation was introduced,which utilize human’s computational power from the crowd to support foundamental data preparation tasks,and developed algorithms for controlling result quality and reducing crowdsourcing cost.Finally,future research directions were summarized and discussed.

关 键 词：数据治理 数据准备 众包 交互机制 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]