应用软件运行日志的收集与服务处理框架  

Collection and service processing framework of application running log

作　　者：张骁 应时[1,2] 张韬 ZHANG Xiao;YING Shi;ZHANG Tao(State Key Lab of Software Engineering,Wuhan University,Wuhan 430072,China;Computer School,Wuhan University,Wuhan 430072,China;China Mobile Communications Corporation Hubei Co.,LTD.,Wuhan 430023,China)

机构地区：[1]武汉大学软件工程国家重点实验室,武汉430072 [2]武汉大学计算机学院,武汉430072 [3]中国移动通信集团湖北有限公司,武汉430023

出　　处：《计算机工程与应用》2018年第10期81-89,142,共10页Computer Engineering and Applications

基　　金：国家自然科学基金面上项目(No.61672392;No.61373038);国家重点研发计划项目(No.2016YFC1202204)

摘　　要：随着现代计算机系统的规模和复杂性不断增大,其运行日志的数量也不断增多,但是由于日志数据的规模巨大、内容杂乱,用户查看日志数据具有一定的困难,因此对应用软件运行日志进行有效收集与处理具有重要意义。提出了一种应用软件运行日志的收集与服务处理框架,利用分布式收集策略对日志数据收集,定义了一种多层次数据存储结构对日志数据进行存储,并向用户提供日志数据查询服务。通过对某综合减灾系统的日志数据分析验证了提出的日志数据收集与服务处理框架的实用性,并与传统的日志收集分析软件ELK和Chukwa进行了对比。As modern computer systems continue to grow in scale and complexity,the number of its running log is also increasing.Due to the huge size of the log data,and the content is messy,the user has some difficulties in viewing the log data.Therefore,it is of great significance to effectively collect and process the log data of application running log.This paper proposes a framework for collection and service processing of application running log,using distributed collection strategy to collect log data,defining a multi-level data storage structure to store log data,and providing the user with log data query services.It analyzes the log data of an integrated disaster reduction system.It is used to verify the practicability of the proposed framework,and it is compared with the traditional log collection and analysis software ELK and Chukwa.

关 键 词：日志数据 框架 收集处理 分布式收集 多层次数据存储 查询服务 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]