基于日志的系统任务模型推理工具及其应用  

A Log-Based Task Model Inference Tool and Its Applications

作　　者：高崇南[1] 余宏亮[1] 郑纬民[1] 

机构地区：[1]清华大学计算机科学与技术系,北京100084

出　　处：《计算机研究与发展》2010年第8期1490-1496,共7页Journal of Computer Research and Development

基　　金：国家"九七三"重点基础研究发展计划基金项目(2007CB311100)

摘　　要：分布式系统成为Internet应用的关键组成部分,理解其运行时行为成为验证系统设计、解决系统逻辑与性能错误的关键.已有工作需要程序员手工标注代码或网络数据包,提供描述请求处理和任务执行的相关信息,以抽取系统运行时路径.工作创新性地从系统日志中提取系统任务信息,推断出系统的层次结构任务模型,利用任务模型将系统运行时行为分解为有层次结构的任务实例.实际应用经验表明,利用日志提取的任务模型能够帮助理解系统运行时行为,并解决系统的性能问题.Distributed systems are the enabler of today＇s Internet services.These systems usually involve multiple tiers,a hierarchy of functional abstractions,and high degrees of concurrency.A user request is processed as a task in a series of stages across multiple machines,processors and threads.Verifying the behavior of such individual tasks therefore becomes a very challenging problem since developers have to reconstruct the task flow by linking together pieces of its execution throughout the system.Understanding system runtime behavior is a key to verify system design and debug system logic and performance problems.Existing works extract system runtime as causal paths,but they require either manual annotation or developer-provided execution structures.Manual annotation is tedious and prone to error when system design is complex and code base is evolving rapidly.Providing execution structures requires deep understanding of system design and this approach is limited to core designers or developers.In this paper,the authors try to infer hierarchical task models from system logs.They first extract task information from logs and infer the hierarchical relationships among tasks.Then the task hierarchies are combined into hierarchical task models.Experiences show that the inferred task models can help both understand system design and debug performance problems.

关 键 词：日志分析 任务模型 因果路径 性能分析 分布式系统 

分 类 号：TP302[自动化与计算机技术—计算机系统结构]