基于分布式任务调度技术对在线监控系统自动化任务的优化研究  

Optimization of automated tasks in online monitoring systems based on distributed task scheduling technology

作　　者：孔华 KONG Hua(PowerChina Huadong Engineering Corporation Limited)

机构地区：[1]中国电建集团华东勘测设计研究院有限公司,浙江杭州311122

出　　处：《大坝与安全》2024年第1期25-31,共7页Dam & Safety

摘　　要：目前水电站大坝运行安全在线监控系统中自动化任务涉及数据处理、信息推送、消息通知和系统监控等多个模块,各模块的自动化任务独立管理维护,存在执行标准不统一、记录不规范及管理混乱等问题,导致自动化任务执行效率低,运维难度大。为解决这一问题,系统引入了PowerJob分布式任务调度平台,充分利用其集中管理、可视化、高可靠性和在线日志追溯等优势对自动化任务进行优化改造,通过PowerJob实现了任务集中配置、集中调度、多节点并行执行、工作流编排和实时监控等功能,并进行了针对性的扩展开发以满足大坝监控系统的自动化任务执行需求,提高了自动化任务的执行效率和运维便利性。Currently,the automated tasks involved in the online safety monitoring system for hydropower dams include data processing,information pushing,message notification,and system monitoring across multiple modules.The automated tasks in each module are independently maintained,resulting in incon-sistencies in execution standards,unstandardized recording and poor management which would lead to low task execution efficiency as well as difficult operations and maintenance.To solve this problem,the PowerJob distributed task scheduling platform is introduced to optimize and reform the automated tasks by taking full advantage of its centralized management,visualization,high reliability,and online log tracking capabilities.PowerJob enables centralized configuration,centralized scheduling,multi-node parallel execution,workflow arrangement and real-time monitoring for the automated tasks.Moreover,it is customized and extended to meet the execution requirements of automated tasks in the dam monitor-ing system,which improves the execution efficiency and convenience in operation and maintenance of the automated tasks.

关 键 词：自动化 分布式调度 PowerJob MAPREDUCE 大坝监控系统 

分 类 号：TV698.1[水利工程—水利水电工程]