作业调度软件LoadLeveler在气象模式中的应用  

Application of Job Scheduling Software LoadLeveler in Meteorological Mode

作　　者：张明[1] 杨效 邹丽 唐艳娟 张燕 ZHANG Ming;YANG Xiao;ZOU Li;TANG Yanjuan;ZHANG Yan(Gansu Provincial Meteorological Information and Technic Support and Equipment Center,Lanzhou 730020)

机构地区：[1]甘肃省气象信息与技术装备保障中心,兰州730020

出　　处：《气象科技》2021年第1期63-68,共6页Meteorological Science and Technology

摘　　要：西北区域气象中心高性能计算集群使用LoadLeveler调度管理作业,为实现资源利用率和吞吐量的最大化,本文探讨了作业调度管理的作用和方法。通过配置文件关键字定义队列、设置调度算法和调度器调节参数,将作业的处理需求与可用资源进行匹配,依据实际需求定义集群和各种资源的可用性规则,防止作业之间的相互干扰。结合LoadLeveler作业抢占功能,保障区域数值预报业务模式优先稳定运行。利用Perl语言编写脚本对高性能计算机集群进行资源记账,使管理员充分掌握各类应用模式的资源使用情况,合理调整系统资源分配调度策略,充分发挥了西北区域气象中心高性能计算机集群的效益。The high performance computing cluster in the Northwest Regional Meteorological Center uses the job scheduling software LoadLeveler to schedule and manage jobs,in order to realize the maximization of resource utilization and throughput.This paper studies and discusses the role and method of scheduling management job.Defining the queue through the configuration file keywords,setting the scheduling algorithm and scheduler adjustment parameters,matching the processing requirements of the job with the available resources,the availability rules of clusters and various resources are defined according to actual requirements,so as to prevent the mutual interference between jobs.Combined with the LoadLeveler job preemption function,the regional numerical weather prediction business model is guaranteed to have the priority and stable operation.Perl language is used to write a script to account the resources of the high performance computer cluster,so that the administrator can fully grasp the use of resources of various application modes,reasonably adjust the system resource allocation and scheduling strategy,and give full play to the benefits of the high performance computer cluster in the Northwest Regional Meteorological Center.

关 键 词：LoadLeveler 作业调度 资源 集群效益 

分 类 号：P409[天文地球—大气科学及气象学] TP319[自动化与计算机技术—计算机软件与理论]