遥感数据集群处理作业调度管理系统研究  

Research on job schedule and management system for remote sensing data processing with cluster

作　　者：史园莉[1] 申文明[1] 熊文成[1] 付卓[1] 肖如林[1] 

机构地区：[1]环境保护部卫星环境应用中心,北京100094

出　　处：《计算机工程与应用》2012年第25期77-82,共6页Computer Engineering and Applications

基　　金：地理空间信息工程国家测绘局重点实验室经费资助项目(No.201013);环保公益性行业科研专项(No.201109043)

摘　　要：高性能遥感数据集群处理技术提高了遥感数据处理的速度和精度。作业调度管理是集群处理系统的核心组成部分,有助于提高系统的吞吐率和资源使用率。常用调度管理系统通用性强,但针对性差,自动化程度低,资源使用存在盲目性。针对遥感数据集群处理,基于集群作业调度管理系统Open PBS,提出一种最优资源自动分配的"双级调度策略";应用分层架构和面向服务的软件开发思想,采用ICE中间件的网络通信技术,使用XML格式作为数据交换模式,研究并实现C/S(Client/Server)架构的灵活、友好、高效的遥感数据集群处理作业调度管理系统。The application of high performance computing cluster technology to remote sensing data processing is one solution to meet the requirements of real-or near-real-time and high-accuracy processing capabilities. Job sched- ule and management is an important component of cluster which is designed to improve the throughput rate and resource utilization rate of system. Low degree of automation, blindness of resource selection and short of feasibility is unavoidable in common schedule system. Aiming at remote sensing data cluster processing, based on open sources Portable Batch System（PBS）, it develops a twin-stage scheduling strategy for resources assigned optimally and automatically. With the layered structure and service-oriented programming method, the job scheduling and management system for cluster-based remote sensing data processing system is C/S pattern which is communicated with ICE（Internet Communications Engine） middleware by XML（Extensible Markup Language） format data transmitting.

关 键 词：双级调度策略 最优资源分配 遥感数据处理 集群 

分 类 号：TP311[自动化与计算机技术—计算机软件与理论]