Efficient fine-grained shared buffer management for multiple OpenCL devices  

作　　者：Chang-qing XUN Dong CHEN Qiang LAN Chun-yuan ZHANG 

机构地区：[1]College of Computer,National University of Defense Technology [2]State Key Laboratory of High Performance Computing,National University of Defense Technology

出　　处：《Journal of Zhejiang University-Science C(Computers and Electronics)》2013年第11期859-872,共14页浙江大学学报C辑（计算机与电子（英文版）

基　　金：Project supported by the National Natural Science Foundation of China(Nos.61033008,61272145,60903041,and 61103080);the Research Fund for the Doctoral Program of Higher Education of China(No.20104307110002);the Hunan Provincial Innovation Foundation for Postgraduate(No.CX2010B028);the Fund of Innovation in Graduate School of NUDT(Nos.B100603 and B120605),China

摘　　要：OpenCL programming provides full code portability between different hardware platforms,and can serve as a good programming candidate for heterogeneous systems,which typically consist of a host processor and several accelerators.However,to make full use of the computing capacity of such a system,programmers are requested to manage diverse OpenCL-enabled devices explicitly,including distributing the workload between different devices and managing data transfer between multiple devices.All these tedious jobs pose a huge challenge for programmers.In this paper,a distributed shared OpenCL memory(DSOM) is presented,which relieves users of having to manage data transfer explicitly,by supporting shared buffers across devices.DSOM allocates shared buffers in the system memory and treats the on-device memory as a software managed virtual cache buffer.To support fine-grained shared buffer management,we designed a kernel parser in DSOM for buffer access range analysis.A basic modified,shared,invalid cache coherency is implemented for DSOM to maintain coherency for cache buffers.In addition,we propose a novel strategy to minimize communication cost between devices by launching each necessary data transfer as early as possible.This strategy enables overlap of data transfer with kernel execution.Our experimental results show that the applicability of our method for buffer access range analysis is good,and the efficiency of DSOM is high.OpenCL programming provides full code portability between different hardware platforms, and can serve as a good programming candidate for heterogeneous systems, which typically consist of a host processor and several accelerators. However, to make full use of the computing capacity of such a system, programmers are requested to manage diverse OpenCL-enabled devices explicitly, including distributing the workload between different devices and managing data transfer between multiple devices. All these tedious jobs pose a huge challenge for programmers. In this paper, a distributed shared OpenCL memory （DSOM） is presented, which relieves users of having to manage data transfer explicitly, by supporting shared buffers across devices. DSOM allocates shared buffers in the system memory and treats the on-device memory as a software managed virtual cache buffer. To support fine-grained shared buffer management, we designed a kernel parser in DSOM for buffer access range analysis. A basic modified, shared, invalid cache coherency is implemented for DSOM to maintain coherency for cache buffers. In addition, we propose a novel strategy to minimize communication cost between devices by launching each necessary data transfer as early as possible. This strategy enables overlap of data transfer with kernel execution. Our experimental results show that the applicability of our method for buffer access range analysis is good, and the efficiency of DSOM is high.

关 键 词：Shared buffer OPENCL Heterogeneous programming Fine grained 

分 类 号：TP333[自动化与计算机技术—计算机系统结构]