A globally shared resource paradigm for encoded storage systems in the public cloud  

作　　者：Zhiyue Li Guangyan Zhang 

机构地区：[1]Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China [2]Beijing National Research Center for Information Science and Technology,Tsinghua University,Beijing 100084,China

出　　处：《Fundamental Research》2024年第3期642-650,共9页自然科学基础研究（英文版）

基　　金：supported by the National Natural Science Foundation of China(62025203).

摘　　要：Public clouds favor sharing of storage resources,in which many tenants acquire bandwidth and storage capacity from a shared storage pool.To provide high availability,data are often encoded to provide fault tolerance with low storage costs.Regarding this,efficiently organizing an encoded storage system for shared I/Os is critical for application performance.This is usually hard to achieve as different applications have different stripe configurations and fault tolerance levels.In this paper,we first study the block trace from the Alibaba cloud,and find that I/O patterns of modern applications prefer the resource sharing scheme.Based on this,we propose a globally shared resource paradigm for encoded storage system in the public cloud.The globally shared resource paradigm can provide balanced load and fault tolerance for numerous disk pool sizes and arbitrary application stripe configurations.Furthermore,we demonstrate with two case studies that our theory can help address the device-specific problems of HDD and SSD RAID arrays with slight modifications:comparing the existing resource partition and resource sharing methods,our theory can promote the rebuild speed of the HDD RAID arrays by 2.5,and reduce the P99 tail latency of the SSD arrays by up to two orders of magnitude.

关 键 词：Public cloud Encoded storage Load balancing RAID reconstruction Tail latency 

分 类 号：TP333[自动化与计算机技术—计算机系统结构]