Labeled Network Stack: A High-Concurrency and Low-Tail Latency Cloud Server Framework for Massive IoT Devices  

作　　者：Wen-Li Zhang Ke Liu Yi-Fan Shen Ya-Zhu Lan Hui Song Ming-Yu Chen Yuan-Fei Chen 

机构地区：[1]State Key Laboratory of Computer Architecture,Institute of Computing Technology,Chinese Academy of Sciences Beijing 100190,China [2]University of Chinese Academy of Sciences,Beijing 100049,China [3]Peng Cheng Laboratory,Shenzhen 518000,China [4]Zhongke Zhicheng Electronic Technology Company Limited,Jining 272000,China

出　　处：《Journal of Computer Science & Technology》2020年第1期179-193,共15页计算机科学技术学报（英文版）

基　　金：The work was supported by the National Key Research and Development Plan of China under Grant No.2016YFB1000203.

摘　　要：Internet of Things(IoT)applications have massive client connections to cloud servers,and the number of networked IoT devices is remarkably increasing.IoT services require both low-tail latency and high concurrency in datacenters.This study aims to determine whether an order of magnitude improvement is possible in tail latency and concurrency in mainstream systems by proposing a hardware-software codesigned labeled network stack(LNS)for future datacenters.The key innovation is a cross-layered payload labeling mechanism that distinguishes different requests by payload across the full network stack,including application,TCP/IP,and Ethernet layers.This type of design enables prioritized data packet processing and forwarding along the full datapath,such that latency-insensitive requests cannot significantly interfere with high-priority requests.We build a prototype datacenter server to evaluate the LNS design against a commercial X86 server and the mTCP research,using a cloud-supported IoT application scenario.Experimental results show that the LNS design can provide an order of magnitude improvement in tail latency and concurrency.A single datacenter server node can support over 2 million concurrent long-living connections for IoT devices as a 99-percentile tail latency of 50 ms is maintained.In addition,the hardware-software codesign approach remarkably reduces the labeling and prioritization overhead and constrains the interference of high-priority requests to low-priority requests.

关 键 词：TAIL LATENCY high CONCURRENCY network stack CLOUD SERVER Internet of Things(IoT)service 

分 类 号：TP39[自动化与计算机技术—计算机应用技术]