针对搜索服务的操作系统伸缩性研究  

Research on operating system scalability for search service

作　　者：赵玉龙[1] 王雷[1] 王欢[1] 

机构地区：[1]北京航空航天大学计算机学院,北京100191

出　　处：《计算机工程与科学》2013年第9期27-35,共9页Computer Engineering & Science

基　　金：863计划资助项目(2011AA01A204);国家自然科学基金资助项目(61272167);核高基重大专项资助项目(2012ZX01039-004)

摘　　要：分析当前成熟操作系统,找出其在多核环境下的性能瓶颈并进行改进,已经成为了现代操作系统研究的重点之一。通过搜索服务压力测试实验发现,运行Nginx反向代理的64核Linux服务器的伸缩性不佳,启用64核时的吞吐量仅是1核时的3倍。瓶颈在于服务器上所有网卡中断和软中断处理都集中在一个CPU核上。结合网卡的Flow Direction机制和Linux内核中断的亲和性配置,实现了网卡中断负载均衡的方法,系统吞吐量提升33%。多核环境下网卡中断负载均衡无法保证TCP连接的亲和性。通过修改Linux内核代码,解决了TCP连接的非亲和性问题,系统吞吐量在之前的提升基础上,又提升9%。Abstract：The scalability of the operating system is the ability that the performance of operating sys- tem grows with the increase of the number of CPU cores. Analyzing current mature operating systems to find the performance bottleneck in multi-core environments and eliminate it has become one of the re- search spots of modern operating systems. Through pressure experiments of search service, it＇s found that the scalability of 64 cores Linux server running Nginx reverse proxy is poor and the throughput of 64 cores only increases by 3 times in comparison to 1 core. The bottleneck is that all NIC interrupts and soft interrupt handling concentrate in one core of the server. Using the NIC Flow Direction mechanisms and the Linux kernel interrupt affinity, the NIC interrupt load balancing approach is achieved. The aver- age throughput increases by 33%. NIC interrupts load balancing in multi-core environments cannot guarantee the TCP connection affinity. By modifying the code of the Linux kernel, the non-affinity prob- lem is solved, and the throughput keeps increasing by 9 %.

关 键 词：多核 操作系统伸缩性 搜索服务 网卡中断均衡 TCP连接亲和性 

分 类 号：TP316.4[自动化与计算机技术—计算机软件与理论]