MCGIM-Based Model Streaming for Realtime Progressive Rendering  

作　　者：盛斌 孟维亮 孙汉秋 吴恩华 

机构地区：[1]Department of Computer Science and Engineering,the Chinese University of Hong Kong [2]State Key Laboratory of Computer Science,Institute of Software,Chinese Academy of Sciences [3]Faculty of Science and Technology,University of Macao

出　　处：《Journal of Computer Science & Technology》2011年第1期166-175,共10页计算机科学技术学报（英文版）

基　　金：supported by the National Basic Research 973 Program of China under Grant No.2009CB320802;the National Natural Science Foundation of China under Grant Nos.60473105,60773030;RGC Research Grant(Ref.416007),RGC Direct Research Grant(No.2050349),and Grant of University of Macao

摘　　要：While most mesh streaming techniques focus on optimizing the transmission order of the polygon data, few approaches have addressed the streaming problems by using geometry images （GIM）. In this paper, we present a new approach which firstly partitions a mesh into several surface patches, then converts these patches into multi-chart geometry images （MCGIM）. After resampling the MCGIM and normal map atlas are obtained, we hierarchically construct the regular geometry image representation by adopting the quadtree structure. In this way, the encoded nodes can be transmitted in arbitrary order with high transmission flexibility. Also, the rendering quality of the partially transmitted models can be greatly improved by using the normal texture atlas. Meanwhile only the geometry on the silhouette to the current viewpoint are required to be refined and transmitted, therefore the amount of data is minimized for transferring each frame. In particular, our approach also allows users to encode and transmit the mesh data via JPEG2000 technique. Therefore, our mesh streaming method is suitable for transmitting 3D animation models with use of Motion JPEG2000 videos. Experimental results have demonstrated the effectiveness of our approach, which enables one server to stream the MCGIM texture atlas to the clients. Also, the transmitted model can be rendered in a multiresolution manner by GPU acceleration on the client side, due to the regular geometry structure of MCGIM.While most mesh streaming techniques focus on optimizing the transmission order of the polygon data, few approaches have addressed the streaming problems by using geometry images （GIM）. In this paper, we present a new approach which firstly partitions a mesh into several surface patches, then converts these patches into multi-chart geometry images （MCGIM）. After resampling the MCGIM and normal map atlas are obtained, we hierarchically construct the regular geometry image representation by adopting the quadtree structure. In this way, the encoded nodes can be transmitted in arbitrary order with high transmission flexibility. Also, the rendering quality of the partially transmitted models can be greatly improved by using the normal texture atlas. Meanwhile only the geometry on the silhouette to the current viewpoint are required to be refined and transmitted, therefore the amount of data is minimized for transferring each frame. In particular, our approach also allows users to encode and transmit the mesh data via JPEG2000 technique. Therefore, our mesh streaming method is suitable for transmitting 3D animation models with use of Motion JPEG2000 videos. Experimental results have demonstrated the effectiveness of our approach, which enables one server to stream the MCGIM texture atlas to the clients. Also, the transmitted model can be rendered in a multiresolution manner by GPU acceleration on the client side, due to the regular geometry structure of MCGIM.

关 键 词：mesh streaming geometry images JPEG2000 multiresolution rendering 

分 类 号：TN919.8[电子电信—通信与信息系统]