Depth Image-based Techniques for Compression, Transmission and Display of Auto-stereo Video

Abstract

This paper proposes a novel framework for the processing of auto-stereo video. It is based on the video-plus-depth data representation and provides high compatibility with diverse displays. An effective stereo matching algorithm based on the genetic algorithm is adopted to generate the depth map streams for the first and last video streams. The layered coding scheme is proposed to transmit the corresponding layer according to the customer demand and the network performance. Then, the multicast technology and the QoS terminal adaptive technology are adopted for the network transmission approach. Finally, the appropriate depth image-based rendering solution is proposed for the whole framework to generate the virtual views for the displays with different view numbers. The experimental results demonstrate the effectiveness of the whole framework. Technical challenges are identified in the end.