Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Multiview Image Coding Based on Geometric Prediction

Xiang San, Hua CAI, Jian-Guang LOU, and Jiang LI

Abstract

Many existing multi-view image/video coding techniques remove inter-viewpoint redundancy by applying disparity compensation in a conventional video coding framework, e.g. H.264/MPEG-4 AVC. However, conventional methodology works ineffectively as it ignores the special characteristics of inter-viewpoint disparity. In this paper, we propose a geometric prediction methodology for accurate disparity vector (DV) prediction, such that we can largely reduce the disparity compensation cost. Based on the new DV predictor, we design a basic framework that can be implemented in most existing multi-view image/video coding schemes. We also use state-of-the-art H.264/MPEG-4 AVC as an example to illustrate how the proposed framework can be integrated with conventional video coding algorithms. Our experiments show proposed scheme can effectively tracks disparity and greatly improves coding performance. Compared with H.264/MPEG-4 AVC codec, our scheme outperforms maximally 1.5 dB when encoding some typical multi-view image sequences. We also carry out an experiment to evaluate the robustness of our algorithm. The results indicate our method is robust and can be used in practical applications.

Details

Publication typeArticle
Published inIEEE Transactions on Circuits and Systems for Video Technology
PublisherInstitute of Electrical and Electronics Engineers, Inc.

Previous versions

Jian-Guang Lou, Hua Cai, and Jiang Li. A RealTime Interactive MultiView Video System, Association for Computing Machinery, Inc., November 2005.

Jiangbo Lu, Hua Cai, Jian-Guang Lou, and Jiang Li. An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding, IEEE Transactions on Circuits and Systems for Video Technology, Institute of Electrical and Electronics Engineers, Inc., June 2007.

> Publications > Multiview Image Coding Based on Geometric Prediction