Multiview Image Coding Based on Geometric Prediction

Many existing multi-view image/video coding techniques remove inter-viewpoint redundancy by applying disparity compensation in a conventional video coding framework, e.g. H.264/MPEG-4 AVC. However, conventional methodology works ineffectively as it ignores the special characteristics of inter-viewpoint disparity. In this paper, we propose a geometric prediction methodology for accurate disparity vector (DV) prediction, such that we can largely reduce the disparity compensation cost. Based on the new DV predictor, we design a basic framework that can be implemented in most existing multi-view image/video coding schemes. We also use state-of-the-art H.264/MPEG-4 AVC as an example to illustrate how the proposed framework can be integrated with conventional video coding algorithms. Our experiments show proposed scheme can effectively tracks disparity and greatly improves coding performance. Compared with H.264/MPEG-4 AVC codec, our scheme outperforms maximally 1.5 dB when encoding some typical multi-view image sequences. We also carry out an experiment to evaluate the robustness of our algorithm. The results indicate our method is robust and can be used in practical applications.

PDF file

In  IEEE Transactions on Circuits and Systems for Video Technology

Publisher  Institute of Electrical and Electronics Engineers, Inc.
© 2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.



Previous Versions

Jian-Guang Lou, Hua Cai, and Jiang Li. A RealTime Interactive MultiView Video System, Association for Computing Machinery, Inc., November 2005.

Jiangbo Lu, Hua Cai, Jian-Guang Lou, and Jiang Li. An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding, IEEE Transactions on Circuits and Systems for Video Technology, Institute of Electrical and Electronics Engineers, Inc., June 2007.

> Publications > Multiview Image Coding Based on Geometric Prediction