H. S. Malvar, A. Hallapuro, M. Karczewicz, and L. Kerofsky
This paper presents an overview of the transform and quantization designs in H.264. Unlike the popular 8x8 discrete cosine transform used in previous standards, the 4x4 transforms in H.264 can be computed exactly in integer arithmetic, thus avoiding inverse transform mismatch problems. The new transforms can also be computed without multiplications, just additions and shifts, in 16-bit arithmetic, thus minimizing computational complexity, especially for low-end processors. By using short tables, the new quantization formulas use multiplications but avoid divisions.
In IEEE Transactions on Circuits and Systems
Publisher Institute of Electrical and Electronics Engineers, Inc.
© 2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.