Rate-distortion modeling for efficient H.264/AVC encoding

Yu Kuang Tu, Jar Ferr Yang, Ming Ting Sun

Research output: Contribution to journalArticlepeer-review

48 Citations (Scopus)


The rate-distortion (R-D) optimization technique plays an important role in optimizing video encoders. Modeling the rate and distortion functions accurately in acceptable complexity helps to make the optimization more practical. In this paper, we propose a bit-rate estimation function and a distortion measure by modeling the transform coefficients with spatial-domain variance. Furthermore, with quantization-based thresholding to determine the number, the absolute sum, and the squared sum of transform coefficients, the simplified transform-domain R-D measurement is introduced. The proposed algorithms can reduce the computation complexity for the R-D optimized mode-decision by using the new cost function evolving from the simplified transform-domain R-D model. Based on the proposed estimations, a rate-control scheme in the macroblock layer is also proposed to improve the coding efficiency.

Original languageEnglish
Pages (from-to)530-543
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Issue number5
Publication statusPublished - 2007 May

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Electrical and Electronic Engineering


Dive into the research topics of 'Rate-distortion modeling for efficient H.264/AVC encoding'. Together they form a unique fingerprint.

Cite this