Skip to search boxSkip to navigationSkip to main content

On dependent bit allocation for multiview image coding with depth-image-based rendering

  • National Institute of Informatics
    ,
  • University of Southern California
Research Output:
Contribution to journal
Article
 Peer-review

Abstract

The encoding of both texture and depth maps of multiview images, captured by a set of spatially correlated cameras, is important for any 3-D visual communication system based on depth-image-based rendering (DIBR). In this paper, we address the problem of efficient bit allocation among texture and depth maps of multiview images. More specifically, suppose we are given a coding tool to encode texture and depth maps at the encoder and a view-synthesis tool to construct intermediate views at the decoder using neighboring encoded texture and depth maps. Our goal is to determine how to best select captured views for encoding and distribute available bits among texture and depth maps of selected coded views, such that the visual distortion of desired constructed views is minimized. First, in order to obtain at the encoder a low complexity estimate of the visual quality of a large number of desired synthesized views, we derive a cubic distortion model based on basic DIBR properties, whose parameters are obtained using only a small number of viewpoint samples. Then, we demonstrate that the optimal selection of coded views and quantization levels for corresponding texture and depth maps is equivalent to the shortest path in a specially constructed 3-D trellis. Finally, we show that, using the assumptions of monotonicity in the predictor's quantization level and distance, suboptimal solutions can be efficiently pruned from the feasible space during solution search. Experiments show that our proposed efficient selection of coded views and quantization levels for corresponding texture and depth maps outperforms an alternative scheme using constant quantization levels for all maps (commonly used in video standard implementations) by up to 1.5 dB. Moreover, the complexity of our scheme can be reduced by at least 80% over the full solution search.

Publication Information

Output type

Research Output:
Contribution to journal
Article
 Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 3179-3194

Journal (Volume, Issue Number)

IEEE Transactions on Image Processing (Volume 20, Issue 11)

Publication milestones

  • Published - 01/11/2011

Publication status

Published - 01/11/2011

ISSN

1057-7149

Publication IDs

  • handle.net: 10547/224109
  • Scopus: 80054801018

Access to documents

Publication metrics