Skip to search boxSkip to navigationSkip to main content

Content adaptive enhancement of multi-view depth maps for free viewpoint video

  • University of Surrey
Research Output: Contribution to journal Article Peer-review

Abstract

Depth map estimation is an important part of the multi-view video coding and virtual view synthesis within the free viewpoint video applications. However, computing an accurate depth map is a computationally complex process, which makes real-time implementation challenging. Alternatively, a simple estimation, though quick and promising for real-time processing, might result in inconsistent multi-view depth map sequences. To exploit this simplicity and to improve the quality of depth map estimation, we propose a novel content adaptive enhancement technique applied to the previously estimated multi-view depth map sequences. The enhancement method is locally adapted to edges, motion and depth-range of the scene to avoid blurring the synthesized views and to reduce the computational complexity. At the same time, and very importantly, the method enforces consistency across the spatial, temporal and inter-view dimensions of the depth maps so that both the coding efficiency and the quality of the synthesized views are improved. We demonstrate these improvements in the experiments, where the enhancement method is applied to several multi-view test sequences and the obtained synthesized views are compared to the views synthesized using other methods in terms of both numerical and perceived visual quality.

Publication Information

Output type

Research Output: Contribution to journal Article Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 352-361

Journal (Volume, Issue Number)

IEEE Journal on Selected Topics in Signal Processing (Volume 5, Issue 2)

Publication milestones

  • Published - 01/04/2011

Publication status

Published - 01/04/2011

ISSN

1932-4553

External Publication IDs

  • handle.net: 10547/224110
  • Scopus: 79952973195

Access to documents

Publication metrics