Article Title
Keywords
image quality assessment, synthetic image, depth-image-based rendering (DIBR), convolutional neural network, local image saliency
Abstract
Depth-image-based rendering (DIBR) is widely used in 3DTV, free-viewpoint video, and interac-tive 3D graphics applications. Typically, synthetic images generated by DIBR-based systems incorporate various distortions, particularly geometric distortions induced by object dis-occlusion. Ensuring the quality of synthetic images is critical to maintaining adequate system service. However, traditional 2D image quality metrics are ineffective for evaluating synthetic images as they are not sensitive to geometric distortion. In this paper, we propose a novel no-reference image quality assessment method for synthetic images based on con-volutional neural networks, introducing local image saliency as prediction weights. Due to the lack of existing training data, we construct a new DIBR synthetic image dataset as part of our contribution. Experiments were conducted on both the public benchmark IRCCyN/IVC DIBR image dataset and our own dataset. Results demonstrate that our proposed metric outperforms traditional 2D image quality metrics and state-of-the-art DIBR-related metrics.
Publisher
Tsinghua University Press
Recommended Citation
Xiaochuan Wang, Xiaohui Liang, Bailin Yang et al. No-reference synthetic image quality assessment with convolutional neural network and local image saliency. Computational Visual Media 2019, 5(2): 193-208.
Included in
Computational Engineering Commons, Computer-Aided Engineering and Design Commons, Graphics and Human Computer Interfaces Commons, Software Engineering Commons