[ 1 ] [ 2 ] [ 3 ] [ 4 ] [ 5 ] [ 6 ] [ 7 ] [ 8 ] [ 9 ] [ 10 ] [ 11 ] [ 12 ] [ 13 ] [ 14 ] [ 15 ]

Journal of Information Science and Engineering, Vol. 36 No. 6, pp. 1353-1374

An Asymmetric Filter Based 3D Synthesis Algorithm with Depth Region Classification

Department of Electrical Engineering
National Chi Nan University
Nantou, 545 Taiwan
E-mail: pjlee@ncnu.edu.tw; honglilin@hotmail.com; trongan93@gmail.com

To reduce geometric distortion in three dimensional (3D) synthesized images and high computation time in the depth map preprocessing, this paper proposes a region classification based asymmetric filter for depth map preprocessing. First, the depth map can be classified into three types of region: depth continuous region, sharp depth transition regions with, and without vertical lines. To maintain 3D experience and reduce computation time, the depth value in the depth continuous region is left unchanged, such as the background region. For the sharp depth transition regions, we determine the presence or lack of vertical lines. Next, an adaptive Horizontal Gaussian filter is used to reduce rubbersheet holes generated in the region which does not contain vertical lines. Additionally, an adaptive Gaussian filter based on the vertical line direction is used to reduce geometric artifacts and further reduce the computation time compared to other asymmetric Gaussian filters used in the region which has vertical lines. The proposed algorithm can improve the quality of the Depth-image-based rendering (DIBR) virtual views by using depth sensors. According to the experiment result, the computation time is reduced by 90-95% compared with the asymmetric Gaussian filter. Moreover, the vertical line comparison and the skewness comparison show that geometric distortion is reduced obviously and the 3D experience is preserved successfully. 

Keywords: 3D, depth region, depth image based rendering, DIBR, synthesized virtual view

  Retrieve PDF document (JISE_202006_14.pdf)