JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]


Journal of Information Science and Engineering, Vol. 40 No. 3, pp. 437-453


Color Image Sketch Stylization with Extended Difference of Gaussian (XDoG) and Deep Learning


SOO-CHANG PEI+,1 AND CHIA-YI CHEN2
1,+Department of Electrical Engineering
2Graduate Institute of Communication Engineering
National Taiwan University
Taipei, 116 Taiwan
E-mail: peisc@ntu.edu.tw


Artists paint portraits using sparse lines and shaded areas to capture the unique look of a face. The face photo sketches generated by deep learning techniques and eXtended Difference of Gaussian (XDoG) edge detection operator are monotonous since they only have two-tone color results, black and white. Therefore, we dedicated to developing an algorithm of color face photo sketch based on existing technology. In this paper, the XDoG operator and its extensions are explained in detail, and its parameters are arranged. Fur-thermore, we demonstrate the application of the XDoG operator, and render the proposed artistic effect of the pencil sketch style and display the technical details and stylistic po-tential of this operator. Moreover, we apply our proposed color face sketch method not only to the retinex theory, but also to the distinct color spaces (HSV, Lab, and YCbCr), and then analyze and discuss these differences. Through the experimental results, the dif-ferences between the color face photo sketch based on the XDoG operator and the deep learning are compared and the visual quality obtained by the method based on the XDoG is better than the system based on the deep learning. Besides, our proposed color face photo sketch can effectively generate high-quality, expressive, and color artistic face drawings from face photos whether for animals or human. Finally, the organized and expanded XDoG will have more practicality and commercial value.


Keywords: color face photo sketch, difference-of-Gaussians, deep learning, pencil drawing, Retinex theory

  Retrieve PDF document (JISE_202403_01.pdf)