Pixel-level Non-local Image Smoothing with Objective Evaluation

Authors
  • L. Shao
  • M.-M. Cheng
Publication date 2021
Journal IEEE Transactions on Multimedia
Volume | Issue number 23
Pages (from-to) 4065-4078
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Recently, imagesmoothing has gained increasing attention due to its prerequisite role in other image processing tasks, e.g., image enhancement and editing. However, the evaluation of image smoothing algorithms is usually performed by subjective observation on images without corresponding ground truths. To promote the development of image smoothing algorithms, in this paper, we construct a novel Nankai Smoothing (NKS) dataset containing 200 images blended by versatile structure images and natural textures. The structure images are inherently smooth and naturally taken as ground truths. On our NKS dataset, we comprehensively evaluate 14 popular image smoothing algorithms. Moreover, we propose a Pixel-level Non-Local Smoothing (PNLS) method to well preserve the structure of the smoothed images, by exploiting the pixel-level non-local self-similarity prior of natural images. Extensive experiments on several benchmark datasets demonstrate that our PNLS outperforms previous algorithms on the image smoothing task. Ablation studies also reveal the work mechanism of our PNLS on image smoothing. To further show its effectiveness, we apply our PNLS on several applications such as semantic region smoothing, detail/edge enhancement, and image abstraction. The dataset and code are available at https://github.com/zal0302/PNLS .
Document type Article
Language English
Published at https://doi.org/10.1109/TMM.2020.3037535
Other links https://github.com/zal0302/PNLS
Permalink to this page
Back