Measuring Perceptual Color Differences of Smartphone Photographs

التفاصيل البيبلوغرافية
العنوان: Measuring Perceptual Color Differences of Smartphone Photographs
المؤلفون: Wang, Zhihua, Xu, Keshuo, Yang, Yang, Dong, Jianlei, Gu, Shuhang, Xu, Lihao, Fang, Yuming, Ma, Kede
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Graphics, Electrical Engineering and Systems Science - Image and Video Processing
الوصف: Measuring perceptual color differences (CDs) is of great importance in modern smartphone photography. Despite the long history, most CD measures have been constrained by psychophysical data of homogeneous color patches or a limited number of simplistic natural photographic images. It is thus questionable whether existing CD measures generalize in the age of smartphone photography characterized by greater content complexities and learning-based image signal processors. In this paper, we put together so far the largest image dataset for perceptual CD assessment, in which the photographic images are 1) captured by six flagship smartphones, 2) altered by Photoshop, 3) post-processed by built-in filters of the smartphones, and 4) reproduced with incorrect color profiles. We then conduct a large-scale psychophysical experiment to gather perceptual CDs of 30,000 image pairs in a carefully controlled laboratory environment. Based on the newly established dataset, we make one of the first attempts to construct an end-to-end learnable CD formula based on a lightweight neural network, as a generalization of several previous metrics. Extensive experiments demonstrate that the optimized formula outperforms 33 existing CD measures by a large margin, offers reasonable local CD maps without the use of dense supervision, generalizes well to homogeneous color patch data, and empirically behaves as a proper metric in the mathematical sense. Our dataset and code are publicly available at https://github.com/hellooks/CDNet.
Comment: 10 figures, 8 tables, 14 pages
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2205.13489
رقم الانضمام: edsarx.2205.13489
قاعدة البيانات: arXiv