Academic Journal
GIPC-GAN: an end-to-end gradient and intensity joint proportional constraint generative adversarial network for multi-focus image fusion
| العنوان: | GIPC-GAN: an end-to-end gradient and intensity joint proportional constraint generative adversarial network for multi-focus image fusion |
|---|---|
| المؤلفون: | Junwu Li, Binhua Li, Yaoxi Jiang |
| المصدر: | Complex & Intelligent Systems, Vol 9, Iss 6, Pp 7395-7422 (2023) |
| بيانات النشر: | Springer, 2023. |
| سنة النشر: | 2023 |
| المجموعة: | LCC:Electronic computers. Computer science LCC:Information technology |
| مصطلحات موضوعية: | Multi-focus image fusion, Gradient-intensity joint proportional constraint, Deep region competition algorithm, Target intensity and detail gradient, Generative adversarial network, GIPC-GAN, Electronic computers. Computer science, QA75.5-76.95, Information technology, T58.5-58.64 |
| الوصف: | Abstract As for the problems of boundary blurring and information loss in the multi-focus image fusion method based on the generative decision maps, this paper proposes a new gradient-intensity joint proportional constraint generative adversarial network for multi-focus image fusion, with the name of GIPC-GAN. First, a set of labeled multi-focus image datasets using the deep region competition algorithm on a public dataset is constructed. It can train the network and generate fused images in an end-to-end manner, while avoiding boundary errors caused by artificially constructed decision maps. Second, the most meaningful information in the multi-focus image fusion task is defined as the target intensity and detail gradient, and a jointly constrained loss function based on intensity and gradient proportional maintenance is proposed. Constrained by a specific loss function to force the generated image to retain the information of target intensity, global texture and local texture of the source image as much as possible and maintain the structural consistency between the fused image and the source image. Third, we introduce GAN into the network, and establish an adversarial game between the generator and the discriminator, so that the intensity structure and texture gradient retained by the fused image are kept in a balance, and the detailed information of the fused image is further enhanced. Last but not least, experiments are conducted on two multi-focus public datasets and a multi-source multi-focus image sequence dataset and compared with other 7 state-of-the-art algorithms. The experimental results show that the images fused by the GIPC-GAN model are superior to other comparison algorithms in both subjective performance and objective measurement, and basically meet the requirements of real-time image fusion in terms of running efficiency and mode parameters quantity. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2199-4536 2198-6053 |
| Relation: | https://doaj.org/toc/2199-4536; https://doaj.org/toc/2198-6053 |
| DOI: | 10.1007/s40747-023-01151-y |
| URL الوصول: | https://doaj.org/article/27e845a93ee44385bab21f909e0f6137 |
| رقم الانضمام: | edsdoj.27e845a93ee44385bab21f909e0f6137 |
| قاعدة البيانات: | Directory of Open Access Journals |
Full Text Finder | تدمد: | 21994536 21986053 |
|---|---|
| DOI: | 10.1007/s40747-023-01151-y |