个人信息Personal Information
教师英文名称:Tony
职称:副教授
硕士生导师
毕业院校:北京科技大学
学科:计算机科学与技术
学历:研究生(博士)毕业
学位:工学博士学位
所在单位:北京科技大学
职务:Associate professor
电子邮箱:
End-to-end learning for simultaneously generating decision map and multi-focus image fusion result
点击次数:
DOI码:10.1016/j.neucom.2021.10.115
发表刊物:Neurocomputing
摘要:The general aim of multi-focus image fusion is to gather focused regions of different images to generate a unique all-in-focus fused image. Deep learning based methods become the mainstream of image fusion by virtue of its powerful feature representation ability. However, most of the existing deep learning structures failed to balance fusion quality and end-to-end implementation convenience. End-to-end decoder design often leads to unrealistic result because of its non-linear mapping mechanism. On the other hand, generating an intermediate decision map achieves better quality for the fused image, but relies on the rectification with empirical post-processing parameter choices. In this work, to handle the requirements of both output image quality and comprehensive simplicity of structure implementation, we propose a cascade network to simultaneously generate decision map and fused result with an end-to-end training procedure. It avoids the dependence on empirical post-processing methods in the inference stag. To improve the fusion quality, we introduce a gradient aware loss function to preserve gradient information in output fused image. In addition, we design a decision calibration strategy to decrease the time consumption in the application of multiple images fusion. Extensive experiments are conducted to compare with 19 different state-of-the-art multi-focus image fusion structures with 6 assessment metrics. The results prove that our designed structure can generally ameliorate the output fused image quality, while implementation efficiency increases over 30% for multiple images fusion.
合写作者:Xiang Yin,Di Wu,Haokai Shen,Xiaojuan Ban,Yu Wang
第一作者:Boyuan Ma
论文类型:期刊论文
学科门类:工学
文献类型:J
卷号:470
期号:1
页面范围:204-216. (TOP期刊)
是否译文:否
发表时间:2022-01-01
收录刊物:SCI