The registration and fusion are the two essential steps to get a composed image from the multispectral infrared images in the night vision. However, at present these two processes are considered as two independent steps, where the registration error may significantly affect the fusion quality. In this paper, a novel iteration optimization method is proposed to obtain the optimal registration parameter for the following fusion process. Definition index of the region of interest in the fused image is used to improve the register process, and simulated annealing method is used to solve the joint optimization problem. The experimental results show that the proposed method provides a robust stability and performance over several other state-of-the-art methods in the registration accuracy and fusion quality.
DENG Miao, ZHANG Jihong, LIU Wei, et al. A total variation-based lowpass weight function optimization in multiscale image fusion[J]. Journal of Electronics & Information Technology, 2013, 35(7): 1657-1663. doi: 10.3724/SP.J.1146.2012.01183.
[2]
LIU Yan and YU Feihong. An automatic image fusion algorithm for unregistered multiply multi-focus images[J]. Optics Communications, 2015, 341: 101-113.
HUANG Liqin and CHEN Caigan. Study on image fusion algorithm of panoramic image stitching[J]. Journal of Electronics & Information Technology, 2014, 36(6): 1292- 1298. doi: 10.3724/ SP.J.1146.2013.01220.
[4]
LEI Fei and WANG Wenxue. A fast method for image mosaic based on SURF[C]. Proceedings of the 2014 9th IEEE Conference on Industrial Electronics and Applications, Hangzhou, China, 2014: 79-82.
YU Xianchuan, L? Zhonghua, and HU Dan. Review of remote sensing image registration technique[J]. Optics and Precision Engineering, 2013, 21(11): 2960-2972.
[6]
BENTOUTOU Y, NASREDDING T, Kidiyo K, et al. An automatic image registration for applications in remote sensing[J]. IEEE Transactions on Geoscience and Remote Sensing, 2005, 43(9): 2127-2137.
[7]
MIAO Qiguang, SHI Cheng, XU Pengfei, et al. A novel algorithm of image fusion using shearlets[J]. Optics Communications, 2011, 284(6): 1540-1547.
[8]
LI Shutao, KANG Xudong, and HU Jianwen. Image fusion with guide filtering[J]. IEEE Transactions on Image Processing, 2013, 22(7): 2864-2875.
[9]
SHI Cheng, MIAO Qiguang, and XU Pengfei. A novel algorithm of image fusion based on shearlets and PCNN[J]. Neurocomputing, 2013, 117: 47-53.
[10]
KONG Weiwei and LIU Jianpeng. Technique for image fusion based on nonsubsampled shearlet transform and improved pulse coupled neural network[J]. Optical Engineering, 2013, 52(1): 017001.
BAI Lianfa, HAN Jing, ZHANG Yi, et al. Registration algorithm of infrared and visible images based on improved gradient normalized mutual information and particle swarm optimization[J]. Infrared and Laser Engineering, 2012, 41(1): 248-254.
[13]
BILODEAU G A, TORABI A, and MORIN F. Visible and infrared image registration using trajectories and composite foreground images[J]. Image and Vision Computing, 2011, 29(1): 41-50.
[14]
CHEN S, GUO Q, LEUNG H, et al. A maximum likelihood approach to joint image registration and fusion[J]. IEEE Transactions on Image Processing, 2011, 20(5): 1363-1372.
[15]
ZHANG Qian, CAO Zhiguo, HU Zhongwen, et al. Joint image registration and fusion for panchromatic and multispectral images[J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(3): 467-471.
[16]
WALD L. Quality of high resolution synthesized images: Is there a simple criterion?[C]. Proceedings of International Conference on Fusion of Earth Data, Nice, France, 2000: 99-105.
[17]
KIM Y S, LEE J H, and RA J B. Multi-sensor image registration based on intensity and edge orientation information[J]. Pattern Recognition, 2008, 41(11): 3356-3365.
GAO Shaoshu, JIN Weiqi, WANG Xia, et al. The Evaluation model of perceived definition based on visible light and infrared color fusion image[J]. Spectroscopy and Spectral Analysis, 2012, 32(12): 3197-3202.
[19]
PELI E. Contrast in complex images[J]. Journal of the Optical Society of America A, 1990, 7(10): 2032-2040.
[20]
KRKPATRIEK S, GELATT C D, and VECCHI M P. Optimization by simulated annealing[J]. Science, 1983, 220: 671-680.
[21]
BURT P J and ADELSON E H. The Laplacian pyramid
as a compact image code[J]. IEEE Transactions on Communications, 1983, 31(4): 532-540.
[22]
TOET A. Natural color mapping for multiband night vision imagery[J]. Information Fusion, 2003, 4(1): 155-166.
[23]
STUDHOLME C, HILL D L G, and HAWKES D J. An overlap in variant entropy measure of 3D medical image alignment[J]. Pattern Recognition, 1999, 32(1): 71-86.
[24]
BROWN L. A survey of image registration techniques[J]. ACM Computing Surveys, 1992, 24(4): 325-376.
[25]
XYDEAS C S and PETROVIC V. Objective image fusion performance measure[J]. Electronics Letters, 2000, 36(4): 305-309.
[26]
TRELEA I C. The particle swarm optimization algorithm: convergence analysis and parameter selection[J]. Information Processing Letters, 2003, 85(6): 317-325.