The classical digital image stabilization system usually suffers from the problems of low precision and hardly real time processing. This paper presents a fast and robust digital image stabilization method. The sub-pixel phase correlation is used for local registration, and the global motion is collaboratively obtained according to the consistency of local motions, which can decrease the calculation while maintain the precision and tolerable stabilization range. The stationary and consistency assessments of intentional movement are proposed, which are used as feedbacks to adjust the parameter online for Kalman filter. Finally, according to the shaking character of frames, the adjacent frames are stored selectively to save storage resources and better compensation effect is achieved. Experiments show that the proposed method is accurate and robust, and can be used for real-time digital image stabilization products.
翟博,郑锦,刘养科. 一种多子块协同的自适应快速数字稳像方法[J]. 电子与信息学报, 2016, 38(5): 1107-1114.
ZHAI Bo, ZHENG Jin, LIU Yangke. A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration. JEIT, 2016, 38(5): 1107-1114.
ZHU Juanjuan. Research on theory and application of electronic image stabilization[D]. [Ph. D. dissertation], Xidian University, 2009.
[2]
ZHANG Haolong, WU Qiang, LIU Tianqi, et al. Design and implementation of electronic image stabilization system based on dual-core DSP[C]. International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Beijing, 2013: 117-120. doi: 10.1109/IIH-MSP. 2013.38.
SHI Yonggang, ZHOU Yubin, and ZHAO Yuejin. Fast parallel implementation of real-time electronic digital image stabilization system[J]. Journal of Electronics & Information Technology, 2006, 28(7): 1175-1179.
[4]
HAQUE M N, BISWAS M, PICKERING M R, et al. A low-complexity image registration algorithm for global motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(3): 426-433. doi: 10.1109/TCSVT.2011.2163983.
WU Hao and DENG Hongbin. A video stabilization method based on sub-block gray projection[J]. Acta Armamentaii, 2013, 34(4): 406-411. doi: 10.3969/j.issn.1000-1093.2013. 04.004.
YU Jialin, SUN Jifeng, and SONG Zhiguo. Full-frame video stabilization based on preferred feature trajectories[J]. Journal of Electronics & Information Technology, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019.
[7]
KIM S W, YIN S, YUN K, et al. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization[J]. Elsevier Computer Vision and Image Understanding, 2014, 118: 71-83. doi: 10.1016/j.cviu. 2013.09.005.
YU Bai, HU Yefeng, ZHENG Jin, et al. Global motion estimation based on sub-sampling and sub-pixel phase correlation[C]. The National Conference on Image and Graphics, Nanjing, 2006: 450-453.
[9]
ALFONSO A, FLAVIO V G, EDGAR R A S, et al. Phase correlation with subpixel accuracy: a comparative study in 1D and 2D[J]. Elsevier Computer Vision and Image Understanding, 2015, 137: 76-87. doi: 10.1016/j.cviu. 2015.03.011.
[10]
ERTURK S. Digital image stabilization with subimage phase correlation based global motion estimation[J]. IEEE Transactions on Consumer Electronics, 2003, 49(4): 1320-1325. doi: 10.1109/TCE.2003.1261235.
[11]
LI Lengyi, MA Xiaohong, and ZHAO Zheng. Real-time video stabilization based on fast block matching and improved Kalman filter[C]. IEEE International Conference on Intelligent Control and Information Processing (ICICIP), Dalian, 2014: 394-397. doi: 10.1109/ICICIP.2014.7010285.
LUO Yu, WANG Yongqing, LUO Haikun, et al. Study on vector tracking loop based on extended Kalman filter[J]. Journal of Electronics & Information Technology, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828.
DONG Jing, YANG Xia, and YU Qifeng. A real-time video stabilization algorithm based on homography trajectory[J]. Journal of National University of Defense Technology, 2014, 36(2): 99-104. doi: 10.11887/j.cn.201402017.
[14]
YEON G R and MYUNG J C. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012, 19(4): 223-226. doi: 10.1109/ LSP.2012.2188286.
[15]
MAI Ying, ZHAO Hongying, and GUO Shiyi. The analysis of image stabilization technology based on small-UAV airborne video[C]. IEEE International Conference on Computer Science and Electronics Engineering, Hangzhou, 2012: 586-589. doi: 10.1109/ICCSEE.2012.77.
[16]
MATSUSHITA Y, OFEK E, WEINA G, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(7): 1150-1163. doi: 10.1109/TPAMI.2006.141.
[17]
TANG Chongwu, YANG Xiaokang, CHEN Li, et al. A fast video stabilization algorithm based on block matching and edge completion[C]. IEEE International Workshop on Multimedia Signal Processing (MMSP), Hangzhou, 2011: 1-5. doi: 10.1109/MMSP.2011.6093781.
