Abstract：A novel non-contact heart rate estimation method is proposed to deal with the issue of heart rate measurement from face videos under motion interference in realistic situations, it is hard to estimate heart rate accurately using existing methods. Firstly, the discriminative response map fitting method and KLT tracking algorithm are used to eliminate the influence of face rigid motion. Then the chrominance features are selected to estimate heart rate with two steps because of the robustness to facial movements. The frequency and spatial domain weights are assigned through spatial gradient to eliminate the influence of non-rigid motion. Finally, the accurate average heart rate value and pulse wave signal waveform can be acquired from different face regions. Compared with three other methods, experimental results indicate that the proposed method enhances the consistency of estimated waveform and ground truth waveform and has obvious superiority in accuracy and robustness of heart rate estimation.
杨昭,杨学志,霍亮,刘雪南,李江山. 抗运动干扰的人脸视频心率估计[J]. 电子与信息学报, 2018, 40(6): 1345-1352.
YANG Zhao, YANG Xuezhi, HUO Liang, LIU Xuenan, LI Jiangshan. Heart Rate Estimation from Face Videos Against Motion Interference. JEIT, 2018, 40(6): 1345-1352.
KANNEL W B, KANNEL C, PAFFENBERGER R S, et al. Heart rate and cardiovascular mortality: The framingham study[J]. American Heart Journal, 1987, 113(6): 1489-1494. doi: 10.1016/0002-8703(87)90666-1.
[2]
TEMKO A. Accurate heart rate monitoring during physical exercises using PPG[J]. IEEE Transactions on Biomedical Engineering, 2017, 64(9): 2016-2024. doi: 10.1109/TBME. 2017.2676243.
[3]
ALLEN J. Photoplethysmography and its application in clinical physiological measurement[J]. Physiological Measurement, 2007, 28(3): 1-39. doi: 10.1088/0967-3334/28/ 3/R01.
[4]
VERKRUYSSE W, SVAASAND L O, and NELSON J S. Remote plethysmographic imaging using ambient light[J]. Opt Express, 2008, 16(26): 21434-21445. doi: 10.1364/OE.16. 021434.
[5]
POH M Z, MCDUFF D J, and PICARD R W. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation[J]. Optics Express, 2010, 18(10): 10762-10774. doi: 10.1364/OE.18.010762.
[6]
POH M Z, MCDUFF D J, and PICARD R W. Advancements in noncontact, multiparameter physiological measurements using a webcam[J]. IEEE Transactions on Biomedical Engineering, 2011, 58(1): 7-11. doi: 10.1109/ TBME.2010.2086456.
[7]
LI X, CHEN J, ZHAO G, et al. Remote heart rate measurement from face videos under realistic situations[C]. IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA, 2014: 4264-4271. doi: 10.1109/CVPR.2014.543.
[8]
CHWYL B, CHUNG A G, AMELARD R, et al. SAPPHIRE: Stochastically acquired photoplethysmogram for heart rate inference in realistic environments[C]. IEEE International Conference on Image Processing, Phoenix, USA, 2016: 1230-1234. doi: 10.1109/ICIP.2016.7532554.
[9]
TULYAKOV S, ALAMEDA-PINEDA X, RICCI E, et al. Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions[C]. IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA, 2016: 2396-2404. doi: 10.1109/CVPR.2016. 263.
[10]
CHENG J, CHEN X, XU L, et al. Illumination variation- resistant video-based heart rate measurement using joint blind source separation and ensemble empirical mode decomposition[J]. IEEE Journal of Biomedical and Health Informatics, 2016, 21(5): 1422-1433. doi: 10.1109/JBHI.2016. 2615472.
[11]
JEONG I C and FINKELSTEIN J. Introducing contactless blood pressure assessment using a high speed video camera[J]. Patient Facing Systems, 2016, 40(4): 77:1-77:10. doi: 10.1007/s10916-016-0439-z.
[12]
ZHANG C, WU X, ZHANG L, et al. Simultaneous detection of blink and heart rate using multi-channel ICA from smart phone videos[J]. Biomedical Signal Processing and Control, 2017, 33(3): 189-200. doi: 10.1016/j.bspc.2016.11.022.
[13]
VIOLA P and JONES M. Rapid object detection using a boosted cascade of simple features[C]. IEEE Conference on Computer Vision and Pattern Recognition, Kauai, USA, 2001: 511-518. doi: 10.1109/CVPR.2001.990517.
[14]
ASTHANA A, ZAFEIRIOU S, CHENG S, et al. Robust discriminative response map fitting with constrained local models[C]. IEEE Conference on Computer Vision and Pattern Recognition, Portland, USA, 2013: 3444-3451. doi: 10.1109/CVPR.2013.442.
[15]
TOMASI C and KANADE T. Detection and tracking of point features[J]. Technical Report, 1991, 91(21): 9795-9802.
[16]
FISCHLER M A and BOLLES R C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6): 381-395. doi: 10.1145/358669.358692.
[17]
HAAN G D and JEANNE V. Robust pulse rate from chrominance-based rPPG[J]. IEEE Transactions on Biomedical Engineering, 2013, 60(10): 2878-2886. doi: 10.1109/TBME.2013.2266196.
[18]
BRENNAN D. Linear diversity combining techniques[J]. Proceedings of the IEEE, 2003, 91(2): 331-356. doi: 10.1109/ JRPROC.2002.808163.
