No-reference Mobile Video Quality Assessment Based on Video Natural Statistics
SHI Wenjuan①② SUN Yanjing① ZUO Haiwei① CAO Qi①
①(School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221008, China) ②(School of New Energy and Electronical Engineering, Yancheng Teachers University, Yancheng 224051, China)
Abstract：Considering the influence of compression and wireless channel packet-loss on mobile video quality in wireless network, analyzing the space-time perceptual statistics of the differences between video adjacent frames, a No-reference Mobile Video Quality Assessment (NMVQA) algorithm is proposed based on video natural statistics. First, the influences of various video distortion type on the statistical characteristics of difference coefficients between video adjacent frames are analyzed in terms of the natural statistical regularities of video frame difference. Second, the temporal change of the distribution parameters with respect to the products of adjacent frame differences computed along horizontal, vertical and diagonal spatial orientations are calculated. Finally, the distortion degree of mobile video is measured by the correlation between the multi-scale temporal changes of statistical characteristics of difference coefficients between video adjacent frames. Experimental results in the LIVE mobile video database show that NMVQA is well consistent with subjective assessment results, and can reflect human subjective feeling well. NMVQA can evaluate the performance of real-time online adjustment of the source rate and wireless channel parameters.
施文娟, 孙彦景, 左海维, 曹起. 基于视频自然统计特性的无参考移动终端视频质量评价[J]. 电子与信息学报, 2018, 40(1): 143-150.
SHI Wenjuan, SUN Yanjing, ZUO Haiwei, CAO Qi. No-reference Mobile Video Quality Assessment Based on Video Natural Statistics. JEIT, 2018, 40(1): 143-150.
LIU Yan and LEE Jack Y B. Streaming variable bitrate video over mobile networks with predictable performance[C]. IEEE Wireless Communications and Networking Conference, Doha, Qatar, 2016: 1-7. doi: 10.1109/WCNC.2016.7565108.
[2]
SHAO Hua, WEN Xiangming, LU Zhaoming, et al. Reduced frame set on wireless distorted video for quality assessment[J]. The Journal of China Universities of Posts and Telecommunications, 2016, 23(4): 77-82. doi: 10.1016/S1005- 8885(16)60048-1.
[3]
MOORTHY A K, CHOI L K, BOVIK A C, et al. Video quality assessment on mobile devices: Subjective, behavioral and objective studies[J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 652-671. doi: 10.1109/JSTSP. 2012.2212417.
[4]
SOUNDARARAJAN R and BOVIK A C. Video quality assessment by reduced reference spatio-temporal entropic differencing[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2013, 23(4): 684-694. doi: 10.1109/ TCSVT.2012.2214933.
[5]
SAAD M A, BOVIK A C, and CHARRIER C. Blind prediction of natural video quality[J]. IEEE Transactions on Image Processing, 2014, 23(3): 1352-1365. doi: 10.1109/TIP. 2014.2299154.
[6]
MITTAL A, SAAD M A, and BOVIK A C. A completely blind video integrity oracle[J]. IEEE Transactions on Image Processing, 2016, 25(1): 289-300. doi: 10.1109/TIP.2015. 2502725.
[7]
HSIAO Yimao, LEE Jengfarn, CHEN Jaishiarng, et al. H.264 video transmissions over wireless networks: challenges and solutions[J]. Computer Communications, 2011, 34: 1661-1672. doi: 10.1016/j.comcom.2011.03.016.
[8]
YU Qingqing and SUN Songlin. Mobile video perception assessment model based on QoE[C]. 16th International Symposium on Communications and Information Technologies, Qingdao, China, 2016: 642-645. doi: 10.1109/ ISCIT.2016.7751712.
CHEN Xihong, JIN Yuehui, and YANG Tan. Study on quality assessment model for mobile videos over 3G network [J]. Computer Science, 2015, 42(9): 86-93.
[10]
SONG Wei and TJONDRONEGORO D W. Acceptablity- based QoE models for mobile video[J]. IEEE Transactions on Multimedia, 2014, 3(16): 738-750. doi: 10.1109/TMM.2014. 2298217.
[11]
OLSON S and GROSSBERG S. A neural network for the develop of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance[J]. Neural Networks, 1998, 11(2): 189-208. doi: 10.1016/s0893-6080(98) 00003-3.
[12]
FREEMAN J and SIMONCELLI E P. Metamers of the ventral stream[J]. Nature Neuroscience, 2011, 14(9): 1195-1201. doi: 10.1038/nn.2889.
[13]
LASMAR N E, STITOU Y, and BERTHOUMIEU Y. Multiscale skewed heavy tailed model for texture analysis[C]. 2009 IEEE International conference on Image Processing, Cairo, Egypt, 2009: 2281-2284. doi: 10.1109/icip.2009. 5414404.
[14]
MITTAL A, MOOTHY A K, and BOVIK A C. No-reference image quality assessment in the spatial domain[J]. IEEE Transactions on Image Processing, 2012, 21(12): 4695-4708. doi: 10.1109/tip.2012.2214050.
SUN Yanjing, YANG Yufen, LIU Donglin, et al. Multiple- scale structural similarity image quality assessment based on internal generative mechanism[J]. Journal of Electronics & Information Technology, 2016, 38(1): 127-134. doi: 10.11999 /JEIT150616.
[16]
WANG Z, LU L, and BOVIK A C. Image quality assessment: from error measurement to structural similarity[J]. IEEE Signal Process Letter, 2004, 13(4): 600-612. doi: 10.1109/tip. 2003.819861.
