|
|
|
| No-reference Mobile Video Quality Assessment Based on Video Natural Statistics |
| SHI Wenjuan①② SUN Yanjing① ZUO Haiwei① CAO Qi① |
①(School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221008, China)
②(School of New Energy and Electronical Engineering, Yancheng Teachers University, Yancheng 224051, China) |
|
|
|
|
Abstract Considering the influence of compression and wireless channel packet-loss on mobile video quality in wireless network, analyzing the space-time perceptual statistics of the differences between video adjacent frames, a No-reference Mobile Video Quality Assessment (NMVQA) algorithm is proposed based on video natural statistics. First, the influences of various video distortion type on the statistical characteristics of difference coefficients between video adjacent frames are analyzed in terms of the natural statistical regularities of video frame difference. Second, the temporal change of the distribution parameters with respect to the products of adjacent frame differences computed along horizontal, vertical and diagonal spatial orientations are calculated. Finally, the distortion degree of mobile video is measured by the correlation between the multi-scale temporal changes of statistical characteristics of difference coefficients between video adjacent frames. Experimental results in the LIVE mobile video database show that NMVQA is well consistent with subjective assessment results, and can reflect human subjective feeling well. NMVQA can evaluate the performance of real-time online adjustment of the source rate and wireless channel parameters.
|
|
Received: 27 February 2017
Published: 08 November 2017
|
|
|
| Fund:The National Natural Science Foundation of China (51504214, 61771417), The Natural Science Foundation of Jiangsu Province (BK20150204), The National Key Research and Development Program (2016YFC0801403), The Fundamental Research and Development Foundation of Jiangsu Province (BE2015040), China Postdoctoral Science Foundation (2015M 581884) |
|
Corresponding Authors:
SUN Yanjing
E-mail: yanjingsun_cn@163.com
|
|
|
|
| [1] |
LIU Yan and LEE Jack Y B. Streaming variable bitrate video over mobile networks with predictable performance[C]. IEEE Wireless Communications and Networking Conference, Doha, Qatar, 2016: 1-7. doi: 10.1109/WCNC.2016.7565108.
|
| [2] |
SHAO Hua, WEN Xiangming, LU Zhaoming, et al. Reduced frame set on wireless distorted video for quality assessment[J]. The Journal of China Universities of Posts and Telecommunications, 2016, 23(4): 77-82. doi: 10.1016/S1005- 8885(16)60048-1.
|
| [3] |
MOORTHY A K, CHOI L K, BOVIK A C, et al. Video quality assessment on mobile devices: Subjective, behavioral and objective studies[J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 652-671. doi: 10.1109/JSTSP. 2012.2212417.
|
| [4] |
SOUNDARARAJAN R and BOVIK A C. Video quality assessment by reduced reference spatio-temporal entropic differencing[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2013, 23(4): 684-694. doi: 10.1109/ TCSVT.2012.2214933.
|
| [5] |
SAAD M A, BOVIK A C, and CHARRIER C. Blind prediction of natural video quality[J]. IEEE Transactions on Image Processing, 2014, 23(3): 1352-1365. doi: 10.1109/TIP. 2014.2299154.
|
| [6] |
MITTAL A, SAAD M A, and BOVIK A C. A completely blind video integrity oracle[J]. IEEE Transactions on Image Processing, 2016, 25(1): 289-300. doi: 10.1109/TIP.2015. 2502725.
|
| [7] |
HSIAO Yimao, LEE Jengfarn, CHEN Jaishiarng, et al. H.264 video transmissions over wireless networks: challenges and solutions[J]. Computer Communications, 2011, 34: 1661-1672. doi: 10.1016/j.comcom.2011.03.016.
|
| [8] |
YU Qingqing and SUN Songlin. Mobile video perception assessment model based on QoE[C]. 16th International Symposium on Communications and Information Technologies, Qingdao, China, 2016: 642-645. doi: 10.1109/ ISCIT.2016.7751712.
|
| [9] |
陈希宏, 金跃辉, 杨谈. 3G网络中移动视频质量评估模型的研究[J]. 计算机科学, 2015, 42(9): 86-93.
|
|
CHEN Xihong, JIN Yuehui, and YANG Tan. Study on quality assessment model for mobile videos over 3G network [J]. Computer Science, 2015, 42(9): 86-93.
|
| [10] |
SONG Wei and TJONDRONEGORO D W. Acceptablity- based QoE models for mobile video[J]. IEEE Transactions on Multimedia, 2014, 3(16): 738-750. doi: 10.1109/TMM.2014. 2298217.
|
| [11] |
OLSON S and GROSSBERG S. A neural network for the develop of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance[J]. Neural Networks, 1998, 11(2): 189-208. doi: 10.1016/s0893-6080(98) 00003-3.
|
| [12] |
FREEMAN J and SIMONCELLI E P. Metamers of the ventral stream[J]. Nature Neuroscience, 2011, 14(9): 1195-1201. doi: 10.1038/nn.2889.
|
| [13] |
LASMAR N E, STITOU Y, and BERTHOUMIEU Y. Multiscale skewed heavy tailed model for texture analysis[C]. 2009 IEEE International conference on Image Processing, Cairo, Egypt, 2009: 2281-2284. doi: 10.1109/icip.2009. 5414404.
|
| [14] |
MITTAL A, MOOTHY A K, and BOVIK A C. No-reference image quality assessment in the spatial domain[J]. IEEE Transactions on Image Processing, 2012, 21(12): 4695-4708. doi: 10.1109/tip.2012.2214050.
|
| [15] |
孙彦景, 杨玉芬, 刘东林, 等. 基于内在生成机制的多尺度结构相似性图像质量评价[J]. 电子与信息学报, 2016, 38(1): 127-134. doi: 10.11999/JEIT150616.
|
|
SUN Yanjing, YANG Yufen, LIU Donglin, et al. Multiple- scale structural similarity image quality assessment based on internal generative mechanism[J]. Journal of Electronics & Information Technology, 2016, 38(1): 127-134. doi: 10.11999 /JEIT150616.
|
| [16] |
WANG Z, LU L, and BOVIK A C. Image quality assessment: from error measurement to structural similarity[J]. IEEE Signal Process Letter, 2004, 13(4): 600-612. doi: 10.1109/tip. 2003.819861.
|
|
|
|
