Fast Coding Unit Decision Algorithm for Depth Intra Coding in 3D-HEVC
ZHANG Hongbin①② FU Changhong① SU Weimin① CHAN Yuilam② SIU Wanchi②
①(School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China) ②(Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China)
针对3维高性能视频编码(3D-HEVC)中深度图像帧内编码单元(Coding Unit, CU)划分复杂度高的问题,该文提出一种基于角点和彩色图像的自适应快速CU划分算法。首先利用角点算子,并根据量化参数选取一定数目的角点,以此进行CU的预划分;然后联合彩色图像的CU划分对预划分的CU深度级进行调整;最后依据调整后的CU深度级,缩小当前CU的深度级范围。实验结果表明,与原始3D-HEVC的算法相比,该文所提算法平均减少了约63%的编码时间;与只基于彩色图像的算法相比,该文的算法减少了约13%的编码时间,同时降低了约3%的平均比特率,有效地提高了编码效率。
An efficient Coding Unit (CU) decision algorithm is proposed for depth intra coding, in which the depth level of CU is predicted by Corner-Point (CP) and the co-located texture CU. More specially, firstly, the CPs are obtained by corner detector in junction with the quantization parameter, which are further used to pre-allocate the depth level. After that, the refinement of pre-allocation depth level is performed by considering the block partition of the co-located texture. Finally, different depth search range is selected based on the final pre-allocation depth levels. Simulation results show that the proposed algorithm can provide about 63% time saving with maintaining coding performance compared with the original 3D-HEVC method. On the other hand, it can achieve about 13% time saving while the BD-rate 3% decreased over the CU decision method that only considers the texture information.
张洪彬,伏长虹,苏卫民,陈锐霖,萧允治. 3D-HEVC深度图像帧内编码单元划分快速算法[J]. 电子与信息学报, 2016, 38(10): 2523-2530.
ZHANG Hongbin, FU Changhong, SU Weimin, CHAN Yuilam, SIU Wanchi. Fast Coding Unit Decision Algorithm for Depth Intra Coding in 3D-HEVC. JEIT, 2016, 38(10): 2523-2530.
ISO&IEC and MPEG. Information technology-MPEG video technologies-Part 3: Representation of auxiliary video and supplemental information[R]. ISO/IEC/JTC1/SC29-23002-3, 2007.
ZHANG Qiuwen, AN Ping, ZHANG Yan, et al. Depth map intra moding based on virtual view rendering distortion estimation[J]. Journal of Electronics & Information Technology, 2011, 33(11): 2541-2546. doi: 10.3724/SP.J.1146. 2011.00218.
SHI Lin, LIU Rongke, and LI Junye. Error concealment based on depth information for stereoscopic video coding[J]. Journal of Electronics & Information Technology, 2012, 34(4): 1678-1684. doi: 10.3724/SP.J.1146.2011.01107.
[4]
MULLER K, SCHWARZ H, MARPE D, et al. 3D high-efficiency video coding for multi-view video and depth data[J]. IEEE Transactions on Image Processing, 2013, 22(9): 3366-3378. doi: 10.1109/TIP.2013.2264820.
[5]
SULLIVAN G J, OHM J R, HAN W J, et al. Overview of the High Efficiency Video Coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12): 1649-1668. doi: 10.1109/TCSVT.2012.2221191.
[6]
MERKLE P, MULLER K, ZHAO X, et al. Simplified Wedgelet search for DMM modes 1 and 3--JCT3V-B0039[R]. ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 2012.
[7]
GU Z Y, ZHENG J H, LING N, et al. Fast depth modeling mode selection for 3D HEVC depth intra coding[C]. IEEE International Conference on Multimedia & Expo Workshops, San Jose, CA, 2013: 1-4. doi: 10.1109/ICMEW.2013.6618267.
[8]
PARK C. Edge-based intra mode selection for depth-map coding in 3D-HEVC[J]. IEEE Transactions on Image Processing, 2015, 24(1): 155-162. doi: 10.1109/TIP.2014. 2375653.
LI Yuan, HE Xiaohai, ZHONG Guoyun, et al. A fast inter-frame prediction unit mode decision algorithm for high efficiency video coding based on temporal correlation[J]. Journal of Electronics & Information Technology, 2013, 35(10): 2364-2370. doi: 10.3724/SP.J.1146.2013.00028.
QI Meibin, CHEN Xiuli, YANG Yanfang, et al. Fast coding unit splitting algorithm for high efficiency video coding intra prediction[J]. Journal of Electronics & Information Technology, 2014, 36(7): 1699-1705. doi: 10.3724/SP.J.1146. 2013.01148.
[11]
SHEN Liquan, ZHANG Zhaoyang, and LIU Zhi. Effective CU size decision for HEVC intra coding[J]. IEEE Transactions on Image Processing, 2014, 23(10): 4232-4241. doi: 10.1109/TIP.2014.2341927.
[12]
SHEN Liquan, ZHANG Zhaoyang, and AN Ping. Fast CU size decision and mode decision algorithm for HEVC intra coding[J]. IEEE Transactions on Consumer Electronics, 2013, 59(1): 207-213. doi: 10.1109/TCE.2013.6490261.
[13]
MIOK K, NAM L, and LI S. Fast single depth intra mode decision for depth map coding in 3D-HEVC[C]. IEEE International Conference on Multimedia & Expo Workshops, Turin, Italy, 2015: 1-6. doi: 10.1109/ICMEW.2015.7169769.
[14]
MORE E G, JUNG J, CAGNAZZO M, et al. Initialization, limitation, and predictive coding of the depth and texture quadtree in 3D-HEVC[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(9): 1554-1565. doi: 10.1109/TCSVT.2013.2283110.
[15]
LI W and LU Y. Rate-distortion optimization for depth map coding with distortion estimation of synthesized view[C]. IEEE International Symposium on Circuits and Systems, Beijing, China, 2013: 17-20. doi: 10.1109/ISCAS.2013. 6571771.
[16]
ROSTEN E and DRUMMOND T. Fusing points and lines for high performance tracking[C]. IEEE International Conference on Computer Vision, Beijing, China, 2005: 1508-1515. doi: 10.1109/ICCV.2005.104.
[17]
SHI J and TOMASI C. Good features to track[C]. IEEE International Conference on Computer Vision and Pattern Recognition, Seattle, WA, 1994: 593-600. doi: 10.1109/ CVPR.1994.323794.
[18]
HARRIS C and STEPHENS M. A combined corner and edge detector[C]. Alvey Vision Conference, Manchester, UK, 1988: 147-151.
BJPMTEGAARD G. Calculation of average PSNR differences between RD curves[R]. ITU-T Video Coding Experts Group, 2002.
[21]
MERKLE P, SMOLIC K, MULLER P, et al. Efficient prediction structures for Multi-view video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(11): 1461-1473. doi: 10.1109/TCSVT.2007.903665.