Saliency Detection Based on Robust Foreground Selection
WANG Chen①② FAN Yangyu① LI Bo①
①(School of Electronics & Information, Northwestern Polytechnical University, Xi’an 710072, China) ②(School of Aeronautics and Astronautics Engineering, Air Force Engineering University, Xi’an 710038, China)
Abstract:Saliency detection is to find the most important object automatically according to the human visual in the unknown scene. For improving the precision of saliency detection, the saliency detection based on robust foreground seeds via manifold ranking is proposed in this paper. Firstly, the two different convex hulls are got by the Harris corner and boundary connectivity algorithm. And the original object region is defined by the intersection about the above convex hulls. Secondly, the superpixels in convex hull are done the similarity detection with the outer edge of the convex hull. The superpixels are removed when they are similar to most of the outer edge, and the more precision foreground seeds are got. Using the anchor graph, a novel graph construction is built to express the relationship between data nodes. And then, two different kinds of salient results will be got based on ranking on manifolds using foreground and background seeds respectively. Finally, the saliency map is got through optimizing a novel cost function. Experimental results prove that the proposed algorithm improves the performance evaluation of precision and recall rate further.
王晨,樊养余,李波. 基于鲁棒前景选择的显著性检测[J]. 电子与信息学报, 2017, 39(11): 2644-2651.
WANG Chen, FAN Yangyu, LI Bo. Saliency Detection Based on Robust Foreground Selection. JEIT, 2017, 39(11): 2644-2651.
GUO Chuanxin, LI Zhenbo, QIAO Xi, et al. Image segmentation of underwater sea cucumber using grabcut with saliency map[J]. Transaction of the Chinese Society for Agricultural Machinery, 2015, 46(1): 147-152. doi: 10.6041/ j.issn.1000-1298. 2015. S0.025.
XUE Mengxia, PENG Hui, LIU Shirong, et al. Scene object recognition based on visual saliency[J]. Control Engineering of China, 2106, 23(5): 687-692. doi: 1671-7848(2016)05-0687- 06.
LI Ran, LI Yanling, CUI Ziguang, et al. Visual saliency oriented compressive sensing measurement and reconstruction of images[J]. Journal of Huazhong University of Science and Technology (Natural Science Edition), 2016, 44(5): 13-18. doi: 10.13245/j.hust.160503.
ZHAO Hongwei, LI Qingliang, LIU Pingping, et al. Feature saliency constraint based image retrieval method[J]. Journal of Jinlin University (Engineering and Technology Edition), 2016, 46(2): 542-548. doi: 10.13229/j.cnki.jdxbgxb20160232.
[5]
PERAZZI F, KRAHENBUHUL P, PRITCH Y, et al. Saliency filters: Contrast based filtering for salient region detection[C]. Computer Vision and Pattern Recognition 2012, Providence, USA, 2012: 733-740. doi: 10.1109 /CVPR.2012. 6247743.
[6]
WEI Yichen, WEN Fang, ZHU Wangjing, et al. Geodesic saliency using background priors[C]. European Conference on Computer Vision 2012, Firenze, Italy, 2012: 29-42. doi: 10.1007/978-3-642-33712-3_3.
[7]
YANG Chuan, ZHANG Lihe, LU Huchuan, et al. Saliency detection via graph-based manifold ranking[C]. Computer Vision and Pattern Recognition 2013, Portland, USA, 2013: 3166-3173. doi: 10.1109/CVPR.2013.407.
[8]
ZHU Wangjiang, LIANG Shuang, WEI Yiche, et al. Saliency optimization from robust background detection[C]. Computer Vision and Pattern Recognition 2014, Columbus, USA, 2014: 2814-2821. doi: 10.1109/CVPR.2014.360.
[9]
LIU Tie, SUN Jian, ZHENG Nanning, et al. Learning to detect a salient object[C]. Computer Vision and Pattern Recognition, 2007, Minneapolis, USA, 2007: 353-367. doi: 10.1109/CVPR.2007.383047.
[10]
YANG Jimei and YANG Minghsuan. Top-down visual saliency via joint CRF and dictionary learning[C]. Computer Vision and Pattern Recognition 2012, Providence, USA, 2012: 2296-2303. doi: 10.1109/CVPR.2012.6247940.
[11]
GOPALAKRISHNAN V, HU Y, and RAJAN D. Random walks on graphs for salient object detection in images[J]. IEEE Transactions on Image Processing, 2010, 19(12): 3232-3242. doi: 10.1109/TIP.2010.2053940.
LU Jianyong and TANG Zhenmin. An imporved graph-based manifold ranking for salient object detection[J]. Journal of Elecctronics & Information Technology, 2015, 37(11): 2555-2563. doi: 10.11999/JEIT150619.
XIE Yulin, LU Huchuan, and YANG Minghsuan. Bayesian saliency via low and mid level cues[J]. IEEE Transactions on Image Processing, 2013, 22(5): 1689-1698. doi: 10.1109/TIP. 2012.2216276.
[15]
LIU Risheng, CAO Junjie, LIN Zhouchen, et al. Adaptive differential equation learning for visual saliency detection[C]. Computer Vision and Pattern Recognition 2014, Columbus, USA, 2014: 3862-3869. doi: 10.1109/CVPR.2014.494.
LIN Xiao, WANG Yanling, ZHU Henliang, et al. Saliency detection based on the Bayesian model of improved convex hull[J]. Journal of computer-Aided Design and Computer Graphics, 2017, 29(2): 221-228.
[17]
ZHOU D, WESTON J, GRETTON A, et al. Ranking on data manifolds[C]. Neural Information Processing Systems 2003, Vancouver, Canada, 2003: 169-176.
[18]
WEIJER J, GEVERS T, and BAGDANOV A. Boosting color saliency in image feature detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(1): 150-156. doi: 10.1109/ TPAMI.2006.3.
[19]
ACHANTA R, SHAJI A, SMITH K, et al. SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11): 2274-2282. doi: 10.1109/ TPAMI.2012.120.
[20]
LIU Wei, HE Junfeng, and CHANG Shihfu. Large graph construction for scalable semi-supervised learning[C]. The 27th International Conference on Machine Learning, Haifa, 2010: 679-686.
[21]
YANG Y, NIE F, XU D, et al. A multimedia retrieval framework basd on semi-supervised ranking and relevance feedback[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(4): 723-742. doi: 10.1109/ TPAMI.2011.170.
[22]
YAN Qiong, SHI Jianping, XU Li, et al. Hierarchical image saliency detection on extended CSSD[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(4): 717-729. doi: 10.1109/ TPAMI.2015.2465960.
[23]
ACHANTA R, HEMAMI S, ESTRADA F, et al. Frequency-tuned salient region detection[C]. Computer Vision and Pattern Recognition 2009, Miami, USA, 2009: 1597-1604. doi: 10.1109 /CVPR.2009.5206596.
[24]
CHENG M, ZHANG G X, MITRA N J, et al. Global contrast based salient region detection[C]. Computer Vision and Pattern Recognition 2011, Colorado, 2011: 409-416. doi: 10.1109/CVPR.2011.5995344.
[25]
YAN Q, XU L, SHI J, et al. Hierarchical saliency detection[C]. Computer Vision and Pattern Recognition 2013, Portland, USA, 2013: 1155-1162. doi: 10.1109 /CVPR.2013.153.