浏览全部资源
扫码关注微信
纸质出版日期： 2017-5 ，
录用日期： 2016-9-18
扫 描 看 全 文
张洪群, 刘雪莹, 杨森, 等. 深度学习的半监督遥感图像检索[J]. 遥感学报, 2017,21(3):406-414.
Hongqun ZHANG, Xueying LIU, Sen YANG, et al. Retrieval of remote sensing images based on semisupervised deep learning[J]. Journal of Remote Sensing, 2017,21(3):406-414.
遥感图像数据的海量性、多样性和复杂性等特点对遥感图像检索的速度和精度提出了更高的要求，其中特征提取是影响遥感图像检索效果的关键。本文方法首先对遥感图像进行预处理，然后基于稀疏自动编码的方法在大量未标注的遥感图像上进行特征学习得到特征字典，基于卷积神经网络的思想，使用训练出来的特征字典对遥感图像进行卷积和池化得到每幅图像的特征图；接下来使用特征图训练Softmax分类器；最后对待检索图像分类，在同一类别中计算特征间的距离，进而实现遥感图像的检索。实验结果表明，该方法能够有效提高遥感图像检索的速度和准确度。
Massive data and diversity characteristics exert higher demands on the retrieval of remote sensing images. The feature extraction algorithm is the most outstanding factor that influences the performance of retrieval methods. Traditional feature extraction methods cause the problem of semantic gap
which occurs when the low-level feature does not perfectly reflect or match the purpose of retrieval. BOVW and multilayer cluster analysis have been proposed to solve semantic gap. However
the usability of these methods is limited given their dependence on classification or cluster algorithms and artificiality. A semi supervised deep-learning method was proposed in this paper. This method combines Sparse Auto encoder (SA) and the principle of Convolutional Neural Networks (CNNs). The method involves four steps: first
the remote sensing images are pretreated with the ZCA whitening method. Second
the feature dictionary is extracted using SA
an algorithm that deals with nonannotated data. Subsequently
the feature dictionary is utilized in image convolution following the principle of CNNs
which imitates the neural net of organisms and decreases the number of features. Average pooling is conducted after image convolution. Both convolution and pooling are implemented to reduce model complexity
thus calculating distance faster. Third
the soft max classifier categorizes remote sensing images into five classes. Lastly
the remote sensing image retrieval is sorted based on the Euclidean distance between the query image and database in the same category as the query image. Experimental results based on high-resolution remote sensing images demonstrate that the proposed method is effective and is more accurate than the methods that are based on color and texture features. Image classification before sorting speeds up retrieval by 27.6%. In addition
the semi-supervised deep learning algorithm is stable when the number of returned images increases. Given that the number of neurons in the hidden SA layer and the region size of pooling primarily affect retrieval results
this study conducted several optimization experiments on these two parameters. Moreover
the algorithm in this research performed well when the number of images in the data set and the retrieval accuracy on a larger data set increased
which are meaningful for the retrieval of massive remote sensing images. The semisupervised deep learning algorithm decreases the time of image annotation
which is an exhausting job. Unlike traditional methods that extracts the features of color
texture
and shape
the method in this study directly extracts the feature dictionary from image elements with good accuracy. Moreover
the efficiency of the proposed method is guaranteed by convolution and pooling
which reduce the feature dimension. Furthermore
our experiment proves that this algorithm performs well in retrieving high-resolution remote sensing images.
遥感图像检索深度学习稀疏自动编码卷积神经网络Softmax分类器
remote sensing image retrievaldeep learningsparse auto encoderconvolutional neural networksSoftmax classifier
Bengio Y, Lamblin P, Popovici D and Larochelle H. 2006. Greedy layer-wise training of deep networks//Proceedings of the 19th International Conference on Neural Information Processing Systems. Cambridge: MIT Press: 153–160
Bishop C M. 2007. Pattern Recognition and Machine Learning. New York: Springer
Bourlard H and Kamp Y. 1988. Auto-association by multilayer perceptrons and singular value decomposition. Biological Cybernetics, 59(4/5): 291–294
Coates A, Lee H and Ng A Y. 2011. An analysis of single-layer networks in unsupervised feature learning//Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. Fort Lauderdale, FL, USA: JMLR: 215–223
段宝彬, 韩立新, 谢进. 2015. 基于堆叠稀疏自编码的模糊C-均值聚类算法. 计算机工程与应用, 51(4): 154–157
Duan B B, Han L X and Xie J. 2015. Fuzzy C-means clustering algorithm based on stacked sparse autoencoders. Computer Engineering and Applications, 51(4): 154–157
Haralick R M and Shangmugam K. 1973. Texture features for image classification. IEEE Transaction on Systems, SMC-3(6): 768–780 (未找到本条文献信息, 请核对)
Hinton G E and Salakhutdinov R R. 2006. Reducing the dimensionality of data with neural networks. Science, 313(5786): 504–507
Hu F, Xia G S, Hu J W and Zhang L P. 2015a. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sensing, 7(11): 14680–14707
Hu F, Xia G S, Hu J W and Zhang L P. 2015b. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sensing, 7(11): 14680–14707
黄劲, 孙洋, 徐浩然. 2013. 稀疏编码(Sparse coding)在图像检索中的应用. 数字技术与应用, (11): 76–77, 81 (未找到本条文献英文信息, 请核对)
Huang J, Sun Y and Xu H R. 2013. The application of Sparse coding on image retrieval. Digital Technology and Application, (11): 76–77, 81
Jia Y Q, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S and Darrell T. Caffe: convolutional architecture for fast feature embedding. Eprint Arxiv, 2014: 675–678
Kitamoto A and Takagi M. 1994. Similarity retrieval of satellite cloud imagery based on optimization principle. IEICE Technical Report Pattern Recognition and Understanding, 94(294): 15–22
LeCun Y. 1989. Generalization and network design strategies//Pfeifer R, Schreter Z, Fogelman F and Steels L, eds. Connectionism in Perspective. Zurich, Switzerland: Elsevier: 143–155
LeCun Y, Bengio Y and Hinton G. 2015. Deep learning. Nature, 521(7553): 436–444
李德仁, 宁晓刚. 2006. 一种新的基于内容遥感图像检索的图像分块策略. 武汉大学学报(信息科学版), 31(8): 659–662
Li D R and Ning X G. 2006. A new image decomposition method for content-based remote sensing image retrieval. Geomatics and Information Science of Wuhan University, 31(8): 659–662
刘米娜. 2013. 基于颜色和纹理特征的遥感图像检索. 西安: 西安工业大学
Liu M N. 2013. Remote Sensing Image Retrieval Based on Color and Texture. Xian: Xi’an Technological University
刘鹏宇. 2004. 基于内容的图像特征提取算法的研究. 长春: 吉林大学
Liu P Y. 2004. Study on the Algorithms for Content-based Image Feature Extraction. Changchun: Jilin University
鲁珂, 赵继东, 叶娅兰, 曾家智. 2005. 一种用于图像检索的新型半监督学习算法. 电子科技大学学报, 34(5): 669–671
Lu K, Zhao J D, Ye Y L and Zeng J Z. 2005. Algorithm for semi-supervised learning in image retrieval. Journal of UEST of China, 34(5): 669–671
陆丽珍, 刘仁义, 刘南. 2004. 一种融合颜色和纹理特征的遥感图像检索方法. 中国图象图形学报, 9(3): 328–333
Lu L Z, Liu R Y and Liu N. 2004. Remote sensing image retrieval using color and texture fused features. Journal of Image and Graphics, 9(3): 328–333
Luus F P S, Salmon B P, Van den Bergh F and Maharaj B T J. 2015. Multiview deep learning for land-use classification. IEEE Geoscience and Remote Sensing Letters, 12(12): 2448–2452
Mnih V and Hintion G E. 2010. Learning to detect roads in high-resolution aerial images//Proceedings of the 11th European Conference on Computer Vision. Berlin Heidelberg: Springer: 210–223 [DOI: 10.1007/978-3-642-15567-3_16]
Mojsilovic A and Rogowitz B. 2001. Capturing image semantics with low-level descriptors//Proceedings of the 2001 International Conference on Image Processing. Thessaloniki: IEEE: 18–21 [DOI: 10.1109/ICIP.2001.958942]
Sheikholeslami G, Zhang A D and Bian L. 1999. A multi-resolution content-based retrieval approach for geographic images. GeoInformatica, 3(2): 109–139
王杰, 贾育衡, 赵昕. 2014.基于稀疏自编码器的烟叶成熟度分类. 烟草科技, 46(9):17-19
Wang J, Jia Y H and Zhao X. 2014. Tobacco leaf matupity classification based on sparse auto-encoder. Tobacco Science & Technology, 46(9):17-19
尹宝才, 王文通, 王立春. 2015. 深度学习研究综述. 北京工业大学学报, 41(1): 48–59
Yin B C, Wang W T and Wang L C. 2015. Review of deep learning. Journal of Beijing University of Technology, 41(1): 48–59
Zhao L J, Tang P and Huo L Z. 2014. Land-use scene classification using a concentric circle-structured multiscale bag-of-visual-words model. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7(12): 4620–4631
Zhu B, Ramsey M and Chen H. 2000. Creating a large-scale content-based airphoto image digital library. IEEE Transactions on Image Processing, 9(1): 163–167
相关作者
相关机构
京公网安备11010802024621