The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLII-2/W7
https://doi.org/10.5194/isprs-archives-XLII-2-W7-719-2017
https://doi.org/10.5194/isprs-archives-XLII-2-W7-719-2017
13 Sep 2017
 | 13 Sep 2017

A ROBUST DESCRIPTOR BASED ON SPATIAL AND FREQUENCY STRUCTURAL INFORMATION FOR VISIBLE AND THERMAL INFRARED IMAGE MATCHING

Z. Fu, Q. Qin, C. Wu, Y. Chang, and B. Luo

Keywords: Multimodal Descriptor, Visible and Thermal Infrared Image Matching, Spatial Structural Information, Frequency Structural Information, Multi-spatial Regions Division

Abstract. Due to the differences of imaging principles, image matching between visible and thermal infrared images still exist new challenges and difficulties. Inspired by the complementary spatial and frequency information of geometric structural features, a robust descriptor is proposed for visible and thermal infrared images matching. We first divide two different spatial regions to the region around point of interest, using the histogram of oriented magnitudes, which corresponds to the 2-D structural shape information to describe the larger region and the edge oriented histogram to describe the spatial distribution for the smaller region. Then the two vectors are normalized and combined to a higher feature vector. Finally, our proposed descriptor is obtained by applying principal component analysis (PCA) to reduce the dimension of the combined high feature vector to make our descriptor more robust. Experimental results showed that our proposed method was provided with significant improvements in correct matching numbers and obvious advantages by complementing information within spatial and frequency structural information.