The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLIII-B3-2020
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLIII-B3-2020, 227–231, 2020
https://doi.org/10.5194/isprs-archives-XLIII-B3-2020-227-2020
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLIII-B3-2020, 227–231, 2020
https://doi.org/10.5194/isprs-archives-XLIII-B3-2020-227-2020

  21 Aug 2020

21 Aug 2020

THE JOINT SPATIAL AND RADIOMETRIC TRANSFORMER FOR REMOTE SENSING IMAGE RETRIEVAL

Y. Wang1, D. Yu1, S. Ji1, Q. Cheng2, and M. Luo2 Y. Wang et al.
  • 1School of Remote Sensing and Information Engineering, Wuhan University, 129 Luoyu Road, Wuhan, China
  • 2Wuhan Geomatics Institute, Wuhan, China

Keywords: Remote Sensing Image Retrieval, Convolutional Neural Network, Spatial Transformation, Radiometric Transformation, Parameter Generation Network

Abstract. Content-based remote sensing image retrieval refers to searching interested images from a remote sensing image dataset that are similar to a query image via extracting features (contents) from images and comparing their similarity. In this work, we come up with a lightweight network structure, which we call the joint spatial and radiometric transformer, which is composed of three modules: parameter generation network (PGN), spatial conversion and radiometric conversion. The PGN module learns specific transformation parameters from input images to guide subsequent spatial and radiometric conversion processes. With these parameters, the spatial conversion and radiometric conversion transform the input images with spatial and spectrum perspectives respectively, to increase the intra-class similarity and inter-class difference, which are attached great importance to CBRSIR. In comparative experiments on multiple remote sensing image retrieval datasets, our proposed joint spatial and radiometric transformer combined with the backbone network ResNet34 has achieved optimal performance.