Volume XLII-1/W2
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-1/W2, 1–8, 2019
https://doi.org/10.5194/isprs-archives-XLII-1-W2-1-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-1/W2, 1–8, 2019
https://doi.org/10.5194/isprs-archives-XLII-1-W2-1-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.

  12 Sep 2019

12 Sep 2019

A REVIEW OF BENCHMARKING IN PHOTOGRAMMETRY AND REMOTE SENSING

K. Bakuła1,4, J. P. Mills2,4, and F. Remondino3,4 K. Bakuła et al.
  • 1Department of Photogrammetry, Remote Sensing and Spatial Information Systems, Faculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, Poland
  • 2School of Engineering, Newcastle University, Newcastle upon Tyne, UK
  • 33D Optical Metrology (3DOM), Bruno Kessler Foundation (FBK), Trento, Italy
  • 4European Spatial Data Research EuroSDR, Leuven, Belgium

Keywords: algorithms, benchmark, data quality, evaluation, sensors

Abstract. This paper is a preface of the ISPRS/EuroSDR Workshop on the “Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing” that was held in Warsaw University of Technology on 16-17 September 2019. The paper reviews benchmarking in photogrammetry and remote sensing found in the literature relating to geodata. The first part of the paper is a bibliographic analysis based on queries in Scopus and Web of Science databases which shows an increase in research activities based on benchmarking data. In the second part, a review of past and ongoing benchmarking initiatives is presented, providing examples of initiatives within e.g. ISPRS and EuroSDR. The topic of evaluating data, sensors and algorithms with benchmarking activities is interesting as it provides the opportunity to compare, with a unique approach, research results from independent scientists. As hereafter reported, benchmarking has increased in recent years, with many benchmarks being presented in the photogrammetric and remote sensing communities.