A REVIEW OF BENCHMARKING IN PHOTOGRAMMETRY AND REMOTE SENSING
- 1Department of Photogrammetry, Remote Sensing and Spatial Information Systems, Faculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, Poland
- 2School of Engineering, Newcastle University, Newcastle upon Tyne, UK
- 33D Optical Metrology (3DOM), Bruno Kessler Foundation (FBK), Trento, Italy
- 4European Spatial Data Research EuroSDR, Leuven, Belgium
Keywords: algorithms, benchmark, data quality, evaluation, sensors
Abstract. This paper is a preface of the ISPRS/EuroSDR Workshop on the “Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing” that was held in Warsaw University of Technology on 16-17 September 2019. The paper reviews benchmarking in photogrammetry and remote sensing found in the literature relating to geodata. The first part of the paper is a bibliographic analysis based on queries in Scopus and Web of Science databases which shows an increase in research activities based on benchmarking data. In the second part, a review of past and ongoing benchmarking initiatives is presented, providing examples of initiatives within e.g. ISPRS and EuroSDR. The topic of evaluating data, sensors and algorithms with benchmarking activities is interesting as it provides the opportunity to compare, with a unique approach, research results from independent scientists. As hereafter reported, benchmarking has increased in recent years, with many benchmarks being presented in the photogrammetric and remote sensing communities.