The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLII-1/W2
https://doi.org/10.5194/isprs-archives-XLII-1-W2-1-2019
https://doi.org/10.5194/isprs-archives-XLII-1-W2-1-2019
12 Sep 2019
 | 12 Sep 2019

A REVIEW OF BENCHMARKING IN PHOTOGRAMMETRY AND REMOTE SENSING

K. Bakuła, J. P. Mills, and F. Remondino

Keywords: algorithms, benchmark, data quality, evaluation, sensors

Abstract. This paper is a preface of the ISPRS/EuroSDR Workshop on the “Evaluation and Benchmarking of Sensors, Systems and Geospatial Data in Photogrammetry and Remote Sensing” that was held in Warsaw University of Technology on 16-17 September 2019. The paper reviews benchmarking in photogrammetry and remote sensing found in the literature relating to geodata. The first part of the paper is a bibliographic analysis based on queries in Scopus and Web of Science databases which shows an increase in research activities based on benchmarking data. In the second part, a review of past and ongoing benchmarking initiatives is presented, providing examples of initiatives within e.g. ISPRS and EuroSDR. The topic of evaluating data, sensors and algorithms with benchmarking activities is interesting as it provides the opportunity to compare, with a unique approach, research results from independent scientists. As hereafter reported, benchmarking has increased in recent years, with many benchmarks being presented in the photogrammetric and remote sensing communities.