Volume XLII-2/W15
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W15, 1135–1140, 2019
https://doi.org/10.5194/isprs-archives-XLII-2-W15-1135-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W15, 1135–1140, 2019
https://doi.org/10.5194/isprs-archives-XLII-2-W15-1135-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.

  26 Aug 2019

26 Aug 2019

MULTI-VIEW STEREO WITH SEMANTIC PRIORS

E.-K. Stathopoulou and F. Remondino E.-K. Stathopoulou and F. Remondino
  • 3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy

Keywords: multi-view stereo (MVS), semantic dense stereo, semantic priors, patch-based

Abstract. Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. In order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to eliminate mismatches of pixels belonging in different classes.