The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLIII-B2-2022
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLIII-B2-2022, 201–208, 2022
https://doi.org/10.5194/isprs-archives-XLIII-B2-2022-201-2022
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLIII-B2-2022, 201–208, 2022
https://doi.org/10.5194/isprs-archives-XLIII-B2-2022-201-2022
 
30 May 2022
30 May 2022

INTEGRATION OF DEPTH MAPS FROM ARCORE TO PROCESS POINT CLOUDS IN REAL TIME ON A SMARTPHONE

R. Haenel1,2, Q. Semler1, E. Semin1, P. Grussenmeyer2, and E. Alby2 R. Haenel et al.
  • 1Syslor SAS, 1 Square Camoufle, 57 000 Metz, France
  • 2Université de Strasbourg, CNRS, INSA Strasbourg, ICUBE Laboratory UMR 7357, Photogrammetry and Geomatics Group, 67000, France

Keywords: 3D scanning, smartphone, real-time, depth map, on-the-fly-reconstruction, ARCore

Abstract. Real-world three-dimensional reconstruction is a project of long-standing interest in global computer vision. Many tools have emerged these past years to accurately perceive the surrounding world either through active sensors or through passive algorithmic methods. With the advent and popularization of augmented reality on smartphones, new visualization issues have emerged concerning the virtual experience. Especially a 3D model seems to be essential to provide more realistic AR effects including consistency of occlusion, shadow mapping or even collision between virtual objects and real environment. However, due to the huge computation of most of current approaches, most of these algorithms are working on a computer desktop or high-end smartphones. Indeed, the reconstruction scale is rapidly limited by the complexity of both computation and memory. Therefore, our study aims to find a relevant method to process real time reconstruction of close-range outdoor scenes such as cultural heritage or underground infrastructures in real time locally on a smartphone.