Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W3, 535-541, 2017
http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W3/535/2017/
doi:10.5194/isprs-archives-XLII-2-W3-535-2017
 
23 Feb 2017
A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY – THE REPLICATE EU PROJECT
E. Nocerino1, F. Lago1, D. Morabito1, F. Remondino1, L. Porzi2, F. Poiesi2, S. Rota Bulo2, P. Chippendale2, A. Locher3, M. Havlena3, L. Van Gool3, M. Eder4, A. Fötschl4, A. Hilsmann5, L. Kausch5, and P. Eisert5 13D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy
2Technology of Vision unit, Bruno Kessler Foundation (FBK), Trento, Italy
3Computer Vision Lab, ETH Zurich, Switzerland
4Wikitude GmbH, Salzburg, Austria
5HHI Fraunhofer, Berlin, Germany
Keywords: 3D reconstruction, Smartphone, Creative industry, REPLICATE Abstract. During the last two decades we have witnessed great improvements in ICT hardware and software technologies. Three-dimensional content is starting to become commonplace now in many applications. Although for many years 3D technologies have been used in the generation of assets by researchers and experts, nowadays these tools are starting to become commercially available to every citizen. This is especially the case for smartphones, that are powerful enough and sufficiently widespread to perform a huge variety of activities (e.g. paying, calling, communication, photography, navigation, localization, etc.), including just very recently the possibility of running 3D reconstruction pipelines. The REPLICATE project is tackling this particular issue, and it has an ambitious vision to enable ubiquitous 3D creativity via the development of tools for mobile 3D-assets generation on smartphones/tablets. This article presents the REPLICATE project’s concept and some of the ongoing activities, with particular attention being paid to advances made in the first year of work. Thus the article focuses on the system architecture definition, selection of optimal frames for 3D cloud reconstruction, automated generation of sparse and dense point clouds, mesh modelling techniques and post-processing actions. Experiments so far were concentrated on indoor objects and some simple heritage artefacts, however, in the long term we will be targeting a larger variety of scenarios and communities.
Conference paper (PDF, 1400 KB)


Citation: Nocerino, E., Lago, F., Morabito, D., Remondino, F., Porzi, L., Poiesi, F., Rota Bulo, S., Chippendale, P., Locher, A., Havlena, M., Van Gool, L., Eder, M., Fötschl, A., Hilsmann, A., Kausch, L., and Eisert, P.: A SMARTPHONE-BASED 3D PIPELINE FOR THE CREATIVE INDUSTRY – THE REPLICATE EU PROJECT, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-2/W3, 535-541, doi:10.5194/isprs-archives-XLII-2-W3-535-2017, 2017.

BibTeX EndNote Reference Manager XML