Global Data Spatially Interrelate System for Scientific Big Data Spatial-Seamless Sharing
- 1School of Environment Science and Spatial Informatics, China University of Mining and Technology, Xuzhou, China
- 2IoT (Mine Perception) Centre, China University of Mining and Technology, Xuzhou, China
- 3Institute of Geo-informatics and Digital Mine Research, Northeastern University, Shenyang, China
- 4College of Geoscience and Surveying Engineering, China University of Mining and Technology (Beijing), Beijing, China
Keywords: Data sharing, global data spatially interrelate system, earth system spatial grid, SDOG-ESSG, big data management
Abstract. A good data sharing system with spatial-seamless services will prevent the scientists from tedious, boring, and time consuming work of spatial transformation, and hence encourage the usage of the scientific data, and increase the scientific innovation. Having been adopted as the framework of Earth datasets by Group on Earth Observation (GEO), Earth System Spatial Grid (ESSG) is potential to be the spatial reference of the Earth datasets. Based on the implementation of ESSG, SDOG-ESSG, a data sharing system named global data spatially interrelate system (GASE) was design to make the data sharing spatial-seamless. The architecture of GASE was introduced. The implementation of the two key components, V-Pools, and interrelating engine, and the prototype is presented. Any dataset is firstly resampled into SDOG-ESSG, and is divided into small blocks, and then are mapped into hierarchical system of the distributed file system in V-Pools, which together makes the data serving at a uniform spatial reference and at a high efficiency. Besides, the datasets from different data centres are interrelated by the interrelating engine at the uniform spatial reference of SDOGESSG, which enables the system to sharing the open datasets in the internet spatial-seamless.