Storing and Clustering Large Spatial Datasets Using Big Data Technologies

Abstract

In this paper we present the architecture of a system to store,query and visualize on the web large datasets of geographic information.The architecture includes a component to simulate a large number ofdrivers that report their position on a regular basis, an ingestion compo-nent that is generic and can acommodate three different storage technolo-gies, a query component that aggregates the results in orderto reducethe query time and the data transfered, and a web-based map viewer. Inaddition, we define an evaluation methodology to be used to benchmarkand compare different alternatives for some components of the system,and we validate the architecture with experiments using a dataset of 40million locations of drivers.