Parallel classification of spatial points into geographical regions
18th International Symposium on Parallel and Distributed Computing, ISPDC 2019, Amsterdam, Hollanda, 5 - 07 Haziran 2019, ss.9-15, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Doi Numarası: 10.1109/ispdc.2019.000-3
- Basıldığı Şehir: Amsterdam
- Basıldığı Ülke: Hollanda
- Sayfa Sayıları: ss.9-15
- Anahtar Kelimeler: Apache spark, Hierarchical triangular mesh, HTM, Parallel processing, Point classification, Spatial indexing, Streaming data classification
- Boğaziçi Üniversitesi Adresli: Evet
Özet
The amount of data generated by social media, social networks and distributed platforms such as blockchain, have reached quite high levels. Various data analysis methods could be applied this big data. One of these methods is to classify geo-tagged social network data in order to report geographical area associated with the data. We propose an efficient parallel classification approach and implement a classifier tool which is capable of processing huge amount of data. To test our approach, we collect Twitter data over five densest areas of Turkey. There are important factors affecting the classification performance such as the spatial indexing and the parallelization strategies. Hierarchical Triangular Mesh (HTM) and R-Tree spatial indexes are used for indexing regions. For parallel processing data streams classifier tool is implemented based on Apache Spark and Kafka platforms in order to obtain high scalability. To show effectiveness of our method, we perform tests on Amazon Web Services (AWS) Cloud environment and compare our method against a method which implements HTM on a Microsoft SQL Server. Results show that 1.6 - 4.5 fold speed-up is obtained and Twitter data that is collected over a month can be processed effectively in three hours.