A software architecture for Twitter collection, search and geolocation services

Batch to Real-Time: Incremental Data Collection & Analytics Platform

“…In [19], a software architecture for collecting and analyzing geospatial and semantic information from Twitter data was described. The tweets were consumed by a Twitter4j Java application and then transferred into a PostgreSQL database using the PostGIS spatial extension.…”

“…The goal of this infrastructure was to search for tweets via semantic keywords and coordinates, and export the results via a map or CSV file. The focus of [19] is on a particular domain-independent analysis technique and not with supporting the entire analysis life cycle for crisis informatics research. In contrast to their work, we store the entire JSON object of collected tweets in Cassandra in a way that allows us to answer all deep queries related to the entire tweet object.…”

“…Proceedings of the 50th Hawaii International Conference on System Sciences | 2017 URI: http://hdl.handle.net/10125/41876 ISBN: 978-0-9981331-0-2 CC-BY-NC-ND design for the system to handle the velocity of streaming data in a 24/7, reliable, fault tolerant, and scalable fashion [14,19]; 2) incrementally indexing data streams in real-time to provide real-time data analysis and creating an indexing schema for later batch analytics; and 3) handling the volume of data by permanently storing incrementally indexed data in a scalable fashion in a persistent store to support batch data processing and analysis [4].…”

Predicting TV programme audience by using twitter based metrics

“…In particular, the access to the twitter API has some limitations such as: the maximum number of request calls in a period, the huge amount of tweets that can be produced for certain cases, the complexity of social relationships among users, the limited size of tweets (140 characters), and the fact that historical Twitter data are not accessible via the Twitter API, etc. These facts force the developers to set up specific architectures for collecting tweets, while attempting to get them with a sufficient reliability [38].…”

News Dissemination on Twitter and Conventional News Channels

“…Carmel resolves locations using three primary methods i.e. looking up directly at the "Place" object, use reverse geocoding APIs to find the name of place from latitude and longitude co-ordinates and third look-up the location from user profile from the four methods described by Gonzalez and co-workers (Gonzalez et al, 2012, Oussalah et al, 2012. The locations obtained were in a tiered format starting from Earth and followed stepwise to country, then state, county and finally the city.…”