Graph-based Interactive Data Federation System for Heterogeneous Data Retrieval and Analytics

Abstract

Given the increasing number of heterogeneous data stored in relational databases, file systems or cloud environment, it needs to be easily accessed and semantically connected for further data analytic. The potential of data federation is largely untapped, this paper presents an interactive data federation system (https://vimeo.com/ 319473546) by applying large-scale techniques including heterogeneous data federation, natural language processing, association rules and semantic web to perform data retrieval and analytics on social network data. The system first creates a Virtual Database (VDB) to virtually integrate data from multiple data sources. Next, a RDF generator is built to unify data, together with SPARQL queries, to support semantic data search over the processed text data by natural language processing (NLP). Association rule analysis is used to discover the patterns and recognize the most important co-occurrences of variables from multiple data sources. The system demonstrates how it facilitates interactive data analytic towards different application scenarios (e.g., sentiment analysis, privacyconcern analysis, community detection).

WINFRA: A Web-Based Platform for Semantic Data Retrieval and Data Analytics

“…This paper extends the work presented in [1] in the following aspects. Firstly, an up-to-date literature review was added, such as classification based association rules.…”

“…As shown in Table 5, the result does not present useful information to the users since the data is text (status update), and this is a major issue for basic association rules mining. The proposed approach tackled this issue by extracting new semantic association rules and compared it with the early work [1], the result presented in Table 5 and Figure 7. The result of the proposed approach (Figure 8, Table 6) shows the ability to extract new semantic rules from FB Posts and new relationships between different objects and subjects (OS).…”

KBot: A Knowledge Graph Based ChatBot for Natural Language Understanding Over Linked Data

“…It was created by David Stillwell in 2007 to share a personality questionnaire with Facebook users. The data was prepared and federated [25] to a virtual database (VDB), indexed in Apache Jena server and accessible via an Endpoint to support semantic web and linked data applications. This VDB is anonymized and sampled to be shared with registered scholars around the world.…”

On the Effects of Data Protection on Multi-database Data-Driven Models

“…That is, for applying machine and statistical learning to large datasets in terms of both number of records and number of variables. Further virtual data integration (data federation) [17,18] have been explored, where data is accessed and virtually integrated in real-time across distributed data sources without copying or otherwise moving data from its system of records. The effects of masking into data integration is not well known.…”