Supporting sense-making and decision-making through time evolution analysis of open sources

Abstract

Modern societies produce a huge amount of open source information that is often published on the Web in a natural language form. The impossibility of reading all these documents is paving the way to semantic-based technologies that are able to extract from unstructured documents relevant information for analysts. Most solutions extract uncorrelated pieces of information from individual documents; few of them create links among related documents and, to the best of our knowledge, no technology focuses on the time evolution of relations among entities. We propose a novel approach for managing, querying and visualizing temporal knowledge extracted from unstructured documents that can open the way to novel forms of sense-making and decision-making processes. We leverage state-of-the-art natural language processing engines for the semantic analysis of textual data sources to build a temporal graph database that highlights relationships among entities belonging to different documents and time frames. Moreover, we introduce the concept of temporal graph query that analysts can use to identify all the relationships of an entity and to visualize their evolution over time. This process enables the application of statistical algorithms that can be oriented to the automatic analysis of anomalies, state change detection, forecasting. Preliminary results demonstrate that the representation of the evolution of entities and relationships allows an analyst to highlight relevant events among the large amount of open source documents

A Survey on Graph Database Management Techniques for Huge Unstructured Data

“…Balboni et al [37] Evolution Analysis natural language processing engines to build temporal graph database Got large amount of open source documents Wu and Chen [38] Frequent Sub-graph Mining By normalizing the incidence matrix Achieved higher speed and efficiency John et al [39] Learning process enhancement against population Natural Language Processing enhanced learner centered online learning experience Xu and Luo [40] Expression-Driven Sketch Graph Matching for Face Recognition multi-layer grammatical face model recognition rates were improved, especially for the smiling and screaming faces whose line-edge maps are greatly distorted Figueira and Libkin [41] Querying Graphs Parikh automata real-life querying…”