PrAVA: Preprocessing profiling approach for visual analytics

Abstract

To accommodate the demands of a data-driven society, we have expanded our ability to collect and store data, develop sophisticated algorithms, and generate elaborated visual representations of the data analysis process outcomes. However, data preprocessing, as the activity of transforming the raw data into an appropriate format for subsequent analysis, is still a challenging part of this process. Although we can find studies that address the use of visualization techniques to support the activities in the scope of preprocessing, the current Visual Analytics processes do not consider preprocessing an equally important phase in their processes. Hence, with this paper, we aim to contribute to the discussion of how we can incorporate the preprocessing as a prominent phase in the Visual Analytics process and promote better alternatives to assist the data analysts during the preprocessing activities. To achieve that, we are introducing the Preprocessing Profiling Approach for Visual Analytics (PrAVA), a conceptual Visual Analytics process that includes Preprocessing Profiling as a new phase. It also contemplates a set of guidelines to be considered by new solutions adopting PrAVA. Moreover, we analyze its applicability through use case scenarios that show resourceful methods for data understanding and evaluation of the preprocessing impacts. As a final contribution, we indicate a list of research opportunities in the scope of preprocessing combined with visualization and Visual Analytics to stimulate a shift to visual preprocessing.

DaVInt - Data Visualization and Interaction Lab

“…The responses of the interviewees led us to a list of ten insights for new visualization solutions [1]. After that, we developed a conceptual VA process that includes preprocessing profiling as a new phase, and we indicate a list of research opportunities in the scope of preprocessing combined with visualization and VA [4]. This work was developed with the collaboration of Fernando Paulovich 2 from Dalhousie University.…”

“…Although we continue researching the initial topic of social media data visualization, novel research topics were added through these years. Recently, we have dedicated efforts to verify how visualization can help in data preprocessing activities [1]- [4], a task that demands a lot of time for data analysts [5]. A result of this research can be seen in a paper we recently published with a conceptual process that includes preprocessing profiling as a new phase in the Visual Analytics (VA) process [4].…”