Meeting Big Data challenges with visual analytics

Abstract

Purpose – This paper aims to explore the role of records management in supporting the effective use of information visualisation and visual analytics (VA) to meet the challenges associated with the analysis of Big Data. Design/methodology/approach – This exploratory research entailed conducting and analysing interviews with a convenience sample of visual analysts and VA tool developers, affiliated with a major VA institute, to gain a deeper understanding of data-related issues that constrain or prevent effective visual analysis of large data sets or the use of VA tools, and analysing key emergent themes related to data challenges to map them to records management controls that may be used to address them. Findings – The authors identify key data-related issues that constrain or prevent effective visual analysis of large data sets or the use of VA tools, and identify records management controls that may be used to address these data-related issues. Originality/value – This paper discusses a relatively new field, VA, which has emerged in response to meeting the challenge of analysing big, open data. It contributes a small exploratory research study aimed at helping records professionals understand the data challenges faced by visual analysts and, by extension, data scientists for the analysis of large and heterogeneous data sets. It further aims to help records professionals identify how records management controls may be used to address data issues in the context of VA.

The Swedish People’s Awareness of The Public Sector Information Directive – a Pilot Study

“…When data is of poor quality, its exploitation requires advanced computer skills. 80 per cent of the time and cost of a data analytics project could instead be used to clean up data to useable levels (Lemieux, Gormly, & Rowledge, 2014). The same observation was made by Shepherd (2015), who a year later, argued that to publish good quality data, resources needed to be invested to avoid data redundancy, inconsistency, to deal with data integrity and interoperability problems.…”

Commercial Visual Analytics Systems–Advances in the Big Data Analytics Field

“…The questions cover system architecture, data import and preparation, automatic and visual analysis, presentation of results, working with sensitive data, and collaboration, and follow the analytics process sketched in [22] and [23]. Most questions (17) target the central visual and automatic analysis process. However, we also value import and preparation of data (8) as they are crucial to practical success and attract increasing interest in the research community.…”

Big Data, Data Analyst, and Improving the Competence of Librarian

“…Di dalam lingkungan organisasi juga mulai tumbuh sejumlah pegawai / staf yang secara spesifik mendapat sebutan sebagai "analis bisnis", "data analis" dan " ilmuwan data" ( Kandel et al ., 2011), yang dalam aktifitas bekerjanya memanfaatkan peralatan yang modern, melakukan praktek dan mencari solusi. Di antaranya adalah melakukan analisis visual (VA), yang didefinisikan sebagai " ilmu penalaran analitis yang difasilitasi oleh layanan antarmuka visual interaktif " Thomas dan Cook, dalam Lemieux (2014) .…”

“…Van Wijk (dalam Lemieux, 2014) menjelaskan proses analisis visual sebagai "visualisasi Melingkar" (gambar 1), yang bergerak dari data, proses analis yang menciptakan visualisasi berupa gambar dan ditangkap sebagai persepsi sehingga memunculkan cara pandang baru sebagai awal sebuah pengetahuan, menjadi sebuah hipotesa dan selanjutnya digali kembali dan dianalisis untuk menjadi spesifik yang kemudian dapat divisualkan kembali.…”

“…Bertolak dari kenyataan diatas, penulis memperkuat dengan makna Big Data seperti dikemukakan oleh Heer and Kandel (dalam Lemieux, 2014), At what volume data become big remains an open question, however, with some suggesting that it comprises data at the scale of exabytes, while others argue for zettabytes or yottabytes. Definisi tersebut memperkuat realitas bahwa pertumbuhan data perlu memdapatkan pengelolaan secara lebih khusus dan staf yang spesifik.…”