The BigDataEurope Platform – Supporting the Variety Dimension of Big Data

Abstract

General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.• Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Take down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

A Mapping Study about Data Lakes: An Improved Definition and Possible Architectures

“…During our analysis, we mapped who the authors of the papers references when using a definition for data lakes. We found that James Dixon was the first one to use the term lake in big data context, in a post in its blog in 2010 [20], and he is referenced by ten papers [4], [6], [17], [32], [38], [44], [62], [63], [67], [91]. The first author to reference Dixon's Concept in academic context was O'Leary [63], in a paper published in 2014.…”

“…Table VII lists the tools cited more than once. Of all the tools, Apache Hadoop was the most mentioned, having 37 citations ( [1], [6], [8], [9], [12], [18], [23]- [25], [27], [28], [30], [31], [40], [42]- [44], [47], [48], [50], [52], [55], [61], [65], [67]- [71], [73], [76], [80], [82]- [86], [88]). Hadoop is a platform that allows distributed processing of large data sets in computer clusters.…”

“…Initial Accepted Scopus 108 53 papers: [1]- [3], [5], [9], [10], [13]- [19], [23]- [29], [31]- [33], [37], [40], [45], [49], [50], [57], [60]- [66], [68], [70], [71], [73], [76]- [78], [81]- [84], [88], [90], [91], [93]- [95] Springer 222 20 papers: [4], [6], [12], [21], [30], [36], [38], [39], [41]- [43], [47], [51], [53], [69], [74], [79], [85], [86], [92] Google Scholar 197 6 papers:...…”

Big Data Platform Architecture under The Background of Financial Technology

“…Integrating the space-time information images of the taxpayers with the space-time remote sensing data, Internet data, business data and claims data of the insured in the overall business, based on which, the spatial-temporal data retrieval, space-time data analysis, Product service tracking, insurance fraud and other services. The concept of "Big Data +" will be extended through such aspects as product design, product pricing, product recommendation [16], product tracking service, product claim settlement and anti-fraud so as to broaden the application scenario of big data technology in smart insurance work, integrate data resources, customer needs, From the relationship between the time and spatial relationship analysis of data, provide a variety of visual analysis capabilities to support the visual relationship between these three layouts, large amounts of data into valuable customer information resources [2]. Dig deeper into data resources to identify potential customers and cheat customers.…”

“…The overall architecture of the platform is divided into seven layers, including data sources, data acquisition and aggregation, data storage and calculation [3], database management layer, data service layer, data analysis layer, integrated application and terminal layer, and to develop corresponding data standards and application specifications and security Management system, the overall structure as shown (see Fig.?? ).…”