Data Lakes: Trends and Perspectives

Abstract

As a relatively new concept, data lake has neither a standard definition nor an acknowledged architecture. Thus, we study the existing work and propose a complete definition and a generic and extensible architecture of data lake. What's more, we introduce three future research axes in connection with our health-care Information Technology (IT) activities. They are related to (i) metadata management that consists of intra-and inter-metadata, (ii) a unified ecosystem for companies' data warehouses and data lakes and (iii) data lake governance.

Spatial Data Lake for Smart Cities: From Design to Implementation

“…[14] ⧫ □ ✓ ✓ ✓ ✓ Alrehamy and Walker [42] ⧫ ✓ ✓ Data wrangling [41] ⧫ ✓ ✓ ✓ ✓ Constance [16] ⧫ ✓ ✓ GEMMS [32] ◊ ✓ CLAMS [12] ⧫ ✓ Suriarachchi and Plale [40] ⧫ ✓ ✓ Singh, K. et al [39] ⧫ ✓ ✓ ✓ ✓ Farrugia et al [13] ⧫ ✓ GOODS [17] ⧫ ✓ ✓ ✓ ✓ CoreDB [3] ⧫ ✓ ✓ Ground [18] ◊ □ ✓ ✓ ✓ ✓ KAYAK [26] ⧫ ✓ ✓ ✓ CoreKG [4] ⧫ ✓ ✓ ✓ ✓ ✓ Diamantini et al [10] ◊ ✓ ✓ ✓ Ravat, F., Zhao, Y. [34] ⧫ ◊ ✓ ✓ ✓ ✓ ✓ MEDAL [36] ◊ ✓ ✓ ✓ ✓ ✓ ✓ Our proposal ⧫ ◊ ✓ ✓ ✓ ✓ ✓ ✓ ⧫ : Data lake implementation ◊ : Metadata model □ : Model or implementation assimilable to a data lake ✓ : feature is available…”

“…The implementation and Table 1 shows the state-of-the-art approaches and the associated features provided. Among seventeen (17) proposals, only one approach [34] proposes a data lake implementation associated with a metadata management system. Moreover, this approach, like the majority, has been set up for a very specific case study, and does not allow, or hardly takes into account, the case of complex data such as spatial data (satellite data).…”

“…Moreover, this approach, like the majority, has been set up for a very specific case study, and does not allow, or hardly takes into account, the case of complex data such as spatial data (satellite data). In terms of completeness of the state-of-the-art, regarding the features mentioned above, approaches such as [4,18,17,34,36,41] respectively cover more than the half of them. Unfortunately, these solutions are difficult to apply, since they are not very understandable, in the implementation ways, or have been proposed but not yet implemented.…”

On data lake architectures and metadata management

“…But on the other hand, the pond architecture is also functional because Inmon's specifications consider some storage and process components distributed across data ponds (Figure 2). Ravat and Zhao also propose such an hybrid data lake architecture (Figure 5 [45]).…”

From Sensor to Cloud: An IoT Network of Radon Outdoor Probes to Monitor Active Volcanoes

“…Data lakes are also characterized by tools designed to allow efficient data indexing and searching. The data lake concept has emerged very recently and is just starting to be comprehensively analyzed and conceptualized [ 37 ]. We will detail in the next chapter the architecture of the data lake that was created to collect the data produced by the sensors deployed on Mt.…”