Dynamic distributed dimensional data model (D4M) database and computation system

Kepner, Jeremy; Arcand, William; Bergeron, William; Bliss, Nadya; Bond, Robert; Byun, Chansup; Condon, Gary R.; Gregson, Kenneth; Hubbell, Matthew; Kurz, J.R.; McCabe, Andrew; Michaleas, Peter; Prout, Andrew; Reuther, Albert; Rosa, Antonio; Yee, Charles

doi:10.1109/icassp.2012.6289129

Cited by 85 publications

(59 citation statements)

References 9 publications

(7 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In BigDawg, we have multiple groups working on islands. One is using a relational model [3] and the second is using associative arrays [4]. Since both islands include the same data (MIMIC II) stored in the same engines, we will have to support multiple islands over the same data.…”

Section: Overview Of Bigdawgmentioning

confidence: 99%

The BigDawg monitoring framework

Chen¹,

Gadepally²

2016

2016 IEEE High Performance Extreme Computing Conference (HPEC)

View full text Add to dashboard Cite

In this thesis, I designed and implemented a monitoring framework for the BigDawg federated database system which maintains performance information on benchmark queries. As environmental conditions change, the monitoring framework updates existing performance information to match current conditions. Using this information, the monitoring system can determine the optimal query execution plan for similar incoming queries. A series of test queries were run to assess whether the system correctly determines the optimal plans for such queries.

show abstract

Section: Overview Of Bigdawgmentioning

confidence: 99%

The BigDawg monitoring framework

Chen¹,

Gadepally²

2016

2016 IEEE High Performance Extreme Computing Conference (HPEC)

View full text Add to dashboard Cite

show abstract

“…One thrust is to implement graphs as sparse matrices. One of our team members (Jeremy Kepner) has a graph-processing engine supported by sparse arrays [24], which we plan to test against the baseline on a GraphLab benchmark.…”

Section: Graph Datamentioning

confidence: 99%

Intel "big data" science and technology center vision and execution plan

Madden

Dubey

2013

SIGMOD Rec.

View full text Add to dashboard Cite

Intel has moved to a collaboration model with universities consisting of "Science and Technology Centers" (ISTCs). These are located at a "hub" university with participation from other universities, contain embedded Intel personnel, and are focused on some research theme. Intel held a national competition for a 5th Science and Technology center in 2012 and selected a proposal from M.I.T. with a theme of "Big Data". This paper presents the big data vision of this technology center and the execution plan for the first few years.

show abstract

“…In BigDAWG, two systems developed by ISTC members will be used as initial islands, and we will build additional ones as we go along. The two initial systems are Myria [13], which uses relational-style semantics plus iteration, and D4M [15], which implements a novel data model based on associative arrays. In our prototype, both islands will mediate access to MIMIC II data stored in the same engines (Accumulo, SciDB, S-Store, and Postgres).…”

Section: Islands Of Informationmentioning

confidence: 99%

The BigDAWG Polystore System

Duggan¹,

et al. 2015

Self Cite

View full text Add to dashboard Cite

This paper presents a new view of federated databases to address the growing need for managing information that spans multiple data models. This trend is fueled by the proliferation of storage engines and query languages based on the observation that "no one size fits all". To address this shift, we propose a polystore architecture; it is designed to unify querying over multiple data models. We consider the challenges and opportunities associated with polystores. Open questions in this space revolve around query optimization and the assignment of objects to storage engines. We introduce our approach to these topics and discuss our prototype in the context of the Intel Science and Technology Center for Big Data.

show abstract

Dynamic distributed dimensional data model (D4M) database and computation system

Cited by 85 publications

References 9 publications

The BigDawg monitoring framework

The BigDawg monitoring framework

Intel "big data" science and technology center vision and execution plan

The BigDAWG Polystore System

Contact Info

Product

Resources

About