Energy Query Language - An Oil and Gas Domain Query Language for Big Data Analytics in Real-Time Data Streaming

Abstract

Within the Oil and Gas industry, real-time data streaming is essential to conduct high-impact analytics. The Energistics Transfer Protocol (ETP) enables data to be streamed with low latency. The current mechanism of querying the data transferred through ETP is cumbersome, especially for the domain user who wants to realize the full benefits of this protocol. Energy Query Language (EQL) is a domain-specific language (DSL) for querying data which is streamed through ETP with a concise SQL-like structure in real-time. The EQL System (EQLS) provides the ability to query streaming data in real-time across various platforms and business applications, as well as in web or analytics platforms like Python. The EQL grammar is simple enough to reduce the complexity of the current mechanism used for querying and aggregating real-time data. Built with components that can support advanced analytics requirements including big data analytics, EQLS is future-proof.