RADAR: Reactive Concept Drift Management with Robust Variational Inference for Evolving IoT Data Streams

Alsaedi, Abdullah; Sohrabi, Nasrin; Mahmud, Redowan; Tari, Zahir

doi:10.1109/icde55515.2023.00155

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Concept Drift Challenges in the Internet of Things (IoT) Era of Smart Cities: A Preliminary Investigation

Etehadi,

Yaghmaee,

Noorani

et al. 2023

2023 7th International Conference on Internet of Things and Applications (IoT)

View full text Add to dashboard Cite

Concept Drift Challenges in the Internet of Things (IoT) Era of Smart Cities: A Preliminary Investigation

Etehadi,

Yaghmaee,

Noorani

et al. 2023

2023 7th International Conference on Internet of Things and Applications (IoT)

View full text Add to dashboard Cite

PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation

Zeng,

Zhang,

Zhong

et al. 2024

Proc. ACM Manag. Data

View full text Add to dashboard Cite

Stream Window Join (SWJ), a vital operation in stream analytics, struggles with achieving a balance between accuracy and latency due to out-of-order data arrivals. Existing methods predominantly rely on adaptive buffering, but often fall short in performance, thereby constraining practical applications. We introduce PECJ, a solution that proactively incorporates unobserved data to enhance accuracy while reducing latency, thus requiring robust predictive modeling of stream oscillation. At the heart of PECJ lies a mathematical formulation of the posterior distribution approximation (PDA) problem using variational inference (VI). This approach circumvents error propagation while meeting the low-latency demands of SWJ. We detail the implementation of PECJ, striking a balance between complexity and generality, and discuss both analytical and learning-based approaches. Experimental evaluations reveal PECJ's superior performance. The successful integration of PECJ into a multi-threaded SWJ benchmark testbed further establishes its practical value, demonstrating promising advancements in enhancing data stream processing capabilities amidst out-of-order data.

show abstract

RADAR: Reactive Concept Drift Management with Robust Variational Inference for Evolving IoT Data Streams

Cited by 2 publications

References 26 publications

Concept Drift Challenges in the Internet of Things (IoT) Era of Smart Cities: A Preliminary Investigation

Concept Drift Challenges in the Internet of Things (IoT) Era of Smart Cities: A Preliminary Investigation

PECJ: Stream Window Join on Disorder Data Streams with Proactive Error Compensation

Contact Info

Product

Resources

About