ProLoD: An Efficient Framework for Processing Logistics Data

IBRIDIA: A hybrid solution for processing big logistics data

“…As mentioned earlier, IBRIDIA relies on the data processing model which we developed in our previous work [3]. We explain the data processing model in this section.…”

“…In [3], we reported several disadvantages of the basic agglomerative clustering algorithm . In particular, undoing is not allowed and the time complexity is O(n 2 log n) where n denotes the number of data points.…”

“…In this paper, we focus on developing a hybrid solution which enables efficient processing of data in realtime and batch style. It is worth noting that this paper is an extension of our previous work [3] where we developed batch style data processing. In this paper, we added functionalities that enable real-time processing of data.…”

“…Additionally, modern technologies have limited capabilities to tackle variety challenge. For instance, we conducted an experimental study with a solution called "Massive Online Analysis" (MOA 3 ) which is an advanced version of one of the most widely used machine learning solution called WEKA 4 . We found that it cannot load tweets (which are texts).…”

“…In our solution called ProLoD [3], we focused on variety challenge. In this paper, we extended ProLoD to tackle the velocity challenge by adding functionalities for collecting and processing data streams in real-time.…”