Message-oriented Middleware: A Review

Jiang, Yongguo; Liu, Qiang; Qin, Changshuai; Su, Jian; Liu, Qianqian

doi:10.1109/bigcom.2019.00023

Cited by 26 publications

(8 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are several message queuing (MQ) systems, such as Kafka [22], RabbitMQ [23], RocketMQ [24], ActiveMQ [25], and Pulsar [26]. In [27], the authors compared the performance of these systems and tested the throughput in three scenarios, including the numbers of partitions, producers and consumers, and message size.…”

Section: System Descriptionmentioning

confidence: 99%

Application of UAVs and Image Processing for Riverbank Inspection

Chiang,

Juang

2023

Machines

View full text Add to dashboard Cite

Many rivers are polluted by trash and garbage that can affect the environment. Riverbank inspection usually relies on workers of the environmental protection office, but sometimes the places are unreachable. This study applies unmanned aerial vehicles (UAVs) to perform the inspection task, which can significantly relieve labor work. Two UAVs are used to cover a wide area of riverside and capture riverbank images. The images from different UAVs are stitched using the scale-invariant feature transform (SIFT) algorithm. Static and dynamic image stitching are tested. Different you only look once (YOLO) algorithms are applied to identify riverbank garbage. Modified YOLO algorithms improve the accuracy of riverine waste identification, while the SIFT algorithm stitches the images obtained from the UAV cameras. Then, the stitching results and garbage data are sent to a video streaming server, allowing government officials to check waste information from the real-time multi-camera stitching images. The UAVs utilize 4G communication to transmit the video stream to the server. The transmission distance is long enough for this study, and the reliability is excellent in the test fields that are covered by the 4G communication network. In the automatic reconnection mechanism, we set the timeout to 1.8 s. The UAVs will automatically reconnect to the video streaming server if the disconnection time exceeds the timeout. Based on the energy provided by the onboard battery, the UAV can be operated for 20 min in a mission. The UAV inspection distance along a preplanned path is about 1 km at a speed of 1 m/s. The proposed UAV system can replace inspection labor, successfully identify riverside garbage, and transmit the related information and location on the map to the ground control center in real time.

show abstract

Section: System Descriptionmentioning

confidence: 99%

Application of UAVs and Image Processing for Riverbank Inspection

Chiang,

Juang

2023

Machines

View full text Add to dashboard Cite

show abstract

“…The messaging integration style is asynchronous messaging and can decouple all the applications so the sender does not need to wait for the receiver, and we can develop the application efficiently in the real-time monitoring system, as shown in Figure 11. In an earlier study [24], the authors compared five typical message queuing systems, including Kafka [25], RabbitMQ [26], RocketMQ [27], ActiveMQ [28], and Pulsar [29]. They also tested the latency and the throughput in the three scenarios, including the message size, number of producers/consumers, and number of partitions.…”

Section: Message Queuing Systemmentioning

confidence: 99%

Real-Time UAV Trash Monitoring System

Liao

Juang

2022

Applied Sciences

View full text Add to dashboard Cite

This study proposes a marine trash detection system based on unmanned aerial vehicles (UAVs) and aims to replace manpower with UAVs to detect marine trash efficiently and provide information to government agencies regarding real-time trash pollution. Internet technology and computer–machine interaction were applied in this study, which involves the deployment of a marine trash detection system on a drone’s onboard computer for real-time calculations. Images of marine trash were provided to train a modified YOLO model (You Look Only Once networks). The UAV was shown to be able to fly along a predefined path and detect trash in coastal areas. The detection results were sent to a data streaming platform for data processing and analysis. The Kafka message queuing system and the Mongo database were used for data transmission and analysis. It was shown that a real-time drone map monitoring station can be built up at any place where mobile communication is accessible. While a UAV is automatically controlled by an onboard computer, it can also be controlled through a remote station. It was shown that the proposed system can perform data analysis and transmit heatmaps of coastal trash information to a remote site. From the heatmaps, government agencies can use trash categories and locations to take further action.

show abstract

“…RocketMQ [8] is developed in Java , it is first used in Alibaba and later opensourced to public. RocketMQ is also supported in Aliyun and supports a set of customized communication protocols.…”

Section: Rocketmqmentioning

confidence: 99%

A Fair Comparison of Message Queuing Systems

Zhang

2021

IEEE Access

View full text Add to dashboard Cite

The production and real-time usage of streaming data bring new challenges for data systems due to huge volume of streaming data and quick response request of applications. Message queuing systems that offer high throughput and low latency play an important role in today's big streaming data processing. There are several popular message queuing systems in production usage and also many in-lab message queuing systems in academia. These systems with different design philosopies have different characteristics. It is non-trivial for a non-expert to choose a suitable system to meet his specific requirement. With this premise, our primary contribution is to provide the community with a fair comparison among message queuing systems, using a standardized comparison metric and reproducible experimental environment. Five typical message queuing systems (including Kafka, RabbitMQ, RocketMQ, ActiveMQ and Pulsar) are evaluated qualitatively (in analysis) and quantitatively (in experimental results). This paper also highlights the distinct features of each system and summarizes the best-suited use cases of each system. The fair comparison and the insight analysis provided in this paper can help users choose the best-suited message queuing systems.INDEX TERMS big data, streaming processing, message queuing system

show abstract

Message-oriented Middleware: A Review

Cited by 26 publications

References 22 publications

Application of UAVs and Image Processing for Riverbank Inspection

Application of UAVs and Image Processing for Riverbank Inspection

Real-Time UAV Trash Monitoring System

A Fair Comparison of Message Queuing Systems

Contact Info

Product

Resources

About