Implementation of Data Abstraction Layer Using Kafka on SEMAR Platform for Air Quality Monitoring

Panduman, Yohanes Yohanie Fridelin; Albaab, Mochamad Rifki Ulil; Besari, Adnan Rachmat Anom; Sukaridhoto, Sritrusta; Tjahjono, Anang; Budiarti, Rizqi Putri Nourma

doi:10.18517/ijaseit.9.5.8547

Cited by 4 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This integration facilitates fast and reliable real-time data transfer between various applications, particularly for handling large data volumes. The platform called SEMAR (Smart Environment Monitoring and Analytical in Real-time) (Fridelin Panduman et al 2019) presents a cloud computing platform based on microservice architecture. The system consists of a device that is placed in the car and sends data via MQTT protocol to the server on which Apache Kafka is installed.…”

Section: Literature Reviewmentioning

confidence: 99%

“… Full Professor, University of Belgrade Faculty of Organizational Sciences, Serbia.-(Hugo et al 2020) propose the use of Apache Kafka as a centralized message distribution system to streamline the architecture of monolithic applications. -(Fridelin Panduman et al 2019) also propose the use of Apache Kafka server, alongside MQTT protocol, for SEMAR (Smart Environment Monitoring and Analytics in Real-time), a cloud computing platform based on microservice architecture. -(Khriji et al 2022) proposed AWS (Amazon Web Services) cloud-based architecture with AWS message broker -REDA (Real-time Event-Driven Architecture).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Untitled

2023

AJTE

View full text Add to dashboard Cite

ATINER is an independent and non-profit Association with a Mission to become a forum where Academics and Researchers from all over the world can meet in Athens, exchange ideas on their research and discuss future developments in their disciplines, as well as engage with professionals from other fields. Athens was chosen because of its long history of academic gatherings, which go back thousands of years to Plato"s Academy and Aristotle"s Lyceum. Both these historic places are within walking distance from ATINER"s downtown offices. Since antiquity, Athens was an open city. In the words of Pericles, Athens"…is open to the world, we never expel a foreigner from learning or seeing". ("Pericles" Funeral Oration", in Thucydides, The History of the Peloponnesian War). It is ATINER"s mission to revive the glory of Ancient Athens by inviting the World Academic Community to the city, to learn from each other in an environment of freedom and respect for other people"s opinions and beliefs. After all, the free expression of one"s opinion formed the basis for the development of democracy, and Athens was its cradle. As it turned out, the Golden Age of Athens was in fact, the Golden Age of the Western Civilization. Education and (Re)searching for the "truth" are the pillars of any free (democratic) society. This is the reason why Education and Research are the two core words in ATINER"s name.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

mentioning

confidence: 99%

Untitled

2023

AJTE

View full text Add to dashboard Cite

show abstract

“…One ongoing research on the development of VaaMSN that integrates with cloud computing services for the monitoring process in the road environment. Implementation of VaaMSN as edge computing with SEMAR cloud (Smart and Analytical Environmental Monitoring in Real-Time) to monitor air quality [12], the developed VaaMSN system consists of single-board computing (SBC) connected with 4G Wi-Fi modem devices, GPS and air sensor. Besides that, the VaaMSN system was also developed to detect holes using an IMU sensor attached to the SBC, location data, and the IMU is sent to cloud computing services to be classified whether or not there are holes [13].…”

Section: International Journal On Informatics Visualization Vol 4 (2020) No 4 E-issn : 2549-9904 Issn : 2549-9610mentioning

confidence: 99%

Implementation SEMAR-IoT-Platform for Vehicle as a Mobile Sensor Network

Panduman

Sukaridhoto

Tjahjono

et al. 2020

JOIV : Int. J. Inform. Visualization

Self Cite

View full text Add to dashboard Cite

With the rapid development of IoT technology in various fields such as smart cities and industry 4.0, the need for wireless sensor network-based systems has increased, one of which is the concept of using a vehicle as a mobile sensor network or known as VaaMSN. Many developers use the IoT platform as a cloud computing service in developing the VaaMSN system. However, not all IoT platform service providers provide monitoring features on every device and provide information such as device location, purpose, condition. Therefore, this research aims to develop an IoT Platform that can receive data and provide information on each device, making it easier to process data and control devices. Therefore, this research aims to develop an IoT platform called the SEMAR-IoT-Platform that able to received data and provide information on each device for easier data processing and control devices. The SEMAR-IoT-Platform integrates Big Data, Data Analytics, Machine Learning, using the principles of Extract, Transfer, and Load (ETL) for data processing and provides communication services using HTTP-POST, MQTT, and NATS. The test results show that the system has been successfully implemented to complement a simple IoT system with an average delay time of HTTP, NATS, and MQTT communications of less than 150ms for the data storage process, and for the data visualization process has an average delay time of less than 300ms.

show abstract

“…Microservices architecture was designed to resolve this issue. It consists of many modules that can communicate to exchange data, and each module stands for only one loosely coupled service [9]. If a module was processing too many tasks, that module's resources could be upgraded to handle the job properly without disturbing another module.…”

Section: Introductionmentioning

confidence: 99%

Real-Time Bus Arrival Time Estimation API using WebSocket in Microservices Architecture

Nugraha¹

2023

Int. J. Adv. Sci. Eng. Inf. Technol.

View full text Add to dashboard Cite

In almost all countries, public transportation is the primary choice for people to make daily trips. One of the main problems of public transportation is the accuracy of the vehicle arrival schedule information. In some types of public transportation with particular tracks, such as rapid transit (e.g., MRT), the arrival time can be predicted easily because traffic jams do not affect transportation. This is different from buses, which use the same route as other vehicles so that traffic jams could affect them. This study tries to solve this problem by building an API that can be used to get information on the estimated arrival time of the bus. Estimated time is calculated based on the condition of the bus position and the actual condition of highway traffic from Google Directions API. The API was built using microservices technology, so it can be done quickly if it is further developed to a larger scale. The test was conducted on the Trans Jogja Bus by taking two routes, the short and the long routes. Each route could be explored 20 times under varying time and traffic conditions. Then, the difference between the estimated bus arrival time and the actual bus arrival time could be calculated on each trip. Based on the test results, the estimated bus arrival time generated by the API can be said to be entirely accurate because the difference between the estimated time and the actual bus arrival time is less than 30 seconds.

show abstract

Implementation of Data Abstraction Layer Using Kafka on SEMAR Platform for Air Quality Monitoring

Cited by 4 publications

References 18 publications

Untitled

Untitled

Implementation SEMAR-IoT-Platform for Vehicle as a Mobile Sensor Network

Real-Time Bus Arrival Time Estimation API using WebSocket in Microservices Architecture

Contact Info

Product

Resources

About