Feature Engineering Algorithms for Traffic Dataset

Abstract

As a result of an increase in the human population globally, traffic congestion in the urban area is becoming worse, which leads to time-consuming, waste of fuel, and, most importantly, the emission of pollutants. Therefore, there is a need to monitor and estimate traffic density. The emergence of an automatic traffic management system allows us to record and monitor motor vehicles' movement in a road segment. One of the challenges researchers face is when the historical traffic data is given as an annual average that contains incomplete data. The annual average daily traffic (AADT) is an average number of traffic volumes at the roadway segment in a specific location over a year. An example of AADT data is the one given by Road Traffic Volume Malaysia (RTVM), and this data is incomplete. The RTVM provides an average of daily traffic data and one peak hour. The recorded traffic data is for sixteen hours, and the only hourly data given is one hour, from 8.00 am to 9.00 am. Hence there is a need to estimate hourly traffic volume for the remaining hours. Feature engineering can be used to overcome the issue of incomplete data. This paper proposed feature engineering algorithms that can efficiently estimate hourly traffic volume and generate features from the existing dataset for all traffic census stations in Malaysia using queuing theory. The proposed feature engineering algorithms were able to estimate the hourly traffic volume and generate features for three years in Jalan Kepong census station, Kuala Lumpur, Malaysia. The algorithms were evaluated using the Random Forest model and Decision Tree Models. The result shows that our feature engineering algorithms improve machine learning algorithms' performance except for the prediction of N O2 using Random Forest, which shows the highest MAE, MSE, and RMSE when traffic data was included for prediction. The algorithm is applied in one of the traffic census stations in Kuala Lumpur, and it can be used for the other stations in Malaysia. Additionally, the algorithm can also be used for any annual average daily traffic data if it includes average hourly data.

An Optimized Artificial Neural Network Model using Genetic Algorithm for Prediction of Traffic Emission Concentrations

“…The CO, N O, N O 2 , and N O x features from air quality and meteorological features such as relative humidity, wind speed, and temperature were used [36]. The traffic dataset consists of traffic volume, the volume of the type of vehicle (taxi and car, bus, van, heavy and light lorries, and motorcycle), time spent on the road, and speed of the vehicle were used [49]. The traffic dataset was collected from the Ministry of Works Malaysia at Jalan Kepong traffic census station located in Kuala Lumpur, Malaysia.…”

A Hybrid Model to Profile and Evaluate Soft Skills of Computing Graduates for Employment

“…These questions consist of open ended questions that leads the graduates to reason on the eight (8) given skills addressed in this research study. Feature engineering [38], [39], [40], an important step in data science studies, will be performed on the questionnaire attempted by the Graduates to perform text pre-processing, extraction and classification.…”