Construction Site Safety Management: A Computer Vision and Deep Learning Approach

Abstract

In this study, we used image recognition technology to explore different ways to improve the safety of construction workers. Three object recognition scenarios were designed for safety at a construction site, and a corresponding object recognition model was developed for each scenario. The first object recognition model checks whether there are construction workers at the site. The second object recognition model assesses the risk of falling (falling off a structure or falling down) when working at an elevated position. The third object recognition model determines whether the workers are appropriately wearing safety helmets and vests. These three models were newly created using the image data collected from the construction sites and synthetic image data collected from the virtual environment based on transfer learning. In particular, we verified an artificial intelligence model based on a virtual environment in this study. Thus, simulating and performing tests on worker falls and fall injuries, which are difficult to re-enact by humans, are efficient algorithm verification methods. The verification and synthesis data acquisition method based on a virtual environment is one of the main contributions of this study. This paper describes the overall application development approach, including the structure and method used to collect the construction site image data, structure of the training image dataset, image dataset augmentation method, and the artificial intelligence backbone model applied for transfer learning.

Vision-Based Construction Safety Monitoring Utilizing Temporal Analysis to Reduce False Alarms

“…The integration of CV technology is driving a significant transformation in the field of construction safety management [35,36]. With the advent of deep learning, opportunities for CV-based data analysis have emerged, offering solutions to challenges associated with the manual observation and recording of unsafe behaviors.…”

Integrating Drone Imagery and AI for Improved Construction Site Management through Building Information Modeling

“…Regarding the advancement of artificial intelligence (AI) in object recognition within vision processing, significant progress has been made [55]. However, the application of AI, especially in complex construction site environments, often requires substantial computational resources and meticulously curated datasets for training the models [56,57]. The challenge of collecting and preparing high-quality training data, coupled with the demand for high computational power, is a significant barrier to the widespread adoption of AI-driven object recognition in construction site management [58].…”

An innovative deep active learning approach for improving unlabeled audio classification by selectively querying informative instance

“…We implement an SSAL approach similar to prior work. 21 The model updates twice per iteration - first with active learning, then SSL. In the active stage, the model performs standard active learning using least confidence sampling with a fixed threshold Td.…”