Noncompliance with safety rules is a major cause of unsatisfactory performance in construction safety worldwide. Although some research efforts have focused on using computer vision (CV) methods for safety rule inspection, these methods are still in their early stages and cannot be effectively applied on construction job sites. Therefore, it is necessary to present a feasible prototype and conduct a detailed analysis of safety rules to ensure compliance at the job site. This study aims to extend the validation of safety rule analysis through four case scenarios. The proposed structured classification of safety rules includes categorizing them based on project phases and work stages. The construction phase-related rules are divided into four groups: (1) before work, (2) with intervals, (3) during work, and (4) after work. To validate the proposed framework, this research developed prototypes for each group’s scenarios using deep learning algorithms, a storage database to record compliance with safety rules, and an Android application for edge computing, which is required in the “before work” and “after work” groups. The findings of this study could contribute to the development of a compact CV-based safety monitoring system to enhance the current safety management process in the construction industry.