The driving domain is inherently dangerous. To develop connected and automated vehicles that can detect potential sources of harm, we must clearly define these hazardous events and metrics to detect them. The majority of driving scenarios we face do not materialise harm, but we often face potentially hazardous near-miss scenarios. Potential harm is difficult to quantify when harm is not materialised; thus, few metrics detect these scenarios in the absence of collision and even fewer datasets label non-collision-based hazardous events. This study focuses on detecting near-miss scenarios due to other actors since human error is the primary source of harm. We first provide a concise overview of current event-specific metrics. We then propose an event-agnostic detection framework that exploits vehicle kinematics to detect evasive manoeuvres early and dynamically calculate minimum safe distances. Given inconsistent dataset labelling methods and collision-focused events, we provide a preliminary study to demonstrate an eventagnostic and configurable dataset annotation technique to label hazardous events, even when harm is not materialised. We show promising results detecting hazardous scenes on a labelled simulation benchmark, GTACrash.