In recent years, automated traffic signal performance measures (ATSPMs) have emerged as a means of developing situational awareness of traffic conditions at intersections and assessing the quality of signal operations. As a growing number of agencies are adopting the technology, there is a need to understand how detector configurations can influence the outcomes of an analysis using ATSPM. Current practices with regard to detector configuration vary considerably from one agency to another; at one extreme, agencies may use one single detector input channel per phase without considering where the detectors are located, whereas at the other extreme, some agencies may utilize all possible channels to observe each individual lane at multiple positions. There are also variations in the design of detection zones (lengths and positions). This study takes on the problem in two parts. The first of these examines the impact of stop bar detection zone length and lane- or approach-based detector assignment on the ability of performance measures to identify accurately whether split failures occur. The second part examines the impact of setback detector distance on the use of a “percentage on green” metric that serves as a proxy measurement of the number of stops. The paper presents recommendations for performance measure calibrations and detector configurations that follow from these outcomes.