“…In many biomedical, engineering, and social applications, users often have prespecified a values to reflect their tolerance on the type I errors and use diverse classification algorithms. Example applications include diagnosis of coronary artery disease (18), cancer early warning system (19), network security control (20,21), Environmental Protection Agency water security research (22), prediction of regional and international conflicts (23,24), and the Early Warning Project to identify countries at risk of new mass atrocities (25). However, existing ad hoc use of classification algorithms cannot control type I errors under a with high probability.…”