Hypothesis testing procedure for binary and multi‐class F₁‐scores in the paired design

Abstract

In modern medicine, medical tests are used for various purposes including diagnosis, disease screening, prognosis, and risk prediction. To quantify the performance of the binary medical test, we often use sensitivity, specificity, and negative and positive predictive values as measures. Additionally, the ‐score, which is defined as the harmonic mean of precision (positive predictive value) and recall (sensitivity), has come to be used in the medical field due to its favorable characteristics. The ‐score has been extended for multi‐class classification, and two types of ‐scores have been proposed for multi‐class classification: a micro‐averaged ‐score and a macro‐averaged ‐score. The micro‐averaged ‐score pools per‐sample classifications across classes and then calculates the overall ‐score, whereas the macro‐averaged ‐score computes an arithmetic mean of the ‐scores for each class. Additionally, Sokolova and Lapalme gave an alternative definition of the macro‐averaged ‐score as the harmonic mean of the arithmetic means of the precision and recall over classes. Although some statistical methods of inference for binary and multi‐class ‐scores have been proposed, the methodology development of hypothesis testing procedure for them has not been fully progressing yet. Therefore, we aim to develop hypothesis testing procedure for comparing two ‐scores in paired study design based on the large sample multivariate central limit theorem.

Exploring the Impact of Batch Size on Deep Learning Artificial Intelligence Models for Malaria Detection

“…F1-score: The F1-score is an accuracy metric used to quantify the performance of binary medical tests and is the harmonic mean of precision and recall [ 23 ]. Mathematically, it can be calculated as follows:…”

Estimated electric conductivities of thermal plasma for air-fuel combustion and oxy-fuel combustion with potassium or cesium seeding

“…Mathematically, Equation (4) indicates that the overall electric conductivity is half of the harmonic mean [ 97 , 98 ] of the two constituent electric conductivities, or …”