Logistic regression is frequently used in many areas of applied statistics. The maximum likelihood estimates (MLE) of the logistic regression parameters are usually computed using the iterative Newton-Raphson method. It is well known that these estimates are biased. Several methods are proposed to correct the bias of these estimates. Among them Firth (1993) and Cordeiro and McCullagh (1991) proposed two promising methods. The conditional exact method (CMLE) is popular for small-sample estimates, and is available in many software packages. In this article we compare these methods in terms of their bias. In general, our extensive simulations show that the methods proposed by Cordeiro and McCullagh and by Firth work well, though Cordeiro and McCullagh is slightly better in our simulations. In case of separation, Firth or CMLE can be used; however, a judicious approach is required when there is a wide variation in results. Two real data analyses are given exhibiting these properties. The data analysis also includes bootstrap results.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.