Businesses contribute immensely to economic growth. However, many enterprises started fail within a year of their operation. This study seeks to predict business success, elucidating on factors affecting the success of a business based on recent data for timely intervention. The study used Rwanda Revenue Authority data. Tree-based models were compared with logistic regression for the prediction of the business success. Log loss, Area under Receiver-Operating Characteristic Curve, accuracy, recall, and F1 score were used to evaluate the performance of each model in differentiating between successful and unsuccessful business. Tree-based ensemble models were more robust than other classifiers. However, gradient boosting was the most robust model. The results showed that the business industry (sector of the economy) is the most important factor determining business success. Other important factors are the nature of the business and type of ownership, duration of operation, and location of the business.