Digital pathology and microscopic image analysis play an important role in cell morphology research. In particular, the effective segmentation of White Blood Cells (WBCs) remains a challenging problem due to the blurring boundaries of WBCs under rapid staining, as well as the adhesion between leukocytes and other cells. In this paper, we propose a novel WBC (including nuclei and cells) segmentation algorithm based on both sparsity and geometry constraints. Specifically, we first construct a sparse image representation via combining the HSL color space and the RGB color channels, followed by the use of a sparsity constraint to only preserve useful information from the nuclei features. In addition, we introduce a robust model fitting strategy (i.e., the geometry constraint) to detect cells. Our model fitting strategy is able to significantly improve the robustness of the proposed segmentation algorithm against outliers that could seriously contaminate WBCs. The experimental results show that the proposed algorithm presents clear advantages over the state-of-the-art WBC segmentation algorithms in terms of accuracy. INDEX TERMS Geometry constraint, sparsity constraint, white blood cell segmentation.