We propose a new multiclass weighted loss function for instance segmentation of cluttered cells. We are primarily motivated by the need of developmental biologists to quantify and model the behavior of blood T-cells which might help us in understanding their regulation mechanisms and ultimately help researchers in their quest for developing an effective immunotherapy cancer treatment. Segmenting individual touching cells in cluttered regions is challenging as the feature distribution on shared borders and cell foreground are similar thus difficulting discriminating pixels into proper classes. We present two novel weight maps applied to the weighted cross entropy loss function which take into account both class imbalance and cell geometry. Binary ground truth training data is augmented so the learning model can handle not only foreground and background but also a third touching class. This framework allows training using U-Net. Experiments with our formulations have shown superior results when compared to other similar schemes, outperforming binary class models with significant improvement of boundary adequacy and instance detection. We validate our results on manually annotated microscope images of T-cells.
The study of cell morphology is an important aspect of the diagnosis of some diseases, such as sickle cell disease, because red blood cell deformation is caused by these diseases. Due to the elongated shape of the erythrocyte, ellipse adjustment and concave point detection are applied widely to images of peripheral blood samples, including during the detection of cells that are partially occluded in the clusters generated by the sample preparation process. In the present study, we propose a method for the analysis of the shape of erythrocytes in peripheral blood smear samples of sickle cell disease, which uses ellipse adjustments and a new algorithm for detecting notable points. Furthermore, we apply a set of constraints that allow the elimination of significant image preprocessing steps proposed in previous studies. We used three types of images to validate our method: artificial images, which were automatically generated in a random manner using a computer code; real images from peripheral blood smear sample images that contained normal and elongated erythrocytes; and synthetic images generated from real isolated cells. Using the proposed method, the efficiency of detecting the two types of objects in the three image types exceeded 99.00%, 98.00%, and 99.35%, respectively. These efficiency levels were superior to the results obtained with previously proposed methods using the same database, which is available at http://erythrocytesidb.uib.es/. This method can be extended to clusters of several cells and it requires no user inputs.
We propose a new loss formulation to further advance the multiclass segmentation of cluttered cells under weakly supervised conditions. We improve the separation of touching and immediate cells, obtaining sharp segmentation boundaries with high adequacy, when we add Youden's J statistic regularization term to the cross entropy loss. This regularization intrinsically supports class imbalance thus eliminating the necessity of explicitly using weights to balance training. Simulations demonstrate this capability and show how the regularization leads to better results by helping advancing the optimization when cross entropy stalls. We build upon our previous work on multiclass segmentation by adding yet another training class representing gaps between adjacent cells. This addition helps the classifier identify narrow gaps as background and no longer as touching regions. We present results of our methods for 2D and 3D images, from bright field to confocal stacks containing different types of cells, and we show that they accurately segment individual cells after training with a limited number of annotated images, some of which are poorly annotated.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.