Image sensors are increasingly being used in biodiversity monitoring, with each study generating many thousands or millions of pictures. Efficiently identifying the species captured by each image is a critical challenge for the advancement of this field. Here, we present an automated species identification method for wildlife pictures captured by remote camera traps. Our process starts with images that are cropped out of the background. We then use improved sparse coding spatial pyramid matching (ScSPM), which extracts dense SIFT descriptor and cell-structured LBP (cLBP) as the local features, that generates global feature via weighted sparse coding and max pooling using multi-scale pyramid kernel, and classifies the images by a linear support vector machine algorithm. Weighted sparse coding is used to enforce both sparsity and locality of encoding in feature space. We tested the method on a dataset with over 7,000 camera trap images of 18 species from two different field cites, and achieved an average classification accuracy of 82%. Our analysis demonstrates that the combination of SIFT and cLBP can serve as a useful technique for animal species recognition in real, complex scenarios.
A proper strategy to alleviate overfitting is critical for deep neural network (DNN). In this work, we introduce the cross-loss-function regularization for boosting the generalization capability of the DNN, which results in the Multi-Loss regularized Deep Neural Network (ML-DNN) framework. For a particular learning task, e.g., image classification, only a single loss function is used for all previous DNNs, and the intuition behind the multiloss framework is that the extra loss functions with different theoretical motivations (e.g, pairwise loss and LambdaRank loss) may drag the algorithm away from the overfitting to one particular single loss function (e.g, softmax loss). In the training stage, we pre-train the model with the single core loss function, and then warm-start the whole ML-DNN with the convolutional parameters transferred from the pre-trained model. In the testing stage, the outputs by ML-DNN from different loss functions are fused with average pooling to produce the ultimate prediction. The experiments conducted on several benchmark datasets (CIFAR-10, CIFAR-100, MNIST and SVHN) demonstrate that the proposed ML-DNN framework, instantiated by the recently proposed Network-in-Network, considerably outperforms all other state-of-the-art methods.
Detection of mitotic tumor cells per tissue area is one of the critical markers of breast cancer prognosis. The aim of this paper is to develop a method for the automatic detection of mitotic figures from breast cancer histological slides using a partially supervised deep learning framework. Unlike the previous literature, which has focused on solving the problem of mitosis detection in the weakly annotated datasets using centroid pixel labels (weak labels) only without taking advantage of the available pixel-level labels (strong labels) of other datasets, in this paper, we design a novel partially supervised framework based on two parallel deep fully convolutional networks. One of them is trained using weak labels and the other is trained using strong labels, together with a weight transfer function. In the detection phase, we fuse the segmentation maps produced by the two networks to obtain the final mitosis detections. Our system exploits the available large sets of mitosis detection samples with mitosis centroid annotation, such as the 2014 ICPR dataset and the AMIDA13 dataset, and only a small set of samples with the annotation of all mitosis pixels, such as the 2012 ICPR dataset, to perform a more accurate mitosis detection on weakly labeled data. This enables us to outperform all previous mitosis detection systems by achieving F-scores of 0.575 and 0.698 on the 2014 ICPR dataset and the AMIDA13 dataset respectively.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.