Existing deep Thermal InfraRed (TIR) trackers usually use the feature models of RGB trackers for representation. However, these feature models learned on RGB images are neither effective in representing TIR objects nor taking fine-grained TIR information into consideration. To this end, we develop a multi-task framework to learn the TIR-specific discriminative features and fine-grained correlation features for TIR tracking. Specifically, we first use an auxiliary classification network to guide the generation of TIR-specific discriminative features for distinguishing the TIR objects belonging to different classes. Second, we design a fine-grained aware module to capture more subtle information for distinguishing the TIR objects belonging to the same class. These two kinds of features complement each other and recognize TIR objects in the levels of inter-class and intra-class respectively. These two feature models are learned using a multi-task matching framework and are jointly optimized on the TIR tracking task. In addition, we develop a large-scale TIR training dataset to train the network for adapting the model to the TIR domain. Extensive experimental results on three benchmarks show that the proposed algorithm achieves a relative gain of 10% over the baseline and performs favorably against the state-of-the-art methods. Codes and the proposed TIR dataset are available at https://github.com/QiaoLiuHit/MMNet.

No abstract

No abstract

No abstract

Accurate extraction of buildings using high spatial resolution imagery is essential to a wide range of urban applications. However, it is difficult to extract semantic features from a variety of complex scenes (e.g., suburban, urban and urban village areas) because various complex man-made objects usually appear heterogeneous with large intra-class and low inter-class variations. The automatic extraction of buildings is thus extremely challenging. The fully convolutional neural networks (FCNs) developed in recent years have performed well in the extraction of urban man-made objects due to their ability to learn state-of-the-art features and to label pixels end-to-end. One of the most successful FCNs used in building extraction is U-net. However, the commonly used skip connection and feature fusion refinement modules in U-net often ignore the problem of feature selection, and the ability to extract smaller buildings and refine building boundaries needs to be improved. In this paper, we propose a trainable chain fully convolutional neural network (CFCN), which fuses high spatial resolution unmanned aerial vehicle (UAV) images and the digital surface model (DSM) for building extraction. Multilevel features are obtained from the fusion data, and an improved U-net is used for the coarse extraction of the building. To solve the problem of incomplete extraction of building boundaries, a U-net network is introduced by chain, which is used for the introduction of a coarse building boundary constraint, hole filling, and "speckle" removal. Typical areas such as suburban, urban, and urban villages were selected for building extraction experiments. The results show that the CFCN achieved recall of 98.67%, 98.62%, and 99.52% and intersection over union (IoU) of 96.23%, 96.43%, and 95.76% in suburban, urban, and urban village areas, respectively. Considering the IoU in conjunction with the CFCN and U-net resulted in improvements of 6.61%, 5.31%, and 6.45% in suburban, urban, and urban village areas, respectively. The proposed method can extract buildings with higher accuracy and with clearer and more complete boundaries.

The quaternion wavelet transform is a new multiscale analysis tool. Firstly, this paper studies the standard orthogonal basis of scale space and wavelet space of quaternion wavelet transform in spatialL2(R2), proves and presents quaternion wavelet’s scale basis function and wavelet basis function concepts in spatial scale spaceL2(R2;H), and studies quaternion wavelet transform structure. Finally, the quaternion wavelet transform is applied to image denoising, and generalized Gauss distribution is used to model QWT coefficients’ magnitude distribution, under the Bayesian theory framework, to recover the original coefficients from the noisy wavelet coefficients, and so as to achieve the aim of denoising. Experimental results show that our method is not only better than many of the current denoising methods in the peak signal to noise ratio (PSNR), but also obtained better visual effect.

The traditional human behavior recognition algorithm is easy to ignore the spatial constraint problem of feature blocks, which leads to poor recognition effect and low correct rate. Therefore, we proposed a human motion target recognition algorithm based on Convolution Neural Network (referred to as the ''CNN'') and global constraint block matching. First, key frames of the human motion video were extracted, second, the local feature and global feature of key frames were analyzed, and CNN was used to perform feature fusion, then, according to the result of the feature fusion, a feature block was formed and the closest matching feature block is obtained, using the definition of spatial constraint, we considered the spatial data of human motion in the vertical direction, calculates the spatial constraint weight, and further completes the matching. Finally, the score of matching block and the spatial constraint weight were calculated, and the human motion targets are recognized based on the cumulative score. The experimental results show that the proposed algorithm has a high key frame extraction accuracy of more than 90% and less time consumed in feature fusion, high matching accuracy of feature blocks of more than 80%, and high feature blocks, the F-measure of human behavior recognition is 0.95 on average, and the overall recognition performance is good.INDEX TERMS Convolutional neural network, global constraint block, feature block, spatial constraints, matching, human motion target, recognition.

No abstract