Underground fire monitoring is an important tool to improve coal mine production safety. In this paper, a multi-source information identification method based on bilinear convolutional neural network (B-CNN) is proposed, which consists of construction of multi-source image acquisition system, B-CNN and integrated decision making based on multi-source B-CNN. Aiming at the problem that Softmax loss function based on the gradient descent in B-CNN is easy falling into the local optimum, an improved Grasshopper Optimization Algorithm (GOA) is proposed to optimally selected two parameters of W and θ; the method of initial solution generation based on sine mapping and the method of accepting bad solution with certain probability are respectively adopted. In order to solve high computational complexity in the stage of model training and integrated recognition by multi-source B-CNN, an image feature preprocessing method is proposed in this paper. Several feature vectors of color feature, shape feature and texture feature of the collected image are extracted and used as input vectors of B-CNN to complete model training and integrated recognition. In simulation experiments, firstly, four Benchmark functions are used to verify the performance of the improved GOA; then, by scaling, expanding and rotating the image to simulate the results of image acquisition at multiple positions and angles, different information sources can be formed to complete the integrated recognition by B-CNN. Three performance indexes of Accuracy, Precision and Recall are used to evaluate the simulation result of different comparative models, which show that the proposed method has better recognition effects.INDEX TERMS Bilinear convolutional neural network, coal mine, data modeling, feature extraction, image processing.