Ni-based superalloys are widely used to manufacture the critical hot-end components of aviation jet engines and various industrial gas turbines. The analysis of Ni-based superalloys microstructures is an important research task during the design and development of superalloys. The material microstructure information can only be understood by experts in the long history. Image segmentation and recognition are developing techniques for accelerating the microstructure analysis automatically. Although deep learning techniques have achieved satisfactory performance, they usually suffer from generalization, i.e., performing worse on a new dataset. In this paper, a deep transfer learning method which just needs a small number of labeled images is proposed to perform the microstructure recognition on γ′ phase. To evaluate the effectiveness, we homely prepare two Ni-based superalloys at temperatures 900 °C and 1000 °C, and manually annotate two datasets named as W-900 and W-1000. Experimental results demonstrate that the proposed method only needs 3 and 5 labeled images to achieve state-of-the-art segmentation accuracy during the transfer from W-900 to W-1000 and the transfer from W-1000 to W-900, while enjoying the advantage of fast convergence. In addition, a simple and effective software for the Ni-based superalloys microstructure recognition on γ′ phase is developed to improve the efficiency of materials experts, which will greatly facilitate the design of new Ni-base superalloys and even other multicomponent alloys.