In order to solve the problem that the surface deformation of large components cannot be photographed in real time due to the influence of assembly stress during assembly, a multi-source sensor surface deformation sensing and 3D imaging prediction technology for large components is proposed, which combined laser tracking, structured light detection and optical fiber sensing monitoring. Firstly, the multi-source sensor system is analyzed, and the multi-source sensor fusion sensing field is constructed. Secondly, the unified model of heterogeneous data is established to complete the accurate conversion of optical fiber monitoring wavelength to space point coordinates. Thirdly, multi-source data fusion is realized based on Gaussian process fusion algorithm to complete 3D imaging prediction of component surface deformation. Finally, a large skin component is taken as an example to simulate the assembly deformation experiment. The results show that the root-mean-square error is less than 0.1mm compared with the actual results. Based on the measured data of structured light scanning and multi-source sensing technology, a real-time sensing and prediction method for surface deformation imaging of large components is proposed. This method not only simplifies the scanning mode of structured light, but also provides a new idea for dynamic model building.