With the rapid development of high-speed signal processing devices, the algorithm with large amounts of data can be implemented in real-time. This paper proposes a kind of signal processing system based on five pieces of multi-core DSP. Firstly, the interface circuit and program between FPGA and DSP, DSP and DSP, the system and computer are designed and tested. Then, this paper puts forward that the system can use Semaphore2 to schedule the task and use DDR3 as well as MSCM to share the data. Finally, the system is tested by using the imaging algorithm with a large amount of data. The time-consuming results of the system and imaging results demonstrate that this system is able to process the algorithm with a large amount of data in real-time.