The use of incoherent broadband pump radiation for improving the electron efficiency in the freeelectron lasers (FEL) based on stimulated backscattering is considered. On the basis of a quasilinear approach, it is shown that the efficiency increases in proportion to the width of the pump spectrum. The effect is owing to a broadening of the spectrum of synchronous combination waves and realization of a mechanism of stochastic particle deceleration. The injection of a monochromatic seed signal in a single pass FEL amplifier or the implementation of a selective high-Q resonator in an FEL oscillator makes the high-frequency scattered radiation be monochromatic in spite of an incoherent pumping. In the regime of stochastic particle deceleration, the efficiency only slightly depends on the spread of the beam parameters, which is beneficial for a terahertz FEL powered by intense relativistic electron beams.