We analyse the stability of large, linear dynamical systems of degrees of freedoms with inhomogeneous growth rates that interact through a fully connected random matrix. We show that in the absence of correlations between the coupling strengths a system with interactions is always less stable than a system without interactions. On the other hand, interactions that are antagonistic, i.e., characterised by negative correlations, can stabilise linear dynamical systems. In particular, we show that systems that have a finite fraction of the degrees of freedom that are unstable in isolation can be stabilised when introducing antagonistic interactions that are neither too weak nor too strong. On contrary, antagonistic interactions that are too strong destabilise further random, linear systems and thus do not help in stabilising the system. These results are obtained with an exact theory for the spectral properties of fully connected random matrices with diagonal disorder.