Universality of local unitary transformations is one of the cornerstones of quantum computing with many applications and implications that go beyond this field. However, it has been recently shown that this universality does not hold in the presence of continuous symmetries: generic symmetric unitaries on a composite system cannot be implemented, even approximately, using local symmetric unitaries on the subsystems [I. Marvian, Nature Physics (2022)]. In this work, we study qubit circuits formed from k-local rotationally-invariant unitaries and fully characterize the constraints imposed by locality on the realizable unitaries. We also present an interpretation of these constraints in terms of the average energy of states with a fixed angular momentum. Interestingly, despite these constraints, we show that, using a pair of ancilla qubits, any rotationally-invariant unitary can be realized with the Heisenberg exchange interaction, which is 2-local and rotationally-invariant. We also show that a single ancilla is not enough to achieve universality. Finally, we discuss applications of these results for quantum computing with semiconductor quantum dots, quantum reference frames, and resource theories.