We establish several finiteness properties of groups defined by algebraic difference equations. One of our main results is that a subgroup of the general linear group defined by possibly infinitely many algebraic difference equations in the matrix entries can indeed be defined by finitely many such equations. As an application, we show that the difference ideal of all difference algebraic relations among the solutions of a linear differential equation is finitely generated.