A quantum cellular automaton (QCA) or a causal unitary is by definition an automorphism of local operator algebra, by which local operators are mapped to local operators. Quantum circuits of small depth, local Hamiltonian evolutions for short time, and translations (shifts) are examples. A Clifford QCA is one that maps any Pauli operator to a finite tensor product of Pauli operators. Here, we obtain a complete table of groups C(d, p) of translation invariant Clifford QCA in any spatial dimension d ≥ 0 modulo Clifford quantum circuits and shifts over prime p-dimensional qudits, where the circuits and shifts are allowed to obey only coarser translation invariance. The group C(d, p) is nonzero only for d = 2k + 3 if p = 2 and d = 4k + 3 if p is odd where k ≥ 0 is any integer, in which case C(d, p) ∼ = W(Fp), the classical Witt group of nonsingular quadratic forms over the finite field Fp. It is well known that W(F2) ∼ = Z/2Z, W(Fp) ∼ = Z/4Z if p = 3 mod 4, and W(Fp) ∼ = Z/2Z ⊕ Z/2Z if p = 1 mod 4. The classification is achieved by a dimensional descent, which is a reduction of Laurent extension theorems for algebraic L-groups of surgery theory in topology.