Let Σ g,n be a compact oriented surface of genus g with n open disks removed. The algebra L g,n (H) was introduced by Alekseev-Grosse-Schomerus and Buffenoir-Roche and is a combinatorial quantization of the moduli space of flat connections on Σ g,n . Here we focus on the two building blocks L 0,1 (H) and L 1,0 (H) under the assumption that the gauge Hopf algebra H is finite-dimensional, factorizable and ribbon, but not necessarily semi-simple. We construct a projective representation of SL 2 (Z), the mapping class group of the torus, using L 1,0 (H) and we study it explicitly for H = U q (sl (2)). We also show that it is equivalent to the representation constructed by Lyubashenko and Majid.and this give the result sinceIt follows that ψ ∈ H * is symmetric if, and only if, J C (±) ⊲ ψ = ψI dim(J) for all J.