We propose a new technique to quantize and feedback the parameters when a beamforming matrix is compressed with the Givens Rotation (GR). We suggest to feedback the parameters with variable feedback rate, and use efficient source coding and codebook to quantize the GR parameters. The variable feedback rate means that the number of bits used to represent the quantized beamforming matrix is based on the value of the matrix itself. And due to the non-uniform distribution of the GR parameters, source coding and code book can be designed to quantize those parameters in a more effective manner. Compared with the fixed feedback rate scheme, the proposed method delivers a better performance without incurring additional feedback bandwidth.