The ideal single photon source and high performance single photon detectors are two key factors that restrict the key security and bit rate in quantum key distribution system. As a single photon source, the weak coherent pulse must contain fewer average photon number for the sake of security, thus the quantum bit rate cannot be raised to a high level. Superconducting transition edge sensor for single photon detection has been introduced. It is proposed that multi-port beam splitter combined with many APDs can be used to detect the photon number in weak coherent pulse in quantum key distribution system. The attack tactics of eavesdropper is analyzed, and based on photon number detection, it is proposed that the average photon number in weak coherent pulse can be improved, thus the quantum key bit rate can be improved.