As the technology develops, people looks forward more on Speech analysis for Speaker Recognition. A large multichannel corpus, including mobile phone, mobile phone headset, laptop microphone and laptop headset, is collected to evaluate the system performance. Also, a comparative study among wavelet packets and DWT on a gender based Speaker recognition database is evaluated in this paper. This work is carried out with a database of four hundred and eighty samples. Speech samples were collected through multi channels devices such as laptop microphone and mobile head set. The speech data used in this work is commonly used for banking purpose such as name of the person, Account Number, Password and two security questions. A neural network Classifier is used for classification.