One of the main steps in human identification is gender classification which can increase the identification accuracy. In many smart phone applications, human identification plays an important role in different reasons such as login permission, sign up certificates, etc. So, accurate gender classification algorithms may increase the accuracy of smart phone applications and reduce its complexity. Also, one of the benefits of gender classification algorithms is for parents to monitor the social network contacts of their child in terms of gender. Different methods have been proposed to do it accurately so far. In all methods, classification accuracy is the main challenge for researchers. But, in smart phone applications, some challenges such as rotation, gray scale variations may reduce the accuracy. In this respect, a rotation invariant approach is proposed in this paper to classify genders in human face images based on improved version of local binary patters (ILBP). Local binary pattern (LBP) is a texture descriptor, which extract local contrast and spatial structure information. Some issues such as noise sensitivity, rotation sensitivity and low discriminative features can be considered as disadvantages of the basic LBP. ILBP solves the above disadvantages using a new theory for binary patterns categorization. The proposed approach includes two stages. First of all, a feature vector is extracted for human face images based on ILBP. Next, Kullback-Leibler divergence classifier is used to classify gender. In this paper Kullback Leibler classifier is evaluated based on log likelihood ratio as distance measure. In the result part, two databases, self-collected and ICPR are used as human face database. Results are compared by different well known methods in this literature that shows the high quality of the proposed approach in terms of accuracy rate. Other main advantages of our approach are rotation invariant, low noise sensitivity, size invariant and low computational complexity. The proposed approach decreases the computational complexity of smartphone applications because of reducing the number of database comparisons. It can also improve performance of the synchronous applications in the smartphones because of memory and CPU usage reduction.