Two new recursive procedures for extracting discriminant features, termed Recursive Modified Linear Discriminant (RMLD) and Recursive Cluster-based Linear Discriminant (RCLD) are proposed in this paper. The two new methods, RMLD and RCLD overcome two major shortcomings of Fisher Linear Discriminant (FLD): it can fully exploit all information available for discrimination; and it removes the constraint on the total number of features that can be extracted. Experiments of comparing the new algorithm with the traditional FLD and some of its variations have been carried out on various types of face recognition problems for Yale database, in which the resulting improvement of the performances by the new feature extraction scheme is significant.