Automatic age group classification is the ability of an algorithm to classify face images into predetermined age groups. It is an important task due to its numerous applications such as monitoring, biometrics and commercial profiling. In this work we propose a fusion technique that combines CNN-and COSFIRE-based features for the recognition of age groups from face images. Both CNN and COSFIRE are trainable approaches that have been demonstrated to be effective in various computer vision applications. As to CNN, we use the pre-trained VGG-Face architecture and for COSFIRE we configure new COSFIRE filters from training data. Since recent literature suggests that CNNs deliver the highest accuracy rates within such problems, the hypothesis which we want to investigate in this work is whether combining CNN and COSFIRE approaches together will improve results. The proposed fusion technique using stacked Support Vector Machine (SVM) classifiers, and trained and tested with the FERET data set images has shown that, indeed, CNN-and COSFIRE-based features are complimentary as their combination reduces the error rate by more than 25%.