COVID-19 is an ongoing pandemic, and according to experts, using a face mask can reduce the spread of the disease. On the other hand, masks cause occlusion in faces and can create safety problems such as the recognition of the face and the estimation of its age. To prevent the spread of COVID-19, some countries have restrictions according to age groups. Also, in different countries, people in some age groups have safety restrictions such as driving and consuming alcohol, etc. But these rules are difficult to follow due to occlusion in faces. Automated systems can assist in monitoring these rules. In this study, a deep learning-based automated multi-task face detection and age group classification system is proposed for masked faces. The system first detects masked/no-masked-faces. Then, it classifies them according to age-groups. It works for multi-person regardless of indoor/outdoor environment. The system achieved 92.0% average precision score for masked face detection using YOLO with resnet50 network. Also, 83.87% accuracy for classifying age groups with masked faces and 84.48% accuracy for nomasked faces using densenet201 network have been observed. It produced better results compared to the literature. The results are significant because they show that a reliable age classification for masked faces is possible.