Facial reshaping operator for controllable face beautification

Abstract

Posting attractive facial photos is part of everyday life in the social media era.Motivated by the demand, we propose a lightweight method to automatically and efficiently beautify the shapes of both portrait and non-portrait faces in photos, while allowing users to customize the beautification of individual facial features. Previous methods focus on the beautification of mostly frontal and neutral faces, without incorporating user controllability in the beautification process. To address these restrictions, we propose the Facial Reshaping Operator representation, which is affine-invariant, captures the pairwise geometric configuration of facial landmarks, and allows for efficient face beautification with the user-specified weights of individual facial parts. We also propose an unsupervised beautification method in the operator space of faces, where an input face is iteratively pulled towards a local nearby density mode with improved attractiveness. Our method distinguishes itself from the commercial beautification tools in that it mildly enhances facial shapes without altering makeups or complexions, which complements these tools that lack fine-grained control on the attractiveness of facial shapes for users. The experimental results show that our method improves facial shape attractiveness for a large range of poses and

A comprehensive survey on semantic facial attribute editing using generative adversarial networks

“…Sketch-to-photo conversion is a common example of these applications where the input domain is the black and white sketches from faces and the goal is to convert the input sketch to a colorful realistic face photo. Sketch to photo translation can be used in criminal tracking and mobile-app entertainment [62,133]. Another form of faceto-face translation is image colorizing which takes a grayscale image as input and converts it into a colorized image that reflects the input's semantic colors and tones [50,129].…”

Face Database Protection via Beautification with Chaotic Systems

“…Users can perform appropriate face beautification before posting selfies on social networks. Unlike makeup that focuses on rendering eye shadow and lip gloss intensely, face beautification [ 13 , 14 , 15 ] aims at removing skin imperfections and fine-tuning facial features. As a result, appropriate beautification is more acceptable to users as it preserves their natural appearance.…”