Fried chicken Cupcake Pineapple Strawberry Moon Cookie Orange Watermelon Soccer Basketball Class-conditioned Outline-to-Image Translation Interactive Sketch & FillFigure 1: (Top) Given a user created incomplete object outline (first row), our model estimates the complete shape and provides this as a recommendation to the user (shown in gray), along with the final synthesized object (second row). These estimates are updated as the user adds (green) or removes (red) strokes over time -previous edits are shown in black.(Bottom) This generation is class-conditioned, and our method is able to generate distinct multiple objects for the same outline (e.g. 'circle') by conditioning the generator on the object category.
AbstractWe propose an interactive GAN-based sketch-to-image translation method that helps novice users create images of simple objects. As the user starts to draw a sketch of a desired object type, the network interactively recommends plausible completions, and shows a corresponding synthesized image to the user. This enables a feedback loop, where the user can edit their sketch based on the network's recommendations, visualizing both the completed shape and final rendered image while they draw. In order to use a single trained model across a wide array of object classes, we introduce a gating-based approach for class conditioning, which allows us to generate distinct classes without feature mixing, from a single generator network.