Real‐Time Oil Painting on Mobile Hardware

Abstract

This paper presents a realistic digital oil painting system, specifically targeted at the real‐time performance on highly resource‐constrained portable hardware such as tablets and iPads. To effectively use the limited computing power, we develop an efficient adaptation of the shallow water equations that models all the characteristic properties of oil paint. The pigments are stored in a multi‐layered structure to model the peculiar nature of pigment mixing in oil paint. The user experience ranges from thick shape‐retaining strokes to runny diluted paint that reacts naturally to the gravity set by tablet orientation. Finally, the paint is rendered in real time using a combination of carefully chosen efficient rendering techniques. The virtual lighting adapts to the tablet orientation, or alternatively, the front‐facing camera captures the lighting environment, which leads to a truly immersive user experience. Our proposed features are evaluated via a user study. In our experience, our system enables artists to quickly try out ideas and compositions anywhere when inspiration strikes, in a truly ubiquitous way. They do not need to carry expensive and messy oil paint supplies.

Simulation of Dendritic Painting

“…Chen et al [CKIW15] propose a hybrid fluid simulation model combining FLIP for the paint near the brush, and an Eulerian representation in the other areas. Stuyck et al [SDHD16], on the other hand, propose an oil painting model for mobile devices based on the shallow water equations modified to suit this type of paint.…”

Reaction-diffusion Woodcuts

“…Since the early work of Haeberli (HAEBERLI, 1990), with the computational simulation of a painting, this area of research has seen major advances, being able to convincingly simulate natural media effects such as pencil drawing (LU; XU; JIA, 2012), oil painting in real-time and on mobile devices (STUYCK et al, 2017), watercolors (DI-VERDI et al, 2013) (WANG et al, 2014, among many others. Hegde, Gatzidis, and Tian present a review of these artistic inspired results in (HEGDE; GATZIDIS; TIAN, 2013).…”

Real-time viscous thin films

“…In recent years, GPUs have become an important tool for more efficient computations in many applications, including in fluid simulation [Goswami et al 2010;Harris 2005;Navarro-Hinojosa et al 2018]. Furthermore, such interactive fluid simulations can now run on mobile devices [Harwood and Revell 2018], enabling the user to control the simulation in real-time, for instance via the touch interface, [Chen et al 2015;Stuyck et al 2017]. Nevertheless, and to the best of our knowledge, there do not currently exist real time fluid simulators that are capable of generating the viscous thin film effects that we demonstrate.…”