Fluid Reconstruction and Editing from a Monocular Video based on the SPH Model with External Force Guidance

Abstract

We specifically present a general method for monocular fluid videos to reconstruct and edit 3D fluid volume. Although researchers have developed many monocular video-based methods, the reconstructed results are merely one layer of geometry surface, lack of accurate physical attributes of fluids, and challenging to edit fluid. We obtain a high-quality 3D fluid volume by extending the smoothed particle hydrodynamics (SPH) model with external force guidance. For reconstructing fluid, we design target particles that are recovered from the shape from shading (SFS) method and initialize fluid particles that are spatially consistent with target particles. For editing fluid, we translate the deformation of target particles into the 3D fluid volume by merging user-specified features of interest. Separating the low-and high-frequency height field allows us to efficiently solve the motion equations for a liquid while retaining enough details to obtain realistic-looking behaviours. Our experimental results compare favourably to the state-of-the-art in terms of global fluid volume motion features and fluid surface details and demonstrate our model can achieve desirable and pleasing effects.

Comparison of Schlieren-based techniques for measurements of a turbulent and wavy free surface

“…This method was labelled 'free-surface synthetic Schlieren' (FS-SS) and has since been used for various applications (Li et al, 2021;Mandel et al, 2017Mandel et al, , 2019Paquier et al, 2015;Pathommapas et al, 2019;Wildeman, 2018). Shape from shading (SFS) has also been used for the reconstruction of water surfaces, wherein the gradual variation in shading is used to recover the shape of the features of interest (Chaudhari et al, 2014;Nie et al, 2021;Pickup et al, 2011).…”