Dyna

Pons-Moll, Gerard; Romero, Javier; Mahmood, Naureen; Black, Michael J.

doi:10.1145/2766993

Cited by 265 publications

(33 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Monocular depth cameras provide additional information and have been shown to aid robust skeletal tracking [Ganapathi et al 2012;Ma and Wu 2014;Shotton et al 2013;Taylor et al , 2012 and enable dense surface reconstruction even under deformation [Dou et al 2016;Newcombe et al 2015;Zollhöfer et al 2014]. Multiple, specialized structured light scanners can be used to capture high-fidelity dense surface reconstructions of humans [Pons-Moll et al 2015].…”

Section: Related Workmentioning

confidence: 99%

Deformation Capture via Soft and Stretchable Sensor Arrays

et al. 2019

View full text Add to dashboard Cite

Fig. 1. Left to right: We propose a method for the fabrication of soft and stretchable silicone based capacitive sensor arrays. The sensor provides dense stretch measurements that, together with a data-driven prior, allow for the capture of surface deformations in real-time and without the need for line-of-sight.We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line of sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments, and design a prototype of wearable wrist, elbow and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.

show abstract

Section: Related Workmentioning

confidence: 99%

Deformation Capture via Soft and Stretchable Sensor Arrays

et al. 2019

View full text Add to dashboard Cite

show abstract

“…The markerless methods generally track changes in a 3D model between consecutive frames. The model can consist of elementary geometric shapes [14,15], be created during an initialization step [16,17], or alternatively be a generative body model [18,19,20] fitted to the observations.…”

Section: Related Workmentioning

confidence: 99%

A Motion Capture System for Sport Performance Analysis Based on Inexpensive RGB-D Sensors

André¹,

Lemaître²,

Voiry³

et al. 2019

Proceedings of 3DBODY.TECH 2019 - 10th International Conference and Exhibition on 3D Body Scanning and Processing Technologies,

View full text Add to dashboard Cite

Motion capture for gesture and performance analysis in sports usually requires tracking of several anatomical landmarks with high spatial accuracy and sampling frequency. In addition, a model of the outer surface of the body can also be useful, e.g. for aerodynamic studies. In this context, we developed a motion capture system based on four inexpensive commercial RGB-D cameras. Our system produces both skeletal poses and 3D meshes of moving human bodies at high frequency with good accuracy.

show abstract

“…Fast models for real-time applications rely on combining linear blend shapes [19], rotation regression [6] or helper-bone rigs that have proven useful for delivering effects such as muscle bulging [5,20]. Another exciting strand of current research is learning dynamics from data, either using statistical methods [21] or by combining statistical methods with physics-based simulation [22].The most recent work [22] is starting to show promise of being able to generalize to imaginary artist-designed characters. Nonetheless, capture-based methods are generally limited by the availability of real-world human subjects.…”

Section: Related Workmentioning

confidence: 99%

Dynamic implicit muscles for character skinning

Roussellet

Rumman

Canezin

et al. 2018

Computers & Graphics

View full text Add to dashboard Cite

Most current methods for character skinning can be categorized into 1) geometric techniques, which are fast and easy to use but often lack physical realism, 2) data-driven approaches, which require a large set of examples that are tedious to edit, and 3) physics-based methods, which are highly realistic but slow and difficult to use. Recently introduced geometric Implicit Skinning methods can solve contact interactions and skin elasticity with results comparable to physics-based simulation in real-time. In this paper we introduce an animation method that adds anatomical plausibility while benefiting from the advantages of Implicit Skinning. We propose an efficient way to model muscle primitives with implicit surfaces. Volumetric extrusions of individual muscles are attached to muscle center lines simulated with a fast, low-dimensional physics-based approach (Position Based Dynamics of one-dimensional line segments). This combination of physics-based simulation with implicit modeling allows us to elegantly resolve muscle-muscle and muscle-bone collisions and add dynamic effects such as flesh jiggling while guaranteeing volume preservation (which is a property of real biological muscles) and producing visually plausible skin-skin contact behavior. Our method runs at interactive frame-rates and features intuitive modeling parameters which allow animators to quickly explore a variety of designs and physics-based effects.

show abstract

Dyna

Cited by 265 publications

References 44 publications

Deformation Capture via Soft and Stretchable Sensor Arrays

Deformation Capture via Soft and Stretchable Sensor Arrays

A Motion Capture System for Sport Performance Analysis Based on Inexpensive RGB-D Sensors

Dynamic implicit muscles for character skinning

Contact Info

Product

Resources

About