Practical color-based motion capture

Wang, Robert; Paris, Sylvain

doi:10.1145/2019406.2019425

Cited by 13 publications

(7 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In our work, we proposed to use measurement garment as a better body representation for virtual try-on compared to other body representations used in previous works (e.g., body parts segmentation label). We plan to investigate other measurement garment designs, e.g., more complicated color patterns used in [43,45] or besides the color-coded measurement garment. For example, we would like to optimize a measurement garment given a set of target garments.…”

Section: Limitation and Discussionmentioning

confidence: 99%

Per Garment Capture and Synthesis for Real-time Virtual Try-on

Chong¹,

Shen²,

Umetani³

et al. 2021

Preprint

View full text Add to dashboard Cite

Fig. 1. Our real-time system allows the user to virtually try-on various garments using different interactions, such as stretching the body and pulling the garment. With the proposed per garment and synthesis workflow, the detailed wrinkles are captured and synthesized according to different motions.Virtual try-on is a promising application of computer graphics and human computer interaction that can have a profound real-world impact especially during this pandemic. Existing image-based works try to synthesize a try-on image from a single image of a target garment, but it inherently limits the ability to react to possible interactions. It is difficult to reproduce the change of wrinkles caused by pose and body size change, as well as pulling and stretching of the garment by hand. In this paper, we propose an alternative per garment capture and synthesis workflow to handle such rich interactions by training the model with many systematically captured images. Our workflow is composed of two parts: garment capturing and clothed person image synthesis. We designed an actuated mannequin and an efficient capturing process that collects the detailed deformations of the target garments under diverse body sizes and poses. Furthermore, we proposed to use a custom-designed measurement garment, and we captured paired images of the measurement garment and the target garments. We then learn a mapping between the measurement garment and the target garments using deep image-to-image translation. The customer can then try on the target garments interactively during online shopping. The proposed workflow requires certain manual labor, but we believe that the cost is acceptable given that the retailers are already paying significant costs for hiring professional photographers and models, stylists, and editors to take photographs for promotion. Our method can remove the need of hiring these costly professionals. We evaluated the effectiveness of the proposed system with ablation studies and quality comparison with previous virtual try-on methods. We perform a user study to show our promising virtual try-on

show abstract

Section: Limitation and Discussionmentioning

confidence: 99%

Per Garment Capture and Synthesis for Real-time Virtual Try-on

Chong¹,

Shen²,

Umetani³

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Approaches with markers Color markers or patterns (binary images) are placed on each of the user's fingers (Pamplona et al 2008;Hürst and Wezel 2013). Colored gloves (Dorner 1994;Geebelen et al 2010;Tokatli 2005;Wang 2011) and colored rings solutions (Mistry et al 2009) are based on the color, which becomes the essential information required to follow the hand or finger movements.…”

Section: Techniques and Algorithms Used In Monoscopic Visionmentioning

confidence: 99%

A seamless solution for 3D real-time interaction: design and evaluation

Hernoux

Christmann²

2014

Virtual Reality

View full text Add to dashboard Cite

This paper aims to propose and evaluate a markerless solution for capturing hand movements in real time to allow 3D interactions in virtual environments (VEs). Tools such as keyboard and mice are not enough for interacting in 3D VE; current motion capture systems are expensive and require wearing equipment. We developed a solution to allow more natural interactions with objects and VE for navigation and manipulation tasks. We conducted an experimental study involving 20 participants. The goal was to realize object manipulation (moving, orientation, scaling) and navigation tasks in VE. We compared our solution (Microsoft Kinect-based) with data gloves and magnetic sensors (3DGloves) regarding two criteria: performance and acceptability. Results demonstrate similar performance (precision, execution time) but a better overall acceptability for our solution. Preferences of participants are mostly in favor of the 3DCam, mainly for the criteria of comfort, freedom of movement, and handiness. Our solution can be considered as a real alternative to conventional systems for object manipulation in virtual reality.

show abstract

“…In literature, different applications of tracking algorithm are proposed. One group of researchers are used it for translating the Sign Languages [5,9], other used it for hand gesture recognition [6][7], another group used it for text localization and detection [8,18], tracing full body motion of object for virtual reality [10] and finger tracking based character recognition [19][20][21] etc. Bragatto et.al developed a method which automatically translates the Brazilian Sign Language from video input.…”

Section: Related Workmentioning

confidence: 99%

“…Moreover, in [10] Wang et.al discussed the color based motion capturing system for both indoor and outdoor environments. In their proposed method they used web camera and a color shirt in order to track the object.…”

Section: Related Workmentioning

confidence: 99%

Text writing in the air

Baig

Khan

Beg

2013

Journal of Information Display

View full text Add to dashboard Cite

This paper presents a real time video based pointing method which allows sketching and writing of English text over air in front of mobile camera. Proposed method have two main tasks: first it track the colored finger tip in the video frames and then apply English OCR over plotted images in order to recognize the written characters. Moreover, proposed method provides a natural human-system interaction in such way that it do not require keypad, stylus, pen or glove etc for character input. For the experiments, we have developed an application using OpenCv with JAVA language. We tested the proposed method on Samsung Galaxy3 android mobile. Results show that proposed algorithm gains the average accuracy of 92.083% when tested for different shaped alphabets. [Ref: http://learnrnd.com/news.php?id=Magnetic_3D_Bio_Printing] Here, more than 3000 different shaped characters were used. Our proposed system is the software based approach and relevantly very simple, fast and easy. It does not require sensors or any hardware rather than camera and red tape. Moreover, proposed methodology can be applicable for all disconnected languages but having one issue that it is color sensitive in such a way that existence of any red color in the background before starting the character writing can lead to false results.

show abstract

Practical color-based motion capture

Cited by 13 publications

References 21 publications

Per Garment Capture and Synthesis for Real-time Virtual Try-on

Per Garment Capture and Synthesis for Real-time Virtual Try-on

A seamless solution for 3D real-time interaction: design and evaluation

Text writing in the air

Contact Info

Product

Resources

About