3D sketching for interactive model retrieval in virtual reality

Giunchi, Daniele; James, Stuart; Steed, Anthony

doi:10.1145/3229147.3229166

Cited by 29 publications

(39 citation statements)

References 80 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Arora et al analyzed various factors that could affect the human ability to sketch freely in a 3D VR environment. Giunchi et al presented an approach to search for 3D models based on free‐form sketches within a virtual environment. We notice that semantic understanding of 3D models in VR environments is important.…”

Section: Related Workmentioning

confidence: 99%

Screwing assembly oriented interactive model segmentation in HMD VR environment

Zhu

Song

Wang

et al. 2019

Computer Animation & Virtual

View full text Add to dashboard Cite

Although different approaches of segmenting and assembling geometric models for 3D printing have been proposed, it is difficult to find any research studies, which investigate model segmentation and assembly in head‐mounted display (HMD) virtual reality (VR) environments for 3D printing. In this work, we propose a novel and interactive segmentation method for screwing assembly in the environments to tackle this problem. Our approach divides a large model into semantic parts with a screwing interface for repeated tight assembly. Specifically, after a user places the cutting interface, our algorithm computes the bounding box of the current part automatically for subsequent multicomponent semantic Boolean segmentations. Afterwards, the bolt is positioned with an improved K3M image thinning algorithm and is used for merging paired components with union and subtraction Boolean operations respectively. Moreover, we introduce a swept Boolean‐based rotation collision detection and location method to guarantee a collision‐free screwing assembly. Experiments show that our approach provides a new interactive multicomponent semantic segmentation tool that supports not only repeated installation and disassembly but also tight and aligned assembly.

show abstract

Section: Related Workmentioning

confidence: 99%

Screwing assembly oriented interactive model segmentation in HMD VR environment

Zhu

Song

Wang

et al. 2019

Computer Animation & Virtual

View full text Add to dashboard Cite

show abstract

“…To aid users in the creation of complex 3D designs, existing methods are often supported by a retrieval algorithm capable of finding complex designs based on a simple sketch made by the user by searching a model database. Common approaches can be divided into methods focusing on gestural interaction [14,42] or techniques allowing to freely draw sketches in either 2D [19] or 3D space [20]. Gestural interaction techniques are widely used to execute an action as a trigger mechanism or depict a simple trajectory in the design space.…”

Section: Introductionmentioning

confidence: 99%

“…The reason for this is twofold: (1) the ability for sketch descriptions of an object to adequately express the model, and (2) ability for users to get confidence with the depiction of structural elements. Prior work by Giunchi et al [20] utilized a Multi-View CNN to solve for the first, and introduced on-model sketching in VR for the second. In the same study, Giunchi et alalso performed a detailed study of descriptors for use in 3D model retrieval.…”

Section: Introductionmentioning

confidence: 99%

“…While Giunchi et al [20] showed how a combination of sketch and model improves the user's retrieval query, they only explore a single modality of interaction, i.e., 3D mid-air sketching, and its level of effectiveness. However, it is essential to understand how different interaction methodologies can impact on both user performance and user experience.…”

Section: Introductionmentioning

confidence: 99%

“…• Four methods of Sketch-based Retrieval interaction in VR: -3D Mid-Air Sketching, based on the method of Giunchi et al [20] using mid-air drawing using a controller; -2D Sketching on a VR Tablet, using a 2D tablet within the virtual environment; -2D Sketching on a VR Whiteboard, using a VR plane to annotate the model; -2D Sketching on a physical tablet, using a real world tablet tracked in VR to annotate the model with strokes. • An extensive user study over the four methods identifying the advantages of methods with regards to the user.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Mixing realities for sketch retrieval in Virtual Reality

Giunchi

James

Degraen

et al. 2019

Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry

Self Cite

View full text Add to dashboard Cite

Drawing tools for Virtual Reality (VR) enable users to model 3D designs from within the virtual environment itself. These tools employ sketching and sculpting techniques known from desktopbased interfaces and apply them to hand-based controller interaction. While these techniques allow for mid-air sketching of basic shapes, it remains difficult for users to create detailed and comprehensive 3D models. In our work, we focus on supporting the user in designing the virtual environment around them by enhancing sketch-based interfaces with a supporting system for interactive model retrieval. Through sketching, an immersed user can query a database containing detailed 3D models and replace them into the virtual environment. To understand supportive sketching within a virtual environment, we compare different methods of sketch interaction, i.e., 3D mid-air sketching, 2D sketching on a virtual tablet, 2D sketching on a fixed virtual whiteboard, and 2D sketching on a real tablet. Our results show that 3D mid-air sketching is considered to be a more intuitive method to search a collection of models while the addition of physical devices creates confusion due to the complications of their inclusion within a virtual environment. While we pose our work as a retrieval problem for 3D models of chairs, our results can be extrapolated to other sketching tasks for virtual environments.

show abstract

A Machine Learning Tool to Match 2D Drawings and 3D Objects’ Category for Populating Mockups in VR

Terrier

Martin

2020

Virtual Reality and Augmented Reality

View full text Add to dashboard Cite

3D sketching for interactive model retrieval in virtual reality

Cited by 29 publications

References 80 publications

Screwing assembly oriented interactive model segmentation in HMD VR environment

Screwing assembly oriented interactive model segmentation in HMD VR environment

Mixing realities for sketch retrieval in Virtual Reality

A Machine Learning Tool to Match 2D Drawings and 3D Objects’ Category for Populating Mockups in VR

Contact Info

Product

Resources

About