Integration of Virtual Reality, 3-D Eye-Tracking, and Protocol Analysis for Re-Designing Street Space

Zhang, Le Min; Jeng, Taysheng; Zhang, Ruo Xi

doi:10.52842/conf.caadria.2018.1.431

Cited by 12 publications

(2 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The actual impact of these complex design decisions has been challenging to assess (Farahi 2018;Shemesh et al 2016) from both quantitative and qualitative standpoints, as neural empathic responses, defined in this paper by feature indexes (FIs) and mind indexes (MIs), are highly subjective experiences (Barrett 2018). With the recent advances in the fields of virtual procedural environments (VPEs) and virtual reality (VR), supported by increasingly powerful game engine (GE) technologies, computational designers are provided with a new set of design instruments that, when combined with newly integrated brain-computing interfacing (BCI) and eye-tracking (E-T) hardware (Zhang, Jeng, and Zhang 2018), can be used to assess complex empathic reactions (Davidson 2004).…”

Section: Introduction Background Researchmentioning

confidence: 99%

Affective Computing for Generating Virtual Procedural Environments Using Game Technologies

Barsan-Pipu,

Hirth,

Sleiman

et al. 2020

Proceedings of the 40th Annual Conference of the Association of Computer Aided Design in Architecture (ACADIA)

View full text Add to dashboard Cite

Architects have long sought to create spaces that can relate to or even induce specific emotional conditions in their users, such as states of relaxation or engagement. Dynamic or calming qualities were given to these spaces by controlling form, perspective, lighting, color, and materiality. The actual impact of these complex design decisions has been challenging to assess, from both quantitative and qualitative standpoints, because neural empathic responses, defined in this paper by feature indexes (FIs) and mind indexes (MIs), are highly subjective experiences. Recent advances in the fields of virtual procedural environments (VPEs) and virtual reality (VR), supported by powerful game engine (GE) technologies, provide computational designers with a new set of design instruments that, when combined with brain-computing interfacing (BCI) and eye-tracking (E-T) hardware, can be used to assess complex empathic reactions. As the COVID-19 health crisis showed, virtual social interaction becomes increasingly relevant, and the social catalytic potential of VPEs can open new design possibilities. The research presented in this paper introduces the cyber-physical design of such an affective computing system. It focuses on how relevant empathic data can be acquired in real time by exposing subjects within a dynamic VR-based VPE and assessing their emotional responses while controlling the actual generative parameters via a live feedback loop. A combination of VR, BCI, and E-T solutions integrated within a GE is proposed and discussed. By using a VPE inside a BCI system that can be accurately correlated with E-T, this paper proposes to identify potential morphological and lighting factors that either alone or combined can have an empathic effect expressed by the relevant responses of the MIs.

show abstract

Section: Introduction Background Researchmentioning

confidence: 99%

Affective Computing for Generating Virtual Procedural Environments Using Game Technologies

Barsan-Pipu,

Hirth,

Sleiman

et al. 2020

Proceedings of the 40th Annual Conference of the Association of Computer Aided Design in Architecture (ACADIA)

View full text Add to dashboard Cite

show abstract

“…Even with the delay between conception and visualization and the necessary abstraction that early VR required, spatial aspects of the design, like order and proportion, benefitted from the ability to "walk-through" the model (Campbell & Wells 2001). The evolution of the VR hardware and the software link it to digital modelling tools has greatly enhanced the experimental capacity of VR in the design process, and more recent design studio implementations have incorporated additional objectives or technologies such as agent-based modeling (Huang et al 2018) and biometric feedback (Zhang et al 2018). Examples below describe VR implementation as an expansion of the design process through conception, data visualization, and fabrication.…”

Section: Introductionmentioning

confidence: 99%

Experimental Applications of Virtual Reality in Design Education

Bartosh¹,

Anzalone²

2019

ACADIA Proceedings

View full text Add to dashboard Cite

By introducing rapid reproduction, algorithms, and complex formal configurations, the digital era of architecture began a revolution. Architects incorporated the computational capacity of the computer into the design process both as a tool and as a critical component of the theories and practice of architecture as a whole. As we move into what has been coined "the second digital turn," a period in which digital integration is considered ubiquitous, how can we consider, prepare, and propel towards the next technological innovation to significantly inform design thinking, representation, and manifestation? What tools are available to investigate this speculative design future and how can they be implemented?If the integration of technology in architecture is now a given, perhaps the next digital design era is not just digital but virtual. As new technologies emerge the potential for integrating the virtual design world with our physical senses affords novel possibilities for interactive design, simulation, analysis and construction. Hybrid reality technologies, including virtual reality (VR) and augmented reality (AR), embody the potential to supersede conventional representation methodologies such as drawing, rendering, physical modeling, and animation. As they become increasingly pervasive, they will transform how we communicate ideas and data as spatial concepts. Further, they will reform the construct of the built environment when applied to both materiality and fabrication. This paper will describe the incorporation of VR as a tool in various classroom and laboratory settings, recognize the educational outcomes of this incorporation, and identify the potential relationship of these technologies to future academic exploration and application to practice.

show abstract

Artificial Intelligence Applied to Brain-Computer Interfacing with Eye-Tracking for Computer-Aided Conceptual Architectural Design in Virtual Reality Using Neurofeedback

Barsan-Pipu

2019

Proceedings of the 2019 DigitalFUTURES

View full text Add to dashboard Cite

Integration of Virtual Reality, 3-D Eye-Tracking, and Protocol Analysis for Re-Designing Street Space

Cited by 12 publications

References 4 publications

Affective Computing for Generating Virtual Procedural Environments Using Game Technologies

Affective Computing for Generating Virtual Procedural Environments Using Game Technologies

Experimental Applications of Virtual Reality in Design Education

Artificial Intelligence Applied to Brain-Computer Interfacing with Eye-Tracking for Computer-Aided Conceptual Architectural Design in Virtual Reality Using Neurofeedback

Contact Info

Product

Resources

About