Real-Time Hallucination Simulation and Sonification through User-Led Development of an iPad Augmented Reality Performance

Abstract

The simulation of visual hallucinations has multiple applications. We present a new approach to hallucination simulation, developed initially for a performance but which proved to have uses to sufferers of certain types of hallucinations. The system allows real-time visual expression, using iPad augmented reality. The system was developed focusing on the visual symptoms of Palinopsia, experienced by the first author. It also allows the hallucinations to be converted into sound through visual sonification. Although no formal experimentation was, we report on a number of unsolicited informal responses to the simulator from palinopsia sufferers and a charity.

Potential Applications of Digital Technology in Assessment, Treatment, and Self-help for Hallucinations

“…An example from a nonhealth literature involved developing a tablet-computer augmented reality simulation of palinopsia, a visual disturbance common in neurological disorders involving persisting afterimages of objects in the visual field. 93 This “Halluciphone” application was co-developed by a musician as a performance arts work, but with a view to broader use as a communicative tool. Anecdotal reports in the article of persons with palinopsia suggested that it had value in helping persons with this experience understand it and communicate it to others.…”

“…Anecdotal reports in the article of persons with palinopsia suggested that it had value in helping persons with this experience understand it and communicate it to others. 93 Another visual hallucination simulation that has been described is the “Hallucination Machine” which uses panoramic virtual reality to present distortions resembling those experienced during use of hallucinogens, 94 but its clinical applications have not been considered. The development of virtual or augmented reality representations of complex hallucinations is more difficult due to technological limitations in the extent of realism that can be achieved particularly with hallucinations in human or animal form.…”