SpokeIt

Duval, Jared; Rubin, Zachary; Segura, Elena Márquez; Friedman, Natalie; Zlatanov, Milla; Yang, Louise; Kurniawan, Sri

doi:10.1145/3229434.3229484

Cited by 30 publications

(39 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Speech Adventure is a game for dyslexic children that is intended to be played for about ten minutes a day. Players are encouraged to give a slug commands for daily tasks by reading them out loud [46]. This is a game predominantly focused on tasks that could be understood as a game environment to the purpose with comparatively fewer 'game' elements.…”

Section: Genresmentioning

confidence: 99%

The Purpose of Play

Spiel

Gerling

2021

ACM Trans. Comput.-Hum. Interact.

116

View full text Add to dashboard Cite

Play presents a popular pastime for all humans, though not all humans play alike. Subsequently, Human–Computer Interaction Games research is increasingly concerned with the development of games that serve neurodivergent 1 players. In a critical review of 66 publications informed by Disability Studies and Self-Determination Theory, we analyse which populations , research methods, kinds of play and overall purpose goals existing games address. We find that games are largely developed for children, in a top-down approach. They tend to focus on educational and medical settings and are driven by factors extrinsic to neurodivergent interests. Existing work predominantly follows a medical model of disability, which fails to support self-determination of neurodivergent players and marginalises their opportunities for immersion. Our contribution comprises a large-scale investigation into a budding area of research gaining traction with the intent to capture a status quo and identify opportunities for future work attending to differences without articulating them as deficit.

show abstract

Section: Genresmentioning

confidence: 99%

The Purpose of Play

Spiel

Gerling

2021

ACM Trans. Comput.-Hum. Interact.

116

View full text Add to dashboard Cite

show abstract

“…In another similar study, Ramamurthy et al proposed a therapy robot, "Buddy," allowing children to practice assigned exercises at home (Ramamurthy & Li, 2018). Many studies have incorporated serious games as an intervention tool for automatic speech therapy (Anjos et al, 2017;Bílková et al, 2020;Duval, 2020;Duval et al, 2018;Ramamurthy & Li, 2018). One of the studies incorporated augmented reality to build a serious game using tongue detection (Bílková et al, 2020).…”

Section: Modes Of Intervention (Rq3)mentioning

confidence: 99%

AI-Based Automated Speech Therapy Tools for persons with Speech Sound Disorders: A Systematic Literature Review

Deka,

Shrivastava,

Abraham

et al. 2024

Preprint

View full text Add to dashboard Cite

This paper presents a systematic literature review of published studies on AI-based automated speech therapy tools for persons with speech sound disorders (SSD). The COVID-19 pandemic has initiated the requirement for automated speech therapy tools for persons with SSD making speech therapy accessible and affordable. However, there are no guidelines for designing such automated tools and their required degree of automation compared to the conventional speech therapy given by Speech Language Pathologists (SLPs). In this systematic review, we followed the PRISMA framework to address four research questions: 1) what types of SSD do AI-based automated speech therapy tools address, 2) what is the level of autonomy achieved by such tools, 3) what are the different modes of intervention, and 4) how effective are such tools in comparison with the conventional mode of speech therapy. An extensive search was conducted on digital libraries to find research papers relevant to our study from 2007 to 2022. The results show that AI-based automated speech therapy tools for persons with SSD are increasingly gaining attention among researchers. Articulation disorders were the most frequently addressed SSD based on the reviewed papers. Further, our analysis shows that most researchers proposed fully automated tools without considering the role of other stakeholders. Our review indicates that mobile-based and gamified applications were the most frequent mode of intervention. The results further show that only a few studies compared the effectiveness of such tools compared to the conventional mode of speech therapy. Our paper presents the state-of-the-art in the field, contributes significant insights based on the research questions, and provides suggestions for future research directions.

show abstract

“…Text entry [9,38,67,71,82,85,93] Application control [22,90,92] Speech analysis [26,36,52,68,72] Spoken output [28,31,66,77] Conversational Agents [33,43,45,48,55,61,96] Probes [18,74] Domains Education [22,43,52,61,68,77] Health & Well-being [26,28,36,71,72,92,94] Transportation [33,38,55,67,90] Gaming [18,26,36,52,66,…”

Section: References Themesmentioning

confidence: 99%

“…On displaying this to the remote therapist, they were able to assign or design speech exercises for the children based on their specific difficulties. SpokeIt [26] by Duval et al is another speech therapy game, capable of providing real-time feedback to help children with speech impairments. The goal was to detect miss-pronunciation, and to that end, they used a custom dictionary in Pocketsphinx [41] encoded with common miss-pronunciations of the words in the training exercises which were then able to be analysed and presented to therapists or parents.…”

Section: Speech Analysismentioning

confidence: 99%

“…A software agent calls the player to help them, a game mechanic that could be incorporated with any number of narrative driven games. By building upon mechanics of vocal analysis such as those used in the Karaoke game SLIONS [68] or the various speech therapy tools [26,36] (which naturally lend themselves to personalised models on a personal device) in combination with the more complex text-to-speech generation provides opportunities for more complex, deeper, and emotive interactions through CUIs motivated by gaming principles and narratives.…”

Section: Gamesmentioning

confidence: 99%

See 1 more Smart Citation

Conversational User Interfaces on Mobile Devices

Jaber

2020

Proceedings of the 2nd Conference on Conversational User Interfaces

View full text Add to dashboard Cite

Conversational User Interfaces (CUI) on mobile devices are the most accessible and widespread examples of voice-based interaction in the wild. This paper presents a survey of mobile conversation user interface research since the commercial deployment of Apple's Siri, the first readily available consumer CUI. We present and discuss Text Entry & Typing, Application Control, Speech Analysis, Conversational Agents, Spoken Output, & Probes as the prevalent themes of research in this area. We also discuss this body of work in relation to the domains of Health & Well-being, Education, Games, and Transportation. We conclude this paper with a discussion on Multi-modal CUIs, Conversational Repair, and the implications for CUIs of greater access to the context of use. CCS CONCEPTS• Computing methodologies → Speech recognition; • Humancentered computing → Interaction techniques; Smartphones; • General and reference → Surveys and overviews.

show abstract

SpokeIt

Cited by 30 publications

References 36 publications

The Purpose of Play

The Purpose of Play

AI-Based Automated Speech Therapy Tools for persons with Speech Sound Disorders: A Systematic Literature Review

Conversational User Interfaces on Mobile Devices

Contact Info

Product

Resources

About