Development of a Communication Aid App with iOS Devices to Support Children/Persons with Speech Disabilities Improvement in Obtaining Positioning Information with iBeacon as Near Field Radio Communication Technology

Karita, Tomonori

doi:10.20965/jaciii.2017.p0371

Cited by 7 publications

(15 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Among the location and environment data-sensing technologies that were used, the app had relatively the lowest performance in detecting and transmitting iBeacon data. Although relatively higher, a previous study on the use of the iBeacon system in Friendly VOCA showed the same result [7]. This trend emphasizes the possible problem with the placement of iBeacon devices and not the mobile apps developed.…”

Section: App Server/api Performancesupporting

confidence: 54%

“…In 2017, Karita [7] developed Friendly VOCA, a user-friendly VOCA iOS mobile app that enables children and individuals with speech and/or intellectual disabilities to communicate with other people independently. Unlike other available VOCAs, Friendly VOCA has the ability to automatically switch displays or interfaces that match the user's location at a specific time [7]. To achieve this, Friendly VOCA uses GPS technology to identify the user's current outdoor location in terms of map coordinates (latitude and longitude).…”

Section: Prior Workmentioning

confidence: 99%

“…These two combined systems have helped Friendly VOCA to switch interfaces, which are displayed automatically depending on the user's location at a specific time. Both the GPS and iBeacon systems have been tested, and experiments revealed that they can automatically show appropriate interfaces and displays that correspond to users' locations with 100% and 71% accuracy, respectively [7].…”

Section: Prior Workmentioning

confidence: 99%

“…Scripts are the organized set or body of our basic background knowledge or "schema" that we must have to understand how we respond or behave appropriately to a particular situation or location [8]. This theory was used to structure the schema of Friendly VOCA on specific scripts in the form of varied displays and interfaces tailored to a specific situation (eg, class or playtime), location (eg, classroom, playground, home), and time (eg, morning, lunch breaks, evening) using the GPS and iBeacon systems [7].…”

Section: Script Theory and Location Datamentioning

confidence: 99%

“…This will help in identifying the method or design of the system that will be further developed in the future. This study is exploratory in the context of testing the app's server/API performance in detecting and transmitting environmental data using the sensors, API, and outdoor location (GPS), but not the use of the iBeacon system for indoor location due to the relatively low server/API performance rate of iBeacon based on a previous experiment [7]. According to previous literature, we hypothesized that the children's behavior will mainly involve head, face, or upper limb movements.…”

Section: Goals and Hypotheses Of This Studymentioning

confidence: 99%

See 4 more Smart Citations

Integrating Behavior of Children with Profound Intellectual, Multiple, or Severe Motor Disabilities With Location and Environment Data Sensors for Independent Communication and Mobility: App Development and Pilot Testing

Herbuela¹,

Karita²,

Furukawa³

et al. 2021

JMIR Rehabil Assist Technol

Self Cite

View full text Add to dashboard Cite

Background Children with profound intellectual and multiple disabilities (PIMD) or severe motor and intellectual disabilities (SMID) only communicate through movements, vocalizations, body postures, muscle tensions, or facial expressions on a pre- or protosymbolic level. Yet, to the best of our knowledge, there are few systems developed to specifically aid in categorizing and interpreting behaviors of children with PIMD or SMID to facilitate independent communication and mobility. Further, environmental data such as weather variables were found to have associations with human affects and behaviors among typically developing children; however, studies involving children with neurological functioning impairments that affect communication or those who have physical and/or motor disabilities are unexpectedly scarce. Objective This paper describes the design and development of the ChildSIDE app, which collects and transmits data associated with children’s behaviors, and linked location and environment information collected from data sources (GPS, iBeacon device, ALPS Sensor, and OpenWeatherMap application programming interface [API]) to the database. The aims of this study were to measure and compare the server/API performance of the app in detecting and transmitting environment data from the data sources to the database, and to categorize the movements associated with each behavior data as the basis for future development and analyses. Methods This study utilized a cross-sectional observational design by performing multiple single-subject face-to-face and video-recorded sessions among purposively sampled child-caregiver dyads (children diagnosed with PIMD/SMID, or severe or profound intellectual disability and their primary caregivers) from September 2019 to February 2020. To measure the server/API performance of the app in detecting and transmitting data from data sources to the database, frequency distribution and percentages of 31 location and environment data parameters were computed and compared. To categorize which body parts or movements were involved in each behavior, the interrater agreement κ statistic was used. Results The study comprised 150 sessions involving 20 child-caregiver dyads. The app collected 371 individual behavior data, 327 of which had associated location and environment data from data collection sources. The analyses revealed that ChildSIDE had a server/API performance >93% in detecting and transmitting outdoor location (GPS) and environment data (ALPS sensors, OpenWeatherMap API), whereas the performance with iBeacon data was lower (82.3%). Behaviors were manifested mainly through hand (22.8%) and body movements (27.7%), and vocalizations (21.6%). Conclusions The ChildSIDE app is an effective tool in collecting the behavior data of children with PIMD/SMID. The app showed high server/API performance in detecting outdoor location and environment data from sensors and an online API to the database with a performance rate above 93%. The results of the analysis and categorization of behaviors suggest a need for a system that uses motion capture and trajectory analyses for developing machine- or deep-learning algorithms to predict the needs of children with PIMD/SMID in the future.

show abstract

Section: App Server/api Performancesupporting

confidence: 54%

Section: Prior Workmentioning

confidence: 99%

Section: Prior Workmentioning

confidence: 99%

Section: Script Theory and Location Datamentioning

confidence: 99%

Section: Goals and Hypotheses Of This Studymentioning

confidence: 99%

See 3 more Smart Citations

Integrating Behavior of Children with Profound Intellectual, Multiple, or Severe Motor Disabilities With Location and Environment Data Sensors for Independent Communication and Mobility: App Development and Pilot Testing

Herbuela¹,

Karita²,

Furukawa³

et al. 2021

JMIR Rehabil Assist Technol

Self Cite

View full text Add to dashboard Cite

show abstract

Designing electronic graphic symbol-based AAC systems: a scoping review. Part 1: system description

Tonsing

Bartram

Morwane

et al. 2022

Disability and Rehabilitation: Assistive Technology

View full text Add to dashboard Cite

This is the first of two papers summarising studies reporting on the design of electronic graphic symbol-based augmentative and alternative communication (AAC) systems, in order to determine the state of the field. The aim of this paper was to provide an overview of the general characteristics of the studies and to describe the features of the systems designed.Methods: A scoping review was conducted. A multifaceted search resulted in the identification of 28 studies meeting the selection criteria. Data was extracted relating to four areas of interest, namely (1) the general characteristics of the studies, (2) features of the systems designed, (3) availability of the systems to the public, and (4) the design processes followed. In this paper, findings relating to the first three areas are presented.Results: Most study authors were affiliated to fields of engineering and/or computer science and came from high-income countries. Most studies reported the design of AAC applications loaded onto mobile technology devices. Common system features included customisable vocabulary items, the inclusion of graphic symbols from both established AAC libraries and other sources, a dynamic grid display, and the inclusion of digital and/or synthetic speech output. Few systems were available to the public. Conclusions:Limited justifications for many of the complex design decisions were provided in the studies, possibly due to limited involvement of rehabilitation professionals during the design process. Furthermore, few studies reported on the design of graphic symbol-based AAC systems specifically for middle-and low-income contexts and also for multilingual populations.

show abstract

Designing electronic graphic symbol-based AAC systems: a scoping review. Part 2: application of human-centred design

Tonsing

Bartram

Morwane

et al. 2022

Disability and Rehabilitation: Assistive Technology

View full text Add to dashboard Cite

Purpose: This is the second of two papers summarising studies reporting on the design of electronic graphic symbol-based augmentative and alternative communication (AAC) systems. The aim of this paper was to describe the design approaches used, and to determine to what extent the principles of human-centred design (HCD) were reflected in the design approaches and processes used.Methods: A scoping review was conducted. A multifaceted search resulted in the identification of 28 studies meeting the selection criteria. Data was extracted relating to four areas of interest, namely (1) the general characteristics of the studies, (2) features of the systems designed, (3) availability of the systems to the public, and (4) the design processes followed. In this paper, findings related to the last area are presented.Results: Design approaches were often inconsistently described. User-centred design was mentioned more often than HCD. Even so, various HCD principles were considered in most studies. Notably, stakeholders were involved in the design process in all studies. However, users were not involved in all studies and stakeholder roles were predominantly informative rather than collaborative. Prototype and product evaluations focused mostly on usability rather than user experience. Although many design teams were multidisciplinary, engineers and computer scientists predominated. Conclusions:There is a need for designers to be more transparent about the type of design approach used to guide the system design and also to clearly report on design approaches and processes used. The application of HCD to the design of graphic symbol-based AAC systems is still limited.

show abstract

Development of a Communication Aid App with iOS Devices to Support Children/Persons with Speech Disabilities Improvement in Obtaining Positioning Information with iBeacon as Near Field Radio Communication Technology

Cited by 7 publications

References 1 publication

Integrating Behavior of Children with Profound Intellectual, Multiple, or Severe Motor Disabilities With Location and Environment Data Sensors for Independent Communication and Mobility: App Development and Pilot Testing

Integrating Behavior of Children with Profound Intellectual, Multiple, or Severe Motor Disabilities With Location and Environment Data Sensors for Independent Communication and Mobility: App Development and Pilot Testing

Designing electronic graphic symbol-based AAC systems: a scoping review. Part 1: system description

Designing electronic graphic symbol-based AAC systems: a scoping review. Part 2: application of human-centred design

Contact Info

Product

Resources

About