Humanoid robot as an educational assistant – insights of speech recognition for online and offline mode of teaching

Pande, Akshara; Mishra, Deepti

doi:10.1080/0144929x.2024.2344726

Behaviour & Information Technology

2024

DOI: 10.1080/0144929x.2024.2344726

|View full text |Cite

Humanoid robot as an educational assistant – insights of speech recognition for online and offline mode of teaching

Akshara Pande,

Deepti Mishra

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 83 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Assessment of Pepper Robot’s Speech Recognition System through the Lens of Machine Learning

Pande,

Mishra

2024

Biomimetics

View full text Add to dashboard Cite

Speech comprehension can be challenging due to multiple factors, causing inconvenience for both the speaker and the listener. In such situations, using a humanoid robot, Pepper, can be beneficial as it can display the corresponding text on its screen. However, prior to that, it is essential to carefully assess the accuracy of the audio recordings captured by Pepper. Therefore, in this study, an experiment is conducted with eight participants with the primary objective of examining Pepper’s speech recognition system with the help of audio features such as Mel-Frequency Cepstral Coefficients, spectral centroid, spectral flatness, the Zero-Crossing Rate, pitch, and energy. Furthermore, the K-means algorithm was employed to create clusters based on these features with the aim of selecting the most suitable cluster with the help of the speech-to-text conversion tool Whisper. The selection of the best cluster is accomplished by finding the maximum accuracy data points lying in a cluster. A criterion of discarding data points with values of WER above 0.3 is imposed to achieve this. The findings of this study suggest that a distance of up to one meter from the humanoid robot Pepper is suitable for capturing the best speech recordings. In contrast, age and gender do not influence the accuracy of recorded speech. The proposed system will provide a significant strength in settings where subtitles are required to improve the comprehension of spoken statements.

show abstract

Assessment of Pepper Robot’s Speech Recognition System through the Lens of Machine Learning

Pande,

Mishra

2024

Biomimetics

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Humanoid robot as an educational assistant – insights of speech recognition for online and offline mode of teaching

Cited by 1 publication

References 83 publications

Assessment of Pepper Robot’s Speech Recognition System through the Lens of Machine Learning

Assessment of Pepper Robot’s Speech Recognition System through the Lens of Machine Learning

Contact Info

Product

Resources

About