A new technology on translating Indonesian spoken language into Indonesian sign language system

Ramadhani, Risky Aswi; Putra, I Ketut; Sudarma, Made; Giriantari, Ida Ayu Dwi

doi:10.11591/ijece.v11i4.pp3338-3346

Cited by 5 publications

(4 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While for the evaluation of the user interface, the menu of options, the results of the translation, the user guide, the informative, and the recording sensitivity. The average value provided by respondents is 86%, which is a very good number (Ramadani et al, 2021). Improve SIBI's gesture recognition ability by trying other hand shape features that have better capabilities than the handshape feature in this study (Erdefi Rakun, 2022).…”

Section: Conducting Application Trials Via Smartphone Mediamentioning

confidence: 79%

Development of Indonesian Sign Language System (SIBI) Dictionary Application for Students with Special Needs

Syamsuddin,

Pristiwaluyo,

A Saleh

et al. 2023

AIJP

View full text Add to dashboard Cite

The process of communication for deaf persons needs to be facilitated by a particular language. Friends who are deaf want language that is appropriate for everyday requirements in order to communicate and comprehend communications. The objectives of developing assistive technology for the Indonesian Sign Language System (SIBI) dictionary application are to optimize services, create friendly assistive technology, improve the language skills of students with hearing impairments by utilizing technology, and create an inclusive campus that is friendly for students with special needs. The model used in research and development (RD) is Borg Gall. The development stage of the SIBI dictionary application goes through 10 stages, from collecting vocabulary information to the resulting product in the form of an application embedded on a smartphone. Product testing was carried out in two stages to identify constraints in the application and use of the available features. The population was 17 students with special needs at various semester levels, including eight students with hearing impairments (deaf), students with visual impairment (blind/low vision) as many as eight students, then there is one student with obstacles to the function of mobility. The results of this study are that the SIBI Dictionary Application is a dictionary in the form of sign language videos equipped with sound and text as well as word meanings. The video also has a tutorial. This tool can help hearing-impaired pupils study after utilising a digital dictionary. Increasing hearing-impaired kids' vocabularies (value indicator assessment). Deaf community "GERKATIN" and special education students. Thus, the SIBI Dictionary Application with sign language movies with sound, text, and word definitions can better aid kids with special needs and can be downloaded from smartphone app services. All UNM students receive volunteer instruction from special needs classmates.

show abstract

Section: Conducting Application Trials Via Smartphone Mediamentioning

confidence: 79%

Development of Indonesian Sign Language System (SIBI) Dictionary Application for Students with Special Needs

Syamsuddin,

Pristiwaluyo,

A Saleh

et al. 2023

AIJP

View full text Add to dashboard Cite

show abstract

“…The research method used in this study of Figure 1 was designed to test the effectiveness of improvised methods of object detection with YOLOv8 and OpenCV distance measurement in assisting blind people in their mobility [12]. The study involved collecting data that included images and distance measurements from field testing.…”

Section: You Only Look Once Version 8 (Yolov8)mentioning

confidence: 99%

Enhanced Yolov8 with OpenCV for Blind-Friendly Object Detection and Distance Estimation

Erwin Syahrudin,

Ema Utami,

Anggit Dwi Hartanto

2024

J. RESTI (Rekayasa Sist. Teknol. Inf.)

View full text Add to dashboard Cite

The development of computer technology and computer vision has had a significant positive impact on the daily lives of blind people, especially in efforts to improve their navigation abilities. This research has the main aim of introducing a superior object detection method, especially in supporting the sustainability and effectiveness of navigation for the blind. The main focus of the research is the use of YOLOv8, the latest version of YOLO, as an object detection method, and distance measurement technology from OpenCV. The main challenge to be addressed involves improving the accuracy and performance of object detection, which is an important key to ensuring safe and effective navigation for blind people. In this context, blind people often face obstacles in their mobility, especially when walking around environments that may be full of obstacles or obstacles. Therefore, better object detection methods become essential to ensure the identification of nearby objects, which may involve obstacles or potential threats, thereby preventing possible accidents or difficulties in daily commuting. Involving YOLOv8 as an object detection method provides the advantage of a high level of accuracy, although with a slight increase in detection duration and GPU power consumption compared to previous versions. The research results show that YOLOv8 provides a low error rate, with an average error percentage of 3.15%, indicating very optimal results. Using a combined performance evaluation approach of YOLOv8 and OpenCV distance measurement metrics, this research not only seeks to improve accuracy but also efficiency in detection time and power consumption. This research makes an important contribution in presenting technological solutions that can help improve mobility and safety for blind people, bringing a real positive impact in facilitating their daily lives.

show abstract

“…The insufficient exploration of local sign languages, especially in post-Soviet countries, remains a pertinent issue. Turkish sign language serves as the subject of detailed study and comparison with Kazakh and other sign languages [5,6].…”

Section: Introductionmentioning

confidence: 99%

Компьютерлік Судроаударма Жүйесі Үшін Анимациялық Кейіпкердіқұру

Nurgazina,

Kudubayeva,

Bekbauova

2024

BULLETIN Series Physical and Mathematical Sciences

View full text Add to dashboard Cite

The article explores the diversity of sign languages using 3D avatars in the context of deaf translation. The research aims to develop algorithms and a 3D avatar based on the visual characteristics of sign language. Special attention is given to the formalization of algorithms and the development of code for 3D avatars, serving as visual demonstrators in sign language translation. Differences between post-Soviet languages using Russian sign language and Kazakhstan, which employs its sign language, are analyzed. The results of the research on the 3D avatar for Turkish sign language are presented, including code development and efficiency evaluation, considering the possibility of algorithm formalization. The research methodology involves analyzing and comparing Kazakh sign language with Turkish attempts or the potential adoption of the Latin script in Kazakhstan. Using a Turkish 3D demonstrator, an animated character model has been created for a computerized sign language translation system into Kazakh Sign Language. The creation of the model utilized the cross-platform graphical package Unity3D. The concluding part emphasizes the significance of such innovations in sign language and their potential application in improving communication for individuals with hearing impairments. Бұл мақала сурдоаударма контекстінде 3D аватарларын қолданатын ым тілдерінің әртүрлілігін зерттейді. Зерттеудің мақсаты –ым тілінің визуалды ерекшеліктеріне негізделген алгоритмдер мен 3D аватарын жасау. Алгоритмдерді ресімдеуге және сурдоаудармада көрнекі демонстранттар ретінде қызметететін 3D аватарларына арналған кодты әзірлеуге ерекше назар аударылады. Орыс ым тілін қолданатынпосткеңестік тілдер мен өз ым тілін қолданатын Қазақстан арасындағы айырмашылықтар талданады. Мақалада түрік ым тіліне арналған 3D аватарын зерттеу нәтижелері, оның ішінде алгоритмдерді формализациялау мүмкіндігін ескере отырып, кодты әзірлеу және өнімділікті бағалау берілген. Зерттеу әдісі ретінде қазақ ым тілін түрік тілімен немесе Қазақстанда латын әліпбиін енгізу мүмкіндігімен салыстыру және талдау негізге алынды. Түрік 3D демонстраторының көмегімен қазақ ым тіліне арналған компьютерлік сурдоаударма жүйесі үшін анимациялық кейіпкердің үлгісі жасалды, модельді құру үшін Unity3D графикалық пакеті пайдаланылды. Қорытынды бөлімде ым тіліндегі осындай инновациялардың маңыздылығы және олардың есту қабілеті нашар адамдар үшін коммуникацияны жақсартудағы әлеуетті қолданбалары көрсетіледі. В статье исследуется разнообразие жестовых языков с использованием 3D-аватаров в контексте сурдоперевода. Целью исследования является разработка алгоритмов и 3D-аватарана основе визуальных особенностей жестового языка. Особое внимание уделяется формализации алгоритмов и разработке кода для 3D-аватаров, которые служат визуальными демонстраторами в переводе жестового языка. Проанализированы различия между постсоветскими языками, использующими русский жестовый язык, и Казахстаном, который использует свой жестовый язык. В статье представлены результаты исследования 3D-аватара для турецкого жестового языка, включая разработку кода и оценку эффективности, с учетом возможности формализации алгоритмов. Как метод исследования в основу взят анализ и сравнение казахского жестового языка с турецким, попытками или возможностью внедрения латиницы в Казахстане. С помощью турецкого 3D-демонстратора создана модель анимированного персонажадля системы компьютерного сурдоперевода под казахский жестовый язык. Для создания модели были использованы кроссплатформенный графический пакет Unity3D. Заключительная часть подчеркивает важность таких инноваций в области жестового языка и их потенциальное применение в улучшении коммуникации для лиц с нарушениями слуха.

show abstract

A new technology on translating Indonesian spoken language into Indonesian sign language system

Cited by 5 publications

References 24 publications

Development of Indonesian Sign Language System (SIBI) Dictionary Application for Students with Special Needs

Development of Indonesian Sign Language System (SIBI) Dictionary Application for Students with Special Needs

Enhanced Yolov8 with OpenCV for Blind-Friendly Object Detection and Distance Estimation

Компьютерлік Судроаударма Жүйесі Үшін Анимациялық Кейіпкердіқұру

Contact Info

Product

Resources

About