Cleveree: an artificially intelligent web service  for Jacob voice chatbot

Octavany, Octavany; Wicaksana, Arya

doi:10.12928/telkomnika.v18i3.14791

Cited by 7 publications

(12 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The questionnaire is distributed to 30 persons and the answers are scaled using the Likert scale. Future work on JACOB is to implement machine learning to update the knowledge-based periodically and automatically [21]. Another work is to improve the user experience when speaking with JACOB by visualizing JACOB.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

JACOB Voice Chatbot Application Using Wit.ai for Providing Information in UMN

Wijaya¹,

Wicaksana²

2019

IJEAT

View full text Add to dashboard Cite

In this modern age, chatbots have been widely used as an information provider. The popularity of voice-based chatbots or voice chatbots has also increased with the presence of technologies such as Microsoft Cortana, Amazon Lex, Apple Siri, and Google Assistant. Interaction with voice chatbot is done using a voice which is more convenient than the text-based chatbots. Universitas Multimedia Nusantara (UMN) requires a tool to provide information for the Informatics joint-degree program. In this paper, a voice chatbot named JACOB is proposed. JACOB is built as a web-based application and implemented with Web Speech API. The sentences received by JACOB are translated using Wit.ai. The Jaro-Winkler distance is also applied in this research to reduce errors in identifying the user’s name. This implementation has been tested successfully, and the total satisfaction score measured using End User Computing Satisfaction is 78.53%

show abstract

Section: Discussionmentioning

confidence: 99%

“…The JACOB voice chatbot application is designed and built on a web base so that it is easily accessible on various platforms [21]. The appearance of this application is very simple and provides enough information for users to interact.…”

Section: Fig 2: Jacob Use Case Diagrammentioning

confidence: 99%

JACOB Voice Chatbot Application Using Wit.ai for Providing Information in UMN

Wijaya¹,

Wicaksana²

2019

IJEAT

View full text Add to dashboard Cite

show abstract

“…Energy is calculated using log-scaled data. These frequency bands are defined empirically, and the frequency bins ( ) are scaled using vocal tract length factor ( ), which is defined by Llorach [1] in (4).…”

Section: Acoustic Analysismentioning

confidence: 99%

“…In previous works, we have developed a voice chatbot application called Jacob [2]- [4]. Jacob functions as a digital assistant to provide users with pre-registered information.…”

Section: Introductionmentioning

confidence: 99%

“…It has a speech-to-text module to process the user input and a text-to-speech module to generate the output speech. It also features a face recognition module called Vision [3] and an artificial intelligence module called the Cleveree [4] to paraphrase answers and summarize conversations. However, Jacob does not have any virtual characters for its conversational agent yet, which is a drawback to the user experience when using Jacob.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Rule-based lip-syncing algorithm for virtual character in voice chatbot

Lovely

Wicaksana

2021

TELKOMNIKA

Self Cite

View full text Add to dashboard Cite

Virtual characters changed the way we interact with computers. The underlying key for a believable virtual character is accurate synchronization between the visual (lip movements) and the audio (speech) in real-time. This work develops a 3D model for the virtual character and implements the rulebased lip-syncing algorithm for the virtual character's lip movements. We use the Jacob voice chatbot as the platform for the design and implementation of the virtual character. Thus, audio-driven articulation and manual mapping methods are considered suitable for real-time applications such as Jacob. We evaluate the proposed virtual character using hedonic motivation system adoption model (HMSAM) with 70 users. The HMSAM results for the behavioral intention to use is 91.74%, and the immersion is 72.95%. The average score for all aspects of the HMSAM is 85.50%. The rule-based lipsyncing algorithm accurately synchronizes the lip movements with the Jacob voice chatbot's speech in real-time.

show abstract

Sorry, I don’t Understand: Improving Voice User Interface Testing

Guglielmi

Rosa

Scalabrino

et al. 2022

Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering

View full text Add to dashboard Cite

Context. The game industry is increasingly growing in recent years. Every day, millions of people play video games, not only as a hobby, but also for professional competitions (e.g., e-sports or speed-running) or for making business by entertaining others (e.g., streamers). The latter daily produce a large amount of gameplay videos in which they also comment live what they experience. But no software and, thus, no video game is perfect: Streamers may encounter several problems (such as bugs, glitches, or performance issues) while they play. Also, it is unlikely that they explicitly report such issues to developers. The identified problems may negatively impact the user's gaming experience and, in turn, can harm the reputation of the game and of the producer. Objective. In this paper, we propose and empirically evaluate GELID, an approach for automatically extracting relevant information from gameplay videos by (i) identifying video segments in which streamers experienced anomalies; (ii) categorizing them based on their type (e.g., logic or presentation); clustering them based on (iii) the context in which appear (e.g., level or game area) and (iv) on the specific issue type (e.g., game crashes). Method. We manually defined a training set for step 2 of GELID (categorization) and a test set for validating in isolation the four components of GELID. In total, we manually segmented, labeled, and clustered 170 videos related to 3 video games, defining a dataset containing 604 segments. Results. While in steps 1 (segmentation) and 4 (specific issue clustering) GELID achieves satisfactory results, it shows limitations on step 3 (game context clustering) and, above all, step 2 (categorization).

show abstract

Cleveree: an artificially intelligent web service for Jacob voice chatbot

Cited by 7 publications

References 18 publications

JACOB Voice Chatbot Application Using Wit.ai for Providing Information in UMN

JACOB Voice Chatbot Application Using Wit.ai for Providing Information in UMN

Rule-based lip-syncing algorithm for virtual character in voice chatbot

Sorry, I don’t Understand: Improving Voice User Interface Testing

Contact Info

Product

Resources

About