Customization of an example-based dialog system with user data and distributed word representations

Seto, Eichi; Nishimura, Ryota; Kitaoka, Norihide

doi:10.23919/apsipa.2018.8659459

Cited by 3 publications

(1 citation statement)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this study, we develop a method of creating an example database using information about a user acquired through a web search. When generating example phrases using the database, we propose using word2vec operations [5]- [9] to substitute user specific information into the example phrases [23]. Simply replacing words in example phrases with user-related words can result in appropriate phrases, however.…”

Section: Introductionmentioning

confidence: 99%

Example Phrase Adaptation Method for Customized, Example-Based Dialog System Using User Data and Distributed Word Representations

Kitaoka

Seto

Nishimura

2020

IEICE Trans. Inf. & Syst.

Self Cite

View full text Add to dashboard Cite

We have developed an adaptation method which allows the customization of example-based dialog systems for individual users by applying "plus" and "minus" operations to the distributed representations obtained using the word2vec method. After retrieving user-related profile information from the Web, named entity extraction is applied to the retrieval results. Words with a high term frequency-inverse document frequency (TF-IDF) score are then adopted as user related words. Next, we calculate the similarity between the distrubuted representations of selected user-related words and nouns in the existing example phrases, using word2vec embedding. We then generate phrases adapted to the user by substituting user-related words for highly similar words in the original example phrases. Word2vec also has a special property which allows the arithmetic operations "plus" and "minus" to be applied to distributed word representations. By applying these operations to words used in the original phrases, we are able to determine which user-related words can be used to replace the original words. The user-related words are then substituted to create customized example phrases. We evaluated the naturalness of the generated phrases and found that the system could generate natural phrases.

show abstract

Section: Introductionmentioning

confidence: 99%