“…Casual observation suggests that in conversation people are often not shy about indicating, moment by moment, how they feel about things, both in terms of making progress towards their goal and in terms of how happy they are with the contributions and behavior of their interlocutor. To date, however, predictive modeling of quality at the level of turns has been rarely attempted, and has focused mostly on interaction quality and conver-sational proficiency, and in only a few dialog genres, both for human-machine and human-human dialogs (Ultes and Minker, 2014;Ultes et al, 2017a;Lykartsis et al, 2018;Bodigutla et al, 2019;Stoyanchev et al, 2019;Spirina et al, 2016;Ramanarayanan et al, 2019;Ando et al, 2020;Katada et al, 2020). In this work we attempt turn-level quality estimation in human-human dialogs in a new genre: short calls to an unknown merchant to make an appointment or arrange a simple transaction.…”