Methods for the Design and Evaluation of HCI+NLP Systems

Abstract

HCI and NLP traditionally focus on different evaluation methods. While HCI involves a small number of people directly and deeply, NLP traditionally relies on standardized benchmark evaluations that involve a larger number of people indirectly. We present five methodological proposals at the intersection of HCI and NLP and situate them in the context of ML-based NLP models. Our goal is to foster interdisciplinary collaboration and progress in both fields by emphasizing what the fields can learn from each other.

Exploring Large Language Model as a Design Partner through Verbal and Non-verbal Conversation in Architectural Design Process

“…(b) If AI, then Natural Language Processing (NLP) Natural Language Processing (NLP), a discipline to explore how humans and computers can communicate using human language instead of computer codes, is commonly agreed to be the candidate for HCI design (Alkatheiri, 2022;Heuer and Buschek, 2021;Wang et al, 2021). NLP exploration in architecture can be traced back to the 1960s.…”