An Unsupervised Machine Learning Approach to Assessing Designer Performance During Physical Prototyping

Abstract

An important part of the engineering design process is prototyping, where designers build and test their designs. This process is typically iterative, time consuming, and manual in nature. For a given task, there are multiple objects that can be used, each with different time units associated with accomplishing the task. Current methods for reducing time spent during the prototyping process have focused primarily on optimizing designer to designer interactions, as opposed to designer to tool interactions. Advancements in commercially available sensing systems (e.g., the Kinect) and machine learning algorithms have opened the pathway toward real-time observation of designer's behavior in engineering workspaces during prototype construction. Toward this end, this work hypothesizes that an object O being used for task i is distinguishable from object O being used for task j, where i is the correct task and j is the incorrect task. The contributions of this work are: (i) the ability to recognize these objects in a free roaming engineering workshop environment and (ii) the ability to distinguish between the correct and incorrect use of objects used during a prototyping task. By distinguishing the difference between correct and incorrect uses, incorrect behavior (which often results in wasted time and materials) can be detected and quickly corrected. The method presented in this work learns as designers use objects, and infers the proper way to use them during prototyping. In order to demonstrate the effectiveness of the proposed method, a case study is presented in which participants in an engineering design workshop are asked to perform correct and incorrect tasks with a tool. The participants' movements are analyzed by an unsupervised clustering algorithm to determine if there is a statistical difference between tasks being performed correctly and incorrectly. Clusters which are a plurality incorrect are found to be significantly distinct for each node considered by the method, each with p ≪ 0.001.

Bounded Kalman filter method for motion-robust, non-contact heart rate estimation

“…It also has the potential of being employed in hospitals to predict the heart rate as patients walk in, without the constraint of having to be in a stationary position. Moreover, it can be combined with Microsoft Kinect to be used as a real time ergonomic system as done by [64] or predicting designers' comfort with engineering equipment [65]. Future research expansions could be devoted to predicting pulse-rate in environments where subjects are made to walk longer distances, gender difference is considered an experimental design factor and activities other than motions performed before the subject's laptops/desktop computers are devised as part of the experimental design.…”

Conceptual Product Development through Parametric Optimization: A Case Study on the Design of an Ophthalmic Instrument

“…The combination of CAD and rapid prototyping has been, and continues to be, transformative for innovation across many industries (Marion and Friar, 2019). Physical prototyping tends to be time consuming due to its iterative and manual nature (Dering et al, 2018). Parallel prototyping, an approach where multiple prototypes are created and evaluated at the same time instead of in a linear manner, has been shown to produce superior results (Dow et al, 2010).…”

Focus and Modality: Defining a Roadmap to Future Ai-Human Teaming in Design

“…Engineers have used reactive AI assistance tools in both product design (Koch and Paris-Saclay, 2017) and concurrent-engineering design (Jin and Levit, 1996). In addition, AI assistance has been used at the concept generation (Camburn, Arlitt, et al, 2020), concept evaluation (Camburn, He, et al, 2020), prototyping (Dering et al, 2018), and manufacturing (Williams et al, 2019) stages,. Work has studied the impacts of AI assistance in aspects of engineering design, including decisionmaking, optimization, and computational tasks Rao et al, 1999), and its effects on mental workload, effort, and frustration (Maier et al, 2020(Maier et al, , 2021.…”