Objective Measures of Communication Behavior Predict Clinical Performance

Peng, Yuhao; Anton, Nicholas E.; Cha, Jackie; Mizota, Tomoko; Hennings, Julie M.; Stambro, Ryan; Rendina, Megan A.; Stanton-Maxey, Katie J.; Stefanidis, Dimitrios; Yu, Denny

doi:10.1016/j.jsurg.2019.03.017

Cited by 8 publications

(6 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Speech metrics. A previously established pipeline to extract surgeons' prosodic patterns of speech was followed (Peng et al, 2019). Surgeon audio after noise removal (e.g., environment noise) was analyzed in PRAAT, a speech analysis in phonetics tool (De Jong & Wempe, 2009).…”

Section: Data Processing and Analysismentioning

confidence: 99%

“…Although no studies have examined sensor-based behavior metrics with NTS, qualitative studies have suggested that NTS may be correlated with changes in communication and flow in the healthcare environment (Rosen et al, 2018; Tiferes et al, 2016). These include speech and location-based metrics such as prosodic elements of speech (e.g., intensity and articulation rate) (Peng et al, 2019) and movement of OR staff (Joseph et al, 2019); however, there is a lack of strong evidence with validated NTS assessments and objective measures.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams

et al. 2022

Self Cite

View full text Add to dashboard Cite

Objective The purpose of this study was to identify objective measures that predict surgeon nontechnical skills (NTS) during surgery. Background NTS are cognitive and social skills that impact operative performance and patient outcomes. Current methods for NTS assessment in surgery rely on observation-based tools to rate intraoperative behavior. These tools are resource intensive (e.g., time for observation or manual labeling) to perform; therefore, more efficient approaches are needed. Method Thirty-four robotic-assisted surgeries were observed. Proximity sensors were placed on the surgical team and voice recorders were placed on the surgeon. Surgeon NTS was assessed by trained observers using the NonTechnical Skills for Surgeons (NOTSS) tool. NTS behavior metrics from the sensors included communication, speech, and proximity features. The metrics were used to develop mixed effect models to predict NOTSS score and in machine learning classifiers to distinguish between exemplar NTS scores (highest NOTSS score) and non-exemplar scores. Results NTS metrics were collected from 16 nurses, 12 assistants, 11 anesthesiologists, and four surgeons. Nineteen behavior features and overall NOTSS score were significantly correlated (12 communication features, two speech features, five proximity features). The random forest classifier achieved the highest accuracy of 70% (80% F1 score) to predict exemplar NTS score. Conclusion Sensor-based measures of communication, speech, and proximity can potentially predict NOTSS scores of surgeons during robotic-assisted surgery. These sensing-based approaches can be utilized for further reducing resource costs of NTS and team performance assessment in surgical environments. Application Sensor-based assessment of operative teams’ behaviors can lead to objective, real-time NTS measurement.

show abstract

Section: Data Processing and Analysismentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…Distance measures help assess positioning of team members, and, when combined with time, give a sense of motion dynamics (Ward et al, 2014). Volume and rate of speech assists with assessing communication characteristics (Peng et al, 2019). Finally, frequency counts help with evaluating outcome measures such as morbidity and mortality as well as process measures and team dynamics (Welsch et al, 2018).…”

Section: Assessing Team Performance In Healthcarementioning

confidence: 99%

“…Finally, frequency counts help with evaluating outcome measures such as morbidity and mortality as well as process measures and team dynamics (Welsch et al, 2018). For example, frequency counts of types of communication may assist with the overall evaluation of communication within a team (Peng et al, 2019).…”

Section: Assessing Team Performance In Healthcarementioning

confidence: 99%

Conceptualizing a Quantitative Measurement Suite to Evaluate Healthcare Teams

Paige

Rogers

Kerdolff

et al. 2022

Simulation & Gaming

View full text Add to dashboard Cite

Background Current team assessment instruments in healthcare tend to involve rater-based evaluations that are susceptible to well-known biases. Recent advances in technology include portable devices to measure team-based activities. Consequently, the possibility exists to move away from rater-based assessments of team function by identifying quantitative measures to replace them. Aim This article aims to provide potential approaches to developing quantitative measurement suites involving large amounts of data to address the challenges of assessment presented by the complex nature of teamwork. Conclusion By addressing construct, measurement, and context components, we provide a practical approach to developing a suite to capture quantitative measurements that, through incorporation of social network analysis and aggregated other values, aligns with the Team Strategies & Tools to Enhance Performance and Patient SafetyTM (TeamSTEPPSTM) dimensions for fostering teamwork.

show abstract

“…Una comunicación efectiva es de vital importancia para lograr resultados positivos para los usuarios de salud (Omura et al, 2017;Peng et al, 2019;Sánchez Expósito et al, 2019). La comunicación entre el equipo sanitario afecta a la atención sanitaria en todos los niveles, desde el desempeño profesional de habilidades técnicas o clínicas, hasta la seguridad del paciente (Foronda et al, 2016).…”

unclassified

El papel de la simulación clínica en el desarrollo de las habilidades de comunicación en los profesionales sanitarios

Costa

2022

Rev Esp Comun Salud

View full text Add to dashboard Cite

Objective Measures of Communication Behavior Predict Clinical Performance

Cited by 8 publications

References 35 publications

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams

Objective Nontechnical Skills Measurement Using Sensor-based Behavior Metrics in Surgical Teams

Conceptualizing a Quantitative Measurement Suite to Evaluate Healthcare Teams

El papel de la simulación clínica en el desarrollo de las habilidades de comunicación en los profesionales sanitarios

Contact Info

Product

Resources

About