Identifying Key Hospital Service Quality Factors in Online Health Communities

Abstract

BackgroundThe volume of health-related user-created content, especially hospital-related questions and answers in online health communities, has rapidly increased. Patients and caregivers participate in online community activities to share their experiences, exchange information, and ask about recommended or discredited hospitals. However, there is little research on how to identify hospital service quality automatically from the online communities. In the past, in-depth analysis of hospitals has used random sampling surveys. However, such surveys are becoming impractical owing to the rapidly increasing volume of online data and the diverse analysis requirements of related stakeholders.ObjectiveAs a solution for utilizing large-scale health-related information, we propose a novel approach to identify hospital service quality factors and overtime trends automatically from online health communities, especially hospital-related questions and answers.MethodsWe defined social media–based key quality factors for hospitals. In addition, we developed text mining techniques to detect such factors that frequently occur in online health communities. After detecting these factors that represent qualitative aspects of hospitals, we applied a sentiment analysis to recognize the types of recommendations in messages posted within online health communities. Korea’s two biggest online portals were used to test the effectiveness of detection of social media–based key quality factors for hospitals.ResultsTo evaluate the proposed text mining techniques, we performed manual evaluations on the extraction and classification results, such as hospital name, service quality factors, and recommendation types using a random sample of messages (ie, 5.44% (9450/173,748) of the total messages). Service quality factor detection and hospital name extraction achieved average F1 scores of 91% and 78%, respectively. In terms of recommendation classification, performance (ie, precision) is 78% on average. Extraction and classification performance still has room for improvement, but the extraction results are applicable to more detailed analysis. Further analysis of the extracted information reveals that there are differences in the details of social media–based key quality factors for hospitals according to the regions in Korea, and the patterns of change seem to accurately reflect social events (eg, influenza epidemics).ConclusionsThese findings could be used to provide timely information to caregivers, hospital officials, and medical officials for health care policies.

Yelp Reviews Of Hospital Care Can Supplement And Inform Traditional Surveys Of The Patient Experience Of Care

“…Previous work on online patient reviews of hospitals has focused on hospitals in the United Kingdom, 14–16 South Korea, 17 and Germany, 18 or has studied U.S. hospitals but has not examined the content of the online reviews. 10, 19 In England, the National Health Service (NHS) runs a website, NHS Choices, which allows structured patient reviews to be published; 14, 15 however, no such government run site currently exists in the U.S. Little is known about how alternative online sources of patient and caregiver experiences of hospitals in the U.S. may contribute to measuring hospital quality, about what information is contained in these online reviews, and how this information might be used to identify patient-centered outcomes for hospitalized patients.…”

What are the Gaps in Mobile Patient Portal? Mining Users Feedback Using Topic Modeling

“…For example, Jung, et al [32] proposed a text mining approach to identify hospital service quality factors and overtime trends automatically from user-generated content from online health communities. Xu, et al [33] examined the impact of online information on patient choice of outpatient care doctors.…”

Aspiring to Unintended Consequences of Natural Language Processing: A Review of Recent Developments in Clinical and Consumer-Generated Text Processing

“…Drawing on data from two South Korean online communities predominantly used by parents to discuss pediatric services, Jung and colleagues defined six quality factors for social media-based hospital service quality analysis and used keywords corresponding to the factors for recommending hospitals [100].…”