New report preparation system for endoscopic procedures using speech recognition technology

Abstract

Background and study aims We developed a new reporting system based on structured data entry, which selectively extracts only endoscopic findings from endoscopists’ oral statements and automatically inputs them into appropriate columns in real time during endoscopic procedures. Methods We compared the time for endoscopic procedures and report preparation (ER time) by using an esophagogastroduodenoscopy simulator in three groups: one preparing reports using a mouse after endoscopic procedures (CE group); a second group preparing reports by using voice alone during endoscopic procedures (SR group); and the final group preparing reports by operating the system with a foot switch and inputting findings using voice during endoscopic procedures (SR + FS group). For the SR and SR + FS groups, we identified the recognition rates of the speech recognition system. Results Mean ER times for cases with three findings each were 162, 130 and 119 seconds in the CE, SR and SR + FS groups, respectively. The mean ER times for cases with six findings each were 220, 144 and 128 seconds, respectively. The times in the SR and SR + FS groups were significantly shorter than that in the CE group ( P < 0.017). The recognition rate of the SR group for cases with three findings each was 98.4 %, and 97.6 % in the same group for cases with six findings each. The rates in the SR + FS group were 95.2 % and 98.4 %, respectively. Conclusion Our reporting system was demonstrated to allow an endoscopist to efficiently complete the report in real time during endoscopic procedures.

Speech Recognition System Generates Highly Accurate Endoscopic Reports in Clinical Practice

“…Our previous study with the SR software program and an upper gastrointestinal endoscopy simulator demonstrated a correct recognition rate of 98.4% ( 10 ). The role of SR software programs in other disciplines has been examined, and the highest correct recognition rate of 96% was documented in radiologic reports ( 1 - 4 ).…”

“…We jointly developed the original Japanese SR system for reporting endoscopic findings equipped with VoiceRex Ⓡ (Nippon Telegraph and Telephone Corporation, Tokyo, Japan) in collaboration with Fujifilm Medical IT Solutions, NTT TechnoCross Corporation, and Nippon Telegraph and Telephone Corporation. The original SR system was used in a preliminary study with an endoscopic simulator ( 10 ). In the present study, we upgraded the VoiceRex Ⓡ system by introducing the latest technology ( 11 , 12 ).…”

“…To address these issues, we developed a new SR system for endoscopic procedures that was based on structured data entry ( 10 ). Our SR system selectively extracts endoscopic findings from spoken conversation and automatically inputs these into the appropriate columns of a structured report.…”

“…We tested this system in a preliminary study with an endoscopic simulator, which demonstrated that our SR system is 98.4% accurate in recognizing the relevant terminology. It also significantly shortens the overall examination time ( 10 ). However, our preliminary study with an endoscopic simulator was conducted in a quiet environment, whereas clinical endoscopy is performed in a space with ambient noise, such as the voices of the patient or nurse, suction sound of the endoscope, and noise from the endoscope washer.…”

Preliminary assessment of two novel mechanical colonoscopic polypectomy simulators: Description, evaluation and validation

“…The preliminary assessment of construct validity was based on the median time needed to complete the tasks. This concept has been used in previous pilot studies [11].…”