Objective-The purpose of this study was to evaluate and validate an offline, automated scalp EEGbased seizure detection system and to compare its performance to commercially available seizure detection software.Methods-The test seizure detection system, IdentEvent™, was developed to enhance the efficiency of post-hoc long-term EEG review in epilepsy monitoring units. It translates multi-channel scalp EEG signals into multiple EEG descriptors and recognizes ictal EEG patterns. Detection criteria and thresholds were optimized in 47 long-term scalp EEG recordings selected for training (47 subjects, ~3653 hours with 141 seizures). The detection performance of IdentEvent was evaluated using a separate test dataset consisting of 436 EEG segments obtained from 55 subjects (~1200 hours with 146 seizures). Each of the test EEG segments was reviewed by three independent epileptologists and the presence or absence of seizures in each epoch was determined by majority rule. Seizure detection sensitivity and false detection rate were calculated for IdentEvent as well as for the comparable detection software (Persyst's Reveal ® , version 2008.03.13, with three parameter settings). Bootstrap re-sampling was applied to establish the 95% confidence intervals of the estimates and for the performance comparison between two detection algorithms.Results-The overall detection sensitivity of IdentEvent was 79.5% with a false detection rate (FDR) of 2 per 24 hours, whereas the comparison system had 80.8%, 76%, and 74% sensitivity using its three detection thresholds (perception score) with FDRs of 13, 8, and 6 per 24 hours, respectively. Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain. Bootstrap 95% confidence intervals of the performance difference revealed that the two detection systems had comparable detection sensitivity, but IdentEvent generated a significantly (p < 0.05) smaller FDR.
NIH Public AccessConclusions-The study validates the performance of the IdentEvent™ .seizure detection system.Significance-With comparable detection sensitivity, an improved false detection rate makes the automated seizure detection software more useful in clinical practice.
Objective
This study investigated inter-rater agreement (IRA) among EEG experts for the identification of electrographic seizures and periodic discharges (PDs) in continuous ICU EEG recordings.
Methods
Eight board-certified EEG experts independently identified seizures and PDs in thirty 1-hour EEG segments which were selected from ICU EEG recordings collected from three medical centers. IRA was compared between seizure and PD identifications, as well as among rater groups that have passed an ICU EEG Certification Test, developed by the Critical Care EEG Monitoring Research Consortium (CCEMRC).
Results
Both kappa and event-based IRA statistics showed higher mean values in identification of seizures compared to PDs (k = 0.58 vs. 0.38; p < 0.001). The group of rater pairs who had both passed the ICU EEG Certification Test had a significantly higher mean IRA in comparison to rater pairs in which neither had passed the test.
Conclusions
IRA among experts is significantly higher for identification of electrographic seizures compared to PDs. Additional instruction, such as the training module and certification test developed by the CCEMRC, could enhance this IRA.
Significance
This study demonstrates more disagreement in the labeling of PDs in comparison to seizures. This may be improved by education about standard EEG nomenclature.
It is widely recognized that visual screening of long-term EEG recordings can be time-consuming and labor-intensive due to the large volume of patient data produced daily in most Epilepsy Monitoring Units (EMUs). As a result, seizures, especially those with only electrographic changes, are sometimes overlooked, which for some patients could result in missed information for diagnosis, an unnecessarily prolonged hospital stay, and unavailable EMU beds for others. In this report, we propose that a better solution for identifying seizures in long-term EEG recording is to combine detection results from a reliable (high sensitivity and low false detection rate) automated detection system with EEG technologists’ visual screening process. Using commercially available detection software, we present case studies that demonstrate potential benefits of this method that could help improve detection rates and bring greater efficiency to the seizure identification process in long-term EEG monitoring.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.