398 Anesthesia Induction Improves Sublingual Micro-Circulation

et al. 2020

Preprint

BACKGROUND: Real-time automated analysis of videos of the microvasculature is an essential step in the development of research protocols and clinical algorithms that incorporate point-of-care microvascular analysis. Validation studies on the software packages developed to perform these analyses have reported low agreement with the current referent standard semi-automated analysis method. In response to the call for validation studies of available automated analysis software by the European Society of Intensive Care Medicine, we report the first human validation study of AVA 4.0. METHODS: Two retrospective perioperative datasets of human microcirculation videos (P1 and P2) and one prospective healthy volunteer dataset (V1) were used. Video quality was assessed using the Microcirculation Image Quality Selection (MIQS) score. Videos were initially analysed with (1) AVA software 3.2 by two experienced users through a semi-manual method, followed by an analysis with (2) AVA automated software 4.0 for perfused vessel density (PVD), total vessel density (TVD), and proportion of perfused vessels (PPV). Bland-Altman analysis and intraclass correlation coefficients (ICC) were used to measure agreement between the two methods. Each method’s ability to discriminate between microcirculatory states before and after induction of general anesthesia was assessed using paired t-tests. RESULTS: Fifty-two videos from P1, 128 videos from P2 and 26 videos from V1 met inclusion criteria for analysis. Correlational analysis and Bland Altman analysis revealed poor agreement and no correlation between AVA 4.0 and AVA 3.2. Increasing video length did not improve agreement. Automated analysis consistently underestimated measures of vessel density. Following the induction of anesthesia, TVD and PVD measured using AVA 3.2 increased significantly for P1 and P2 (p < 0.05). However, these changes could not be replicated with the data generated by AVA 4.0. CONCLUSIONS: AVA 4.0 is not a suitable tool for research or clinical purposes at this time. Future validation studies of automated microvascular flow analysis software should aim to measure the new software’s agreement with the referent standard, its ability to discriminate between clinical states and the quality thresholds at which its performance becomes unacceptable.

Section: Discussionsupporting

confidence: 90%

“…Lastly, we hypothesized that both methods would reveal significant increases in TVD and PVD following induction of general anesthesia, a robust finding that has previously been reported. [21][22][23]…”

Section: Introductionmentioning

confidence: 99%

Evaluation of Automated Microvascular Flow Analysis Software AVA 4.0: A Validation Study

et al. 2020

Preprint

“…pre-vs. post-induction of general anesthesia), whereas data generated using the referent method did replicate the ndings that TVD and PVD increase following induction of general anesthesia. [26][27][28] These results are consistent with a previous validation study of AVA 4.1 conducted with videos of the conjunctival microcirculation of sheep subjected to experimentally-induced hemorrhagic shock. 25 Our study expands their ndings to the human microcirculation and rea rms the conclusion that AVA 4.1 cannot be used to accurately assess the human microcirculation.…”

Section: Discussionsupporting

confidence: 87%

“…Furthermore, we hypothesized that both methods would reveal signi cant increases in TVD and PVD following induction of general anesthesia, a robust nding that has previously been reported. [26][27][28]…”

Section: Introductionmentioning

confidence: 99%

Evaluation of Automated Microvascular Flow Analysis Software AVA 4: A Validation Study

et al. 2021

Preprint

BACKGROUND: Real-time automated analysis of videos of the microvasculature is an essential step in the development of research protocols and clinical algorithms that incorporate point-of-care microvascular analysis. In response to the call for validation studies of available automated analysis software by the European Society of Intensive Care Medicine, and building on a previous validation study in sheep, we report the first human validation study of AVA 4.METHODS:Two retrospective perioperative datasets of human microcirculation videos (P1 and P2) and one prospective healthy volunteer dataset (V1) were used in this validation study. Video quality was assessed using the modified Microcirculation Image Quality Selection (MIQS) score. Videos were initially analyzed with (1) AVA software 3.2 by two experienced investigators using the gold standard semi-automated method, followed by an analysis with (2) AVA automated software 4.1. Microvascular variables measured were perfused vessel density (PVD), total vessel density (TVD), and proportion of perfused vessels (PPV). Bland-Altman analysis and intraclass correlation coefficients (ICC) were used to measure agreement between the two methods. Each method’s ability to discriminate between microcirculatory states before and after induction of general anesthesia was assessed using paired t-tests. RESULTS: Fifty-two videos from P1, 128 videos from P2 and 26 videos from V1 met inclusion criteria for analysis. Correlational analysis and Bland Altman analysis revealed poor agreement and no correlation between AVA 4.1 and AVA 3.2. Following the induction of general anesthesia, TVD and PVD measured using AVA 3.2 increased significantly for P1 (p < 0.05) and P2 (p < 0.05). However, these changes could not be replicated with the data generated by AVA 4.1. CONCLUSIONS: AVA 4.1 is not a suitable tool for research or clinical purposes at this time. Future validation studies of automated microvascular flow analysis software should aim to measure the new software’s agreement with the gold standard, its ability to discriminate between clinical states and the quality thresholds at which its performance becomes unacceptable.

“…Furthermore, AVA 4.1 was unable to discriminate between different microvascular states that have previously been characterized (i.e., pre- vs. post-induction of general anesthesia), whereas data generated using the referent method did replicate the findings that TVD and PVD increase following induction of general anesthesia. [ 26 – 28 ].…”

Section: Discussionmentioning

confidence: 99%

Evaluation of automated microvascular flow analysis software AVA 4: a validation study

et al. 2021

ICMx

Background Real-time automated analysis of videos of the microvasculature is an essential step in the development of research protocols and clinical algorithms that incorporate point-of-care microvascular analysis. In response to the call for validation studies of available automated analysis software by the European Society of Intensive Care Medicine, and building on a previous validation study in sheep, we report the first human validation study of AVA 4. Methods Two retrospective perioperative datasets of human microcirculation videos (P1 and P2) and one prospective healthy volunteer dataset (V1) were used in this validation study. Video quality was assessed using the modified Microcirculation Image Quality Selection (MIQS) score. Videos were initially analyzed with (1) AVA software 3.2 by two experienced investigators using the gold standard semi-automated method, followed by an analysis with (2) AVA automated software 4.1. Microvascular variables measured were perfused vessel density (PVD), total vessel density (TVD), and proportion of perfused vessels (PPV). Bland–Altman analysis and intraclass correlation coefficients (ICC) were used to measure agreement between the two methods. Each method’s ability to discriminate between microcirculatory states before and after induction of general anesthesia was assessed using paired t-tests. Results Fifty-two videos from P1, 128 videos from P2 and 26 videos from V1 met inclusion criteria for analysis. Correlational analysis and Bland–Altman analysis revealed poor agreement and no correlation between AVA 4.1 and AVA 3.2. Following the induction of general anesthesia, TVD and PVD measured using AVA 3.2 increased significantly for P1 (p < 0.05) and P2 (p < 0.05). However, these changes could not be replicated with the data generated by AVA 4.1. Conclusions AVA 4.1 is not a suitable tool for research or clinical purposes at this time. Future validation studies of automated microvascular flow analysis software should aim to measure the new software’s agreement with the gold standard, its ability to discriminate between clinical states and the quality thresholds at which its performance becomes unacceptable.