The need for a system view to regulate artificial intelligence/machine learning-based software as medical device

Abstract

Artificial intelligence (AI) and Machine learning (ML) systems in medicine are poised to significantly improve health care, for example, by offering earlier diagnoses of diseases or recommending optimally individualized treatment plans. However, the emergence of AI/ML in medicine also creates challenges, which regulators must pay attention to. Which medical AI/ML-based products should be reviewed by regulators? What evidence should be required to permit marketing for AI/ML-based software as a medical device (SaMD)? How can we ensure the safety and effectiveness of AI/ML-based SaMD that may change over time as they are applied to new data? The U.S. Food and Drug Administration (FDA), for example, has recently proposed a discussion paper to address some of these issues. But it misses an important point: we argue that regulators like the FDA need to widen their scope from evaluating medical AI/ML-based products to assessing systems. This shift in perspective-from a product view to a system view-is central to maximizing the safety and efficacy of AI/ML in health care, but it also poses significant challenges for agencies like the FDA who are used to regulating products, not systems. We offer several suggestions for regulators to make this challenging but important transition.

Regulatory, safety, and privacy concerns of home monitoring technologies during COVID-19

“…They preferably should also work in interdisciplinary teams to reduce the risk of incorporating unconscious bias into the code. It is also essential that during the process of designing home monitoring technologies, technology companies adopt a system view rather than a product view 27 . A system view requires that companies, among other things, look at the context in which the home monitoring technology will be deployed (e.g., the home setting) and analyze the additional challenges that need to be overcome for successful implementation.…”

Predicting Old-age Mortality Using Principal Component Analysis: Results from a National Panel Survey in Korea

“…In addition, we suggest that studies revealing multiple grouped conditions associated with mortality may improve a value-based healthcare strategy, along with the advanced estimation model using AI. Since 2019, the Centers for Medicare and Medicaid Services (CMS) has launched the projects for AI Health Outcomes Challenge and offered federal grants and contracts to innovators to demonstrate how AI tools—such as deep learning and neural networks—can be used to predict unplanned hospital and skilled nursing facility admissions as well as adverse events [ 34 , 35 ]. A variety of lifestyle and health data enable us to analyze negative health outcomes at once and prevent such harmful triggers as soon as possible.…”

Precision medicine in the era of artificial intelligence: implications in chronic disease management

“…Various omics technologies along with other physiological measurements will be used to molecularly characterize an individual's risk for disease. Further implementation of a systems approach to the big-data analysis and integration will provide a platform for machine learning and artificial intelligence in clinical decision-making for early disease risk identification and prevention systems to promote medical imaging evaluation, including the detection of abnormal lesions that may progress to cancer [112]. A recent work highlights how AI and the advancement of technologies together are empowering the aim of personalized and precision medicine [113].…”