Abstract:Soft tissue modelling plays a significant role in surgery simulation as well as surgical procedure planning and training. However, it is a challenging research task to satisfy both physical realism and realtime simulation for soft tissue deformation. The finite element method (FEM) is a representative strategy for modelling of soft tissue deformation with highly physical realism. However, it suffers from expensive computations, unable to meet the requirement of real-time simulation. This paper proposes a novel… Show more
“…The Kalman filter is a well-known algorithm for state estimation in the form of feedback control. Xie et al [83] proposed the KF-FEM method for real-time and accurate modeling of soft tissue deformation. This method allows online estimation of softtissue deformation from the local measurement of displacement by formulating the deformation of the soft tissue as a filtering identification process.…”
Section: ) Mesh-based Modeling Methodsmentioning
confidence: 99%
“…Model order reduction by proper orthogonal decomposition is performed before the real-time simulation [14]. The Kalman-filter method compute the Kalman gain offline [83]. Thus should offline simulation be included to account for the most complex tissue simulations, or to enable simulation of larger systems.…”
The use of digital twins to represent a product or process digitally is trending in many engineering disciplines. This term has also been recently introduced in the medical field. In arthroscopic surgery education, the paradigm shift from apprenticeship to simulation training has driven the need for better simulators, and the current focus is on improving simulators with respect to computational efficiency and system accuracy. However, expanding surgical simulations towards digital twins has not yet been explored. This paper introduces the digital twin concept for arthroscopic surgery, and explores its potential in light of the existing scientific literature. Thus, a systematic review was conducted to summarize and analyze the literature with respect to fast and robust design of an arthroscopic digital twin using patientspecific information, and methods for interactive surgical soft tissue simulation. The review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol with three reliable scientific search engines: IEEE Explore, ScienceDirect and PubMed. Eighty papers were included in the review, and the extracted data included modeling methods, tissue types, constitutive behavior, computational efficiency or accuracy, hardware configuration, haptic device description, software tools, and system architectures. Considering the review, a novel macro-level conceptual arthroscopic digital twin system is presented, and the applicability of the review findings for the identified subsystems are discussed. The proposed system integrates patient-specific images, diagnostic data, intraoperative sensor data, and surgical practice as inputs, and conceptually enables surgical skills training, preoperative planning, and a database of virtual surgeries.
“…The Kalman filter is a well-known algorithm for state estimation in the form of feedback control. Xie et al [83] proposed the KF-FEM method for real-time and accurate modeling of soft tissue deformation. This method allows online estimation of softtissue deformation from the local measurement of displacement by formulating the deformation of the soft tissue as a filtering identification process.…”
Section: ) Mesh-based Modeling Methodsmentioning
confidence: 99%
“…Model order reduction by proper orthogonal decomposition is performed before the real-time simulation [14]. The Kalman-filter method compute the Kalman gain offline [83]. Thus should offline simulation be included to account for the most complex tissue simulations, or to enable simulation of larger systems.…”
The use of digital twins to represent a product or process digitally is trending in many engineering disciplines. This term has also been recently introduced in the medical field. In arthroscopic surgery education, the paradigm shift from apprenticeship to simulation training has driven the need for better simulators, and the current focus is on improving simulators with respect to computational efficiency and system accuracy. However, expanding surgical simulations towards digital twins has not yet been explored. This paper introduces the digital twin concept for arthroscopic surgery, and explores its potential in light of the existing scientific literature. Thus, a systematic review was conducted to summarize and analyze the literature with respect to fast and robust design of an arthroscopic digital twin using patientspecific information, and methods for interactive surgical soft tissue simulation. The review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol with three reliable scientific search engines: IEEE Explore, ScienceDirect and PubMed. Eighty papers were included in the review, and the extracted data included modeling methods, tissue types, constitutive behavior, computational efficiency or accuracy, hardware configuration, haptic device description, software tools, and system architectures. Considering the review, a novel macro-level conceptual arthroscopic digital twin system is presented, and the applicability of the review findings for the identified subsystems are discussed. The proposed system integrates patient-specific images, diagnostic data, intraoperative sensor data, and surgical practice as inputs, and conceptually enables surgical skills training, preoperative planning, and a database of virtual surgeries.
“…FEM, PBD, and deep learning are typically used as simulation methods for flexible actuators. FEM has high simulation accuracy and is used not only used for structural analysis and material property simulation but also for the deformation simulation of flexible objects [37], [38]. However, the computational cost increases when simulating flexible objects accurately, and the real-time simulation is challenging.…”
Flexible actuators are popular in the consumer and medical fields because of their flexibility and compliance. However, they are typically difficult to model because of their viscoelasticity and nonlinearity. This letter proposes a method for correcting the deformation of the simulated flexible robots to make it similar to the deformation of real robots using point clouds by deep learning. Long shortterm memory (LSTM) can simulate the next frame of actuator deformation from the previous frames of deformations. In this study, we presented the robots with four different muscle structures. We found that using an encoder-LSTM-decoder network can improve the similarity between the deformation of a learned muscle structure and the real deformation and is also effective in correcting the deformation of the unlearned structures. Our correction method reduced the average Chamfer distance of the simulated point clouds of the basic-type structure actuator from 15.89 to 7.81. This research can provide a new concept for future flexible robot modeling using point clouds.
“…It consists of various mesh elements interpolated with different order of shape functions to cover the solution domain in the most efficient and less computational method [34,35]. It is widely used even in other scientific fields due to its reliability and flexibility as a modeling method [36,37]. The FEM is involved in RONST for the modal solution of the wave equation and to get the spatial distribution of the optical fields.…”
This paper presents a radio optical network simulation tool (RONST) for modeling optical-wireless systems. For a typical optical and electrical chain environment, performance should be optimized concurrently before system implementation. As a result, simulating such systems turns out to be a multidisciplinary problem. The governing equations are incompatible with co-simulation in the traditional environments of existing software (SW) packages. The ultra-wideband (UWB) technology is an ideal candidate for providing high-speed short-range access for wireless services. The limited wireless reach of this technology is a significant limitation. A feasible solution to the problem of extending UWB signals is to transmit these signals to endusers via optical fibers. This concept implies the need for the establishment of a dependable environment for studying such systems. Therefore, the essential novelty of the proposed SW is that it provides designers, engineers, and researchers with a dependable simulation framework that can accurately and efficiently predict and/or optimize the behavior of such systems in a single optical-electronic simulation package. Furthermore, it is supported by a strong mathematical foundation with integrated algorithms to achieve broad flexibility and low computational cost. To validate the proposed tool, RONST was deployed on an ultra-wideband over fiber (UWBoF) system. The bit error rate (BER) has been calculated over a UWBoF system, and there is good agreement between the experimental and simulated results.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.