KR-20260067741-A - METHOD FOR PROVIDING AN ENVIRONMENT FOR AI-BASED VIRTUAL REALITY SURGICAL MODELING, AND APPARATUS THEREOF

Abstract

The present invention is a method for providing an AI-based virtual reality surgery modeling environment and an apparatus related thereto, comprising the steps of: loading data from a patient terminal; preprocessing the loaded data; performing 3D modeling by integrating the preprocessed data; loading data from an Internet of Things terminal; and providing a VR simulation environment related to patient surgery based on the loaded data and the 3D modeling results.

Inventors

• 남윤영
• 모하메드 압델 바셋
• 압두알라 가말 압두알라
• 레다 모하메드 라마단
• 알라 마하무드 모하메드 엘모어
• 모하메드 아부하와쉬

Assignees

• 순천향대학교 산학협력단

Dates

Publication Date

20260513

Application Date

20241106

Claims (14)

1. In a method performed by a virtual reality providing device, Step of loading data from a patient terminal; Step for preprocessing loaded data; A step of performing 3D modeling by integrating preprocessed data; Step of loading data from an Internet of Things terminal; and A step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results; The above VR simulation environment relates to a surgical environment performed by a physician and includes surgical instruments related to surgery. Method for providing an AI-based virtual reality surgical modeling environment.
2. In paragraph 1, Based on loaded data and 3D modeling results, the step of providing a VR simulation environment related to patient surgery further includes the step of providing smart surgical instruments to the VR simulation environment. Method for providing an AI-based virtual reality surgical modeling environment.
3. In paragraph 2, The step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes the step of receiving data collected from a smart surgical instrument and a corresponding surgical instrument. Method for providing an AI-based virtual reality surgical modeling environment.
4. In paragraph 3, The step of providing a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes the step of providing feedback data to the VR simulation environment based on received data. Method for providing an AI-based virtual reality surgical modeling environment.
5. In paragraph 4, The step of providing feedback data to a VR simulation environment further includes a step of evaluating surgical movements based on the feedback data. Method for providing an AI-based virtual reality surgical modeling environment.
6. In paragraph 5, The step of providing feedback data to a VR simulation environment further includes the step of providing evaluation results. Method for providing an AI-based virtual reality surgical modeling environment.
7. In paragraph 6, The step of providing feedback data to a VR simulation environment further includes a step of providing deviations or errors from predefined rules along with evaluation results. Method for providing an AI-based virtual reality surgical modeling environment.
8. processor; Network interface; Memory; and It includes a computer program that is loaded into the memory and executed by the processor, The above processor is, Instructions to load data from a patient terminal; Instructions for preprocessing loaded data; Instructions for performing 3D modeling by integrating preprocessed data; Instructions for loading data from an Internet of Things terminal; and Instructions that provide a VR simulation environment related to patient surgery based on loaded data and 3D modeling results; are performed, including The above VR simulation environment relates to a surgical environment performed by a physician and includes surgical instruments related to surgery. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
9. In paragraph 8, Based on loaded data and 3D modeling results, instructions for providing a VR simulation environment related to patient surgery are executed by further including instructions for providing smart surgical instruments to the VR simulation environment. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
10. In Paragraph 9, Based on loaded data and 3D modeling results, instructions for providing a VR simulation environment related to patient surgery further include instructions for receiving data collected from smart surgical instruments and corresponding surgical instruments. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
11. In Paragraph 10, An instruction that provides a VR simulation environment related to patient surgery based on loaded data and 3D modeling results further includes an instruction that provides feedback data to the VR simulation environment based on the received data. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
12. In Paragraph 11, Instructions that provide feedback data to a VR simulation environment include additional instructions for evaluating surgical movements based on the feedback data. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
13. In Paragraph 12, Instructions that provide feedback data to a VR simulation environment are executed by further including instructions that provide evaluation results. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.
14. In Paragraph 13, Instructions that provide feedback data to a VR simulation environment are executed by including additional instructions regarding deviations or errors from predefined rules, along with evaluation results. A virtual reality providing device that provides an AI-based virtual reality surgical modeling environment.

Description

Method for providing an environment for AI-based virtual reality surgical modeling and apparatus therefor The present invention relates to a method and apparatus for providing an AI-based virtual reality surgical modeling environment, and more specifically, to a method and apparatus for providing a realistic surgical modeling environment related to various images, including CT scans, MRI, angiography, and endoscopy, by utilizing generative AI technology tailored to the anatomical and pathological characteristics of each patient. Virtual reality is revolutionizing medical practice by providing powerful ways to explore and interact with digital medical data. Potential benefits of adding VR to surgical training include preoperative residents being exposed to surgical techniques and practicing complex procedures in a risk-free environment, improving patient safety outcomes, and reducing potential errors and complications during live surgery, which can also lead to reduced medical costs associated with surgical errors. However, despite its potential benefits, VR technology is not without its limitations, and one of the major challenges is that current VR simulations may not be able to fully replicate the complexity of organic tissues or accurately simulate medical and surgical scenarios. These limitations can result in unrealistic virtual environments where physicians may not be adequately prepared for actual surgery. Standard 3D models used in VR simulations are often generated from imaging data such as CT scans and MRIs, but these models can be generic and may fail to capture the detailed complexity of individual patient cases. Consequently, these models may not effectively represent each patient's unique anatomical and pathological features, which can impact surgical planning and execution. Manually creating detailed and accurate 3D models for surgical simulation is a complex and resource-intensive process, and integrating data from multiple image sources into a single, consistent 3D model requires a high level of expertise. This process is costly because it is not only labor-intensive but also requires significant time and effort from skilled professionals, and the manual approach to model creation also raises scalability issues. Since a new model is required for each new case, the efficiency of generating customized simulations for numerous unique patients is limited. These gaps may limit the widespread adoption of VR simulation in surgical training and practice and restrict its use in various medical centers worldwide. This highlights the urgent need for detailed, individualized, and affordable 3D models to enhance surgical simulation, and advancements in generative AI offer potential solutions to address these challenges. Creating highly accurate 3D models of the human body or specific body parts for surgical simulation requires integrating various detailed image modalities, each providing unique and critical information. The aforementioned background technology is technical information that the inventor possessed for the derivation of the present invention or acquired during the process of deriving the present invention, and it cannot be considered technology that was known to the general public prior to the filing of the present invention. FIG. 1 illustrates an exemplary environment in which a virtual reality providing device according to some embodiments of the present disclosure may be applied. FIG. 2 is a flowchart relating to an operation of providing a surgical simulation based on a 3D modeling result that can be performed in a virtual reality providing device according to some embodiments of the present disclosure. FIG. 3 is a flowchart for specifically describing the steps of providing a surgical simulation environment according to some embodiments of the present disclosure. FIG. 4 is a flowchart for specifically describing the step of providing feedback data to a VR simulation environment according to some embodiments of the present disclosure. FIG. 5 is an exemplary drawing of an architecture in which the present invention can be implemented according to some embodiments of the present disclosure. FIG. 6 is a drawing of an exemplary computing device capable of implementing a device and/or system according to various embodiments of the present disclosure. Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the attached drawings. The advantages and features of the present disclosure and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the attached drawings. However, the technical concept of the present disclosure is not limited to the following embodiments but can be implemented in various different forms. The following embodiments are provided merely to complete the technical concept of the present disclosure and to fully inform those skilled in the art of the scope of t