KR-20260062109-A - MEDICAL IMAGE PROCESSING DEVICE USING AUGMENTED REALITY AND OPERATING METHOD THEREOF

KR20260062109AKR 20260062109 AKR20260062109 AKR 20260062109AKR-20260062109-A

Abstract

A method of operating a medical image processing device comprises the steps of: obtaining two-dimensional first images including the patient's vascular structure and pelvic structure by tomographically scanning the inside of the patient's pelvis from a first external device; performing three-dimensional modeling on the first images to generate three-dimensional modeling data; labeling the target blood vessel in the first image in real time so that the blood vessel name is recorded when a medical professional labels the target blood vessel in the three-dimensional modeling data; aligning the three-dimensional modeling data with a second image including the patient's pelvic structure and pelvic curvature obtained by three-dimensionally scanning the patient from a second external device; generating an augmented reality-based synthetic image that allows a medical image to be output on the patient's body in the second image; and transmitting the first images and the three-dimensional modeling data to an output device that outputs the synthetic image.

Inventors

최시은
박찬웅
윤건택
서현민
이근호
최윤진
이우영
김이석

Assignees

주식회사 스키아
가톨릭대학교 산학협력단

Dates

Publication Date: 20260507
Application Date: 20241024

Claims (15)

In a method of operating a medical image processing device, A step of obtaining two-dimensional first images including the patient's vascular structure, pelvic structure, and skin structure by tomographically imaging the inside of the patient's pelvis from a first external device; A step of generating 3D modeling data by performing 3D modeling on the first images; A step of labeling the target blood vessel of the blood vessel structure in the above 3D modeling data to record the blood vessel name, and labeling the target blood vessel in the first image in real time so that the blood vessel name is recorded thereon; and A method of operating a medical image processing device comprising the steps of: aligning the 3D modeling data with a second image including the pelvic internal structure and pelvic curvature of the patient obtained by 3D scanning the patient from a second external device; generating an augmented reality-based synthetic image that outputs a medical image on the patient's body in the second image; and transmitting the first images and the 3D modeling data to an output device that outputs the synthetic image.
In claim 1, the step of labeling the target blood vessel in the 3D modeling data to record the blood vessel name in real time, wherein the blood vessel name is recorded on the target blood vessel in the first image, is The above medical staff includes the step of clicking the target blood vessel in the above 3D modeling data to output a record window, and A method of operation of a medical image processing device characterized by the fact that when the medical staff records the name of the target blood vessel in the record window, the name of the target blood vessel is recorded in the first image in real time.
A method of operation of a medical image processing device according to claim 1, wherein the target blood vessel comprises at least one of the patient's uterine artery, superior vesical artery, aorta, common iliac artery, internal iliac artery, external iliac artery, and renal vein.
In claim 1, after the step of generating the three-dimensional modeling data, A method of operation of a medical image processing device characterized by further including the step of rotating and moving the above-mentioned three-dimensional modeling data.
A method of operation of a medical image processing device according to claim 4, characterized in that, in the step of rotating and moving the three-dimensional modeling data, the rendering quality of the three-dimensional modeling data is limited while the three-dimensional modeling data is rotated and moved.
In claim 1, after the step of acquiring the first images, In the first image above, the first-1 region and the first-2 region of the blood vessel structure are each processed to have a first color and a second color different from the first color, and A method of operation of a medical image processing device characterized in that the 2-1 region and the 2-2 region of the blood vessel structure, corresponding respectively to the 1-1 region and the 1-2 region in the above 3D modeling data, each have the 1 color and the 2 color.
In claim 6, after the step of generating the three-dimensional modeling data, A method of operation of a medical image processing device characterized by further including the step of labeling at least a portion of the 1-1 region and the 1-2 region of the blood vessel structure in the 1st image to be modified, and labeling at least a portion of the 2-1 region and the 2-2 region of the blood vessel structure corresponding thereto in the 3D modeling data to be modified and displayed in real time.
In claim 6, after the step of generating the three-dimensional modeling data, A method of operation of a medical image processing device characterized by further including the step of, when a specific area other than the blood vessel structure in the first image is processed with the first color or the second color, labeling the first color or the second color of the specific area in the first image to be deleted, and labeling the first color or the second color of the corresponding part of the specific area in the 3D modeling data to be deleted in real time.
A computer-readable recording medium having a computer program recorded thereon for performing a method of operating a medical image processing device using augmented reality according to any one of claims 1 to 8.
A data receiving unit that receives two-dimensional first images including the patient's vascular structure, pelvic structure, and skin structure obtained by tomographically scanning the inside of the patient's pelvis from a first external device; An image processing unit that performs three-dimensional modeling on the first images to generate three-dimensional modeling data; An output unit that outputs the first images and the three-dimensional modeling data; A labeling unit that labels the target blood vessel in the first image in real time so that the blood vessel name is recorded when a medical professional labels the target blood vessel of the blood vessel structure in the above 3D modeling data; and A medical image processing device comprising: a data transmission unit that aligns the 3D modeling data with a second image including the pelvic internal structure and pelvic curvature of the patient obtained by 3D scanning the patient from a second external device; generates an augmented reality-based synthetic image that outputs a medical image on the patient's body in the second image; and transmits the first images and the 3D modeling data to an output device that outputs the synthetic image.
In Article 10, The above output unit outputs a record window when the medical staff clicks the target blood vessel in the 3D modeling data, and A medical image processing device characterized by the above labeling unit labeling the blood vessel name of the target blood vessel in the first image in real time when the medical staff records the blood vessel name of the target blood vessel in the recording window.
In Article 10, It further includes a processor that controls the operation of the data receiving unit, the image processing unit, the labeling unit, and the data transmission unit, and A medical image processing device characterized by the processor controlling the rendering quality of the three-dimensional modeling data to be limited while the three-dimensional modeling data is rotated and moved.
In claim 10, the image processing unit is, In the first image above, the 1-1 region and the 1-2 region of the blood vessel structure are processed to each have a first color and a second color different from the first color, and A medical image processing device characterized in that the 2-1 region and 2-2 region of the blood vessel structure, corresponding respectively to the 1-1 region and the 1-2 region in the above 3D modeling data, each have the 1 color and the 2 color.
In claim 13, if the medical staff labels the color of at least part of the 1-1 region and the 1-2 region of the vascular structure in the 1st image, A medical image processing device characterized by the above labeling unit labeling in real time so that at least a portion of the 2-1 region and the 2-2 region of the vascular structure corresponding thereto in the 3D modeling data is modified and displayed.
In claim 13, if a specific area other than the blood vessel structure in the first image is processed with the first color or the second color, and the medical staff labels the first color or the second color of the specific area in the first image to be deleted, A medical image processing device characterized by the above labeling unit labeling to delete the first color or the second color of a part corresponding to the specific area corresponding thereto in the three-dimensional modeling data in real time.

Description

Medical image processing device and method of operation thereof The present invention relates to a medical image processing device and a method of operating the same. More specifically, the present invention relates to a medical image processing device used in an augmented reality-based medical image processing system and a method of operating the same. There is a high level of interest in the medical industry in improving technologies for visualizing the inside of a patient during medical procedures. For example, various imaging technologies, such as computed tomography (CT) scans and magnetic resonance imaging (MRI), can be utilized to enable medical professionals to visualize organs, bones, and other tissues inside a patient's body. FIG. 1 is a block diagram showing a medical image processing system according to one embodiment of the present invention. Figure 2 is a drawing showing an example of a screen displayed in the medical image processing device of Figure 1. Figure 3 is a drawing showing another example of a screen displayed in the medical image processing device of Figure 1. Figure 4 is a drawing showing a screen displayed on the output device of Figure 1. FIG. 5 is a flowchart for explaining the operation method of a medical image processing device according to one embodiment of the present invention. FIG. 6 is a flowchart illustrating a method of operation of a medical image processing device according to an embodiment of the present invention. With respect to the embodiments of the present invention disclosed in the text, specific structural or functional descriptions are provided merely for the purpose of explaining the embodiments of the present invention, and the embodiments of the present invention may be implemented in various forms and should not be interpreted as being limited to the embodiments described in the text. The present invention is capable of various modifications and may take various forms, and specific embodiments are illustrated in the drawings and described in detail in the text. However, this is not intended to limit the invention to the specific disclosed forms, and it should be understood that the invention includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the invention. Terms such as first, second, etc. may be used to describe various components, but said components should not be limited by said terms. said terms may be used for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. Conversely, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. Other expressions describing the relationships between components, such as "between" and "exactly between," or "adjacent to" and "directly adjacent to," should be interpreted in the same way. The terms used in this application are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "having" are intended to specify the existence of the described features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof. Additionally, terms such as "~part" mentioned in the text refer to a unit that processes at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software. Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application. Hereinafter, embodiments of the present invention will be described in more detail with reference to the attached drawings. Identical or similar reference numerals are used for identical components in the drawings. In this specification, "medical image processing device" and "output device" include all various devices capable of performing computat