US-12619059-B2 - Image enhancement system and implementation method therefor

US12619059B2US 12619059 B2US12619059 B2US 12619059B2US-12619059-B2

Abstract

The present invention discloses an image enhancement system and an implementation method therefor. The system comprises a media signal processing apparatus, an image enhancement apparatus, a microscope body, and a binocular tube. The image enhancement apparatus comprises a housing, and a display device and a superposition lens group that are disposed in the housing, the display device is connected to the media signal processing apparatus, the superposition lens group is disposed on a main optical path of the microscope body, the binocular tube is disposed on the microscope body, the display device is configured to receive information data sent by the media signal processing apparatus and convert the received information data into an optical image, the optical image sent by the display device is superposed to the main optical path of the microscope body through the superposition lens group to form a superposed image, and the superposed image can be observed through the binocular tube. In this application, some images with additional information may be superposed into an observation field of view of a microscope, so that an operator can observe required information more intuitively, and compare, superpose, and fuse the information with a real object under the microscope better, thereby improving operation accuracy and precision.

Inventors

Jilong Wang
Bobby NADEAU
Jianyue Li
Bin Huang
Jian Chen
Jin He
Tao QIU
ZhuangZhuang HU

Assignees

ZUMAX MEDICAL CO., LTD.

Dates

Publication Date: 20260505
Application Date: 20220617
Priority Date: 20210618

Claims (17)

1 . An image enhancement system, comprising a media signal processing apparatus, an image enhancement apparatus, a microscope body, and a binocular tube, wherein the image enhancement apparatus comprises a housing, a display device, and a superposition lens group, both the display device and the superposition lens group are located in the housing, the display device is communicatively connected to the media signal processing apparatus, the superposition lens group is disposed on a main optical path of the microscope body, the binocular tube is disposed on the microscope body, the display device is configured to receive information data sent by the media signal processing apparatus and convert the received information data into an optical image, the optical image sent by the display device is superposed to the main optical path of the microscope body through the superposition lens group to form a superposed image, and the superposed image can be observed through the binocular tube, wherein the image enhancement system further comprises a plurality of information input apparatuses, wherein the information input apparatuses are respectively communicatively connected to the media signal processing apparatus, and the media signal processing apparatus is configured to convert information data inputted by the plurality of information input apparatuses into composite information data and send the composite information data to the display device, wherein the information input apparatus comprises a positioning and navigation device, the positioning and navigation device is mounted on a surgical instrument, the positioning and navigation device is communicatively connected to the media signal processing apparatus, and the positioning and navigation device is configured to acquire position information of the surgical instrument in real time and input the position information into the media signal processing apparatus, and wherein the information input apparatus further comprises a root canal measurement device, the root canal measurement device is communicatively connected to the media signal processing apparatus, and the root canal measurement device is configured to measure length information of a root canal of a target tooth and input the length information into the media signal processing apparatus.
2 . The image enhancement system according to claim 1 , wherein the display device comprises an information display region, the information display region matches an observation field of view of the binocular tube, and an optical image corresponding to the composite information data converted by the media signal processing apparatus is displayed in the information display region; and the display device is an OLED display, an LCD display, or a DLP display, the optical image sent by the display device is black in a region outside the optical image corresponding to the composite information data.
3 . The image enhancement system according to claim 2 , further comprising an adjustment apparatus, wherein the adjustment apparatus is communicatively connected to the media signal processing apparatus, the adjustment apparatus is configured to input adjustment information into the media signal processing apparatus, and the media signal processing apparatus is configured to control, according to the adjustment information, on/off, a size, a position, and an angle of an image that is of the information data inputted by the information input apparatuses and that is displayed in the information display region, the image enhancement system further comprises an acquisition apparatus, wherein the acquisition apparatus is communicatively connected to the media signal processing apparatus, the acquisition apparatus is configured to acquire biometric feature information of a user in real time, and the media signal processing apparatus is configured to control, according to the biometric feature information, on/off, a size, a position, and an angle of an image that is of the information data inputted by the information input apparatuses and that is displayed in the information display region.
4 . The image enhancement system according to claim 1 , further comprising an image acquisition apparatus, wherein the image acquisition apparatus is communicatively connected to the media signal processing apparatus, and the image acquisition apparatus is configured to acquire image information in the main optical path of the microscope body in real time and input the image information to the media signal processing apparatus.
5 . The image enhancement system according to claim 1 , wherein the media signal processing apparatus is a mobile terminal, the media signal processing apparatus is the mobile terminal with a touch screen, and on/off, a size, a position, or an angle of a corresponding image of each piece of information data displayed in the display device is adjusted by touching the touch screen.
6 . The image enhancement system according to claim 4 , further comprising a terminal support, wherein the media signal processing apparatus is disposed on one side of the image enhancement apparatus or one side of the microscope body through the terminal support, a wireless charging module for charging the mobile terminal is disposed on the terminal support.
7 . The image enhancement system according to claim 1 , wherein the image enhancement apparatus further comprises a beam splitter group, the beam splitter group is disposed in the housing, a beam splitter interface is provided on one side of the housing, and the beam splitter group is capable of emitting a part of a light beam in the main optical path of the microscope body or a part of a light beam of the superposed image from the beam splitter interface, the media signal processing apparatus is configured to acquire the light beam emitted from the beam splitter interface.
8 . The image enhancement system according to claim 4 , wherein the media signal processing apparatus is configured to display a three-dimensional model, wherein an angle of the three-dimensional model is adjustable, and/or a size of the three-dimensional model is adjustable, and/or a transparency of the three-dimensional model is adjustable, the media signal processing apparatus is configured to display a CBCT image, wherein an angle of the CBCT image is adjustable, and/or a size of the CBCT image is adjustable, and/or a transparency of the CBCT image is adjustable.
9 . An implementation method for an image enhancement system, comprising: importing information data of a target object into a media signal processing apparatus; processing the imported information data, and sending processed information data to a display device of an image enhancement apparatus by the media signal processing apparatus; and receiving the information data, and converting the information data into an optical image for display by the display device , wherein the optical image displayed by the display device enters a superposition lens group on a main optical path of a microscope body through a lens optical path, and the optical image displayed by the display device is superposed to the main optical path to form a superposed image, and then the superposed image enters a binocular tube, wherein the information data comprises CBCT image data, and after the CBCT image data is imported into the media signal processing apparatus, the media signal processing apparatus parses the CBCT image data, to obtain a three-dimensional image of an oral cavity of the target object, highlights key information in the three-dimensional image of the oral cavity of the target object, generates a four-view image, and selectively displays the four-view image in an information display region of the display device, and a target tooth is selected from any view image in the four-view image, and the media signal processing apparatus generates a three-dimensional image and a cross section cutting view of the selected target tooth, and selectively displays the three-dimensional image and the cross section cutting view in the information display region of the display device.
10 . The implementation method for an image enhancement system according to claim 9 , wherein the information data comprises three-dimensional model data of a target tooth, and after the three-dimensional model data of the target tooth is imported into the media signal processing apparatus, the media signal processing apparatus processes the three-dimensional model data and selectively displays processed three-dimensional model data in an information display region of the display device.
11 . The implementation method for an image enhancement system according to claim 9 , wherein the information data further comprises additional information data, and after the additional information data is imported into the media signal processing apparatus, the media signal processing apparatus processes the additional information data and selectively displays processed additional information data in an information display region of the display device.
12 . The implementation method for an image enhancement system according to claim 9 , wherein when sending the information data to the display device, the media signal processing apparatus first integrates all information data into composite information data, and then sends the composite information data to the display device ( 21 ) for display, wherein on/off, a size, a position, and an angle of a corresponding image of each piece of information data displayed in the display device are adjustable.
13 . The implementation method for an image enhancement system according to claim 9 , wherein an operation of parsing the CBCT image data by the media signal processing apparatus comprises: obtaining a folder path in whictl the CBCT image data is located; obtaining a DICOM sequence and sequence information, wherein the sequence information comprises a sequence path, a quantity of slices, and each picture; selecting a sequence according to the sequence information, adding the sequence to a database, and outputting the sequence path; parsing sequence basic information, storing parsed basic information into a sequence volume data structure, outputting sequence volume data information, and receiving, by a data control thread, the sequence volume data information and controlling image display and interaction, and during four-view image display and interaction, interactively selecting the target tooth on an interface, inputting the selected information into a tooth segmentation module for tooth segmentation, then outputting a divided tooth three-dimensional graph to the data control thread, and continuously maintaining, by the data control thread, image display and interaction.
14 . The implementation method for an image enhancement system according to claim 13 , wherein after the outputting the sequence path, the method further comprises: parsing the sequence basic information, storing the parsed basic information into a sequence slice information base, and outputting the parsed basic information, and receiving, by an instance management module, the parsed basic information, and adding the parsed basic information to the database.
15 . The implementation method for an image enhancement system according to claim 13 , wherein during four-view image display and interaction, an exported path is interactively selected on the interface, the selected information is inputted into a path control module for storing and managing the path, and the data control thread continuously maintains image display and interaction.
16 . The implementation method for an image enhancement system according to claim 9 , wherein an image acquisition apparatus is disposed to acquire image information in the main optical path of the microscope body in real time and input the image information into the media signal processing apparatus, and the media signal processing apparatus performs matching according to the image information acquired by the image acquisition apparatus to obtain a cross section cutting view matching the target tooth in the image information in the main optical path, and superposes the cross section cutting view on an image of the target tooth.
17 . The implementation method for an image enhancement system according to claim 9 , wherein a positioning and navigation device is disposed on a surgical instrument to acquire position information of the surgical instrument in real time and input the position information into the media signal processing apparatus, and the media signal processing apparatus processes image data of the target tooth to obtain an optimal path for operating the target tooth, and then selectively display the position information of the surgical instrument and relative position information between the surgical instrument and the optimal path in the information display region of the display device.

Description

RELATED APPLICATION This application is a National Stage Application of International Application No. PCT/CN2022/099487 filed on Jun. 17, 2022 which further claims priority from China Patent Application having Ser. No. 20/211,0680210.X respectively filed on Jun. 18, 2021, which is incorporated herein by reference for all purpose. FIELD OF THE INVENTION The present invention relates to the field of dental diagnosis and treatment technologies, and in particular, to an image enhancement system of an operating microscope and an implementation method therefor. BACKGROUND TECHNOLOGY Modern medicine has made substantive progress in the fields of in vitro diagnosis, micro treatment, medical imaging, minimally invasive treatment, and the like, and diagnosis and treatment means of cross-category and multidisciplinary integration are emerging. Due to the continuous development of medical imaging devices and the rapid development of medical imaging technologies, sub-disciplines of medical imaging such as CT, MR, interventional radiography, ultrasound, and nuclear medicine are gradually established, and a medical imaging technology discipline is also gradually formed. Medical imaging information is more sensitive, intuitive, specific, and early-stage. Image analysis develops from qualitative to quantitative, and from displaying diagnostic information to providing a surgical path solution. Image camera and display develops from two-dimensional simulation to three-dimensional full digitalization. Image storage develops from film hard copy to soft copy without film, and even image transmission networking; and from a single image technology to an integrated image technology. To adapt to the digitization, networking, and integration of medical imaging, it is necessary to establish a viewpoint of integrating three majors of diagnosis, technology, and engineering. A single major can no longer complete the functions of the modern medical imaging discipline. Root canal therapy is used as an example. A doctor needs to completely open a pulp cavity, and find and treat all root canals. A human being generally has one to four root canals per tooth, with a rear tooth having the most root canals. When a root canal orifice of a multi-root canal tooth is difficult to find due to a case such as age-related changes or deposition of reparative dentine, pulp stone, pulp cavity calcification, or root canal morphological variation, an anatomic form of the pulp cavity should be understood and viewed from all directions and positions with the aid of the three-dimensional anatomic form of a tooth. Quantities, shapes, positions, directions, and bending of roots and root canals, a relationship between a root of tooth and a dental crown, and various variation conditions of anatomic forms of the root of tooth and the root canal are learned and pointed out by using X-ray films captured by using a multi-angle projection method. Because a quantity of root canals in some teeth may reach four, there may be complicated cases such as lateral canals, accessory root canals, apical ramification, and apical bifurcation, which may be missed even under magnification observation. It is necessary to estimate a possible position of the root canal. If necessary, a small ball drill may be used to remove a small amount of dentin at a developmental groove where the root canal may or is expected to be located, then a sharp probe may be used to attempt to pierce any calcified region to indicate dentinal collar with a tooth neck being removed in a root canal orifice to expose a position of the root canal orifice. That is, if there is calcification in the root canal orifice and the like, it is more necessary for a doctor to repeatedly explore each possible position, which inevitably removes too much healthy tooth tissue. At present, a manner of preoperative dental film is often used to help a doctor judge and determine a quantity and shapes of root canals. First, the doctor needs to pay most attention on remembering the shapes of the root canals, and even suspend the operation to observe the dental film again. In addition, because the tooth film is only a two-dimensional planar image, a three-dimensional shape of the root canal cannot be accurately reflected. In fact, a plurality of root canals are bent for a plurality of times, and cannot rely on the tooth film for accurate positioning. CBCT and other three-dimensional images are complex and difficult to remember. The doctor needs to remember a three-dimensional shape of a tooth structure, and take a lot of effort to compare, stack, and fuse the three-dimensional shape with a real object under a microscope during operation, which is difficult to ensure accuracy and precision. Therefore, in view of the above existing technical problems, it is necessary to provide a new technical solution. SUMMARY OF THE INVENTION To resolve the technical problems existing in the related art, this application provides an image enhancement s