Search

CN-121999993-A - Medical image display system

CN121999993ACN 121999993 ACN121999993 ACN 121999993ACN-121999993-A

Abstract

The invention provides a medical image display system which comprises a glasses part and a server, wherein the glasses part receives and recognizes voice instructions, gesture instructions and staring instructions of users, the staring instructions are utilized to select gesture instructions of the users from the recognized gesture instructions, the gesture instructions of the users are utilized to correct the voice instructions to form request instructions, and the server receives the request instructions and provides medical images of shooting objects for the glasses part according to the request instructions.

Inventors

  • HAN YINGGEN
  • WANG DONGMEI
  • He Huishu
  • LI XIJIN

Assignees

  • 钰臻元(天津)医疗器械有限公司

Dates

Publication Date
20260508
Application Date
20260127

Claims (10)

  1. 1. A medical image display system, comprising: A glasses unit (100) for receiving and recognizing a voice command, a gesture command, and a gaze command of a user, selecting the gesture command of the user from the recognized gesture commands by using the gaze command, and correcting the voice command by using the gesture command of the user to form a request command, and And a server (200) which receives the request instruction and supplies the medical image of the subject (S) to the eyeglass portion (100) according to the request instruction.
  2. 2. The medical image display system according to claim 1, wherein, The eyeglass portion (100) comprises: a voice part for receiving and recognizing the voice instruction; a vision part for observing and recognizing the object in front and the gesture instruction; an eyeball tracking part for tracking the eyeball of the user to identify the sight line of the user and the staring instruction, and And a display unit for displaying the medical image through a lens.
  3. 3. The medical image display system according to claim 1, wherein, Further comprises a three-dimensional fluorescence tomography device (10), wherein the three-dimensional fluorescence tomography device (10) is used for forming a real-time three-dimensional fluorescence tomography image of the shooting object (S), The medical image includes the stereoscopic fluorescent tomogram.
  4. 4. A medical image display system according to claim 3, wherein, The server (200) receives the stereoscopic fluorescent tomogram from the stereoscopic fluorescent tomogram apparatus (10) and, when receiving a request instruction for the stereoscopic fluorescent tomogram from the eyeglass portion (100), supplies the stereoscopic fluorescent tomogram to the eyeglass portion (100), When the user 'S line of sight is looking at the subject (S), the glasses unit (100) displays the stereoscopic fluorescent tomogram so that the stereoscopic fluorescent tomogram and the subject (S) overlap each other within the user' S line of sight.
  5. 5. A medical image display system according to claim 3, wherein, The medical image further includes at least one of a computed tomography image, a nuclear magnetic resonance image, an X-ray image, and an ultrasound image, The server (200) provides at least one of the stereoscopic fluoroscopic tomogram, the computed tomography image, the nuclear magnetic resonance image, the X-ray image, and the ultrasound image to the eyeglass portion (100) according to the request instruction.
  6. 6. The medical image display system according to claim 5, wherein, The server (200) integrates two or more medical images to form an integrated image, and when a request instruction for the integrated image is received from the eyeglass portion (100), provides the integrated image to the eyeglass portion (100), When the user 'S line of sight is looking at the subject (S), the glasses unit (100) displays the integrated image so that the integrated image and the subject (S) overlap each other within the user' S line of sight.
  7. 7. The medical image display system according to claim 6, wherein, The integrated image comprises an image formed by integrating the three-dimensional fluorescence tomography image with at least one of a computer tomography image, a nuclear magnetic resonance image, an X-ray image and an ultrasonic image.
  8. 8. A medical image display system according to claim 3, wherein, The three-dimensional fluorescence tomography apparatus (10) includes: An imaging unit (1) for imaging an imaging subject (S) to obtain a fluorescence image and an optical coherence tomography image; An image processing part for processing the image shot by the shooting part (1) to obtain a three-dimensional fluorescence tomography image; A plurality of excitation light emitting sections (21) for emitting excitation light beams (211) having a field angle to the subject (S) to excite fluorescence in the subject (S); a tomographic light emission section (22) for emitting a tomographic light beam (221) to perform optical coherence tomography on the photographic subject (S); a first mirror (71) for reflecting the tomographic light beam (221) onto a main optical axis (11) of the photographing section (1); a beam splitter (72) disposed on the main optical axis (11) and configured to split a tomographic light beam (221) reflected by the first mirror (71) into a first light beam (222) and a transmitted second light beam (223) that are directed toward the subject (S) along the main optical axis (11); -a second mirror (73) reflecting said second light beam (223) back to said beam splitter (72); A multi-wavelength light source unit (3) connected to the plurality of excitation light emitting units (21) and the tomographic light emitting unit (22) for providing the plurality of excitation light emitting units (21) with excitation light sources of different wavelengths, respectively, so that the plurality of excitation light emitting units (21) emit excitation light beams (211) of different wavelengths, respectively, to excite fluorescence at different depths of the subject (S), and simultaneously providing the tomographic light emitting unit (22) with a tomographic light source for forming the tomographic light beam (221), and And a wavelength-tunable filter (4) that is disposed in front of the field of view of the imaging unit (1) and filters light emitted to the imaging unit (1) according to the excitation light sources and the tomographic light sources of different wavelengths so that the imaging unit (1) obtains fluorescent images of different depths based on the first fluorescent developer for the imaging subject (S) and optical coherence tomographic images of the entire imaging subject (S) at the same time.
  9. 9. The medical image display system according to claim 8, wherein, The image processing unit calculates the depth corresponding to each of the fluorescent images from the depth information in the optical coherence tomography image, and combines the fluorescent images according to the depth to form a stereoscopic fluorescent tomography image of the subject (S) corresponding to the first fluorescent developer.
  10. 10. The medical image display system according to claim 8, wherein, The image processing part extracts a first separation image corresponding to a first fluorescent developer and a second separation image corresponding to a second fluorescent developer from each fluorescent image, calculates the depth corresponding to each first separation image and each second separation image according to the depth information in the optical coherence tomography, and combines each first separation image and each second separation image according to the depth thereof to form a three-dimensional fluorescent tomography image corresponding to the first fluorescent developer and a three-dimensional fluorescent tomography image corresponding to the second fluorescent developer of the shooting object (S).

Description

Medical image display system Technical Field The present invention relates to a medical image display system, and more particularly, to a medical image display system that accurately forms a request instruction and displays a medical image in a line of sight of a user in a manner entirely overlapping a photographic subject based on the request instruction. Background With the development of medical technology, the medical imaging technologies such as fluorescence imaging, optical coherence tomography, CT, nuclear magnetic resonance, B-ultrasonic and the like are endlessly layered. Different medical imaging technologies have respective advantages and pertinence, so in order to fully understand the condition of a patient, doctors generally perform comprehensive examination on affected parts of the patient by adopting various medical imaging technologies so as to comprehensively judge the condition of the patient, thereby obtaining an accurate diagnosis result. Wherein the fluorescent imaging clearly shows tissues, organs, lesions, etc. which are not visible by other medical imaging techniques by means of autofluorescent substances contained in the human body or a previously injected fluorescent developer. Generally, an image obtained through fluorescence imaging is a planar image, and if a stereoscopic fluorescence image is to be obtained, a sample needs to be scanned layer by layer, so that the operation is complicated, the time consumption is long, and the imaging cannot be completed rapidly or in real time. Therefore, the image processing device cannot be integrated with other types of medical images in real time to comprehensively reflect the actual situation. On the other hand, with the development of technologies such as AR (Augmented reality; augmented reality), VR (Virtual reality), and the like, more and more intelligent display devices and interactive devices are beginning to be applied to the medical field. In the prior art, some AR or VR devices have functions that can be controlled by voice, gestures, or the like, but there is still a problem that interference from other people's voice, motion, gestures, or the like cannot be eliminated. Therefore, there is a strong need for a medical image display system that can correct and determine a request command simultaneously according to a plurality of commands, and based on the request command, display real-time stereoscopic fluorescent tomograms and images thereof integrated with other types of medical images directly to a user through glasses in a manner of overlapping with corresponding parts of a human body. Disclosure of Invention Technical problem An object of the present invention is to provide a medical image display system capable of accurately forming a request instruction for a medical image. Another object of the present invention is to provide a medical image display system capable of forming a real-time stereoscopic fluorescent tomogram and displaying the stereoscopic fluorescent tomogram in a line of sight of a user in a manner corresponding to a size, an angle, and the like of a subject. Another object of the present invention is to provide a medical image display system capable of integrating a real-time stereoscopic fluoroscopic tomographic image with other types of medical images to form a real-time integrated image and displaying the integrated image in a line of sight of a user in a manner corresponding to a size, an angle, etc. of a subject. The technical problems to be solved by the present invention are not limited to the above-described technical problems, and other technical problems to be solved by the present invention can be understood by those skilled in the art from the description of the present invention. Technical proposal The invention provides a medical image display system which comprises a glasses part and a server, wherein the glasses part receives and recognizes voice instructions, gesture instructions and staring instructions of users, the staring instructions are utilized to select gesture instructions of the users from the recognized gesture instructions, the gesture instructions of the users are utilized to correct the voice instructions to form request instructions, and the server receives the request instructions and provides medical images of shooting objects for the glasses part according to the request instructions. As one embodiment, the glasses part may include a voice part to receive and recognize the voice command, a vision part to observe and recognize an object in front and the gesture command, an eye tracking part to track the eyes of the user to recognize the line of sight of the user and the gaze command, and a display part to display the medical image through a lens. As an embodiment, the method may further include a stereoscopic fluorescent tomography apparatus for forming a real-time stereoscopic fluorescent tomogram of the photographing object, and the medical image may include the stereosco