US-12626362-B2 - Methods and systems for ehnanced ophthalmic visualization

US12626362B2US 12626362 B2US12626362 B2US 12626362B2US-12626362-B2

Abstract

In certain embodiments, a system, a computer-implemented method, and computer-readable medium are disclosed for enhanced ophthalmic visualization. A plurality of images corresponding to different portions of the electromagnetic spectrum are obtained and combined, such as by pixel-wise subtraction to obtain a combined image. The images may be weighted with weights selected to enhance visualization of features, such as layers of the retina or features corresponding to pathologies. The combined image may be processed, such as by a machine learning model, to extract features.

Inventors

Qing Xiang
John Park
Ying Zhu
Jonathan Che-Pin CHANG

Assignees

ALCON INC.

Dates

Publication Date: 20260512
Application Date: 20230927

Claims (16)

1 . An ophthalmic visualization system comprising: one or more processing devices and one or more memory devices coupled to the one or more processing devices, the one or more memory devices storing executable code that, when executed by the one or more processing devices, causes the one or more processing devices to: receive a plurality of images of an eye of a patient obtained using a multi-spectral imaging MSI) device, each image corresponding to a different portion of an electromagnetic spectrum; obtain a combined image by performing pixel-wise combination of two or more images of the plurality of images; and output a representation of the combined image to a display device, comprising: process the combined image to obtain a segmentation mask identifying one or more features represented in the combined image; and superimpose the segmentation mask onto one of (a) one or more of the plurality of images and (b) the combined image to obtain the representation of the combined image.
2 . The ophthalmic visualization system of claim 1 , wherein the plurality of images include red, green, and blue images constituting a color image.
3 . The ophthalmic visualization system of claim 1 , wherein the plurality of images include an infrared image.
4 . The ophthalmic visualization system of claim 1 , wherein, when executed by the one or more processing devices, the executable code further causes the one or more processing devices to obtain the combined image by performing pixel-wise subtraction of one or more first images of the plurality of images from one or more second images of the plurality of images.
5 . The ophthalmic visualization system of claim 1 , wherein, when executed by the one or more processing devices, the executable code further causes the one or more processing devices to obtain the combined image by weighting the two or more images with two or more weights to obtain two or more weighted images and obtaining a pixel-wise combination of the two or more weighted images.
6 . The ophthalmic visualization system of claim 5 , wherein the two or more weights are selected to enhance representation of one or more features selected from the group consisting of vasculature, drusen, hemorrhaging, and cotton wool spots.
7 . The ophthalmic visualization system of claim 5 , wherein the two or more weights are selected to enhance representation of one or more layers of a retina in the eye of the patient.
8 . The ophthalmic visualization system of claim 5 , wherein the two or more weights are selected to enhance representation of one or more features corresponding to a pathology selected from the group consisting of: Retinal tear(s); Retinal detachment; Diabetic retinopathy; Hypertensive retinopathy; Sickle cell retinopathy; Central retinal vein occlusion; Epiretinal membrane; Macular hole(s); Macular degeneration (including age-related Macular Degeneration); Retinal pigmentosa; Glaucoma; Alzheimer's disease; Parkinson's disease.
9 . A ophthalmic visualization method comprising: receiving, by a computing device, a plurality of images of an eye of a patient obtained using a multi-spectral imaging (MSI) device, each image corresponding to a different portion of an electromagnetic spectrum; obtaining, by the computing device, a combined image by performing pixel-wise combination of two or more images of the plurality of images; and outputting, by the computing device, a representation of the combined image to a display device, comprising: processing the combined image to obtain a segmentation mask identifying one or more features represented in the combined image; and superimposing the segmentation mask onto one of (a) one or more of the plurality of images and (b) the combined image to obtain the representation of the combined image.
10 . The ophthalmic visualization method of claim 9 , wherein the plurality of images include red, green, and blue images constituting a color image.
11 . The ophthalmic visualization method of claim 9 , wherein the plurality of images include an infrared image.
12 . The ophthalmic visualization method of claim 9 , further comprising performing, by the computing device, pixel-wise subtraction of one or more first images of the plurality of images from one or more second images of the plurality of images to obtain the combined image.
13 . The ophthalmic visualization method of claim 9 , further comprising: weighting, by the computing device, the two or more images with two or more weights to obtain two or more weighted images; and performing, by the computing device, a pixel-wise combination of the two or more weighted images to obtain the combined image.
14 . The ophthalmic visualization method of claim 13 , wherein the two or more weights are selected to enhance representation of one or more features selected from the group consisting of vasculature, drusen, hemorrhaging, and cotton wool spots.
15 . The ophthalmic visualization method of claim 13 , wherein the two or more weights are selected to enhance representation of one or more layers of a retina in the eye of the patient.
16 . The ophthalmic visualization method of claim 13 , wherein the two or more weights are selected to enhance representation of one or more features corresponding to a pathology selected from the group consisting of: Retinal tear(s); Retinal detachment; Diabetic retinopathy; Hypertensive retinopathy; Sickle cell retinopathy; Central retinal vein occlusion; Epiretinal membrane; Macular hole(s); Macular degeneration (including age-related Macular Degeneration); Retinal pigmentosa; Glaucoma; Alzheimer's disease; or Parkinson's disease.

Description

BACKGROUND The diagnosis and treatment of many eye disorders requires imaging of a patient's eye. The retina has many intricate features that are imaged to diagnose eye disorders as well as other disorders that cause physiological changes to the retina. An ophthalmoscope may be used to image the retina in order to diagnose eye disorders. When performing ophthalmic surgery, a surgeon typically uses an ophthalmic microscope, such as a digital surgical microscope. A digital ophthalmic microscope or ophthalmoscope may image the retina using a color (i.e., red, green, and blue) digital camera that captures images of the retina illuminated with a broadband light source (e.g., visible white light). Multispectral imaging (MSI) is another technique that may be used in an ophthalmic microscope or ophthalmoscope. MSI involves measuring (or capturing) light reflected from the retina at different wavelengths or spectral bands across the electromagnetic spectrum, such as from infrared to ultraviolet wavelengths. MSI may capture more information from the retina that may not be visible through conventional imaging. It would be an advancement in the art to improve imaging of the retina in order to better diagnose eye disorders and provide a more accurate representation of a patient's eye during eye surgery. SUMMARY In certain embodiments, a system is provided that includes one or more processing devices and one or more memory devices coupled to the one or more processing devices. The one or more memory devices store executable code that, when executed by the one or more processing devices, causes the one or more processing devices to receive a plurality of images of an eye of a patient, each image corresponding to a different portion of an electromagnetic spectrum. A combined image is obtained by performing pixel-wise combination of two or more images of the plurality of images. A representation of the combined image is output to a display device. BRIEF DESCRIPTION OF THE DRAWINGS So that the manner in which the above recited features of the present disclosure can be understood in detail, a more particular description of the disclosure, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only exemplary embodiments and are therefore not to be considered limiting of its scope, and may admit to other equally effective embodiments. FIG. 1 illustrates an example operating environment in which enhanced ophthalmic visualization may be used in accordance with certain embodiments. FIG. 2 is a diagram illustrating a system for enhanced ophthalmic visualization in accordance with certain embodiments. FIGS. 3A, 3B, and 3C are diagrams illustrating reflection of light of various wavelengths from layers of a retina in accordance with certain embodiments. FIG. 4A includes images of a sample of a retina for various wavelengths. FIG. 4B includes difference images obtained from the images of the retina in accordance to certain embodiments. FIG. 5 is a process flow diagram of a method for enhanced ophthalmic visualization in accordance with certain embodiments. FIG. 6 illustrates an example computing device that implements, at least partly, one or more functionalities for implementing enhanced ophthalmic visualization in accordance with certain embodiments. To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements and features of one embodiment may be beneficially incorporated in other embodiments without further recitation. DETAILED DESCRIPTION FIG. 1 illustrates an example ophthalmic viewing system 100 in which the enhanced ophthalmic visualization method disclosed herein may be used. The system 100 includes an ophthalmic microscope 102. A surgeon 104 uses the ophthalmic microscope 102 to visualize structures on and in an eye 106 of a patient 108 undergoing a surgery or examination. The microscope 102 is supported on, in this illustration, an adjustable overhead arm 110 of a microscope support pedestal 112. The patient 108 may be supported on an operating table 114. The ophthalmic microscope 102 is movable with the supporting arm 110 in three dimensions so that the surgeon 104 can position the ophthalmic microscope 102 as desired with respect to the eye 106 of the patient 108. In certain embodiments, the ophthalmic microscope 102 comprises a high resolution, high contrast stereo viewing surgical microscope. The ophthalmic microscope 102 will often include a monocular eyepiece 116 or binocular eyepieces 116, through which the surgeon 104 will have an optically magnified view of the relevant eye structures that the surgeon 104 will need to see to accomplish a given surgery or diagnose an eye condition of the patient 108. The ophthalmic microscope 102 includes a digital camera and br