DE-112024003124-T5 - ALGORITHM MODELS FOR UNITED SOURCES

DE112024003124T5DE 112024003124 T5DE112024003124 T5DE 112024003124T5DE-112024003124-T5

Abstract

A system for identifying and classifying a target in an image acquired during a medical procedure may comprise a medical device and a processing circuit associated with the medical device. The processing circuit may be configured to receive an image of a surgical site and analyze the image to locate a target within the image. The processing circuit may further cause light to be emitted from a light source associated with the medical device toward the target. At least some of the emitted light, which is scattered or reflected by the target, may be collected at an optical splitter, and the collected light may be analyzed using a spectrometer coupled to the optical splitter to identify or classify the target. The processing circuit may provide a user with an output based on at least one of the identification or classification of the target.

Inventors

Kurt G. Shelton
Sergey A. Bukesov
Kester Julian Batchelor
Maria Rao
David Marcus

Assignees

GYRUS ACMI, INC. D/B/A OLYMPUS SURGICAL TECHNOLOGIES AMERICA

Dates

Publication Date: 20260513
Application Date: 20240724
Priority Date: 20230727

Claims (20)

A system for identifying and classifying a target in an image acquired during a medical procedure, comprising: a medical device; and a processing circuit associated with the medical device, the processing circuit being configured to: receive an image of a surgical site; analyze the image of the surgical site to locate a target within the image of the surgical site; cause light to be emitted from a light source associated with the medical device toward the target; collect at least a portion of the emitted light reflected or scattered by the target object at an optical splitter associated with the medical device; analyze the collected light using an optical sensor associated with the optical splitter to at least identify or classify the target object; and provide an output to a user based on at least one of the identification or classification of the target object.
The system according to Claim 1 , wherein the medical device is an endoscope and the image of the surgical site is captured by an endoscopic camera, and wherein the processing circuit is designed to: compare one or more colors on the image of the surgical site with one or more colors determined during the spectral analysis of the surgical site; and to calibrate or otherwise adjust the one or more colors on the image of the surgical site based on the spectral analysis of the surgical site in order to produce a calibrated endoscopic image of the surgical site.
The system according to Claim 2 , the processing circuit serves to output the calibrated endoscopic image of the surgical area on a graphical user interface.
The system according to Claim 2 , the processing circuit serves to annotate the calibrated endoscopic image of the surgical site.
The system according to Claim 4 , wherein the annotation of the calibrated endoscopic image of the surgical site includes annotating the calibrated endoscopic image of the surgical site with at least one of the following information: information about the target, information about the surgical site, identification of non-target anatomy, information about a change in the target, or information about a change in the surgical site.
The system according to Claim 1 , wherein the image of the operation site is analyzed using a first algorithm and the identification or classification of the target is carried out using a second algorithm, wherein an output of the first algorithm and an output of the second algorithm are used as inputs for a recommendation algorithm.
The system according to Claim 6 , wherein the processing circuit serves to: receive data from one or more additional sources; and input the data from the one or more additional sources into the recommendation algorithm, and wherein the output is based at least partially on an analysis of the data from the one or more additional sources.
The system according to Claim 7 , wherein the processing circuit serves to effect an adaptation of the medical device, at least partially, based on one or more data from one or more additional sources or on the identification or classification of the target.
The system according to Claim 7 , wherein the data from one or more additional sources include historical data on a patient undergoing the medical procedure, historical data on a previous medical procedure undergone by a member of a demographic class to which the patient belongs, or real-time data obtained from a sensor coupled or connected to the medical device.
The system according to Claim 9 , where the historical data relating to the patient includes information about a previous medical intervention, a pre-existing condition of the patient, or a physical characteristic of the patient.
The system according to Claim 1 , wherein the output includes a recommendation, wherein the recommendation includes a recommendation regarding a subsequent medical intervention, and wherein the recommendation regarding a subsequent medical intervention includes one or more of the following elements: a type of medical endoscope to be used during the subsequent medical intervention, a type and intensity of ablation energy to be used during the type and amount of anesthesia to be used during the subsequent medical procedure, or a risk during the subsequent medical procedure.
The system according to Claim 1 , wherein the processing circuit further serves to: determine one or more morphological features of the target; and to use the determined one or more morphological features in conjunction with the analysis of the light collected by the optical sensor to identify or classify the target.
A computer-aided method for identifying and classifying a target in an image acquired during a medical procedure, comprising: Receiving an image of a surgical site from an optical sensor connected to a medical device used during the medical procedure; Analyzing the image using a first algorithm; Emitting a signal toward a target from a light source connected to the medical device; Collecting at least part of a response signal reflected or scattered by the target object in response to the emitted signal at an optical splitter connected to the medical device; Analyzing the collected response signal using an optical sensor connected to the optical splitter to identify or classify the target object; and Providing an output to a user based at least in part on the identification or classification of the target object.
Procedure according to Claim 13 , comprising: comparing one or more colors on the image of the surgical site with one or more colors determined during the spectral analysis of the surgical site; and calibrating or otherwise adjusting the one or more colors on the image of the surgical site based on the spectral analysis of the surgical site to produce a calibrated endoscopic image of the surgical site.
The procedure according Claim 14 , comprising: annotating the calibrated endoscopic image of the surgical site, wherein the annotation of the calibrated endoscopic image of the surgical site includes annotating the calibrated endoscopic image of the surgical site with at least one of the following information: information about the target, information about the surgical site, identification of non-target anatomy, information about a change in the target or information about a change in the surgical site; and outputting the calibrated endoscopic image of the surgical site on a graphical user interface.
Procedure according to Claim 13 , wherein the image of the surgical site is analyzed using a first algorithm and the identification or classification of the target is performed using a second algorithm, wherein an output of the first algorithm and an output of the second algorithm are used as inputs for a recommendation algorithm, and wherein the method further comprises: receiving data from one or more additional sources, wherein the data from the one or more additional sources comprise historical data on a patient undergoing the medical procedure, historical data on a previous medical procedure undergone by a member of a demographic class to which the patient belongs, or real-time data obtained from a sensor coupled or connected to the medical device; inputting the data from the one or more additional sources into the recommendation algorithm, wherein the output is based at least partially on an analysis of the data from the one or more additional sources; and causing an adjustment of the medical device based at least partially on one or more of the data from the one or more additional sources or on the identification or classification of the target.
A non-volatile, computer-readable medium containing instructions which, when executed by a processor of a computer connected to a medical device, cause the processor to: receive an image of a surgical site; analyze the image of the surgical site to locate a target within the image of the surgical site; cause light to be emitted from a light source connected to the medical device toward the target; collect at least some of the emitted light, which is reflected or scattered back from the target, at an optical splitter connected to the medical device; analyze the collected light using an optical sensor connected to the optical splitter to locate the target at least to identify or classify; and to provide output to a user based on at least one of the identification or classification of the target.
The non-volatile, computer-readable medium according to Claim 17 , wherein the instructions cause the processor to: compare one or more colors on the image of the surgical site with one or more colors determined during the spectral analysis of the surgical site; calibrate or otherwise adjust the one or more colors on the image of the surgical site based on the spectral analysis of the surgical site to produce a calibrated endoscopic image of the surgical site; annotate the calibrated endoscopic image of the surgical site; output the calibrated endoscopic image of the surgical site to a graphical user interface; receive data from one or more additional sources; and input the data from the one or more additional sources into a recommendation algorithm, the output being based at least in part on an analysis of the data from the one or more additional sources.
The non-volatile, computer-readable medium according to Claim 18 , wherein the image of the operation site is analyzed using a first algorithm and the identification or classification of the target is carried out using a second algorithm, wherein an output of the first algorithm and an output of the second algorithm are used as inputs for a recommendation algorithm.
The non-volatile, computer-readable medium according to Claim 19 , wherein the output includes a recommendation regarding a subsequent medical intervention and wherein the recommendation regarding a subsequent medical intervention includes one or more of the following elements: a type of medical endoscope to be used during the subsequent medical intervention, a type and intensity of ablation energy to be used during the subsequent medical intervention, a type and amount of anesthetic to be used during the subsequent medical intervention, or a risk during the subsequent medical intervention.

Description

PRIORITY CLAIM This application claims priority over the preliminary US patent application with serial number 63/515,896 , filed on July 27, 2023, and the preliminary US patent application with serial number 63/652.256 , submitted on May 28, 2024, the contents of which are hereby incorporated by reference. TECHNICAL FIELD The present disclosure relates to the determination of a property of a target during a medical procedure. BACKGROUND During a medical procedure, such as lithotripsy, a user, such as a physician or a robot, can interact with one or more targets of varying types, sizes, or other properties, such as material composition. The target might be a stone (for example, a kidney stone or gallstone), a tumor, a piece of tissue, or the like within a patient's body. The target object might be in a medium (e.g., a liquid such as water or saline), and the physician might use a medical device (such as an endoscope) or a surgical laser to perform surgical procedures on the target objects. The characteristics of the target can vary depending on the type of procedure and may change during the procedure. One or more characteristics of the target may affect how the medical procedure is initiated (e.g., what type of medical instruments are used, what types of lasers are used, etc.), and the conditions during the procedure, including changes in the target, may affect how a physician proceeds during the procedure. SUMMARY When performing a diagnostic or therapeutic procedure, it is desirable to know one or more properties of anatomical targets within a patient, such as a tumor or a stone. For example, a user who wants to visualize a cancerous tumor needs to determine its dimensions (e.g., height and width) to determine whether the tumor can be surgically removed, to establish a baseline for the tumor, to monitor changes in tumor size after the start of cancer treatment, or similar purposes. Similarly, a user performing an endoscopic procedure such as ablation or removal of stones or tissue may want to determine the size of the stone or tissue to be removed, for example, to decide whether the target object is small enough to be removed with the endoscope, such as through the ureter or through an access sheath with a specific inner diameter, or whether the target object should be further reduced in size before removal. During laser treatments such as laser lithotripsy, the clinician may want to know the position of the endoscope within the patient's body. For example, the physician might want to know the distance between the tip of the endoscope and the target object. This distance is helpful for determining, for instance, the amount or intensity of ablation energy (e.g., laser energy, radiation, ultrasound energy, or the like) to be delivered to the target object. Furthermore, it may be necessary to reposition the endoscope and adjust (or stop entirely) the intensity of the ablation energy if the targets change during a procedure. For example, the target composition may change during the procedure (e.g., the material composition of a kidney stone may change during ablation), or the tissue touched by the laser energy may change from target tissue to non-target tissue. Similarly, a physician may need to be vigilant about when the ablation energy touches non-target tissue or objects. A model can be used to calculate, predict, or suggest how a surgical procedure should be performed or how to proceed during the procedure. For example, the model can be used to predict how much ablation energy, such as from a laser or acoustic transducer, is required or appropriate to ablate or reduce the size of a kidney stone. The model can base the prediction, at least in part, on endoscopic videos or images acquired by an imaging device such as a camera, optical spectrum measurements of the target, or spectral analyses of signals from the surgical field. For example, the endoscopic video can be used to locate one or more targets in a surgical scene. Then, a response signal from a target, such as light reflected, scattered, or otherwise emitted by the target (e.g., in response to illumination of the target), can be detected by an optical sensor or light detector. The target is captured and analyzed by a device such as a spectrometer to identify or classify the target. The accuracy or precision of the model can be improved or increased by using data or measurements of one or more parameters, such as temperature or pressure, at the surgical site, acquired by one or more sensors that may be attached to or connected to a medical device, such as an endoscope. A system for identifying and classifying a target in an image acquired during a medical procedure may comprise a medical device and a processing circuit. The processing circuit may be configured or configurable to receive an image of a surgical site and analyze the image of the surgical site to locate a target within the image. The processing circuit may further cause an electromagneti