CN-122028850-A - Instrument anomaly detection for medical devices

Abstract

Systems and methods for automatically detecting instrument anomalies in a sampling device during a medical procedure may include obtaining a sequence of ultrasound images of a target site of the medical procedure via a transducer of the medical device. The system or method may further include detecting an instrument extending from the medical device and within a field of view of the transducer in the sequence of ultrasound images. Characteristics of an instrument extending from the medical device are determined for each ultrasound image in a sequence of ultrasound images including the instrument extending from the medical device. The system or method may further include generating an alert indicative of a potential abnormality of the instrument extending from the medical device based on the characteristic of the instrument extending from the medical device exceeding a threshold.

Inventors

• Vignesh Mandarapapupati
• Frederick Pelton
• Joshua Michael. Adler
• Richard. Rhodes

Assignees

• 韦兰医疗技术有限责任公司

Dates

Publication Date

20260512

Application Date

20241010

Priority Date

20231016

Claims (20)

1. 1. A medical system, comprising: A medical device configured to be inserted into a patient during a medical procedure, the medical device comprising: an elongate member including a distal portion; An instrument configured to extend through the elongate member and protrude from a side of a distal portion of the elongate member, the instrument configured to interact with a target site during the medical procedure, and A transducer mounted on a distal portion of the elongate member such that the instrument extending from the elongate member is within a field of view of the transducer, the transducer configured to capture medical images within the field of view throughout the medical procedure, and A controller comprising processing circuitry, the controller coupled to a memory comprising instructions that, when executed by the processing circuitry, are configured to cause the processing circuitry to: determining an angle of extension of the instrument from the elongate member via the medical image from the transducer, and An alarm is generated if the angle of extension is above or below a threshold value.
2. 2. The medical system of claim 1, wherein the elongate member comprises: A lumen extending through the elongate member, the lumen configured to receive the instrument, and A side exit chute extending from the lumen and configured to guide the instrument out of the side of the elongate member and toward a target site of the medical procedure.
3. 3. The medical system of claim 2, wherein the threshold comprises a set variance above or below an expected angle of extension defined by the side exit chute.
4. 4. The medical system of claim 1, wherein the instructions cause the processing circuit to: Determining a curved shape of the instrument via the medical image from the transducer; Determining that the medical device is advanced with the instrument extending from the medical device based on the curved shape including the concave shape, and A reverse translation alert is generated to indicate that the medical device should be withdrawn to remove the concave shape from the instrument.
5. 5. The medical system of claim 4, wherein the instructions cause the processing circuit to: Determining that the medical device is retracted with the instrument extended from the medical device based on the curved shape including a convex shape, and An advance translation alert is generated to indicate that the medical device should be advanced to remove the convex shape from the instrument.
6. 6. The medical system of claim 1, wherein the medical image comprises a first medical image and a second medical image.
7. 7. The medical system of claim 6, wherein the instructions cause the processing circuit to: Determining a first location of a feature marker in the first medical image; determining a second position of the feature marker in the second medical image, and A movement of the signature is determined based on the first and second positions of the signature.
8. 8. The medical system of claim 7, wherein the instructions cause the processing circuit to: A reverse translational alert is generated based on the movement of the signature in a first direction to indicate that the medical device should be withdrawn from the patient.
9. 9. The medical system of claim 8, wherein the instructions cause the processing circuit to: An advance translational alert is generated based on the movement of the signature in a second direction to indicate that the medical device should be advanced within the patient.
10. 10. The medical system of claim 1, wherein the medical image comprises a first medical image and a second medical image, and wherein the instructions cause the processing circuit to: Determining a first angle of extension of the instrument from the elongate member via the first medical image; determining a second angle of extension of the instrument from the elongate member via the second medical image, and Based on a change between the first angle of extension and the second angle of extension exceeding a change threshold, a warning is generated indicating a changed angle of extension.
11. 11. The medical system of claim 1, wherein the medical device comprises a sensor within the distal portion of the elongate member, the sensor configured to detect longitudinal movement of the medical device.
12. 12. The medical system of claim 11, wherein the instructions cause the processing circuit to: receiving, via the sensor, a translation signal related to longitudinal movement of the medical device; Determining a first location of the feature marker in the first medical image; Determining a second location of the feature marker in a second medical image; Determining a movement of the signature based on the first position of the signature, the second position of the signature, and the translation signal, and An unintended movement alert is generated based on movement of the signature being disproportionate to longitudinal movement of the medical device detected by the sensor.
13. 13. The medical system of claim 1, further comprising: A clinical decision support system configured to assist a medical professional during the medical procedure, the clinical decision support system including a trained neural network to analyze information received from processing circuitry of the controller and to transmit suggested clinical information based on the information received from the controller.
14. 14. The medical system of claim 13, wherein the instructions cause the processing circuit to: Transmitting a sequence of ultrasound images of a target site of the medical procedure to the clinical decision support system; receiving an alarm signal from the clinical decision support system indicating an abnormality of the instrument, the alarm signal including instructions for remediating the detected abnormality, and An alert summary is generated based on the alert signal, the alert summary including a description of the alert and instructions for remediating the detected anomaly.
15. 15. A method for automatically detecting instrument anomalies of a medical device during a medical procedure, the method comprising: Obtaining, via a transducer of the medical device, a sequence of ultrasound images of a target site of the medical procedure; detecting an instrument extending from the medical device and within a field of view of the transducer in the sequence of ultrasound images; determining a characteristic of the instrument extending from the medical device for each ultrasound image in the sequence of ultrasound images including the instrument extending from the medical device, and An alert is generated indicating a potential abnormality of the instrument extending from the medical device based on a characteristic of the instrument extending from the medical device exceeding a threshold.
16. 16. The method of claim 15, comprising: Determining a bending angle of the instrument by comparing the detected angle of extension of the instrument with an expected angle of extension, and A bend alert is generated in response to the bend angle exceeding a bend threshold.
17. 17. The method of claim 16, comprising: receiving, via a sensor mounted within a distal portion of the medical device, a translation signal related to longitudinal movement of the medical device; Determining a first location of the feature marker in the first medical image; Determining a second location of the feature marker in a second medical image; Determining a movement of the signature based on the first position of the signature, the second position of the signature, and the translation signal, and An unintended movement alert is generated based on movement of the signature being disproportionate to longitudinal movement of the medical device detected by the sensor.
18. 18. The method of claim 16, wherein determining the characteristic of the instrument protruding from the medical device for each ultrasound image in the sequence of ultrasound images including the instrument protruding from the medical device comprises an edge detection technique.
19. 19. The method of claim 15, comprising: Transmitting a sequence of ultrasound images of a target site of the medical procedure to a clinical decision support system; receiving an alarm signal from the clinical decision support system indicating an abnormality of the instrument, the alarm signal including instructions for remediating the detected abnormality, and An alert summary is generated based on the alert signal, the alert summary including a description of the alert and instructions for remediating the detected anomaly.
20. 20. The method of claim 19, comprising: the alert summary is displayed on a display visible to a clinician performing the medical procedure.

Description

Instrument anomaly detection for medical devices Priority statement This patent application claims priority from U.S. provisional patent application Ser. No. 63/652,799, filed on 5/29 at 2024, and U.S. provisional patent application Ser. No. 63/590,620, filed on 10/16 at 2023, in section 35 S.C.119 (e), both of which are incorporated herein by reference in their entirety. Technical Field Examples described herein relate generally to sampling devices. More particularly, examples described herein relate to automatic instrument anomaly detection for sampling devices. Background Conventional endoscopes may be used in a variety of clinical procedures including, for example, illuminating, imaging, detecting, and diagnosing one or more disease states, providing fluid delivery (e.g., saline or other agents via a fluid channel) toward an anatomical region, providing access to one or more treatment devices (e.g., via a working channel) for sampling or treating the anatomical region, providing aspiration access for collecting fluids (e.g., saline or other agents), and the like. Such anatomical regions may include the gastrointestinal tract (e.g., esophagus, stomach, duodenum, cholangiopancreatic duct, intestine, colon, etc.), kidney regions (e.g., kidney, ureter, bladder, urethra), other internal organs (e.g., reproductive system, sinus cavity, submucosa region, respiratory tract), and the like. The sampling device (which may be an endoscope or may be delivered via a working channel of an endoscope) may be used to sample target tissue within a patient for medical purposes. Such sampling devices may be deployed within the airways of the lung to capture samples of target nodules, such as isolated lung nodules (SPNs) in the patient's lungs, for example. Samples of target nodules may be extracted to aid in medical procedure planning, diagnosis, and the like. Disclosure of Invention In some examples, a medical system may include a medical device configured to be inserted into a patient during a medical procedure, the medical device including an elongate member including a distal end portion. The medical device may further include an instrument configured to extend through the elongate member and protrude from a side of the distal portion of the elongate member, the instrument configured to interact with the target site during a medical procedure. The medical device may further include a transducer mounted on the distal portion of the elongate member such that an instrument extending from the elongate member is within a field of view of the transducer, the transducer configured to capture medical images of the field of view throughout a medical procedure. Further, the medical device may include a controller including processing circuitry coupled to the memory including instructions that, when executed by the processing circuitry, are configured to cause the processing circuitry to determine an angle of extension of the instrument from the elongate member via the medical image from the transducer and generate an alert if the angle of extension exceeds a threshold. In some examples, a method for automatically detecting instrument anomalies in a medical device during a medical procedure may include obtaining a sequence of ultrasound images of a target site of the medical procedure via a transducer of the medical device, detecting an instrument extending from the medical device within a field of view of the transducer in the sequence of ultrasound images, determining a characteristic of the instrument extending from the medical device for each of the ultrasound images or at least some individual ultrasound images in the sequence of ultrasound images including the instrument extending from the medical device, and generating an alert indicating a potential anomaly of the instrument extending from the medical device based on the characteristic of the instrument extending from the medical device exceeding a threshold. Drawings Various examples are shown in the figures of the accompanying drawings. Such examples are illustrative and are not intended to be exhaustive or exclusive examples of the present subject matter. Fig. 1 shows a schematic diagram of an example of a sampling device system. Fig. 2 shows a schematic diagram of an example of an imaging and control system of a sampling device system. Fig. 3 shows a cross-sectional view of a portion of an example of a sampling device. FIG. 4 illustrates a block diagram of an example method for detecting a potential anomaly of a sampling device. Fig. 5 shows a cross-sectional view of a portion of an example of a sampling device. Fig. 6 shows a cross-sectional view of a portion of an example of a sampling device. Fig. 7 shows a cross-sectional view of a portion of an example of a sampling device. Fig. 8 shows a cross-sectional view of a portion of an example of a sampling device. Fig. 9 shows a cross-sectional view of a portion of an example of a sampling device. Fig. 10 shows an exampl