Search

DE-102020204454-B4 - Monitoring the treatment of an object

DE102020204454B4DE 102020204454 B4DE102020204454 B4DE 102020204454B4DE-102020204454-B4

Abstract

Device for monitoring the treatment of an object (4) comprising the device (1) - an optical unit (2) designed to direct ionizing radiation (3) onto the object (4); - a filter element (5) which can be arranged in a beam path of the ionizing radiation (3) in order to attenuate a portion of the ionizing radiation (3); - an imaging unit (6) configured to detect components of the ionizing radiation (3) passing through the object (4) in order to produce an image (8) of part of the object (4); - an eye-tracking system (26) designed to detect the eye movements of an observer (25); and a control unit (10) designed to control the position of the filter element (5) depending on the eye movement during a first operating mode; characterized by the fact that the control unit (10) is set up to - to identify a predefined eye movement sequence depending on the eye movement; - to switch from the first operating mode to a second operating mode once the eye-tracking sequence has been identified; and - during the second operating mode, to control the position of the filter element (5) depending on an image analysis of the image (8).

Inventors

  • Anton Nekovar
  • Mohammad Sharifi

Assignees

  • Siemens Healthineers Ag

Dates

Publication Date
20260513
Application Date
20200407
Priority Date
20190514

Claims (17)

  1. Device for monitoring the treatment of an object (4), the device (1) comprising: - an optical unit (2) configured to direct ionizing radiation (3) onto the object (4); - a filter element (5) which can be arranged in a beam path of the ionizing radiation (3) to attenuate a portion of the ionizing radiation (3); - an imaging unit (6) configured to detect portions of the ionizing radiation (3) passing through the object (4) in order to generate an image (8) of a portion of the object (4); - an eye-tracking system (26) configured to detect the eye movement of an observer (25); and a control unit (10) configured to control the position of the filter element (5) depending on the eye movement during a first operating mode; characterized in that the control unit (10) is configured to identify a predefined eye movement sequence depending on the eye movement; - to switch from the first operating mode to a second operating mode when the eye movement sequence has been identified; and - during the second operating mode to control the position of the filter element (5) depending on an image analysis of the image (8).
  2. Device according to Claim 1 , characterized in that the control unit (10) is configured to - recognize, depending on the eye movement, whether a viewing direction of the observer (25) lies within a predetermined viewing direction range; and - maintain the first operating mode or switch from the second operating mode to the first operating mode if the viewing direction lies within the viewing direction range.
  3. device according to one of the Claims 1 or 2 characterized in that by identifying the eye movement sequence it is recognized that the gaze direction of the observer (25) lies within a given further gaze direction range.
  4. device according to one of the Claims 1 until 3 , characterized in that the control unit (10) is configured to switch from the first operating mode to the second operating mode when the eye-tracking system (26) cannot detect the eye movement of the observer (25).
  5. device according to one of the Claims 1 until 4 , characterized in that the device (1) includes a computing unit (11) configured to perform image analysis in order to determine the position of an area of interest (12); and the control unit (10) is configured to control the position of the filter element (5) during the second operating mode depending on the position of the area of interest (12).
  6. device according to one of the Claims 1 until 5 , characterized in that the control unit (10) is configured to: - repeatedly capture the eye movement and compare the repeatedly captured eye movement with the predefined eye movement sequence; and - identify the predefined eye movement sequence based on a result of the comparison.
  7. device according to one of the Claims 1 until 6 , characterized in that the control unit (10) is configured to: - identify a predefined further eye movement sequence depending on the eye movement; - determine at least one state variable of the device (1) or a change in the at least one state variable; - switch from the first operating mode to a second operating mode depending on the at least one state variable or the change in the at least one state variable when the further eye movement sequence has been identified.
  8. Training device for a model for image analysis during monitoring the treatment of an object (4), characterized in that the training device (1) comprises an optical unit (2) configured to direct ionizing radiation (3) onto the object (4); a filter element (5) which can be arranged in a beam path of the ionizing radiation (3) to attenuate a portion of the ionizing radiation (3) and thereby define a priority area (13); an imaging unit (6) configured to detect portions of the ionizing radiation (3) passing through the object (4) in order to generate an image (8) of a portion of the object (4); an eye-tracking system (26) configured to detect the eye movement of an observer (25); and a control unit (10) configured to determine a target position for the priority area (13) depending on the eye movement. and has a computing unit, set up to determine a parameter set for the model based on a correlation of the image (8) with the target position.
  9. A method for training a model for image analysis during the monitoring of the treatment of an object (4), characterized in that ionizing radiation (3) is directed at the object (4), in particular by means of an optical unit (2); a portion of the ionizing radiation (3) is attenuated, in particular by means of a filter element (5) to define a priority area (13); an image (8) of a portion of the object (4) is generated based on the portions of the ionizing radiation (3) passing through the object (4) by means of an imaging unit (6); the eye movement of an observer (25) is detected by means of an eye-tracking system (26); a target position for the priority area (13) is determined, in particular by means of a control unit (10), as a function of the eye movement; and a parameter set for the model is determined by means of a computing unit (11) based on a correlation of the image (8) with the target position.
  10. Procedure according to Claim 9 , characterized in that, by means of the computing unit (11): a further target position for the priority area (13) is determined on the basis of the model using the specified parameter set based on the image (8); the further target position is compared with the target position; and a quality indicator for the specified parameter set is determined based on a result of the comparison.
  11. device according to one of the Claims 1 until 7 , characterized in that the control unit (10) is configured to control the position of the priority area (13) during the second operating mode using a trained model; wherein the model was trained depending on control data generated during the first operating mode to control the position of the priority area (13) depending on eye movement, in particular using a method according to one of the Claims 9 or 10 trained model.
  12. Method for monitoring the treatment of an object (4), wherein ionizing radiation (3) is directed at the object (4), in particular by means of an optical unit (2); a portion of the ionizing radiation (3) is attenuated, in particular by means of a filter element (5), in order to define a priority area (13); an image (8) of a portion of the object (4) is generated based on the portions of the ionizing radiation (3) passing through the object (4) by means of an imaging unit (6); and the eye movement of an observer (25) is monitored by means of a gaze detection system (26) is detected; and during a first operating mode, a position of the priority area (13) is controlled by a control unit (10) depending on the eye movement; characterized in that a predefined eye movement sequence is identified by the control unit (10) depending on the eye movement; the system switches from the first operating mode to a second operating mode by means of the control unit (10) when the eye movement sequence has been identified; and during the second operating mode, the position of the priority area (13) is controlled by the control unit (10) depending on an image analysis of the image (8).
  13. Procedure according to Claim 12 , characterized in that , in order to control the position of the priority area (13) as a function of the eye movement, a target position for the priority area (13) is determined as a function of the eye movement; and a position of a filter element (5) for attenuating the part of the radiation (3) is controlled such that the position of the priority area (13) corresponds to the target position.
  14. Procedure according to Claim 13 , characterized in that the position of the priority area (13) is controlled during the second operating mode using a trained model; the model is trained depending on control data generated during the first operating mode to control the position of the priority area (13) depending on the eye movement.
  15. Procedure according to Claim 14 , characterized in that the model is produced by means of a method according to one of the Claims 9 or 10 training is taking place.
  16. Procedure according to one of the Claims 12 until 15 , characterized in that a position of an area of interest (12) is determined by means of image analysis using a computing unit (11); the position of the area of interest (12) is defined as a further target position for the priority area (14) using the computing unit (11) in order to control the position of the priority area during the second operating mode.
  17. Computer program product with instructions which, when executed by a device (1) according to one of the Claims 1 until 7 or 11 , cause the device (1) to perform a procedure according to one of the Claims 12 until 16 to be performed; or which, when performed by a training device (1), Claim 8 , cause the training device (1) to perform a procedure according to one of the Claims 9 or 10 to carry out.

Description

The present invention relates to a device for monitoring the treatment of an object, comprising an optical unit configured to direct ionizing radiation onto the object, a filter element that can be arranged in a beam path of the ionizing radiation and configured to attenuate a portion of the ionizing radiation, an imaging unit configured to detect portions of the ionizing radiation passing through the object in order to generate an image of a portion of the object, an eye-tracking system configured to detect the eye movement of an observer, and a control unit configured to control the position of the filter element as a function of the eye movement during a first operating mode. The invention further relates to a training device for a model for image analysis during the monitoring of the treatment of an object, a method for training a model for image analysis during the monitoring of the treatment of an object, a method for monitoring the treatment of an object, a computer program, and a computer-readable storage medium. When treating an object with ionizing radiation, for example, during X-ray-guided catheterization in a therapeutic procedure on a patient or a non-medical procedure on another object, it can be advantageous to minimize the dose of ionizing radiation to which an observer, such as a physician, and/or the object are exposed. This can be achieved by inserting a filter element into the beam path of the ionizing radiation. This filter element defines a priority area within which the ionizing radiation is not attenuated to obtain the best possible image results, while outside this priority area, the ionizing radiation is attenuated. Since the position of the region of interest (ROI), which should be imaged with the highest possible image quality, can change during the procedure, the position of the filter element can be adjusted accordingly. If the position of the filter element is controlled by an eye-tracking system based on the observer's gaze movement, the system may lose track of the user's or observer's current viewing position, meaning it cannot detect the gaze movement, or cannot detect it correctly, or for other reasons it may be impossible to position the filter element correctly. In such a case, the filter element can, for example, be completely removed from the optical path to ensure that the region of interest (ROI) continues to be imaged with good image quality. A disadvantage is that this eliminates the filter element's primary function, namely dose reduction for the observer and/or object. Another disadvantage is that removing and reinserting the filter element into the beam path can lead to disturbing artifacts in the image. In document US 5 278 887 A This document describes a device and a method for reducing the X-ray dose during a fluorescence-guided procedure. A filter element is used that allows X-rays to pass through undamped, enabling imaging of an area of interest with high X-ray intensity and correspondingly high image quality. In the document US 8 754 388 B2 A radiation control system is described to minimize radiation exposure to a patient or system user. This system employs an attention monitoring system, which can be configured, for example, as a brain sensor or an eye sensor. An area of interest is automatically determined based on this attention monitoring system. From the document DE 10 2016 219 708 A1 A filter device for an X-ray machine is known, comprising a filter aperture element designed to be arranged in the X-ray machine in a beam path between a radiation source and a detector element. The filter aperture element has at least one hole. A holding device secures the filter aperture element to the X-ray machine, and the filter aperture element is movable by means of the holding device in a vertical direction perpendicular to a principal plane of extension of the filter aperture element in order to increase flexibility in selecting the size of a region of interest (ROI) of an X-ray image without altering any relevant image content of the X-ray image. From the document DE 10 2015 221 638 A1 A method for adjusting at least one radiation parameter of a radiation source in an X-ray device is known, wherein the radiation source is controlled according to the radiation parameter to provide X-rays. The radiation parameter is adjusted as a function of the radiation emitted by the beam in a fluoroscopy area, as long as the filter element is not moved. The image data acquired by the detector is predetermined. At least one intermediate image is captured, at least partially, within a movement interval during which the filter element is moved, after which the radiation parameter is predetermined independently of the image data of the intermediate image, or after which only image data of the intermediate image are considered in determining the radiation parameter, which are captured in an overlap area of the radiation detector that lies within the fluoroscopy area during the