Search

CN-121987209-A - Visual guiding system of muscle relaxation state based on AR

CN121987209ACN 121987209 ACN121987209 ACN 121987209ACN-121987209-A

Abstract

The embodiment of the invention provides an AR-based visual guiding system for muscle relaxation state, and relates to the technical field of medical auxiliary device technology. The system comprises a muscle relaxation monitoring module, an image sensing module, an image processing module and an augmented reality display terminal. The invention solves the problems of high perception delay and low coordination efficiency, thereby achieving the effects of reducing the perception delay and improving the coordination efficiency.

Inventors

  • JIANG HUIFANG

Assignees

  • 浙江省肿瘤医院

Dates

Publication Date
20260508
Application Date
20260129

Claims (10)

  1. 1. An AR-based muscle relaxation state visualization guidance system, comprising: the muscle relaxation monitoring module is used for collecting muscle relaxation monitoring data of a patient in real time and outputting four series stimulation ratios; the image sensing module is used for capturing a real-time environment image of the surgical field and acquiring pose tracking data; The image processing module is connected with the muscle relaxation monitoring module and the image sensing module and is used for constructing a real-time operation space coordinate system, converting the four serial stimulation ratios into a virtual information layer and calculating projection parameters of the virtual information layer; and the augmented reality display terminal is connected with the image processing module and used for displaying the virtual information graph layer in a physical target position of the target visual field in a superposition mode.
  2. 2. The system of claim 1, wherein the image processing module comprises: A data preprocessing unit for preprocessing four serial stimulation ratios; The space anchoring unit is used for calculating the coordinate mapping relation between the virtual object and the physical world based on the image information and the pose data; And the rendering engine unit is used for generating a virtual instrument or a color map with a dynamic visual effect in real time according to the values of the four preprocessed serial stimulation ratios.
  3. 3. The system of claim 1, wherein the augmented reality display terminal employs an optical waveguide optical assembly for directing the micro-display signal generated by the image processing module to the retina of a human eye and maintaining the transmittance of external ambient light.
  4. 4. The system of claim 1, wherein the image processing module further comprises: A visual data integrity monitoring unit for receiving multi-modal physiological data related to a physiological state of a patient, wherein the multi-modal physiological data includes at least one of heart rate, blood oxygen saturation or end-tidal carbon dioxide partial pressure; The assessment unit is used for assessing the consistency between the muscle relaxation state displayed by the virtual information layer and the multi-mode physiological data so as to generate a physiological consistency risk score; The monitoring unit is used for continuously monitoring the visual spatial position stability of the virtual information layer relative to the physical anchoring target so as to generate a spatial stability risk score; And the superposition layer unit is used for controlling the augmented reality display terminal to generate and superpose an abnormal warning layer under the condition that the physiological consistency risk score or the spatial stability risk score exceeds a preset threshold.
  5. 5. An AR-based visual guidance method for muscle relaxation state, comprising: acquiring real-time muscle relaxation monitoring data of a patient, wherein the real-time muscle relaxation monitoring data comprise four serial stimulation ratios; Capturing image information of a surgical field and constructing a real-time surgical space coordinate system containing a physical anchoring target based on the image information; inputting the four serial stimulation ratios into a preset visual mapping model to generate a corresponding virtual information layer, wherein the virtual information layer comprises color features and graphic geometric features which are related to the four serial stimulation ratio values; Calculating projection parameters of the virtual information layer in the augmented reality glasses display unit according to the real-time operation space coordinate system; and projecting the virtual information map layer to a preset position in the operation visual field by using the augmented reality glasses so as to realize immersive monitoring of the muscle relaxation state of the patient.
  6. 6. The method of claim 5, wherein constructing a real-time surgical space coordinate system including a physical anchoring target based on the image information comprises: acquiring a multi-frame video stream of an operation field of view through an external camera of the augmented reality glasses; identifying a preset physical anchoring marker in the video stream or identifying body surface features of a patient surgical site; A rotational translational transformation matrix between the world coordinate system of the augmented reality glasses and the physical anchoring target is established.
  7. 7. The method of claim 5, wherein inputting the four series stimulation rates into a preset visual mapping model, generating a corresponding virtual information layer comprises: mapping the four serial stimulation ratios to a preset continuous color space; the pointer deflection angle of the virtual dashboard is determined based on the four serial stimulation ratios, or the transparency parameter or flicker frequency of the virtual color patch is determined.
  8. 8. The method of claim 5, wherein the method further comprises: acquiring multi-modal physiological data related to a physiological state of a patient, wherein the multi-modal physiological data includes at least one of heart rate, blood oxygen saturation, or end-tidal carbon dioxide partial pressure; evaluating consistency between the muscle relaxation state displayed by the virtual information layer and the multi-modal physiological data to generate a physiological consistency risk score; Continuously monitoring the visual spatial position stability of the virtual information layer relative to the physical anchoring target to generate a spatial stability risk score; If the physiological consistency risk score or the spatial stability risk score exceeds a preset threshold, generating and superposing an abnormal warning layer in the augmented reality glasses.
  9. 9. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program, wherein the computer program is arranged to execute the method of any of the claims 5 to 8 when run.
  10. 10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to run the computer program to perform the method of any of the claims 5 to 8.

Description

Visual guiding system of muscle relaxation state based on AR Technical Field The embodiment of the invention relates to the field of medical auxiliary devices, in particular to an AR-based visual guiding system for muscle relaxation state. Background In anesthesia management of modern surgery, ensuring that the patient is in a proper muscle relaxation state is critical to the smooth performance of the procedure. Too deep a muscle relaxation may lead to delayed postoperative recovery or complications, while insufficient muscle relaxation may cause patient movement during surgery, severely interfering with the surgical procedure and increasing patient risk. Traditional muscle relaxation monitoring relies on a physical monitor that outputs a numerical indicator such as "four Train-of-Four (TOF) ratio" by electrically stimulating the patient's nerves and measuring the muscle contraction response, and by interpreting these abstract numbers, the anesthesiologist determines the muscle relaxation depth and adjusts the drug dosage in conjunction with clinical experience. However, existing monitoring modes have significant drawbacks. First, anesthesiologists need to pay attention to both the vital sign changes of the patient in the surgical field and the digital index on the physical monitor screen located at the side of the operating table during surgery. Such frequent switching of visual focus not only increases the cognitive load of the physician, but each line of sight switch is accompanied by head movements, eye refocusing and cognitive context reconstruction, resulting in a perceived interruption of about 300ms to 500 ms. In critical surgical steps, this delay may lead to a lag in response to changes in patient muscle relaxation depth, affecting surgical safety. Second, there is an asynchrony between the surgeon and anesthesiologist in the information acquisition of muscle relaxation status. The surgeons mainly pay attention to the operation part, and the anesthesiologists pay attention to the monitor data, so that the surgeons lack of uniform and visual spatial references, and the efficiency and instantaneity of decision coordination are limited. The verbal delays in information delivery and uncertainty in spatial location limit decision efficiency when insufficient muscle relaxation leads to body movement risk. In addition, the original 'four serial stimulation ratios' are only abstract numbers, and lack of visual physiological space association, so that doctors need to perform secondary mapping in the brain, and the cognitive burden is increased. Therefore, how to design a technical scheme, the visual and immersive monitoring of the muscle relaxation state and the anchoring of the body space of a patient are realized, and meanwhile, the friction point of the medical information is solved, so that the technical scheme is a technical scheme which needs to be solved urgently in the clinical anesthesia field, and the medical risk is reduced and the operation flow is optimized. Disclosure of Invention The embodiment of the invention provides an AR-based visual guiding system for muscle relaxation state, which at least solves the problems of perception delay and low cooperative efficiency caused by spatial separation of muscle relaxation state monitoring information and an operation visual field in the related technology. According to one embodiment of the present invention, there is provided an AR-based muscle relaxation state visualization guidance system, comprising: the muscle relaxation monitoring module is used for collecting muscle relaxation monitoring data of a patient in real time and outputting four series stimulation ratios; the image sensing module is used for capturing a real-time environment image of the surgical field and acquiring pose tracking data; The image processing module is connected with the muscle relaxation monitoring module and the image sensing module and is used for constructing a real-time operation space coordinate system, converting the four serial stimulation ratios into a virtual information layer and calculating projection parameters of the virtual information layer; and the augmented reality display terminal is connected with the image processing module and used for displaying the virtual information graph layer in a physical target position of the target visual field in a superposition mode. In one exemplary embodiment, the image processing module includes: A data preprocessing unit for preprocessing four serial stimulation ratios; The space anchoring unit is used for calculating the coordinate mapping relation between the virtual object and the physical world based on the image information and the pose data; And the rendering engine unit is used for generating a virtual instrument or a color map with a dynamic visual effect in real time according to the values of the four preprocessed serial stimulation ratios. In one exemplary embodiment, the augmented reality display termin