Search

CN-121983258-A - Full-dimension intelligent nursing inspection system and method for patient based on virtual reality technology

CN121983258ACN 121983258 ACN121983258 ACN 121983258ACN-121983258-A

Abstract

The invention belongs to the technical field of intelligent nursing, and relates to a full-dimension intelligent nursing inspection system and method for patients based on a virtual reality technology, wherein the full-dimension intelligent nursing inspection system comprises a plurality of sensors of different types, virtual reality intelligent glasses, a mobile computing unit and a server; the intelligent patrol system comprises a sensor, a virtual reality intelligent glasses, a mobile computing unit and a server, wherein the sensor is arranged on a patrol site and used for acquiring images and data of the patrol site, the virtual reality intelligent glasses are used for establishing a three-dimensional simulation display scene according to the images and data acquired by the sensor, the mobile computing unit is arranged on the virtual reality intelligent glasses and used for computing single-mode data through an artificial intelligent model according to the images and data acquired by the sensor, and the server is used for fusing the computing results of the single-mode data through a multi-mode analysis model to generate full-dimension intelligent care patrol results. The method can realize objectification and standardization of nursing evaluation, establish continuity and preventive monitoring and achieve comprehensive evaluation in all dimensions.

Inventors

  • Min Yudi
  • WEI YANMEI

Assignees

  • 北京大学人民医院

Dates

Publication Date
20260505
Application Date
20260109

Claims (10)

  1. 1. The full-dimension intelligent nursing inspection system for the patient based on the virtual reality technology is characterized by comprising a multi-mode sensor array, virtual reality intelligent glasses, a mobile computing unit and a server; The multi-mode sensor array comprises a plurality of sensors of different types, wherein the sensors are arranged on a patrol site and are used for acquiring images and data of the patrol site; The virtual reality intelligent glasses are used for establishing a three-dimensional live-action fusion display interface according to the images and the data obtained by the sensors; The mobile computing unit is integrated on the virtual reality intelligent glasses and is used for carrying out real-time single-mode data analysis through a lightweight artificial intelligent model according to the images and the data obtained by the sensors; And the server is used for generating a full-dimension inspection report and risk early warning by fusing the single-mode data analysis result through the multi-mode analysis model.
  2. 2. The full-dimensional intelligent care tour system for patients based on virtual reality technology according to claim 1, wherein the multi-modal sensor array comprises a high-definition RGB camera, a thermal infrared imager, a multi-spectral sensor, an inertial measurement unit IMU, a microphone and a 3D depth sensor, wherein the virtual reality intelligent glasses support voice command and gesture recognition, and tour is started by voice or gesture, evaluation results are confirmed and nurse notes are entered.
  3. 3. The virtual reality technology based patient full-dimension intelligent care tour system of claim 2, wherein the tour site images and data include: heart rate, blood pressure, blood oxygen, respiration, and body temperature data of the patient; The position, smoothness, fixation condition and surrounding skin of the outlet of the catheter; pump rate, delivered quantity, and drug name; Pain-related facial movements, generating a quantified pain index; identifying pressure sores, scratches and lacerations, and automatically grading according to colors, depths and tissue types; Assessing subcutaneous tissue health by multispectral or thermal imaging; automatically identifying and evaluating healing conditions of the surgical incision, the stoma and the outlet of the drainage tube; Identifying a patient position; Examination couch rail and restraint strap.
  4. 4. The full-dimension intelligent nursing tour system for patients based on virtual reality technology according to claim 3, wherein the mobile computing unit comprises a risk comprehensive scoring module for comparing the data with safety thresholds of various indexes and finding out relations between the data, wherein risk comprehensive scoring is carried out according to the comparison result and the relations between the data, and alarming is carried out according to the risk class according to the risk comprehensive scoring.
  5. 5. The virtual reality technology-based full-dimension intelligent care tour system of a patient according to claim 4, wherein the risk level comprises immediate treatment including complete extirpation of a catheter, severe transfusion reactions and vital signs extreme abnormalities, marked red, important care including pain index high-enterprise, stage II and above pressure sores and infusion rate deviations large, marked yellow, and regular care including stage I pressure sores, mild skin abnormalities and environmental reminders, marked blue.
  6. 6. The virtual reality technology based patient full-dimension intelligent care tour system of any one of claims 1-5, wherein the multimodal analysis model includes a refined skin lesion classification model and a multimodal data fusion model for big data storage, depth analysis, trend prediction, electronic medical record integration and system management.
  7. 7. The full-dimension intelligent nursing tour system of patient based on virtual reality technology according to any one of claims 1-5, wherein the server generates an improvement suggestion according to the result of risk comprehensive scoring, tracks items with high risk in risk comprehensive scoring, performs automatic image comparison and quantifies comparison results in subsequent tour, encrypts and stores all time series data, image snapshots, evaluation results and operation logs to form a patient dynamic nursing digital twin body, and generates a dynamically updated holographic health file by integrating patient time series data, evaluation snapshots and operation records.
  8. 8. A full-dimension intelligent care tour method for a patient based on a virtual reality technology, for the full-dimension intelligent care tour system for a patient based on a virtual reality technology as set forth in any one of claims 1 to 7, comprising the steps of: Starting tour by voice or gesture, and matching the sensor, the device and the three-dimensional map; Reading data of the multi-modal sensor array and the device; comparing the data with the safety threshold values of all indexes, and finding out the connection between the data; Carrying out risk comprehensive scoring according to the comparison result and the relation between the data; and generating a structured electronic record according to the result of the risk comprehensive scoring, and synchronizing the structured electronic record to a server.
  9. 9. The virtual reality technology based patient full-dimensional intelligent care tour method of claim 8, wherein the data of the sensors and devices comprises: vital sign recognition, locking a monitor screen, and extracting heart rate, blood pressure, blood oxygen, respiration and body temperature in real time; Identifying the category of the catheter, and evaluating the position, smoothness, fixation condition and surrounding skin of the outlet of the catheter; identifying the rate, delivered quantity, and drug name of the pump; Identifying pain-related facial movements, generating a quantified pain index; identifying pressure sores, scratches and lacerations, and automatically grading according to the color, the depth and the tissue type; Assessing subcutaneous tissue health by multispectral or thermal imaging; automatically identifying and evaluating healing conditions of the surgical incision, the stoma and the outlet of the drainage tube; Identifying a patient position; Examination couch rail and restraint strap.
  10. 10. The full-dimension intelligent nursing tour method of the patient based on the virtual reality technology according to claim 8, wherein an improvement suggestion is generated according to the result of risk comprehensive scoring, a nurse quickly confirms or corrects the improvement suggestion through voice or gestures, the items with high risks in the risk comprehensive scoring are tracked, automatic image comparison is carried out in subsequent tour, the comparison result is quantized, and all time sequence data, image snapshot, evaluation result and operation log are stored in an encrypted mode to form a dynamic nursing digital twin body of the patient.

Description

Full-dimension intelligent nursing inspection system and method for patient based on virtual reality technology Technical Field The invention relates to a full-dimension intelligent nursing tour system and method for patients based on a virtual reality technology, and belongs to the technical field of intelligent nursing. Background The intelligent nursing inspection is a nursing mode integrating the internet of things, the AI and the big data technology, and the transformation from 'passive response' to 'active intervention' is realized through real-time monitoring, intelligent early warning and automation tasks. The system collects patient health data by using sensors, wearable equipment and the like, analyzes risks and optimizes a nursing scheme by combining an AI algorithm, supports semantic understanding and task decomposition through a large language model, and improves nursing efficiency and patient safety. At present, the mode is widely applied to hospitals, nursing homes and communities, and can significantly improve the nursing quality and reduce medical errors. The existing intelligent nursing inspection method is highly dependent on personal experience and manual operation of nurses, so that the efficiency is low, the subjectivity of evaluation is strong, blind areas exist in monitoring, data coordination is insufficient, and the evaluation of special patient groups is difficult. The method is characterized in that a device and a recording system are required to be frequently switched in a data acquisition link, vital signs are manually transcribed, the infusion volume is estimated and the skin condition is described, time is long and errors are easily caused by human factors, the method relies on nurse experience in aspects of conduit smoothness judgment, pain degree assessment (particularly, patients cannot be communicated), pressure sore stage and edema degree judgment and the like, objective quantitative standards are lacking, consistency is poor, process monitoring is difficult to cover key details such as the whole infusion and blood transfusion process, pain expression of the patients and early skin change and the like, abnormal conditions depend on passive discovery to cause response lag, potential safety hazards are prominent, information island phenomenon is serious, vital sign data, pain records, skin states and treatment information are usually isolated and stored, potential clinical problems (such as heart rate increase and local red swelling associated prompt infection risk) cannot be revealed through multi-mode associated analysis, and accurate and continuous assessment of pain perception, comfort and physiological requirements of special groups such as sedative state, dementia patients and infants are difficult to realize. Disclosure of Invention Aiming at the problems, the invention aims to provide a full-dimension intelligent nursing inspection system, method and readable medium for patients based on virtual reality technology, which can realize objectification and standardization of nursing evaluation, establish continuity and preventive monitoring and achieve full-dimension comprehensive evaluation. The full-dimension intelligent nursing inspection system for the patients comprises a multi-mode sensor array, virtual reality intelligent glasses, a mobile computing unit and a server, wherein the multi-mode sensor array comprises a plurality of different types of sensors which are arranged on an inspection site and are used for acquiring images and data of the inspection site, the virtual reality intelligent glasses are used for establishing a three-dimensional live-action fusion display interface according to the images and the data obtained by the sensors, the mobile computing unit is integrated on the virtual reality intelligent glasses and is used for carrying out real-time single-mode data analysis through a lightweight artificial intelligent model according to the images and the data obtained by the sensors, and the server is used for generating a full-dimension inspection report and risk early warning by fusing the results of the single-mode data analysis through the multi-mode analysis model. Further, the multi-mode sensor array comprises a high-definition RGB camera, a thermal infrared imager, a multi-spectrum sensor, an inertial measurement unit IMU, a microphone and a 3D depth sensor, wherein the virtual reality intelligent glasses support voice command and gesture recognition, and enable inspection, confirm evaluation results and enter nurse notes through voice or gesture. Further, the images and data of the inspection site include heart rate, blood pressure, blood oxygen, respiration and body temperature data of the patient, catheter position, patency, fixation and skin around the outlet, pump rate, delivered volume and drug name, pain related facial movements, generating quantified pain indices, identifying pressure sores, bruises and lacerations and automatically