CN-121987157-A - Vestibular function detecting system based on virtual reality technology

CN121987157ACN 121987157 ACN121987157 ACN 121987157ACN-121987157-A

Abstract

The invention discloses a vestibular function detection system based on a virtual reality technology, and relates to the field of medical detection equipment. The system comprises a head-mounted virtual reality display device with an environment isolation unit and a head posture sensing unit, an eyeball tracking module, a face embedded physiological signal acquisition module, an interaction control module and a data processing module. The data processing module issues trigger pulse with unified system time stamp through the clock synchronization management unit to realize microsecond time axis alignment of multi-source heterogeneous data, extracts fluctuation quantity of physiological signals, dynamically and adaptively adjusts an observed noise covariance matrix in a Kalman filtering model to accurately filter stress micropunching noise, and in addition, a dynamic feedback logic loop is built in the system to automatically degrade visual parameters when monitoring that the first derivative of the physiological index is out of limit. The invention thoroughly eliminates the interference of visual environment, solves the high-precision synchronization problem of multi-mode data, and constructs a safe closed-loop mechanism for preventing severe dizziness.

Inventors

YIN SHANKAI
SHI HAIBO
WANG HUI
FENG YANMEI
YU DONGZHEN
Chen Zhengnong

Assignees

上海市第六人民医院

Dates

Publication Date: 20260508
Application Date: 20260407

Claims (10)

1. A vestibular function detection system based on virtual reality technology, comprising: The head-mounted virtual reality display device comprises a display unit, an environment isolation unit and a head posture sensing unit, wherein the environment isolation unit is a shading structure for wrapping the display unit, the display unit is used for receiving and displaying virtual visual target stimulation signals, and the head posture sensing unit is used for collecting head movement data of a detected person; The eyeball tracking module is arranged at the inner side of the environment isolation unit and is used for collecting eyeball movement data of the detected person; The physiological signal acquisition module is used for acquiring physiological response signals of the detected person; The interaction control module is used for receiving the input test type and detection parameters; The data processing module is respectively in communication connection with the head-mounted virtual reality display device, the eyeball tracking module, the physiological signal acquisition module and the interaction control module, and is configured to generate the virtual visual target stimulation signal according to the test type and the detection parameter, send the virtual visual target stimulation signal to the display unit, receive the head movement data, the eyeball movement data and the physiological response signal, and generate a detection result according to the head movement data, the eyeball movement data and the physiological response signal.
2. The virtual reality technology-based vestibular function detection system of claim 1, wherein the head-mounted virtual reality display device further comprises an optical adjustment unit disposed on a light emitting side of the display unit, the optical adjustment unit comprising an adjustable focus lens and a viewing angle adjustment mechanism; The head posture sensing unit comprises a triaxial accelerometer, a triaxial gyroscope and a triaxial magnetometer, and the head motion data comprise a head rotation angle and a head rotation angular speed in a three-dimensional space.
3. The virtual reality technology-based vestibular function detection system of claim 1, wherein the eye tracking module comprises an infrared light source, an infrared image sensor, and an image processing unit; The infrared light source is configured to emit infrared light having a wavelength of 850 nm; the image processing unit is connected with the infrared image sensor and is configured to extract pupil position coordinates, a gazing direction vector and eyeball rotation angle parameters from an eye image acquired by the infrared image sensor as the eyeball motion data.
4. The virtual reality technology-based vestibular function detection system of claim 1, wherein the physiological signal acquisition module comprises a heart rate sensor and a galvanic skin response sensor, the physiological response signal comprising heart rate variation data and skin conductivity variation data; the heart rate sensor and the galvanic skin response sensor are embedded on the contact surface of the environment isolation unit, which is attached to the face of the person to be detected.
5. The virtual reality technology-based vestibular function detection system of claim 1, wherein the data processing module comprises a visual target generation unit; The visual target generating unit is configured to generate a fixed point, a moving point, a grating, a chessboard pattern, a stripe pattern or a dot matrix pattern with set visual angle size, geometric shape, color characteristics and motion trail coordinates as the virtual visual target stimulation signal according to the detection parameters; The visual target generating unit is further configured to superimpose and generate dynamic interferent images presented or hidden according to a preset time period in a peripheral area of a main visual field for generating the virtual visual target stimulation signals.
6. The vestibular function detection system based on the virtual reality technology according to claim 1, wherein a clock synchronization management unit is configured in the data processing module; the clock synchronization management unit is configured to send a synchronization trigger pulse with a uniform system time stamp to the head posture sensing unit, the eyeball tracking module and the physiological signal acquisition module; The data processing module is configured to perform time axis alignment processing on the head movement data, the eyeball movement data and the physiological reaction signal with different sampling frequencies according to the time stamp of the synchronous trigger pulse.
7. The vestibular function detection system based on the virtual reality technology according to claim 1, wherein the data processing module comprises a data analysis unit, and a kalman filter algorithm model is built in the data analysis unit; The data analysis unit is configured to perform filtering processing on the eyeball motion data and the head motion data through the Kalman filtering algorithm model; The data analysis unit is further configured to extract a numerical fluctuation amount of the physiological response signal and dynamically modify an observed noise covariance matrix parameter in the kalman filter algorithm model according to an absolute value of the numerical fluctuation amount.
8. A virtual reality technology based vestibular function detection system according to claim 1, wherein the data processing module is configured to extract vestibular function feature parameters from the eye movement data and the head movement data according to the trial type, the rule of extraction of vestibular function feature parameters comprising: When the test type is a staring test, extracting the eye vibration frequency and the eye vibration amplitude parameter; When the test type is a glance test, extracting glance speed and latency parameters; When the test type is a stable tracking test, extracting tracking gain and phase difference parameters; And when the test type is a head pulse test, calculating a ratio time sequence of the head rotation angular speed in the head movement data to the eyeball rotation speed in the eyeball movement data so as to generate a vestibulo-ocular reflex gain parameter.
9. The vestibular function detection system based on the virtual reality technology according to claim 4, wherein a dynamic feedback control logic loop is provided in the data processing module; The dynamic feedback control logic loop is configured to calculate a first derivative value of the heart rate variation data or the skin conductivity variation data, and when the absolute value of the first derivative value exceeds a preset physiological threshold value, generate a visual parameter adjustment instruction to be sent to the head-mounted virtual reality display device so as to control the reduction of the motion speed value or the reduction of the angle of view value of the currently displayed virtual visual target stimulation signal.
10. The virtual reality technology based vestibular function detection system of claim 1, further comprising a result output module connected to the data processing module, the result output module comprising a display screen; the data processing module is configured to render and generate a multi-mode synchronous display interface on the display screen, wherein the multi-mode synchronous display interface comprises a uniform time abscissa axis, and a two-dimensional eye movement track curve generated by the eyeball movement data, a one-dimensional head angular velocity curve generated by the head movement data and a time domain waveform curve generated by the physiological response signal are separately and aligned on the uniform time abscissa axis along the direction of the ordinate axis.

Description

Vestibular function detecting system based on virtual reality technology Technical Field The invention relates to the field of medical software, in particular to a vestibular function detection system based on a virtual reality technology. Background The vestibular system is responsible for maintaining the balance and spatial orientation of the human body, and abnormal functions of the vestibular system can lead to dizziness, balance disturbance and other symptoms. Vestibular function detection is an important means for diagnosing vestibular system diseases, and common detection items include vestibular function examination tests such as a position test, a deflection test, a gaze test, a glance test, a visual movement test, a tracking test, a head pulse test, a shaking test, a subjective vision test, a rotation test (constant acceleration test, sinusoidal harmonic acceleration test), an off-axis rotation test, a dynamic visual acuity test, a VVOR vision enhancement vestibular eye reflex test, a VORS vestibular eye reflex suppression test, a static balance test/mCTSIB, a balance limit test and the like. Conventional vestibular function detection devices generally use a display or projector as a delivery vehicle for a stimulus signal vision target, and have the following drawbacks: 1. The light is greatly influenced by the ambient light, the reflection and the interference are easy to generate, and the quality of the visual target is influenced; 2. the visual field angle is limited, an immersive visual environment cannot be provided, and a detected person is easily interfered by the outside; 3. The adjustment of vision target parameters (such as movement track, speed and the like) is not accurate enough, and complex detection requirements are difficult to meet; 4. The equipment has large volume, inconvenient movement and limited detection scene; 5. Different detection items often require different devices or device adjustments, which are cumbersome to operate. The virtual reality technology has the characteristics of strong immersion sense, high environmental controllability, accurate parameter adjustment and the like, and is expected to overcome the defects of the traditional equipment when being applied to vestibular function detection. Therefore, it is necessary to design a vestibular function detection system based on the virtual reality technology to improve the accuracy and convenience of detection. Disclosure of Invention In order to solve the above technical problems, the present invention provides a vestibular function detection system based on virtual reality technology, including: The head-mounted virtual reality display device comprises a display unit, an environment isolation unit and a head posture sensing unit, wherein the environment isolation unit is a shading structure for wrapping the display unit, the display unit is used for receiving and displaying virtual visual target stimulation signals, and the head posture sensing unit is used for collecting head movement data of a detected person; The eyeball tracking module is arranged at the inner side of the environment isolation unit and is used for collecting eyeball movement data of the detected person; The physiological signal acquisition module is used for acquiring physiological response signals of the detected person; The interaction control module is used for receiving the input test type and detection parameters; The data processing module is respectively in communication connection with the head-mounted virtual reality display device, the eyeball tracking module, the physiological signal acquisition module and the interaction control module, and is configured to generate the virtual visual target stimulation signal according to the test type and the detection parameter, send the virtual visual target stimulation signal to the display unit, receive the head movement data, the eyeball movement data and the physiological response signal, and generate a detection result according to the head movement data, the eyeball movement data and the physiological response signal. Compared with the prior art, the invention has the following beneficial effects: 1. The VR glasses are used as a visual target delivery carrier, so that a closed and immersed visual environment can be provided, external interference is eliminated, and detection accuracy is improved; 2. Parameters (size, shape, color, movement track, movement speed, stimulation time/period, interferent throwing rule and the like) of the virtual visual target stimulation signals can be accurately controlled and regulated, and the requirements of different detection projects are met; 3. The integrated eyeball tracking module can collect eyeball motion data in real time and accurately and provides a reliable basis for vestibular function evaluation; 4. the equipment has high integration level, small volume and convenient movement, and can be detected in various scenes; 5. The vestibule function