CN-121982264-A - Method and system for cooperatively simulating visual state of patient with impaired vision by using AR

CN121982264ACN 121982264 ACN121982264 ACN 121982264ACN-121982264-A

Abstract

The application provides a method and a system for cooperatively simulating the visual state of a patient with impaired vision by using AR, which belong to the technical field of visual state simulation, wherein the method is applied to a server end, the server end is connected with AR equipment worn by the patient with impaired vision, and the method comprises the steps of acquiring visual field meter inspection data of the patient with impaired vision; the visual field defect area characteristics of the visual field defect patient are determined based on the visual field meter inspection data, the visual field defect area characteristics are remapped to visual field images of the visual field defect patient to simulate the visual state of the visual field defect patient, and the visual field images are acquired through the AR equipment. By adopting the technical scheme of the application, the vision states of the patients with different vision impairment can be accurately simulated.

Inventors

LIU JIANG
Tohda Risa
LI LIANG
Xi Ruiling
WANG XINBO
LI KERUI
HAN ZAIDAO

Assignees

南方科技大学
长春大学

Dates

Publication Date: 20260505
Application Date: 20250930

Claims (10)

1. A method for collaborative simulation of visual status of a patient with impaired vision using AR, the method being applied to a server side connected to an AR device worn by the patient with impaired vision, the method comprising: Obtaining perimeter examination data of a patient with impaired vision; Determining a visual field defect region characteristic of the visual field impaired patient based on the perimeter examination data; remapping the vision field defect region features to a vision field picture of the vision field impaired patient to simulate a visual state of the vision field impaired patient; wherein, the visual field picture is acquired by the AR equipment.
2. The method of claim 1, wherein the remapping the field of view defect region features to a field of view picture of the field of view impaired patient comprises: Constructing a visual field defect simulation model of the visual field impaired patient based on the visual field defect region features and a visual field picture of the visual field impaired patient to remap the visual field defect region features to the visual field picture; Wherein the visual field defect simulation model is used to characterize the visual state of the patient with impaired visual field.
3. The method of claim 2, wherein the constructing a visual field defect simulation model of the visual field impaired patient based on the visual field defect region characteristics and a visual field picture of the visual field impaired patient comprises at least one of; Blurring a vision-impaired region in a vision field picture of the vision-impaired patient based on the vision-impaired region characteristics to construct a vision-impaired simulation model of the vision-impaired patient; and overlaying the visual field defect area characteristics on a visual field picture of the visual field-impaired patient to construct a visual field defect simulation model of the visual field-impaired patient.
4. The method of claim 1, wherein after the remapping the vision field defect region features to a vision field view of the vision field impaired patient to simulate a visual state of the vision field impaired patient, the method further comprises: Sending remapping processing data to the AR device, such that the AR device renders the view based on the remapping processing data; The remapping processing data is the processing data of the server side remapping the vision defect area characteristic to the vision picture.
5. The method according to claim 1, wherein the method further comprises: The eye movement tracking data of the patient with the impaired vision is obtained by carrying out eye movement tracking on the patient with the impaired vision through the AR equipment; and highlighting the attention area of the patient with impaired vision based on the eye movement tracking data, wherein the attention area is a target image area in the vision picture, and the target image area is obtained based on target detection of the vision picture.
6. The method of claim 5, wherein highlighting the area of attention of the field-of-view impaired patient based on the eye-tracking data comprises: Generating a display element associated with the eye-tracking data in the field of view picture, wherein the position of the display element in the field of view picture is the same as the fixation point position of the patient with impaired vision corresponding to the eye-tracking data in the field of view picture; In the case of performing target detection on the visual field screen, an attention area of the patient whose visual field is impaired is determined from the detected target image areas based on the display element, and the attention area is highlighted.
7. A method for collaborative simulation of visual status of a patient with impaired vision using AR, the method being applied to an AR device worn by the patient with impaired vision, the AR device being connected to a server side, the method comprising: Collecting a visual field picture of the patient with impaired visual field, and sending the visual field picture to the server side; The remapping processing data are the processing data of remapping the vision defect area characteristics of the vision-impaired patient to the vision frame by the server, and the vision defect area characteristics are determined based on the vision meter inspection data of the vision-impaired patient; rendering the view based on the remapping process data.
8. A system for cooperatively simulating the visual state of a patient with impaired vision by using AR is characterized by comprising a server side and AR equipment worn by the patient with impaired vision, wherein the server side is connected with the AR equipment; The server side is used for acquiring visual field meter inspection data of a patient with a damaged visual field, determining visual field defect area characteristics of the patient with the damaged visual field based on the visual field meter inspection data, and remapping the visual field defect area characteristics to a visual field picture of the patient with the damaged visual field so as to simulate the visual state of the patient with the damaged visual field; The AR equipment is used for acquiring the visual field picture, sending the visual field picture to the server side, acquiring remapping processing data sent by the server side, and rendering the visual field picture based on the remapping processing data; the remapping processing data is the processing data of the server side remapping the visual field defect area characteristics of the visual field damaged patient to the visual field picture.
9. A computer device comprising a memory storing a computer program and a processor implementing a method of simulating visual states of a patient with impaired vision using AR collaboration according to any one of claims 1 to 7 when the computer program is executed by the processor.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements a method of simulating visual states of a patient with impaired vision using AR synergy according to any one of claims 1 to 7.

Description

Method and system for cooperatively simulating visual state of patient with impaired vision by using AR Technical Field The application relates to the technical field of vision state simulation, in particular to a method and a system for cooperatively simulating vision states of a patient with impaired vision by using AR. Background Low vision is a vision disorder between normal vision and blindness, and a patient group of the low vision is faced with a plurality of inconveniences in daily production and life, and the research and development and application of related auxiliary technologies have become the focus of attention in the fields of medical health and man-machine interaction. Among the causes of low vision, visual field defect is one of common factors, and particularly, the visual field defect is prominent in eye diseases such as glaucoma, optic atrophy and the like, and brings great challenges to visual perception and information acquisition of patients. In recent years, some researchers have developed an exploration for this problem, such as attempting to restore the world in the eyes of a patient with impaired vision by technical means, or proposing a related technical solution based on visual compensation. However, these studies and techniques are still at a relatively preliminary stage. Disclosure of Invention The embodiment of the application mainly aims to provide a method and a system for cooperatively simulating visual states of patients with impaired vision by using AR, aiming at accurately simulating the visual states of patients with impaired vision. To achieve the above object, a first aspect of an embodiment of the present application proposes a method for collaborative simulation of visual status of a patient with impaired vision using AR, the method being applied to a server, the server being connected to an AR device worn by the patient with impaired vision, the method comprising: Obtaining perimeter examination data of a patient with impaired vision; Determining a visual field defect region characteristic of the visual field impaired patient based on the perimeter examination data; remapping the vision field defect region features to a vision field picture of the vision field impaired patient to simulate a visual state of the vision field impaired patient; wherein, the visual field picture is acquired by the AR equipment. In some embodiments, the remapping the field of view defect region features to a field of view picture of the field of view impaired patient comprises: Constructing a visual field defect simulation model of the visual field impaired patient based on the visual field defect region features and a visual field picture of the visual field impaired patient to remap the visual field defect region features to the visual field picture; Wherein the visual field defect simulation model is used to characterize the visual state of the patient with impaired visual field. In some embodiments, the constructing a visual field defect simulation model of the visual field impaired patient based on the visual field defect region characteristics and a visual field picture of the visual field impaired patient includes at least one of; Blurring a vision-impaired region in a vision field picture of the vision-impaired patient based on the vision-impaired region characteristics to construct a vision-impaired simulation model of the vision-impaired patient; and overlaying the visual field defect area characteristics on a visual field picture of the visual field-impaired patient to construct a visual field defect simulation model of the visual field-impaired patient. In some embodiments, after the remapping the field of view defect region features to a field of view screen of the field of view impaired patient to simulate a visual state of the field of view impaired patient, the method further comprises: Sending remapping processing data to the AR device, such that the AR device renders the view based on the remapping processing data; The remapping processing data is the processing data of the server side remapping the vision defect area characteristic to the vision picture. In some embodiments, the method further comprises: The eye movement tracking data of the patient with the impaired vision is obtained by carrying out eye movement tracking on the patient with the impaired vision through the AR equipment; and highlighting the attention area of the patient with impaired vision based on the eye movement tracking data, wherein the attention area is a target image area in the vision picture, and the target image area is obtained based on target detection of the vision picture. In some embodiments, the highlighting the attention area of the impaired-field patient based on the eye movement tracking data comprises: Generating a display element associated with the eye-tracking data in the field of view picture, wherein the position of the display element in the field of view picture is the sam