Search

CN-122024305-A - Eye movement tracking device, eye movement tracking method, and electronic apparatus

CN122024305ACN 122024305 ACN122024305 ACN 122024305ACN-122024305-A

Abstract

The application provides an eye movement tracking device, an eye movement tracking method and electronic equipment, which can be used in the technical field of eye movement tracking. The eye tracking device comprises a polarization projection module, a polarization imaging module and a data processing module, wherein the polarization projection module is used for projecting infrared stripe polarization patterns with different polarization directions to a target eye, the polarization imaging module is used for collecting polarized reflection images of the infrared stripe polarization patterns reflected by eyeballs and lenses, the data processing module comprises a phase deviation analysis module and an eye movement calculation module, the phase deviation analysis module is used for separating lens reflection components of the polarized reflection images and obtaining a cornea depth map based on polarization state changes of the polarized reflection images, the eye movement calculation module is used for obtaining three-dimensional gazing vectors based on the cornea depth map, and the three-dimensional gazing vectors are used for representing positions and directions of sight lines in a three-dimensional space. The application can effectively eliminate the facula interference caused by the reflection of the lens and realize the high-precision eye movement tracking of the user wearing the glasses.

Inventors

  • PAN CHENG

Assignees

  • 无锡睿勤科技有限公司

Dates

Publication Date
20260512
Application Date
20251230

Claims (10)

  1. 1. An eye tracking device, comprising: the polarization projection module is used for projecting infrared stripe polarization patterns with different polarization directions to the target eye; the polarization imaging module is used for collecting polarized reflection images of the infrared stripe polarization patterns reflected by eyeballs and lenses; The system comprises a data processing module, a phase deflection analysis module and an eye movement calculation module, wherein the phase deflection analysis module is used for separating lens reflection components of a polarized reflection image and acquiring a cornea depth map based on the polarization state change of the polarized reflection image, the eye movement calculation module is used for acquiring a three-dimensional gazing vector based on the cornea depth map, and the three-dimensional gazing vector is used for representing the position and the direction of a sight line in a three-dimensional space.
  2. 2. The eye tracking device according to claim 1, wherein the polarized projection module comprises an infrared polarized light source and a pattern projection module; The infrared polarized light source is used for emitting infrared polarized light; The pattern projection module is used for projecting the infrared polarized light to the target eye to form an infrared stripe polarization pattern.
  3. 3. An eye tracking device according to claim 2 wherein the infrared polarized light source comprises a plurality of polarization-controllable infrared LEDs.
  4. 4. The eye tracking device according to claim 1, wherein the polarized imaging module is a split focal plane polarized camera or a rotating polarizer camera.
  5. 5. An eye tracking method, applied to an eye tracking device according to any one of claims 1 to 4, comprising: the method comprises the steps of obtaining a polarized reflection image, wherein the polarized reflection image is formed by reflecting an infrared stripe polarization pattern projected to a target eye by a polarized projection module through an eyeball and a lens; Separating the lens reflection component of the polarized reflection image and obtaining a cornea depth map based on the polarization state change of the polarized reflection image; And acquiring a three-dimensional fixation vector based on the cornea depth map, wherein the three-dimensional fixation vector is used for representing the position and the direction of the sight line in a three-dimensional space.
  6. 6. The eye tracking method according to claim 5, wherein separating the lens reflection components of the polarized reflectance image and acquiring a corneal depth map based on the change in the polarization state of the polarized reflectance image, comprises: acquiring the polarization degree corresponding to each pixel based on the Stokes vector of each pixel in the polarized reflection image; generating a phase unwrapping mask based on the degree of polarization of each pixel, wherein the phase unwrapping mask is used for marking a lens reflection area on the polarized reflection image; Processing the polarized reflection image based on a phase deviation algorithm to obtain an absolute phase diagram; Based on the absolute phase map and the geometric parameters calibrated by the eye tracking device, converting the absolute phase into physical depth by using the mapping relation between the phase and the depth to obtain a cornea front surface height map; And replacing the depth value of the lens reflection area on the cornea front surface height map with the cornea front surface height based on the phase unwrapped mask, and obtaining the cornea depth map.
  7. 7. The eye tracking method according to claim 6, wherein generating a phase unwrapped mask based on the degree of polarization of each pixel comprises: And performing threshold segmentation based on the polarization degree of each pixel in the polarized reflection image, and marking the pixel as a lens reflection area if the polarization degree of the pixel is larger than a threshold value so as to generate a phase expansion mask.
  8. 8. The eye tracking method according to claim 6, wherein processing the polarized reflectance image based on a phase-shift algorithm to obtain an absolute phase map comprises: performing Fourier transform or phase shift processing on the polarized reflection image to obtain a wrapped phase diagram; And cutting and expanding the parcel phase map to obtain an absolute phase map.
  9. 9. The eye-tracking method according to any one of claims 5-8, wherein acquiring a three-dimensional gaze vector based on the corneal depth map comprises: Acquiring a cornea front surface reflection point and a pupil center based on the cornea depth map; and performing line-of-sight calculation based on the cornea front surface reflection point, the pupil center and the double-sphere model to obtain the three-dimensional gazing vector.
  10. 10. An electronic device comprising an eye tracking apparatus according to any one of claims 1-4.

Description

Eye movement tracking device, eye movement tracking method, and electronic apparatus Technical Field The present application relates to the field of eye tracking technologies, and in particular, to an eye tracking device, an eye tracking method, and an electronic apparatus. Background The eye tracking technology can realize more natural fixation point interaction by capturing and analyzing the motion trail of human eyes and the fixation point. Therefore, the technology is widely applied to the fields of Virtual Reality (VR), augmented Reality (AR), assisted driving, man-machine interaction and the like. The prior eye tracking system mostly adopts an infrared light source to irradiate eyeballs, an eye image is collected through an infrared camera, and the pupil position and the sight line direction are extracted by utilizing an image processing algorithm. However, when a user wears optical glasses such as myopia and hyperopia, an infrared reflection light spot formed by specular reflection can cover or confuse key eye features such as pupils and irises, and the extraction of the eye features is seriously interfered, so that the eye tracking precision is reduced or even disabled. Thus, there is a need for an eye tracking solution that can operate stably and with high accuracy under eyewear conditions. Disclosure of Invention The application provides an eye movement tracking device, an eye movement tracking method and electronic equipment, which are used for solving the technical problems that the eye movement tracking precision is reduced or even the eye movement tracking technology is invalid when a user wears glasses. According to a first aspect of the present disclosure, there is provided an eye tracking device comprising The polarization projection module is used for projecting infrared stripe polarization patterns with different polarization directions to the target eye; the polarization imaging module is used for collecting polarized reflection images of the infrared stripe polarization patterns reflected by eyeballs and lenses; The system comprises a data processing module, a phase deflection analysis module and an eye movement calculation module, wherein the phase deflection analysis module is used for separating lens reflection components of a polarized reflection image and acquiring a cornea depth map based on the polarization state change of the polarized reflection image, the eye movement calculation module is used for acquiring a three-dimensional gazing vector based on the cornea depth map, and the three-dimensional gazing vector is used for representing the position and the direction of a sight line in a three-dimensional space. In one possible embodiment, the polarized projection module includes an infrared polarized light source and a pattern projection module; The infrared polarized light source is used for emitting infrared polarized light; The pattern projection module is used for projecting the infrared polarized light to the target eye to form an infrared stripe polarization pattern. In one possible embodiment, the infrared polarized light source comprises a plurality of infrared LEDs of controllable polarization state. In one possible embodiment, the polarized imaging module is a split focal plane polarized camera or a rotating polarizer camera. According to a second aspect of the present disclosure, there is provided an eye tracking method applied to the eye tracking apparatus according to any one of the first aspects, comprising: the method comprises the steps of obtaining a polarized reflection image, wherein the polarized reflection image is formed by reflecting an infrared stripe polarization pattern projected to a target eye by a polarized projection module through an eyeball and a lens; Separating the lens reflection component of the polarized reflection image and obtaining a cornea depth map based on the polarization state change of the polarized reflection image; And acquiring a three-dimensional fixation vector based on the cornea depth map, wherein the three-dimensional fixation vector is used for representing the position and the direction of the sight line in a three-dimensional space. In one possible embodiment, separating the lens reflection components of the polarized reflectance image and acquiring a corneal depth map based on the change in the polarization state of the polarized reflectance image comprises: acquiring the polarization degree corresponding to each pixel based on the Stokes vector of each pixel in the polarized reflection image; generating a phase unwrapping mask based on the degree of polarization of each pixel, wherein the phase unwrapping mask is used for marking a lens reflection area on the polarized reflection image; Processing the polarized reflection image based on a phase deviation algorithm to obtain an absolute phase diagram; Based on the absolute phase map and the geometric parameters calibrated by the eye tracking device, converting the absol