CN-121996059-A - Head-mounted eyeball tracking system

Abstract

The invention discloses a head-mounted eyeball tracking system which comprises a light-transmitting substrate, an eyeball tracker and a signal processor. The eye tracker is configured to perceive an eye of a wearer. The eye tracker includes a plurality of light emitting devices and a plurality of sensing devices. The plurality of light emitting devices are configured to emit tracking light beams. The plurality of sensing devices are configured to receive a tracking beam reflected by an eyeball of a wearer. The signal processor is electrically connected to the eye tracker. A plurality of sensing devices are embedded in a recess within the light transmissive substrate.

Inventors

• FU HANKUI
• LIN MENGHAN
• HUANG XUSHI
• WU MINGXIAN
• ZHAO JIAXIN
• GUO WEIHONG

Assignees

• 财团法人工业技术研究院

Dates

Publication Date

20260508

Application Date

20241223

Priority Date

20241108

Claims (20)

1. 1. A head-mounted eye tracking system adapted to track an eye of a wearer, the head-mounted eye tracking system comprising: a first light-transmitting substrate; an eye tracker configured to perceive a position or movement of the eye, the eye tracker comprising: A plurality of light emitting devices configured to emit tracking light beams, and A plurality of sensing devices configured to receive the tracking light beam reflected by the eyeball, and A signal processor electrically connected to the eye tracker, wherein the plurality of sensing devices are embedded in a recess within the optically transmissive substrate.
2. 2. The head-mounted eye tracking system of claim 1, wherein the eye tracker further comprises: a plurality of sensing light guides disposed corresponding to the plurality of sensing devices.
3. 3. The head mounted eye tracking system of claim 1, wherein at least one of the plurality of light emitting devices, the plurality of sensing devices, or a combination of the plurality of light emitting devices and the plurality of sensing devices is disposed corresponding to a lower portion of the eye of the wearer.
4. 4. The head mounted eye tracking system of claim 3, wherein the plurality of light emitting devices, the plurality of sensing devices, or a combination of the plurality of light emitting devices and the plurality of sensing devices are further disposed corresponding to left and right portions of the eye.
5. 5. The head mounted eye tracking system of claim 1, wherein, The plurality of light emitting devices are arranged farther from the upper eyelid of the wearer, farther from the upper eyelash of the wearer, or farther from the upper eyelid and the upper eyelash of the wearer than the lower eyelid of the wearer; the plurality of sensing devices are arranged further from the upper eyelid of the wearer, the lower eyelashes further from the upper eyelid of the wearer, or the lower eyelid and lower eyelashes of the wearer further from the upper eyelid and upper eyelashes of the wearer than the lower eyelid of the wearer, or The plurality of light emitting devices and the plurality of sensing devices are arranged farther from the upper eyelid, lower eyelash, or lower eyelid and lower eyelash of the wearer than the lower eyelid, or upper eyelid and upper eyelash of the wearer.
6. 6. The head-mounted eye tracking system of claim 1, wherein the eye tracker further comprises: An optical combiner comprising an optical coupler, wherein the eye tracker is located at least partially on the optical combiner along a front view of a third arrangement direction, wherein the third arrangement direction is perpendicular to a first arrangement direction and a second arrangement direction, and wherein the first arrangement direction is perpendicular to the second arrangement direction.
7. 7. The head-mounted eye tracking system of claim 6, wherein the eye tracker further comprises: A display adapted to emit a display beam, wherein the display beam is illuminated to the eyeball through the optical combiner.
8. 8. The head mounted eye tracking system of claim 7, wherein the plurality of sensing devices are disposed on the optical combiner and the plurality of light emitting devices are disposed on the display.
9. 9. The head mounted eye tracking system of claim 6, wherein the plurality of light emitting devices or the plurality of sensing devices are disposed on the optical combiner.
10. 10. The head mounted eye tracking system of claim 6, wherein the plurality of light emitting devices or the plurality of sensing devices at least partially overlap the optical coupler.
11. 11. The head mounted eye tracking system of claim 6, wherein the eye tracker further comprises a second optically transparent substrate integrated in the optical combiner, wherein the plurality of light emitting devices or the plurality of sensing devices surround the second optically transparent substrate.
12. 12. The head mounted eye tracking system according to claim 1, wherein in the first arrangement direction, a portion of the plurality of light emitting devices and a portion of the plurality of sensing devices are alternately arranged with each other.
13. 13. The head mounted eye tracking system according to claim 12, wherein a portion of the plurality of light emitting devices and a portion of the plurality of sensing devices are alternately arranged with each other in a second arrangement direction perpendicular to the first arrangement direction.
14. 14. The head mounted eye tracking system of claim 1, wherein the plurality of light emitting devices are disposed on a frame.
15. 15. A head-mounted eye tracking system adapted to track an eye of a wearer, the head-mounted eye tracking system comprising: a light-transmitting substrate made of a material that allows light to pass through; At least two eye trackers configured on the optically transmissive substrate to perceive the eye, each of the at least two eye trackers comprising: a light emitting device on the surface of the transparent substrate for emitting tracking light beam, and A sensor device adjacent to the light emitting device for receiving the reflected light beam after the light emitting device emits the tracking light beam, and A signal processor electrically connected to two of the at least two eye trackers, wherein the surface of the optically transmissive substrate has at least two grooves with reflective surfaces and each of the sensing devices is embedded in the grooves.
16. 16. The head mounted eye tracking system of claim 15, wherein two of the at least two eye trackers are disposed along an inner edge of the optically transparent substrate.
17. 17. The head mounted eye tracking system according to claim 15, wherein the light emitting devices and the sensing devices are alternately arranged.
18. 18. The head-mounted eye tracking system of claim 15, further comprising: a plurality of light emitting light guides matched at positions of a plurality of the light emitting devices, wherein one of the plurality of light emitting light guides is arranged in front of one of the light emitting devices to guide the light to another position corresponding to a boundary between an iris and a sclera of one of the eyeballs.
19. 19. The head mounted eye tracking system of claim 18, wherein one of the plurality of light emitting light guides is located in front of one of the sensing devices and the light emitting light guides of the sensing devices are configured to direct the light to the same location as the light emitting light guides of the light emitting devices.
20. 20. The head mounted eye tracking system of claim 15, wherein the at least two eye trackers are integrated into the optically transparent substrate.

Description

Head-mounted eyeball tracking system Technical Field The present invention relates to a head-mounted eye tracking system. Background To provide higher quality audio and video effects, more attention is paid to Virtual Reality (VR), augmented reality (augmented reality, AR), mixed Reality (MR), and the like in order to develop new generation display technologies. A head mounted eye tracking system is one of the approaches taken to implement these techniques. In general, a head-mounted eye tracking system tracks the movement of an eyeball by using an eye tracker installed therein and adjusts a displayed image according to a visual direction to improve a realistic effect. Taking the present eye tracker as an example, it uses a camera for capturing moving images to track and determine the position of the eye. However, such tracking methods are typically limited by the frame rate of the camera. Furthermore, due to the high complexity, bulk and/or heavy weight of the camera, the wearer may feel uncomfortable when using the camera. Current eye trackers use multiple light emitting components to direct illumination to the eye and its vicinity, which, because the illumination distributed around the eye and its vicinity is scattered, inaccurately tracks and determines the position of the eye. On the other hand, current eye trackers use multiple photosensitive components to generate a photoelectric signal associated with directional illumination. Current eye trackers also cannot accurately track and determine the position of an eye when the gain of the photoelectric signal is insufficient. Disclosure of Invention The present invention is directed to a head-mounted eye tracking system (EYE TRACKING SYSTEM) adapted to sense eye movement of a wearer. According to an embodiment of the present invention, a head-mounted eye tracking system includes a light transmissive substrate, an eye tracker, and a signal processor. The eye tracker is configured to perceive an eye of a wearer. The eye tracker includes a plurality of light emitting devices and a plurality of sensing devices. The plurality of light emitting devices are configured to emit tracking light beams. The plurality of sensing devices are configured to receive a tracking beam reflected by an eyeball of a wearer. The signal processor is electrically connected to the eye tracker. A plurality of sensing devices are embedded in a recess within the light transmissive substrate. According to an embodiment of the present invention, a head-mounted eye tracking system includes a light transmissive substrate, at least two eye trackers, and a signal processor. The light-transmitting substrate is made of a material that allows light to pass through. The at least two eye trackers are configured to perceive an eye of a wearer on the optically transparent substrate. Each eye tracker includes a light emitting device and a sensing device. The light emitting device is located on a surface of the light transmissive substrate and is configured to emit a tracking light beam. The sensing device is adjacent to the light emitting device for receiving a tracking light beam reflected from an eyeball of a wearer. The signal processor is electrically connected to the two eye trackers. The surface of the light-transmitting substrate has at least two grooves with reflective surfaces, in which grooves each sensor device is embedded. The plurality of light-emitting guides may also guide and direct light emitted from the light-emitting device to a specific region around the pupil of the eyeball. In this way, the illumination area can be concentrated and the quality of the optical signal or the corresponding electrical signal received by the sensing device of the eye tracker can be improved. Drawings FIG. 1A is a partial perspective view of a head mounted eye tracking system of a first embodiment of the application; FIG. 1B is a schematic partial top view of a head mounted eye tracking system of a first embodiment of the application; FIG. 1C is a schematic partial front view of a head mounted eye tracking system of a first embodiment of the application; FIG. 1D is a schematic diagram of an arrangement of light emitting and sensing devices of a head mounted eye tracking system of an embodiment of the application; FIG. 1E is a schematic diagram of an arrangement of light emitting and sensing devices of another head mounted eye tracking system of an embodiment of the application; FIG. 1F is a schematic illustration of an arrangement of light emitting and sensing devices of yet another head mounted eye tracking system of an embodiment of the application; FIG. 2 is a schematic partial front view of a head mounted eye tracking system of a second embodiment of the application; FIG. 3 is a schematic partial front view of a head mounted eye tracking system of a third embodiment of the application; FIG. 4 is a schematic partial front view of a head mounted eye tracking system of a fourth embodiment of the appl