KR-102963858-B1 - Image tracking information detection device, image tracking device, image tracking information detection method and image tracking method

KR102963858B1KR 102963858 B1KR102963858 B1KR 102963858B1KR-102963858-B1

Abstract

The present invention aims to provide an image tracking information detection device capable of obtaining information for tracking the center of an image to the user's gaze. The image tracking information detection device (10) of the present invention comprises: an image display system (100) including an image light projection unit (110) that projects image light, and a transmission reflection member (120) that reflects a portion of the image light projected from the image light projection unit (110) toward the eyeball (1) and transmits it to the other part; at least one non-visible light source (211); a diffraction optical element (212c) that is integrally installed with the transmission reflection member (120) and includes a reflection diffraction unit (212c1) that reflects and diffracts non-visible light from the non-visible light source (211) toward the eyeball (1); and a light receiving element (220a) that receives the non-visible light reflected from the eyeball (1) and reflected and diffracted by the reflection diffraction unit (212c1). When viewed from the thickness direction of the transmission reflection member (120), the The portion (120a) where the center of the image light of the transmission reflection member (120) is irradiated and the reflection diffraction portion (212c1) overlap.

Inventors

토쿠야마 카즈타츠

Assignees

소니그룹주식회사

Dates

Publication Date: 20260511
Application Date: 20201215
Priority Date: 20200204

Claims (20)

An image display system comprising an image light projection unit that projects image light, and a transmission-reflection member that reflects a portion of the image light projected from the image light projection unit toward the eyeball and transmits it to the other part, and A line-of-sight detection system comprising at least one invisible light source, a diffraction optical element including a reflection diffraction member installed integrally with the transmission reflection member and reflecting and diffracting invisible light from the invisible light source toward the eyeball, and a light receiving element receiving the invisible light reflected from the eyeball and reflected and diffracted by the reflection diffraction member. Equipped with, When viewed from the thickness direction of the above-mentioned transmission-reflection member, the portion where the center of the image light of the above-mentioned transmission-reflection member is irradiated overlaps with the above-mentioned reflection-reflection member, and An image tracking information detection device in which the size of the reflection diffraction part is less than or equal to the maximum diameter of the pupil of the eye.
In paragraph 1, An image tracking information detection device in which, when viewed from the thickness direction of the transmission-reflection member, the portion of the transmission-reflection member where the center of the image light is irradiated overlaps with the center of the reflection-diffraction portion.
delete
In paragraph 1, An image tracking information detection device having a maximum diameter of 8 mm.
In paragraph 1, The image light projection unit is an image tracking information detection device installed integrally with the transmission and reflection member.
In paragraph 1, The above light receiving element is an image tracking information detection device having a plurality of light receiving regions.
In paragraph 6, The above plurality of light receiving regions is an image tracking information detection device comprising four light receiving regions arranged in a two-dimensional array.
In paragraph 1, The above diffraction optical element has a plurality of reflection diffraction sections with different diffraction wavelengths and sizes stacked in the thickness direction, The above-described line-of-sight detection system comprises a pupil diameter acquisition unit for acquiring the pupil diameter of the eyeball, a plurality of non-visible light sources having different emission wavelengths, and a lighting control unit capable of selectively lighting the plurality of non-visible light sources based on the acquisition result from the pupil diameter acquisition unit, an image tracking information detection device.
In paragraph 8, The above pupil diameter acquisition unit includes an illuminance sensor, and the image tracking information detection device obtains the pupil diameter based on the detection result of the illuminance sensor.
In paragraph 1, The above diffraction optical element has a plurality of reflection diffraction sections with different diffraction wavelengths and sizes stacked in the thickness direction, The above-described line-of-sight detection system includes a plurality of non-visible light sources with different emission wavelengths, and an image tracking information detection device that obtains information for calculating the misalignment of the line of sight, which is the direction of the eyeball, between the center of the image displayed by the image display system and each time the plurality of non-visible light sources are lit.
In paragraph 1, A beam splitter disposed between the reflection diffraction part and the light receiving element, through which invisible light from the invisible light source is incident, is further provided. The beam splitter is an image tracking information detection device that reflects a portion of the invisible light from the invisible light source toward the reflection diffraction part and transmits a portion of the invisible light from the reflection diffraction part toward the light receiving element.
In paragraph 1, The above-described line-of-sight detection system is an image tracking information detection device having a collimating lens that makes the invisible light emitted from the above-described invisible light source into parallel light.
In paragraph 1, The above-described line-of-sight detection system is an image tracking information detection device having a polarizing plate disposed on the optical path of the invisible light between the invisible light source and the reflection diffraction section.
In paragraph 1, The above-described line-of-sight detection system is an image tracking information detection device having a wavelength selection filter disposed on the optical path of the non-visible light between the reflection diffraction section and the light receiving element.
The image tracking information detection device described in claim 1, in which the image light projection unit is integrally installed with the transmission reflection member, and An actuator that moves the above image display system and the above diffraction optical element in a direction parallel to the in-plane direction of the above transmission-reflection member, and A control device that controls the actuator based on a signal from a light receiving element of the image tracking information detection device, An image tracking device equipped with
In paragraph 15, An image tracking device comprising a collimator lens that converts invisible light from the above invisible light source into parallel light of a cross-sectional size according to the assumed movement range of the image display system and the diffractive optical element.
In paragraph 15, The light-receiving element has a plurality of light-receiving regions arranged in a two-dimensional array, The above control device is an image tracking device that detects a misalignment of the center of an image displayed by the image display system and the direction of the eyeball based on signals from the plurality of light receiving areas, and controls the actuator based on the detection result.
In paragraph 15, The above control device is an image tracking device that controls the actuator to track the image produced by the image light to the line of sight.
In paragraph 15, The above reflection diffraction section has a vertically elongated shape, and The above actuator is an image tracking device that moves the image display system and the diffraction optical element in a direction orthogonal to the longitudinal direction of the reflection diffraction section.
In paragraph 15, The above-mentioned reflection diffraction section has a horizontally elongated shape, and The above actuator is an image tracking device that moves the image display system and the diffraction optical element in a direction orthogonal to the longitudinal direction of the reflection diffraction section.

Description

Image tracking information detection device, image tracking device, image tracking information detection method and image tracking method The technology related to the present disclosure (hereinafter also referred to as the “present technology”) relates to an image tracking information detection device, an image tracking device, an image tracking information detection method, and an image tracking method. Conventionally, a display device is known that makes an image visible as a virtual image by irradiating image light onto a projection surface within the user's field of vision. For example, Patent Document 1 discloses a display device equipped with a gaze detection device and which makes an image visible to the user as a virtual image through a half mirror that serves as a projection surface. FIG. 1 is a cross-sectional view showing an example of the configuration of an image tracking information detection device according to a first embodiment of the present technology. FIG. 2 is a diagram illustrating a method for detecting a user's gaze using a light receiving element in an image tracking information detection device according to a first embodiment of the present technology. FIG. 3 is a block diagram showing an example of the configuration of a control device of an image tracking device having an image tracking information detection device according to a first embodiment of the present technology. FIG. 4 is a flowchart for explaining an example of operation of an image tracking device equipped with an image tracking information detection device according to a first embodiment of the present technology. FIG. 5 is a drawing showing a state in which the center of an image is out of sight in an image tracking device having an image tracking information detection device according to a first embodiment of the present technology. FIG. 6 is a drawing showing the state in which the center of an image is tracked by an image tracking device equipped with an image tracking information detection device according to the first embodiment of the present technology. FIGS. 7A to 7C are drawings for explaining an example of a method for tracking an image center to a line of sight by an image tracking device equipped with an image tracking information detection device according to a first embodiment of the present technology. FIG. 8 is a cross-sectional view (the first) for explaining an example of the configuration of an image tracking information detection device according to a second embodiment of the present technology. FIG. 9 is a cross-sectional view (the 2) for explaining an example of the configuration of an image tracking information detection device according to a second embodiment of the present technology. FIG. 10 is a block diagram showing an example of the configuration of a control device of an image tracking device having an image tracking information detection device according to a second embodiment of the present technology. FIG. 11 is a flowchart for explaining an example of operation of an image tracking device equipped with an image tracking information detection device according to a second embodiment of the present technology. FIG. 12 is a flowchart for explaining an example of operation of an image tracking device equipped with an image tracking information detection device according to a third embodiment of the present technology. FIGS. 13A and FIGS. 13B are cross-sectional views of a diffraction optical element for explaining configuration examples 1 and 2 of an image tracking device having an image tracking information detection device according to the fourth embodiment of the present technology, respectively. FIGS. 14A and FIGS. 14B are cross-sectional views of a diffraction optical element for explaining configuration examples 1 and 2 of an image tracking device having an image tracking information detection device according to the fifth embodiment of the present technology, respectively. Preferred embodiments of the present technology will be described in detail below with reference to the attached drawings. Meanwhile, in this specification and drawings, components having substantially the same functional configuration are given the same reference numerals to avoid redundant descriptions. The embodiments described below represent representative embodiments of the present technology, and the scope of the present technology is not to be interpreted narrowly by this. Even if the image tracking information detection device, image tracking device, image tracking information detection method, and image tracking method each of the present technology are described as exhibiting multiple effects in this specification, each of the image tracking information detection device, image tracking device, image tracking information detection method, and image tracking method must exhibit at least one effect. The effects described in this specification are merely examples and are not limited thereto, and other e