KR-102962930-B1 - DEVICE AND METHOD FOR CORRECTING USER’S EYESIGHT AND PERFORMING CALIBRATION

KR102962930B1KR 102962930 B1KR102962930 B1KR 102962930B1KR-102962930-B1

Abstract

A device and a method for correcting a user's vision and performing calibration are provided. A method for an augmented reality device to perform eye-tracking sensor calibration based on a user's gaze comprises: outputting at least one first character of a preset size through a wave guide; acquiring at least one first input of a user corresponding to the at least one first character; acquiring at least one first gaze information detected through the eye-tracking sensor when the at least one first input is acquired; comparing the at least one first character and the at least one first input; and determining the refractive power of a variable focus lens of the augmented reality device as a first refractive power.

Inventors

신성환
고재우
구본곤
김도윤
윤상호
이규근

Assignees

삼성전자주식회사

Dates

Publication Date: 20260512
Application Date: 20200827
Priority Date: 20200707

Claims (20)

In a method of operating an augmented reality device, A step of outputting at least one first character of a preset size at a first position on a wave guide of the augmented reality device; A step of obtaining a user's first input for at least one first character; A step of acquiring at least one first gaze information of the user through the gaze tracking sensor of the augmented reality device at the time when the first input is acquired; A step of comparing at least one first character and the first input; Based on the above comparison result, a step of determining the refractive power of the variable focus lens of the augmented reality device at the time when the first input is acquired as the first refractive power; and A step of calibrating the gaze tracking sensor by mapping the at least one first gaze information to the position coordinate value of the first position where the first character is displayed on the wave guide; A method of operation including
delete
In Article 1, After the refractive power of the variable focus lens is changed to a first refractive power, a step of outputting at least one second character of the preset size through the wave guide; A step of obtaining at least one second input from the user for at least one second character; A step of acquiring at least one second gaze information of the user through the gaze tracking sensor at the time when the at least one second input is acquired; A step of comparing the at least one second character and the at least one second input; and A step of determining the refractive power of the variable focus lens of the augmented reality device as the second refractive power based on the comparison result of the at least one second character and the at least one second input; Includes more, The step of calibrating the eye tracking sensor is a method of operation in which the eye tracking sensor is calibrated based on at least one first eye information and at least one second eye information.
In Paragraph 3, A method of operation in which at least one first character and at least one second character have a size corresponding to a preset corrected visual acuity and are displayed at a preset depth for measuring the user's visual acuity.
In Article 1, A method of operation in which the first position is at least one of a plurality of positions on the wave guide that are preset for the eye tracking sensor calibration.
In Article 1, The step of comparing at least one first character and the first input comprises comparing at least one first character and at least one character corresponding to the first input; A method of operation that includes
In Article 1, A method of operation in which the refractive power of the above-described variable focus lens is changed by changing the arrangement of LC particles (Liquid Crystal molecules) within the above-described variable focus lens.
In Article 1, A step of acquiring the above user's vision information; A step of pre-changing the refractive power of the variable focus lens of the augmented reality device based on the above-mentioned acquired visual information; Includes more, A method of operation in which the step of displaying at least one first character is to display the at least one first character after the refractive power of the variable focus lens has been changed in advance.
In Paragraph 3, A method of operation in which the first gaze information is stored for the calibration of the gaze tracking sensor together with the display position of the corresponding first character, and the second gaze information is stored for the calibration of the gaze tracking sensor together with the display position of the corresponding second character.
In Article 1, A method of operation in which the first gaze information and the second gaze information are obtained by at least one gaze tracking sensor positioned toward the user's eyes in the augmented reality device.
An image output unit including an optical engine and a wave guide; Eye tracking sensor that tracks the user's gaze; Variable focus lens section; Memory for storing one or more instructions; and By executing one or more of the above commands, Controlling the optical engine of the above image output unit to output at least one first character of a preset size at a first position on the wave guide; Acquiring the first input of the user for at least one first character, and By controlling the eye tracking sensor, at least one first gaze information of the user is obtained through the eye tracking sensor at the time when the first input is obtained, and Compare the above at least one first character and the above first input, and Based on the above comparison result, the refractive power of the variable focus lens unit at the time when the first input is obtained is determined as the first refractive power, and A processor that calibrates the gaze tracking sensor by mapping at least one first gaze information to the position coordinate value of the first position where the first character is displayed on the wave guide; An augmented reality device including
delete
In Article 11, The above processor executes the above one or more instructions, After the refractive power of the variable focus lens unit is changed to the first refractive power, at least one second character of a preset size is output through the wave guide, and Obtaining at least one second input from the user for at least one second character, and At the time when the above at least one second input is acquired, at least one second gaze information of the user is acquired through the gaze tracking sensor, and Compare the above at least one second character and the above at least one second input, and Based on the comparison result of the above at least one second character and the above at least one second input, the refractive power of the variable focus lens unit is determined as the second refractive power, and An augmented reality device that calibrates the gaze tracking sensor based on the first gaze information and the second gaze information.
In Article 13, An augmented reality device wherein the at least one first character and the at least one second character have a size corresponding to a preset corrected visual acuity and are displayed at a preset depth for measuring the user's visual acuity.
In Article 11, An augmented reality device in which the first position is at least one of a plurality of positions on the wave guide that are preset for the eye-tracking sensor calibration.
In Article 11, An augmented reality device wherein the processor executes the one or more instructions to compare the at least one first character with at least one character corresponding to the at least one first input.
In Article 11, An augmented reality device in which the processor changes the refractive power of the variable focus lens portion by executing the one or more instructions and changing the arrangement of LC particles (Liquid Crystal molecules) within the variable focus lens.
In Article 11, The above processor executes the above one or more instructions, Acquire the vision information of the above user, and Based on the above-mentioned acquired visual acuity information, the refractive power of the variable focus lens unit is changed in advance, and An augmented reality device that displays at least one first character after the refractive power of the variable focus lens is changed in advance.
In Article 13, An augmented reality device wherein the first gaze information is stored for the calibration of the gaze tracking sensor together with the display position of a corresponding first character, and the second gaze information is stored for the calibration of the gaze tracking sensor together with the display position of a corresponding second character.
A computer-readable recording medium having a program for executing the method of claim 1 on a computer.

Description

Device and method for correcting user’s eyesight and performing calibration The present disclosure relates to a device and method for correcting a user's vision and performing calibration, and more specifically, to a device and method for simultaneously correcting a user's vision and calibrating an eye-tracking sensor. Augmented Reality is a technology that projects virtual images onto the physical environment of the real world or onto real-world objects to display them as a single image. Augmented reality devices allow users to view real-world scenes and virtual images together through a see-through waveguide positioned in front of their eyes while the device is worn on the user's face or head. As research on such augmented reality devices is actively underway, various types of wearable devices are being released or are expected to be released. Among users of augmented reality devices, those who rely on glasses for vision correction require the use of additional means such as prescription clips. However, due to the inconvenience of prescription clips, research is being conducted on augmented reality devices equipped with vision correction functions for the visually impaired using variable focus lenses. Meanwhile, glasses-type augmented reality devices track the user's gaze using an eye-tracking sensor, and a calibration process for the eye-tracking sensor is required to accurately sense the direction in which the user's gaze is directed. To this end, the augmented reality device needs to display multiple points as virtual images at multiple pre-set locations using a waveguide and acquire accurate gaze information of the user regarding these multiple points. Accordingly, technology is required to determine the refractive power of variable focus lenses for user vision correction and to efficiently perform eye-tracking sensor calibration. FIG. 1a is a diagram showing an example in which an augmented reality device according to one embodiment of the present disclosure performs detection of the refractive power of a variable focus lens for user vision correction during the eye tracking sensor calibration process for detecting the user's gaze. FIG. 1b is a diagram comparing eye tracking sensor calibration according to one embodiment of the present disclosure with conventional eye tracking sensor calibration. FIG. 2 is a block diagram of an augmented reality device according to one embodiment of the present disclosure. FIG. 3 is a drawing showing an example of an augmented reality device including a variable focus lens unit according to one embodiment of the present disclosure. FIG. 4 is a drawing showing an example in which the refractive power of a variable focus lens part is changed according to one embodiment of the present disclosure. FIG. 5 is a diagram showing an example of an augmented reality device according to one embodiment of the present disclosure performing operations for user vision correction and eye tracking sensor calibration when the accuracy rate of the user's voice input is low. FIG. 6 is a diagram showing an example of an augmented reality device according to one embodiment of the present disclosure performing operations for user vision correction and eye tracking sensor calibration when the accuracy rate of the user's voice input is normal. FIG. 7 is a diagram showing an example of an augmented reality device according to one embodiment of the present disclosure performing operations for user vision correction and eye tracking sensor calibration when the accuracy rate of the user's voice input is high. FIG. 8 is a flowchart of a method for an augmented reality device according to an embodiment of the present disclosure to perform an operation for calibrating a user's eye tracking sensor before changing the refractive power of a variable focus lens unit. FIG. 9 is a flowchart of a method for an augmented reality device according to an embodiment of the present disclosure to perform an operation for calibrating a user's eye tracking sensor after changing the refractive power of a variable focus lens unit. Embodiments of the present disclosure are described below in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals. Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components interposed between them. Furthermore, when a part is described as "including" a certain component, this means that, unless specifically stated