EP-4742067-A1 - ELECTRONIC DEVICE FOR ENHANCING SECURITY BY USING FEATURE OF EYEBALL IMAGE AND METHOD FOR CONTROLLING SAME

EP4742067A1EP 4742067 A1EP4742067 A1EP 4742067A1EP-4742067-A1

Abstract

Disclosed are an electronic device for enhancing security by using features of an eyeball image, and a method for controlling same. An electronic device according to an embodiment of the present document comprises: at least one camera; and at least one processor. The at least one processor may be configured to: acquire a user's eyeball image through the at least one camera; and determine, on the basis of the acquired eyeball image, whether the user wearing the electronic device is a legitimate user. Whether the user wearing the electronic device is a legitimate user may be determined on the basis of at least one among position information of a glint for the eyeball image, the elliptical shape of a pupil, the elliptical shape of an iris, and whether glasses are worn.

Inventors

KANG, JINMO
KOO, Bonkon
KIM, Sungoh
RYU, JISU
PARK, Sungkweon
YEOM, DONGHYUN

Assignees

Samsung Electronics Co., Ltd.

Dates

Publication Date: 20260513
Application Date: 20240730

Claims (14)

A wearable device, comprising: at least one camera; at least one light emitting diode (LED); at least one processor; and memory configured to store a plurality of instructions, wherein the memory is configured to store instructions that, when executed by the at least one processor, cause the wearable device to: detect that the wearable device is worn by a user, based on the detection, obtain an eye image of the user wearing the wearable device using light output from the at least one light emitting diode via the at least one camera, and based on position information of at least one glint, included in the obtained eye image and corresponding to the at least one light emitting diode, determine whether the user is a legitimate user, and based on the user being the legitimate user, perform an iris authentication for the user.
The wearable device of claim 1, wherein the at least one light emitting diode includes a first light emitting diode and a second light emitting diode arranged at different positions in the wearable device, wherein the eye image includes a first glint formed by light emitted from the first light emitting diode and reflected from an eye of the user while the first light emitting diode is in an ON state and the second light emitting diode is in an OFF state, and a second glint formed by light emitted from the second light emitting diode and reflected from the eye of the user while the first light emitting diode is in an OFF state and the second light emitting diode is in an ON state, and wherein the plurality of the instructions further include instructions that cause the wearable device to determine whether the user is a legitimate user based on the first glint and the second glint.
The wearable device of claim 1 or 2, wherein the plurality of the instructions further include instructions that cause the wearable device to perform the iris authentication by comparing reference iris information of the user stored in the memory and first iris information of the user included in the eye image.
The wearable device of any one of claims 1 to 3, wherein a position of the at least one glint corresponds to a position of the at least one light emitting diode, wherein the position of the at least one light emitting diode is arranged in a ring shape.
The wearable device of any one of claims 1 to 4, wherein the at least one light emitting diode is configured to be used for determining whether the user is the legitimate user, for performing the iris authentication, and for tracking a gaze of the user.
The wearable device of any one of claims 1 to 5, wherein the plurality of the instructions further include instructions that cause the wearable device to, when the position information of the glint corresponds to position information of a glint stored in the memory, determine the user as the legitimate user who intends to perform the iris authentication through the eye image of the user obtained in real time rather than a user who intends to perform the iris authentication through a previously captured eye image.
The wearable device of any one of claims 1 to 6, wherein the at least one camera includes an infrared camera, and the at least one camera is configured to be used for tracking a gaze of the user and for determining whether the user is the legitimate user.
A non-transitory computer-readable recording medium configured to store a plurality of instructions which, when executed by at least one processor of a wearable device, cause the wearable device to: detect a user's wearing of the wearable device; based on the detection, acquire an eyeball image of the user wearing the wearable device by using light output from at least one light-emitting diode of the wearable device, through at least one camera of the wearable device; determine whether the user is a legitimate user, based on position information of at least one glint corresponding to the at least one light-emitting diode and comprised in the acquired eyeball image; and store instructions for performing an iris authentication for the user, based on the user being a legitimate user.
The non-transitory recording medium of claim 8, wherein the at least one light-emitting diode may comprise a first light-emitting diode and a second light-emitting diode arranged at different positions within the wearable device, wherein the eyeball image comprises a first glint formed by light reflected from an eye of the user after being emitted from the first light-emitting diode in a state where the first light-emitting diode is ON and the second light-emitting diode is OFF, and a second glint formed by light reflected from the eye of the user after being emitted from the second light-emitting diode in a state where the first light-emitting diode is OFF and the second light-emitting diode is ON, and wherein the plurality of the instructions further comprises instructions causing the wearable device to determine whether the user is a legitimate user based on the first glint and the second glint.
The non-transitory recording medium of claim 8 or 9, wherein the plurality of the instructions further comprises instructions that cause the wearable device to perform the iris authentication by comparing reference iris information of the user stored in the memory and first iris information of the user comprised in the eyeball image.
The non-transitory recording medium of any one of claims 8 to 10, wherein a position of the at least one glint corresponds to a position of the at least one light-emitting diode, and wherein the position of the at least one light-emitting diode is disposed in a ring shape.
The non-transitory recording medium of any one of claims 8 to 11, wherein the at least one light-emitting diode is configured to be used for determining whether the user is the legitimate user, for performing the iris authentication, and for tracking the user's gaze.
The non-transitory recording medium of any one of claims 8 to 12, wherein the plurality of the instructions further comprises instructions that cause the wearable device to, in case that the position information of the glint corresponds to position information of a glint stored in the memory, determine the user as the legitimate user who intends to perform the iris authentication through the eyeball image of the user obtained in real time rather than a user who intends to perform the iris authentication through a previously captured eyeball image.
The non-transitory recording medium of any one of claims 8 to 13, wherein the at least one camera comprises an infrared camera, and wherein all of the at least one camera is configured to be used for tracking the user's gaze and for determining whether the user is the legitimate user.

Description

[Technical Field] The disclosure relates to an electronic device for enhancing security by using the characteristics of an eyeball image and a method for controlling same. [Background Art] Various services and additional functions provided through an electronic device, for example, a wearable electronic device such as smart glasses (e.g., glasses-type augmented reality device), are gradually increasing. To increase the utility value of such electronic devices and satisfy the diverse needs of users, communication service providers or electronic device manufacturers are developing electronic devices in a competitive manner to provide various functions and differentiate themselves from other companies. Accordingly, various functions provided through electronic devices are becoming increasingly advanced. [Detailed Description of the Invention] [Technical Problem] An eye tracking algorithm may include a feature extraction operation for identifying a pupil position, an infrared (IR) LED reflection position. and the like in a captured image, a 3D eye model estimation operation for predicting the parameters of a 3D eye model based on the extracted eye features, and a user calibration operation for correcting the gaze. In addition, an iris recognition algorithm may include a segmentation operation for segmenting the iris from a captured image, a normalization operation for normalizing the segmented iris image, and a feature extraction operation for extracting iris features. The electronic device may perform the personal authentication based on whether the extracted feature points match a registered template. According to the prior art, when applying an iris recognition algorithm, false authentication may be possible by using the output image of an eye tracking camera. According to an embodiment of the disclosure, the electronic device may determine whether the user wearing the electronic device is a legitimate user (e.g., whether a user who has previously used the electronic device is actually wearing the electronic device), based on at least one of the position information of a glint in an eyeball image, the elliptical shape of the pupil, the elliptical shape of the iris, or the wearing state of glasses, thereby providing an electronic device with enhanced security. [Technical Solution] An electronic device according to an embodiment of the disclosure may include at least one camera and at least one processor, and the at least one processor may be configured to acquire an eyeball image of a user through the at least one camera, and determine whether a user wearing the electronic device is a legitimate user, based on the acquired eyeball image, and whether the user is a legitimate user may be determined based on at least one of position information of a glint in the eyeball image, an elliptical shape of the pupil, an elliptical shape of the iris, or whether glasses are being worn by the user. A method for controlling an electronic device according to an embodiment of the disclosure may include the operations of: acquiring a user's eyeball image through at least one camera; and determining whether a user wearing the electronic device is a legitimate user, based on the acquired eyeball image. Whether the user is a legitimate user may be determined based on at least one of position information of a glint in the eyeball image, the elliptical shape of the pupil, the elliptical shape of the iris, or whether glasses are being worn by the user. [Advantageous Effects] According to an embodiment of the disclosure, an electronic device may determine whether a user wearing the electronic device is a legitimate user (e.g., whether a user who has previously used the electronic device is actually wearing the electronic device), based on at least one of the position information of a glint in the eyeball image, the elliptical shape of the pupil, the elliptical shape of the iris, or whether glasses are worn by the user, thereby providing an electronic device having enhanced security. [Brief Description of Drawings] FIG. 1 is a block diagram illustrating an electronic device in a network environment according to various embodiments.FIG. 2A is a perspective view of a wearable device (e.g., an electronic device) according to an embodiment of the disclosure.FIG. 2B is a perspective view illustrating an internal configuration of a wearable device (e.g., an electronic device) according to an embodiment of the disclosure.FIG. 2C is an exploded perspective view of a wearable device (e.g., an electronic device) according to an embodiment of the disclosure.FIG. 3 illustrates an eye tracking camera structure of a wearable device according to an embodiment of the disclosure.FIG. 4 is an exemplary view illustrating a function or operation of determining whether a user wearing an electronic device is a legitimate user, based on various parameters, according to an embodiment of the disclosure.FIG. 5A is an exemplary view illustrating an eyeball ima