KR-20260064150-A - Apparatus for determining concentration based on optical axis ahanges reflecting user's visual perception, method applied to the same

KR20260064150AKR 20260064150 AKR20260064150 AKR 20260064150AKR-20260064150-A

Abstract

The present invention discloses a concentration determination device based on optical axis change reflecting a user's visual perception and a method applied thereto. The concentration determination device based on optical axis change reflecting a user's visual perception according to the present invention comprises: a content providing unit that outputs a predetermined content; a gaze data measuring unit that measures gaze data including a focus on the user's gaze based on at least one of the user's pupil and iris looking at the content; and a concentration calculation unit that calculates a focus divergence scale, which is an optical axis change value reflecting the user's visual perception, based on whether there is a match between the focus and a screen focus in which the focus is projected onto a screen on which the content is output, and determines that the user's concentration has decreased if the calculated focus divergence scale is greater than or equal to a predetermined threshold value.

Inventors

김윤상
이유진
김규아

Assignees

한국기술교육대학교 산학협력단

Dates

Publication Date: 20260507
Application Date: 20241031

Claims (10)

A content provider that outputs predetermined content; A gaze data measuring unit that measures gaze data including focus on the user's gaze based on at least one of the user's pupil and iris looking at the content; and A concentration determination device based on optical axis change reflecting the user's visual perception, comprising a concentration calculation unit that calculates a focus divergence measure, which is an optical axis change value reflecting the user's visual perception, based on whether there is a match between the screen focus, which is an orthogonal projection of the focus on the screen where the content is displayed, and the focus divergence measure, which determines that the user's concentration has decreased if the calculated focus divergence measure is greater than or equal to a predetermined threshold.
In Article 1, The above focal divergence measure is obtained through the following Equation 1, <Formula 1> (Here, f(d): focus divergence measure, focus on the user's gaze: P f (x a , y b , z c ), screen focus projected from the user's gaze: P' f (x' a , y' b , z' c ), d: distance between P f (x a , y b , z c ) and P' f (x' a , y' b , z' c )) Concentration determination device based on optical axis change reflecting user's visual perception, characterized by being produced.
In Article 2, The above focus learns a change pattern for at least one of the user's pupil and iris for a predetermined period after the start time of viewing the content, or as a result of learning a change pattern for at least one of the pupil and iris of a plurality of users in advance, extracts a pattern and size for at least one of the user's left eye's pupil and iris and a pattern and size for at least one of the user's right eye's pupil and iris, and based on the data regarding the extracted pattern and size, specifies the angle ( θ1 ) between the optical axis of the left eye reflecting the user's visual perception and the left pupil center point, the length ( D1 ) between the perception content screen point located at the end of the optical axis of the left eye reflecting the user's visual perception and the pupil center point, the angle (θ2) between the optical axis of the right eye reflecting the user's visual perception and the right pupil center point, and the length ( D2 ) between the perception content screen point located at the end of the optical axis of the right eye reflecting the user's visual perception and the pupil center point, and specifies the specific θ1 , D1 , θ2 and An optical axis change-based concentration determination device reflecting the user's visual perception, characterized by being calculated through D 2 .
In Article 2, The concentration calculation unit calculates the user's gaze distraction through the standard deviation of the gaze position value for each frame, which is the result of tracking the position of the user's gaze based on the gaze data, and determines the decrease in the user's concentration through the focus divergence scale and the gaze distraction, thereby reflecting the user's visual perception and is a concentration determination device based on optical axis change.
In Paragraph 4, The above gaze data is stored and updated in a FIFO (First in first out) structure, and the size of the FIFO (First in first out) queue in the above FIFO structure is a concentration determination device based on optical axis change that reflects the user's visual perception, which changes according to at least one of the user and the content.
In Paragraph 4, The above visual distraction is calculated using the following Equation 2, <Equation 2> (Here, Xi: I-th gaze position value, X: group mean, ν: group variance, σ: group standard deviation representing the user's gaze distraction) Concentration determination device based on optical axis change reflecting user's visual perception, characterized by being produced.
In Article 6, The concentration calculation unit calculates the user's non-concentration, which is a combination of the focus divergence scale and the visual distraction, through the following Equation 3: <Equation 3> (Here, ω: weight, d: distance between P f (x a , y b , z c ) and P' f (x' a , y' b , z' c ), σ: view distraction) Concentration determination device based on optical axis change reflecting user's visual perception, characterized by being produced.
A content provision step in which a predetermined content is output in a concentration judgment device; A gaze data measurement step for measuring gaze data including a focus on the user's gaze based on at least one of the user's pupil and iris looking at the content; and A method for determining concentration based on optical axis change reflecting a user's visual perception, comprising a concentration calculation step of calculating a focus divergence scale, which is an optical axis change value reflecting the user's visual perception, based on whether there is a match between the screen focus, which is an orthogonal projection of the focus on the screen on which the content is displayed, and the focus divergence scale, which is an optical axis change value reflecting the user's visual perception, and determining that the user's concentration has decreased if the calculated focus divergence scale is greater than or equal to a predetermined threshold.
In Article 8, The above focus learns a change pattern for at least one of the user's pupil and iris for a predetermined period after the start time of viewing the content, or as a result of learning a change pattern for at least one of the pupil and iris of a plurality of users in advance, extracts the pattern and size of at least one of the user's left eye's pupil and iris and the pattern and size of at least one of the user's right eye's pupil and iris, and based on the data regarding the extracted pattern and size, specifies the angle ( θ1 ) between the optical axis of the left eye reflecting the user's visual perception and the left pupil center point, the length ( D1 ) between the perception content screen point located at the end of the optical axis of the left eye reflecting the user's visual perception and the pupil center point, the angle (θ2) between the optical axis of the right eye reflecting the user's visual perception and the right pupil center point, and the length ( D2 ) between the perception content screen point located at the end of the optical axis of the right eye reflecting the user's visual perception and the pupil center point, and through the specified θ1 , D1 , θ2 , and D2 A concentration determination method based on optical axis change reflecting the user's visual perception, characterized by being calculated.
In Article 8 or Article 9, A method for determining concentration based on optical axis change reflecting a user's visual perception, comprising the step of calculating the concentration level based on the standard deviation of the gaze position value for each frame, which is the result of tracking the position of the user's gaze based on the gaze data, and determining the decrease in the user's concentration level through the focus divergence scale and the gaze distraction.

Description

Apparatus for determining concentration based on optical axis changes reflecting user's visual perception and method applied to the same The present invention relates to a concentration determination device based on optical axis change reflecting a user's visual perception and a method applied thereto. More specifically, it relates to a concentration determination device based on optical axis change reflecting a user's visual perception and a method applied thereto, in relation to the advanced determination of a user's concentration regarding a predetermined content. Recently, driven by the development of information and communication technology, fields such as online education and vehicle control for safe driving are moving beyond the one-way provision of specific content to a stage of two-way communication with users. For example, in the field of online education, attempts have been made to collect data tracking the duration, frequency, and direction of users' gaze while providing educational content, and to calculate the level of user concentration on the provided educational content based on this collected gaze-related information. However, there are cases where a user's gaze is directed correctly toward the content, yet they are unable to focus on it cognitively. In such instances where there is a dissonance between the playback of the content and the user's cognitive state, even if the user is looking at the content properly and following its progression, they may fail to grasp the content's content and the required user response resulting from its acquisition due to reduced concentration caused by this cognitive dissonance. Such cases occur very frequently. This is because conventional technology tracks a person's gaze on an object or content based on the visual axis originating from the center of the pupil, and thus fails to overcome the limitations of gaze tracking based on the visual axis. In contrast, the optical axis originating from the center of the pupil in the human eye is an axis based on the optical center of the eye. Since it reflects changes in the pattern and size of the pupil and iris according to a person's cognitive state, it can reflect whether a person perceives an object or content they are looking at, as well as the degree of such perception. However, human vision discrimination based on such an optical axis is limited to visual acuity measurement using optical tools and is not currently being applied to eye-tracking technology for viewing specific content (including content for discriminating a person's vision while looking at an object), nor is it being researched for practical application. As another example, conventional technology for determining the driving concentration state of a driver while driving has attempted to collect information tracking the driver's gaze direction and, based on this collected gaze-related information, determine whether the driver is drowsy, driving under the influence of alcohol, or whether the current driving state is significantly lacking in concentration for driving for any reason. However, similar to the lack of concentration regarding the content described earlier, if a driver is properly looking straight ahead along the visual axis, it can lead to an error where the vehicle is judged to be in a "normal drivable state" due to a failure to determine the driver's actual cognitive state. This is a problem that threatens not only the driver's own safety but also the lives of other vehicles and passengers on the road. Therefore, eye-tracking technology is needed that can detect a decrease in concentration even when the user is looking at specific content. FIG. 1 is a configuration diagram showing a concentration determination device according to one embodiment of the present invention. FIG. 2 is a configuration diagram showing a concentration determination device according to another embodiment of the present invention. Figure 3 is an illustrative diagram showing an example of measuring gaze data through the concentration determination device of Figure 1 or Figure 2. Figure 4 is an experimental graph showing an example of a threshold value applied to the concentration judgment device of Figure 1 or Figure 2. Figure 5 is an experimental graph showing two examples of concentration trends calculated through the concentration judgment device of Figure 1 or Figure 2. Figure 6 is an experimental graph showing the degree of performance achievement according to the concentration trend of Figure 5. And, FIG. 7 is a flowchart illustrating a concentration determination method according to one embodiment of the present invention. Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, the scope of the patent application is not limited or restricted by these embodiments. Identical reference numerals in each drawing indicate identical components. Various modifications may be made to the embodiments described below