KR-20260066232-A - A SYSTEM THAT INCLUDES A SENIOR-TAILORED INTERFACE

KR20260066232AKR 20260066232 AKR20260066232 AKR 20260066232AKR-20260066232-A

Abstract

A system including a senior-tailored interface is provided. The system includes a user terminal including a touch display panel and a camera, and a server that transmits and receives data to and from the user terminal via a communication network. The server periodically receives camera images from the user terminal, analyzes the camera images to determine whether the user experiences visual perception difficulties while using the user terminal, and tracks the user's pupils to calculate the coordinates of the gaze area on the screen of the user terminal where the user's gaze is directed.

Inventors

엄일섭

Assignees

주식회사 마이게이트

Dates

Publication Date: 20260512
Application Date: 20241104

Claims (10)

A user terminal including a touch display panel and a camera; and It includes a server that transmits and receives data through a communication network with the above-mentioned user terminal, A system in which the server periodically receives camera images from the user terminal, analyzes the camera images to determine whether the user experiences visual perception difficulties while using the user terminal, and tracks the user's pupils to calculate the coordinates of the gaze area on the screen of the user terminal where the user's gaze is focused.
In Article 1, The above user terminal periodically activates the camera to capture an image, converts the image into RGB data, and The above server is a system that detects the user's face by converting RGB data received from the user terminal to grayscale and removing noise.
In Article 2, A system in which the server calculates the area of the face and determines that the user's face has moved closer to or further away from the user terminal when the change in the area exceeds a preset threshold, and detects the repetition of the movement of moving closer and further away to determine that the user is experiencing visual perception difficulties according to the cycle of the user moving back and forth.
In Paragraph 3, A system in which the server executes an AI-based chatbot on the user terminal when it determines that the user is experiencing visual perception difficulties while using the user terminal.
In Article 2, The above server analyzes the camera image to map the user's pupil movement to the coordinates on the screen of the user terminal, and tracks the screen area of the user terminal that the user is looking at in real time, and A system for analyzing the above camera image, comprising a process for detecting face and eye regions, a pupil detection process, an eye position-based gaze tracking process, a process for calculating the gaze region on the screen, and a calibration process.
In Article 5, A system in which the server provides an interface to the user terminal so that a specific screen area that the user is looking at is enlarged by a first magnification ratio and displayed on the screen of the user terminal.
In Article 6, The above server is a system that displays an input button on the screen of the user terminal that can be changed to a second magnification different from the first magnification.
In Article 6, A system in which the server displays to the user terminal, via an AI-based chatbot, a button that executes a function displayed within a specific screen area that the user is watching on the screen of the user terminal.
In Article 1, The above server is a system comprising a deep learning network and a training data set.
In a system including a senior-customized interface, The above system is, A user terminal including a touch display panel and a camera; and It includes a server that transmits and receives data through a communication network with the above-mentioned user terminal, The above server executes a senior-customized interface on the user terminal, and The method by which the above server executes the above interface is, The server collects camera images from the user terminal and extracts the user's face from the images; A step in which the server analyzes images received during a specific period to determine whether the user experiences visual perception difficulties while using the user terminal; A step of executing an AI-based chatbot function on the user terminal when the server determines that the user is experiencing visual perception difficulties; A step in which the server analyzes the image to track the user's pupil and calculates the area on the screen of the user terminal where the user's gaze is focused; and A system comprising the step of providing an interface to a user terminal such that the server magnifies and displays a specific screen area that the user is looking at on the screen of the user terminal.

Description

A system that includes a senior-tailored interface The present invention relates to a system including a senior-customized interface. The main reasons why the elderly experience difficulties using smartphones include declining eyesight, hearing loss, physical limitations, and a lack of experience using digital devices. Recently, applications featuring interfaces with improved text sizes and UI designs for better readability are being distributed to enhance the convenience of smartphone use for the elderly. For example, applications are utilizing large text and icons, or implementing interfaces that provide large font sizes and simple icons in the default settings to improve readability. However, if large text and icons are used in applications used by the elderly, the number of icons or text that can be displayed on a single screen decreases due to the smartphone's resolution. FIG. 1 is a schematic diagram showing the overall configuration of a system according to one embodiment of the present invention. FIG. 2 is a block diagram illustrating the configuration of a server according to an embodiment of the present invention. FIG. 3 is an algorithm flowchart illustrating a method for providing a senior-customized interface according to an embodiment of the present invention. FIG. 4 is a diagram illustrating some processes for providing a senior-customized interface according to one embodiment of the present invention. FIG. 5 is a diagram illustrating some processes for providing a senior-customized interface according to one embodiment of the present invention. FIG. 6 is a diagram illustrating some processes for providing a senior-customized interface according to one embodiment of the present invention. FIG. 7 is a diagram illustrating some processes for providing a senior-customized interface according to one embodiment of the present invention. The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention. A singular expression includes a plural expression unless the context clearly indicates otherwise. Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. Identical or similar reference numerals are used for identical components in the drawings. FIG. 1 is a schematic diagram showing the overall configuration of a system according to one embodiment of the present invention. Referring to FIG. 1, the system (1) includes a user terminal (10), a server (20), and a communication network (30). The user terminal (10) may include a processor, controller, integrated circuit, programmable logic circuit, or other database and signal processing device, each comprising any combination thereof, and may also include one or more memories, transmitters and receivers, a display, and a communication module capable of communicating with various devices. Additionally, it may include a computer program that performs data operations through a specified algorithm and displays the result so that it can be recognized externally through a display, and a user interface (UI) implemented to allow a user to operate it. For example, the user terminal (10) can be implemented as various electronic devices such as a smartphone, smart tablet, mobile communication device (including wireless device), workstation, desktop computer, laptop computer, palmtop computer, tablet computer, PDA (portable digital assistant), kiosk, etc. In one embodiment, the user terminal (10) may include a touch display panel (110) and a camera (120). The touch display panel (110) is an interface that integrates input and output devices, and can input data and provide information visually through direct interaction with the user. For example, the touch display panel (110) is composed of a transparent electrode layer and a sensing sensor, and can detect user touch and transmit coordinate data to a processing device. For example, the touch input function operates in a capacitive or resistive manner, and the touch display panel (110) is applied to a user terminal (10) to provide an intuitive and efficient us