KR-20260063409-A - DISPLAY APPARATUS AND CONTROL METHOD THEREOF

KR20260063409AKR 20260063409 AKR20260063409 AKR 20260063409AKR-20260063409-A

Abstract

A display device is disclosed. The display device may include at least one processor comprising a camera, a communication circuit, a display, a memory for storing instructions, and a processing circuit. When instructions are executed individually or collectively, the at least one processor detects a user's hand around the display device using at least one of the camera and the communication circuit while the display device is in standby mode, and when the hand is identified as being close to the display, displays a power UI element and a plurality of UI elements corresponding to directions located around the power UI element on the display based on the position of the hand, identifies the direction of the hand gesture using at least one of the camera and the communication circuit, identifies a mode corresponding to the direction of the hand gesture among a plurality of modes corresponding to the UI elements corresponding to directions, turns on the display device, and displays an image corresponding to the identified mode on the display.

Inventors

정우성
차승원
김후권

Assignees

삼성전자주식회사

Dates

Publication Date: 20260507
Application Date: 20241030

Claims (16)

In a display device, camera; Communication circuit; display; Memory for storing instructions; and at least one processor including processing circuitry; and The above at least one processor, when the instructions are executed individually or collectively, While the mode of the display device is in standby mode, at least one of the camera and the communication circuit is used to detect a user's hand around the display device, and When the hand is identified as being close to the display, a power UI (user interface) element and a plurality of UI elements corresponding to directions located around the power UI element are displayed on the display based on the position of the hand. Identifying the direction of the hand gesture using at least one of the camera and the communication circuit, and Identifying a mode corresponding to the hand gesture direction among a plurality of modes corresponding to UI elements corresponding to the plurality of directions above, and A display device that turns on the display device and displays an image corresponding to the identified mode on the display.
In paragraph 1, The UI element corresponding to the above plurality of directions includes at least two indicators facing at least two directions, and A display device wherein the above at least two directions include at least two of the following: an upward direction, a downward direction, a left direction, a right direction, an upper right direction, an upper left direction, a lower left direction, and a lower right direction centered on the power UI element.
In paragraph 1, The above at least one processor, when the instructions are executed individually or collectively, If the hand is identified as being located within a preset area on the xy plane, the area where the hand is located is identified among a plurality of areas within the preset area, and A display device that displays the above power UI element and the above plurality of direction-corresponding UI elements at a position corresponding to the identified area on the display.
In paragraph 3, The above-mentioned preset area includes a central area, an upper-right area, an upper-left area, a lower-left area, and a lower-right area, and The above at least one processor, when the instructions are executed individually or collectively, When the hand is identified as being located in the central area, the power UI element and the UI elements corresponding to the plurality of directions are displayed in the center of the screen of the display, and When the hand is identified as being located in the upper right area, the power UI element and the UI elements corresponding to the plurality of directions are displayed in the center of the upper right area of the screen, and When the hand is identified as being located in the upper-left area, the power UI element and the UI elements corresponding to the plurality of directions are displayed in the center of the upper-left area of the screen, and When the hand is identified as being located in the lower-left area, the power UI element and the UI elements corresponding to the plurality of directions are displayed in the center of the lower-left area of the screen, and A display device that, when the hand is identified as being located in the lower right area, displays the power UI element and the UI elements corresponding to the plurality of directions in the center of the lower right area of the screen.
In paragraph 3, The center coordinates of the above-mentioned preset area correspond to the center coordinates of the screen of the display, and The horizontal length of the above-mentioned preset area is larger than the horizontal length of the screen of the above-mentioned display by a preset ratio, and A display device in which the vertical length of the above-mentioned preset area is larger than the vertical length of the screen of the above-mentioned display by a preset ratio.
In paragraph 1, The above at least one processor, when the instructions are executed individually or collectively, If the direction of the hand gesture is identified as corresponding to the first direction of a UI element corresponding to the plurality of directions, the mode corresponding to the direction of the hand gesture is identified as the first mode, and If the direction of the hand gesture is identified as corresponding to the second direction of a UI element corresponding to the plurality of directions, the mode corresponding to the direction of the hand gesture is identified as the second mode, and If the direction of the hand gesture is identified as corresponding to the third direction of a UI element corresponding to the plurality of directions, the mode corresponding to the direction of the hand gesture is identified as the third mode, and A display device that identifies the mode corresponding to the hand gesture direction as the fourth mode when the hand gesture direction is identified as corresponding to the fourth direction of a UI element corresponding to the plurality of directions.
In paragraph 6, The above at least one processor, when the instructions are executed individually or collectively, If the mode corresponding to the direction of the hand gesture is identified as the first mode, a first function corresponding to the first mode is executed to display an image corresponding to the first mode on the display, and If the mode corresponding to the direction of the hand gesture is identified as the second mode, a second function corresponding to the second mode is executed to display an image corresponding to the second mode on the display, and If the mode corresponding to the direction of the hand gesture is identified as the first mode, a third function corresponding to the third mode is executed to display an image corresponding to the third mode on the display, and A display device that, when the mode corresponding to the direction of the hand gesture is identified as the first mode, executes a fourth function corresponding to the fourth mode and displays an image corresponding to the fourth mode on the display.
In paragraph 6, The above first mode is a normal mode, and The above second mode is a game mode, and The above third mode is a gallery mode, and The above-mentioned fourth mode is a display device that is an internet mode.
In a control method for a display device including a display, An operation to detect a user's hand around the display device while the mode of the display device is in standby mode; When the hand is identified as being close to the display, an operation to display a power UI (user interface) element and UI elements corresponding to a plurality of directions located around the power UI element based on the position of the hand; Action for identifying the direction of the hand gesture above; An operation to identify a mode corresponding to the hand gesture direction among a plurality of modes corresponding to UI elements corresponding to the plurality of directions; and A control method comprising the operation of turning on the display device and displaying an image corresponding to the identified mode on the display.
In Paragraph 9, The UI element corresponding to the above plurality of directions includes at least two indicators facing at least two directions, and A control method wherein the above at least two directions include at least two of the following: an upward direction, a downward direction, a left direction, a right direction, an upper right direction, an upper left direction, a lower left direction, and a lower right direction centered on the power UI element.
In Paragraph 9, The operation indicated above is, If the hand is identified as being located within a preset area on the xy plane, the operation of identifying the area where the hand is located among a plurality of areas within the preset area; and A control method comprising: an operation of displaying the above power UI element and the above plurality of direction-corresponding UI elements at a position corresponding to the identified area on the display.
In Paragraph 11, The above-mentioned preset area includes a central area, an upper-right area, an upper-left area, a lower-left area, and a lower-right area, and The operation indicated above is, When the hand is identified as being located in the central area, the operation of displaying the power UI element and the UI elements corresponding to the plurality of directions at the center of the screen of the display; When the hand is identified as being located in the upper right area, the operation of displaying the power UI element and the UI elements corresponding to the plurality of directions at the center of the upper right area of the screen; When the hand is identified as being located in the upper-left area, the operation of displaying the power UI element and the UI elements corresponding to the plurality of directions at the center of the upper-left area of the screen; When the hand is identified as being located in the lower-left area, the operation of displaying the power UI element and the UI elements corresponding to the plurality of directions at the center of the lower-left area of the screen; A control method comprising: an action of displaying the power UI element and the UI elements corresponding to the plurality of directions at the center of the lower right area of the screen when the hand is identified as being located in the lower right area.
In Paragraph 11, The center coordinates of the above-mentioned preset area correspond to the center coordinates of the screen of the display, and The horizontal length of the above-mentioned preset area is larger than the horizontal length of the screen of the above-mentioned display by a preset ratio, and A control method in which the vertical length of the above-mentioned preset area is larger than the vertical length of the display screen by a preset ratio.
In Paragraph 9, The above-mentioned identifying operation is, If the direction of the hand gesture is identified as corresponding to a first direction of a UI element corresponding to the plurality of directions, the operation of identifying the mode corresponding to the direction of the hand gesture as the first mode; If the direction of the hand gesture is identified as corresponding to a second direction of a UI element corresponding to the plurality of directions, the operation of identifying the mode corresponding to the direction of the hand gesture as the second mode; If the gesture direction of the hand is identified as corresponding to a third direction of a UI element corresponding to the plurality of directions, the operation of identifying the mode corresponding to the gesture direction of the hand as a third mode; and A control method comprising: an action of identifying that the mode corresponding to the hand gesture direction is the fourth mode when the hand gesture direction is identified as corresponding to the fourth direction of a UI element corresponding to the plurality of directions.
In Paragraph 14, The operation indicated above is, If the mode corresponding to the direction of the hand gesture is identified as the first mode, the operation of executing a first function corresponding to the first mode to display an image corresponding to the first mode on the display; If the mode corresponding to the hand gesture direction is identified as the second mode, the operation of executing a second function corresponding to the second mode to display an image corresponding to the second mode on the display; If the mode corresponding to the hand gesture direction is identified as the first mode, the operation of executing a third function corresponding to the third mode to display an image corresponding to the third mode on the display; and A control method comprising: an operation in which, if the mode corresponding to the direction of the hand gesture is identified as the first mode, a fourth function corresponding to the fourth mode is executed to display an image corresponding to the fourth mode on the display.
In Paragraph 14, The above first mode is a normal mode, and The above second mode is a game mode, and The above third mode is a gallery mode, and The above-mentioned fourth mode is a control method, which is an internet mode.

Description

Display apparatus and control method thereof { DISPLAY APPARATUS AND CONTROL METHOD THEREOF } The present disclosure relates to a display device for displaying UI elements and a method for controlling the same. A display device is a device that displays video signals. Recently, display devices are being equipped with features that provide diverse user experiences, in addition to the function of displaying video. FIG. 1 is a drawing for explaining a display device according to one embodiment. FIG. 2 is a block diagram of a display device according to one embodiment. FIG. 3 is a block diagram showing an example of an implementation of a display device according to one embodiment. FIG. 4 is a diagram illustrating the operations of a display device displaying UI elements according to one embodiment. FIG. 5 is a diagram illustrating an example of an operation in which a display device according to one embodiment displays a power UI element and a plurality of UI elements corresponding to directions. FIG. 6 is a drawing for explaining a preset area according to one embodiment. FIGS. 7A, FIGS. 7B, FIGS. 7C, FIGS. 7D, and FIGS. 7E are drawings for explaining operations in which a display device according to one embodiment displays UI elements based on the position of a user's hand. FIGS. 8A, FIGS. 8B, and FIGS. 8C are drawings for explaining operations in which a display device according to one embodiment displays UI elements based on the position of a user's hand. FIGS. 9a and 9b are drawings for explaining the operation of a display device according to one embodiment identifying the direction of a UI element corresponding to the direction of a user's hand gesture. FIGS. 10a, FIGS. 10b, FIGS. 10c and FIGS. 10d are drawings for illustrating an example in which a display device according to one embodiment identifies a mode corresponding to the direction of a user's hand gesture and performs an operation corresponding to the mode. FIGS. 11, FIGS. 12a, and FIGS. 12b are drawings for illustrating an example in which a display device according to one embodiment displays UI elements based on the position of a user's hand and performs an action corresponding to the direction of the hand gesture. FIGS. 13a, FIGS. 13b, and FIGS. 13c are drawings for illustrating an example in which a display device according to one embodiment displays UI elements based on the position of a user's hand and performs an action corresponding to the direction of the hand gesture. The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component. Throughout the specification, singular expressions include plural expressions unless the context clearly indicates otherwise. Wherever a part of the specification states that it "includes" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC). Embodiments of the present disclosure will be described in more detail below with reference to the attached drawings. FIG. 1 is a drawing for explaining a display device according to one embodiment. Referring to FIG. 1, the display device (100) may be implemented as a televisi