Search

WO-2026095396-A1 - DISPLAY DEVICE AND OPERATING METHOD THEREOF

WO2026095396A1WO 2026095396 A1WO2026095396 A1WO 2026095396A1WO-2026095396-A1

Abstract

A display device according to one embodiment comprises: a display; at least one camera acquiring line-of-sight information of a user; a memory storing one or more instructions; and at least one processor including a processing circuit. When the one or more instructions are individually or collectively executed by the at least one processor, the display device may: display an image corresponding to image content on the display; identify an information area in the image on the basis of image content information; identify a gaze area corresponding to the line-of-sight information of the user in the image; and output a sub-image corresponding to the information area on the basis of matching of the information area and the gaze area.

Inventors

  • JANG, Sungchang
  • KANG, MINGU
  • RYU, Chanyeol
  • KIM, Youngeol

Assignees

  • 삼성전자 주식회사

Dates

Publication Date
20260507
Application Date
20251001
Priority Date
20241031

Claims (15)

  1. In a display device (100), Display (140); At least one camera (150) for acquiring user's gaze information; Memory (130) for storing one or more instructions; and It includes at least one processor (120) including a processing circuit, and When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device (100) is, Displays a video corresponding to the video content on the above display, and Based on the above video content information, an information region is identified in the above video, and In the above image, a gaze area corresponding to the user's gaze information is identified, and A display device that outputs a sub-image corresponding to the information area based on the fact that the information area and the gaze area match.
  2. In paragraph 1, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, Obtain title information for the above video content, and Based on the title information of the video content and the aspect ratio information of the video, at least one of the reference aspect ratio information, location, size, and shape of the information area is obtained, and A display device that identifies an information region in an image based on at least one of reference aspect ratio information, location, size, and shape of the information region.
  3. In paragraph 2, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that obtains title information of the image content by recognizing at least one object included in the image.
  4. In any one of paragraphs 1 through 3, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that determines whether the information area and the gaze area coincide based on the distance between the point where the user's gaze is directed and the center point of the information area in the above image.
  5. In any one of paragraphs 1 through 4, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that sets the On/Off status of a function for automatically detecting the information area and the On/Off status of a user eye tracking function based on user input.
  6. In paragraph 5, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that identifies the information area and the gaze area based on the fact that the function of automatically detecting the information area and the user gaze tracking function are set to On.
  7. In any one of paragraphs 1 through 6, A display device that displays a message asking whether to output a sub-image corresponding to the information area based on the fact that the information area and the gaze area match.
  8. In any one of paragraphs 1 through 7, The above video content includes game content, and The above video includes game video corresponding to the above game content, and A display device wherein the information area includes at least one of a minimap, a skill window, an item-related window, a character-related window, a chat window, and a control-related window included in the game image.
  9. In any one of paragraphs 1 through 8, The above sub-image includes an image that is an enlarged version of the information area, and When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that displays the above sub-image on the above display.
  10. In any one of paragraphs 1 through 9, When the one or more instructions are executed individually or collectively by the at least one processor (120), the display device, A display device that transmits the above sub-image to an external device.
  11. In a method of operating a display device, Step of displaying a video corresponding to the video content (S610); A step (S620) of identifying an information region in the image based on the above image content information; In the above image, a step of identifying a gaze area corresponding to the user's gaze information (S630); and A method of operating a display device, comprising the step (S650) of outputting a sub-image corresponding to the information area based on the fact that the information area and the gaze area match.
  12. In Paragraph 11, The step of identifying information regions in the above image is, A step of obtaining title information of the above video content; A step of obtaining at least one of the reference aspect ratio information, location, size, and shape of the information area based on the title information of the video content and the aspect ratio information of the video; and A method of operating a display device comprising the step of identifying an information region in an image based on at least one of reference aspect ratio information, location, size, and shape of the information region.
  13. In Paragraph 12, The step of obtaining title information for the above video content is, A method of operating a display device comprising the step of obtaining title information of the image content by recognizing at least one object included in the image.
  14. In any one of paragraphs 11 through 13, The above method of operation is, A method of operating a display device, further comprising the step of determining whether the information area and the gaze area coincide based on the distance between the point where the user's gaze is directed and the center point of the information area in the above image.
  15. One or more computer-readable recording media storing a program that enables the method of any one of paragraphs 11 through 14.

Description

Display device and method of operation thereof Various embodiments relate to a display device and a method of operation thereof that identify specific information included in a displayed image and provide an image corresponding to the identified specific information. Due to technological advancements in display devices, display devices capable of implementing various functions are being developed. A representative example of a display device is the television. Conventional TVs simply received broadcast signals and performed the function of playing broadcast content corresponding to the received signals (e.g., news, dramas, entertainment programs, etc.). Recently, however, due to technological advancements in display devices, various applications or programs can be stored and installed on the TV to perform diverse functions. Through these installed applications, the TV can provide various functions and services in addition to playing broadcast content. For example, a game application can be stored and installed on the TV, allowing game content to be executed through the application. In addition, as communication technology or communication connection functions of the display device are developed, the display device can provide various functions or services through wired or wireless communication with an external device. For example, the display device is connected to an external device (e.g., a source device, a game console device) via wired or wireless communication, and can receive content (e.g., game content) from the external device (e.g., a source device, a game console device) through the aforementioned wired or wireless communication. When providing game content through a display device, the device needs to output the content in a way that enhances user satisfaction and convenience. For example, the display device can perform functions such as magnifying and displaying specific information included in the game video or sharing it with an external device. To improve usability when magnifying or sharing specific information included in the game video, a method is required to automatically recognize specific information without user input. FIG. 1 is a drawing showing a display device and a source device according to one embodiment. FIG. 2 shows game images corresponding to various game contents according to one embodiment. FIGS. 3a and FIGS. 3b show game images having various aspect ratios according to one embodiment. FIG. 4 is a diagram illustrating the operation of a display device according to one embodiment to enlarge or share a portion of an image. FIG. 5 is a drawing showing a user interface screen for setting a game mode of a display device according to one embodiment. FIG. 6 is a flowchart illustrating the operation method of a display device according to one embodiment. FIGS. 7 and 8 are drawings illustrating the operation of a display device according to one embodiment identifying an information region in an image. FIG. 9 is a diagram showing the operation of a display device according to one embodiment identifying a gaze area corresponding to the user's gaze information. FIG. 10 is a diagram illustrating an operation for determining whether an information area identified in an image according to one embodiment matches a user's gaze area. FIG. 11 is a diagram showing the operation of a display device displaying a confirmation message according to one embodiment. FIG. 12 is a diagram showing the operation of a display device according to one embodiment displaying a menu for selecting to expand or share an information area. FIG. 13 is a diagram showing the operation of a display device according to one embodiment. FIG. 14 is a block diagram showing the configuration of a source device according to one embodiment. FIG. 15 is a block diagram showing the configuration of a display device according to one embodiment. FIG. 16 is a block diagram showing the configuration of a display device according to one embodiment. The terms used in this specification will be briefly explained, and the invention will be described in detail. The terms used in this invention have been selected based on currently widely used general terms, taking into account their functions within the invention; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should be defined not merely by their names, but based on their meanings and the overall content of the invention. When a part of a specification is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part"