Search

CN-122029803-A - Electronic device and control method thereof

CN122029803ACN 122029803 ACN122029803 ACN 122029803ACN-122029803-A

Abstract

An electronic device includes a display implemented to be operable in a three-dimensional mode or in both a two-dimensional mode, one or more cameras to capture images in front of the display, a memory to store one or more instructions, and one or more processors. The one or more processors execute one or more instructions to identify whether a user is in front of the display based on the captured image, identify whether a user gaze is directed in front of the display when the user is identified as being in front of the display, control the display to operate in a three-dimensional mode when the user gaze is identified as being directed in front of the display, and control the display to operate in a two-dimensional mode when the user is identified as not being in front of the display or the user gaze is not directed in front of the display.

Inventors

  • YIN DAYUAN
  • ZHAO SHENGJI

Assignees

  • 三星电子株式会社

Dates

Publication Date
20260512
Application Date
20241206
Priority Date
20240108

Claims (15)

  1. 1. An electronic device, comprising: A display configured to operate in a three-dimensional 3D mode and a two-dimensional 2D mode; At least one camera for capturing an image in front of the display; A memory storing at least one instruction, and At least one processor configured to execute the at least one instruction to: Identifying whether a user is located in front of the display based on the captured image; identifying whether a user gaze is directed in front of the display when the user is identified as being located in front of the display; Controlling the display to operate in the 3D mode when the user gaze is identified as pointing forward of the display, and The display is controlled to operate in the 2D mode when the user is not identified as being in front of the display, or when the user gaze is identified as not pointing in front of the display.
  2. 2. The electronic device of claim 1, wherein, The at least one processor is configured to execute the at least one instruction to: identifying a probability that content to be displayed is stereoscopic content for each content duration when the user gaze is identified as pointing in front of the display; Controlling the display to operate in the 3D mode for a content duration in which the probability of recognition of the stereoscopic content is a threshold value or more, and Controlling the display to operate in the 2D mode for a content duration for which the probability of identification of the stereoscopic content is less than the threshold.
  3. 3. The electronic device of claim 2, wherein, The at least one processor is configured to execute the at least one instruction to: inputting the content to be displayed into a trained artificial intelligence model trained for each content duration, and A probability that the content to be displayed is the stereoscopic content is identified based on information output from the trained artificial intelligence model.
  4. 4. The electronic device of claim 2, wherein, The at least one processor is configured to execute the at least one instruction to: Inputting the captured image into a trained artificial intelligence model, and Based on information output from the trained artificial intelligence model, it is identified whether the user gaze is directed in front of the display.
  5. 5. The electronic device of claim 1, wherein, The content to be displayed includes side-by-side content, and The at least one processor is configured to execute the at least one instruction to: Identifying whether a similarity between a left region of the side-by-side content and a right region of the side-by-side content within each side-by-side content duration is a threshold; controlling the display to operate in the 3D mode for a side-by-side content duration in which a similarity between a left region of the side-by-side content and a right region of the side-by-side content is a threshold or greater, and Controlling the display to operate in the 2D mode for a side-by-side content duration in which a similarity between a left region of the side-by-side content and a right region of the side-by-side content is less than the threshold.
  6. 6. The electronic device of claim 1, wherein, The at least one processor is configured to execute the at least one instruction to: while the display is operating in the 3D mode, The display is controlled to switch to the 2D mode when the user is not identified as being in front of the display, or when the user gaze is identified as not pointing in front of the display.
  7. 7. The electronic device of claim 1, wherein, The at least one processor is configured to execute the at least one instruction to: while the display is operating in the 2D mode, Identifying whether the content to be displayed is stereoscopic content for each content duration when the user gaze is identified as pointing forward of the display, and And when the content to be displayed is identified as the stereoscopic content, controlling the display to switch to the 3D mode.
  8. 8. The electronic device of claim 1, wherein, The at least one processor is configured to execute the at least one instruction to: identifying a probability that the content to be displayed is stereoscopic content within each content duration; Identifying whether the user gaze is directed in front of the display based on the captured image for a content duration in which the identification probability of the stereoscopic content is a threshold or greater; Controlling the display to operate in the 3D mode when the user gaze is recognized as pointing forward of the display and the recognition probability of the stereoscopic content is the threshold value or more, and Controlling the display to operate in the 2D mode for a content duration for which the probability of identification of the stereoscopic content is less than the threshold.
  9. 9. The electronic device of claim 1, wherein, The at least one processor is configured to execute the at least one instruction to: the user is identified as being in front of the display when a specific body part of the user is included in the captured image or a user body area having a predetermined ratio or more is identified as being included in the captured image.
  10. 10. The electronic device of claim 1, wherein, The display is implemented as a light field display comprising an array of lenticular lenses, and The at least one processor is configured to control the display to operate in the 3D mode or the 2D mode by adjusting a voltage applied to the lenticular array included in the light field display.
  11. 11. A method of controlling an electronic device comprising a display configured to operate in a three-dimensional 3D mode and a two-dimensional 2D mode and at least one camera for capturing images in front of the display, the method comprising: identifying whether a user is located in front of the display based on images captured by the at least one camera; identifying whether a user gaze is directed in front of the display when the user is identified as being located in front of the display; Controlling the display to operate in the 3D mode when the user gaze is identified as pointing forward of the display, and The display is controlled to operate in the 2D mode when the user is not identified as being in front of the display, or when the user gaze is identified as not pointing in front of the display.
  12. 12. The method of claim 11, further comprising: identifying a probability that content to be displayed is stereoscopic content for each content duration when the user gaze is identified as pointing in front of the display; Controlling the display to operate in the 3D mode for a content duration in which the probability of recognition of the stereoscopic content is a threshold value or more, and Controlling the display to operate in the 2D mode for a content duration for which the probability of identification of the stereoscopic content is less than the threshold.
  13. 13. The method of claim 12, wherein, The identifying the probability that the content to be displayed is the stereoscopic content comprises: inputting the content to be displayed into a trained artificial intelligence model trained for each content duration, and A probability that the content to be displayed is the stereoscopic content is identified based on information output from the trained artificial intelligence model.
  14. 14. The method of claim 12, wherein, Identifying whether the user gaze is directed in front of the display includes: inputting the captured image into a trained artificial intelligence model, and Based on information output from the trained artificial intelligence model, it is identified whether the user gaze is directed in front of the display.
  15. 15. A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform operations comprising a display configured to operate in a three-dimensional 3D mode and a two-dimensional 2D mode and at least one camera for capturing images in front of the display, wherein the operations comprise: identifying whether a user is located in front of the display based on images captured by the at least one camera; identifying whether a user gaze is directed in front of the display when the user is identified as being located in front of the display; Controlling the display to operate in the 3D mode when the user gaze is identified as pointing forward of the display, and The display is controlled to operate in the 2D mode when the user is not identified as being in front of the display, or when the user gaze is identified as not pointing in front of the display.

Description

Electronic device and control method thereof Technical Field The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device providing a three-dimensional (3D) image and a control method thereof. Background With the development of electronic technology, various types of electronic devices have been developed and provided. In particular, display devices used in various places such as home, office, public place, etc. have been continuously developed in recent years. Stereoscopic refers to three-dimensional (3D) technology. The 3D display currently being commercialized is mainly implemented using the binocular parallax method. The binocular parallax method can provide a three-dimensional effect on a single screen such as a television or cinema screen. Binocular parallax methods can be classified into a glasses method (stereoscopic vision) and a glasses-free method (auto-stereoscopic vision) using auxiliary equipment such as glasses. In recent years, continuous research has been conducted to realize commercialization of eyeglass-free light field displays and eyeglass-free 3D displays using eye tracking technology. Disclosure of Invention Technical scheme Aspects of embodiments of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments. According to an embodiment of the present disclosure, an electronic device includes a display configured to operate in a three-dimensional (3D) mode and a two-dimensional (2D) mode, at least one camera to capture an image in front of the display, a memory to store at least one instruction, and at least one processor configured to execute the at least one instruction to identify whether a user is in front of the display based on the captured image, to identify whether a user gaze is directed in front of the display when the user is identified as being in front of the display, to control the display to operate in the 3D mode when the user gaze is identified as being directed in front of the display, and to control the display to operate in the 2D mode when the user gaze is not identified as being in front of the display, or when the user gaze is identified as not being directed in front of the display. According to an embodiment of the present disclosure, the at least one processor may be configured to execute at least one instruction to identify a probability that the content to be displayed is stereoscopic content for each content duration when the user gaze is identified as pointing in front of the display, control the display to operate in a 3D mode for a content duration for which the identification probability of stereoscopic content is a threshold value or greater, and control the display to operate in a 2D mode for a content duration for which the identification probability of stereoscopic content is less than the threshold value. In accordance with an embodiment of the present disclosure, the at least one processor may be configured to execute at least one instruction to input content to be displayed into a trained artificial intelligence model trained for each content duration and identify a probability that the content to be displayed is stereoscopic based on information output from the trained artificial intelligence model. In accordance with an embodiment of the present disclosure, the at least one processor may be configured to execute at least one instruction to input a captured image into the trained artificial intelligence model and to identify whether a user gaze is directed in front of the display based on information output from the trained artificial intelligence model. According to embodiments of the present disclosure, the content to be displayed may include side-by-side content. The at least one processor may be configured to execute at least one instruction to identify whether a similarity between a left region of the side-by-side content and a right region of the side-by-side content within each side-by-side content duration is a threshold, control the display to operate in a 3D mode for the side-by-side content duration in which the similarity between the left region of the side-by-side content and the right region of the side-by-side content is the threshold or greater, and control the display to operate in a 2D mode for the side-by-side content duration in which the similarity between the left region of the side-by-side content and the right region of the side-by-side content is less than the threshold. According to an embodiment of the present disclosure, the at least one processor is configured to execute at least one instruction to control the display to switch to the 2D mode when the user is not identified as being in front of the display, or when the user gaze is identified as not pointing in front of the display while the display is operating in the 3D m