Search

EP-4742655-A1 - ELECTRONIC DEVICE AND CONTROL METHOD THEREFOR

EP4742655A1EP 4742655 A1EP4742655 A1EP 4742655A1EP-4742655-A1

Abstract

An electronic apparatus including a display that is operable in a 3D mode and a 2D mode; a camera to capture an image in front of the display; a memory storing at least one instruction; and a processor to execute the at least one instruction to identify whether a user is positioned in front of the display based on the captured image, when the user is identified as being in front of the display, identify whether a user gaze is directed toward a front of the display, when the user gaze is identified as being directed toward the front of the display, control the display to operate in the 3D mode, and, when the user is not identified as being in front of the display, or the user gaze is identified as not being directed toward the front of the display, control the display to operate in the 2D mode.

Inventors

  • YOON, Daewon
  • CHO, Seungki

Assignees

  • Samsung Electronics Co., Ltd.

Dates

Publication Date
20260513
Application Date
20241206

Claims (15)

  1. An electronic apparatus comprising: a display configured to be operated in a three-dimensional (3D) mode and a two-dimensional (2D) mode; at least one camera to capture an image in front of the display; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction to: identify whether a user is positioned in front of the display based on the captured image, when the user is identified as being positioned in front of the display, identify whether a user gaze is directed toward a front of the display, when the user gaze is identified as being directed toward the front of the display, control the display to be operated in the 3D mode, and when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed toward the front of the display, control the display to be operated in the 2D mode.
  2. The apparatus as claimed in claim 1, wherein the at least one processor is configured to execute the at least one instruction to: when the user gaze is identified as being directed toward the front of the display, identify a probability that content to be displayed is stereoscopic content for each content duration, control the display to be operated in the 3D mode in a content duration in which the identified probability of the stereoscopic content is a threshold value or more, and control the display to be operated in the 2D mode in a content duration in which the identified probability of the stereoscopic content is less than the threshold value.
  3. The apparatus as claimed in claim 2, wherein the at least one processor is configured to execute the at least one instruction to: input the content to be displayed into a trained artificial intelligence model trained for each content duration, and identify the probability that the content to be displayed is the stereoscopic content based on information output from the trained artificial intelligence model.
  4. The apparatus as claimed in claim 2, wherein the at least one processor is configured to execute the at least one instruction to: input the captured image into a trained artificial intelligence model, and identify whether the user gaze is directed toward the front of the display based on information output from the trained artificial intelligence model.
  5. The apparatus as claimed in claim 1, wherein content to be displayed includes side-by-side content, and the at least one processor is configured to execute the at least one instruction to: identify whether similarity between a left region of the side-by-side content and a right region of the side-by-side content is a threshold value for each side-by-side content duration, control the display to be operated in the 3D mode in the side-by-side content duration in which the similarity between the left region of the side-by-side content and the right region of the side-by-side content is the threshold value or more, and control the display to be operated in the 2D mode in the side-by-side content duration in which the similarity between the left region of the side-by-side and the right region of the side-by-side content is less than the threshold value.
  6. The apparatus as claimed in claim 1, wherein the at least one processor is configured to execute the at least one instruction to, while the display is being operated in the 3D mode: when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed toward the front of the display, control the display to switch to the 2D mode.
  7. The apparatus as claimed in claim 1, wherein the at least one processor is configured to execute the at least one instruction to, while the the display is being operated in the 3D mode: when the user gaze is identified as being directed toward the front of the display, identify whether content to be displayed is stereoscopic content for each content duration, and control the display to be switched to the 3D mode when the content to be displayed is identified as the stereoscopic content.
  8. The apparatus as claimed in claim 1, wherein the at least one processor is configured to execute the at least one instruction to: identify a probability that content to be displayed is stereoscopic content for each content duration, identify whether the user gaze is directed toward the front of the display based on the captured image in the content duration in which the identified probability of the stereoscopic content is a threshold value or more, control the display to be operated in the 3D mode when the user gaze is identified as being directed toward the front of the display and the identified probability of the stereoscopic content is the threshold value or more, and control the display to be operated in the 2D mode in the content duration in which the identified probability of the stereoscopic content is less than the threshold value.
  9. The apparatus as claimed in claim 1, wherein the at least one processor is configured to execute the at least one instruction to: identify the user as being positioned in front of the display when a specific body part of the user is included in the captured image or a user body region that has a predetermined ratio or more is identified as being included in the captured image.
  10. The apparatus as claimed in claim 1, wherein the display is implemented as a light field display including a lenticular lens array, and the at least one processor is configured to control the display to be operated either in the 3D mode or the 2D mode by adjusting a voltage applied to the lenticular lens array included in the light field display.
  11. A method of controlling an electronic apparatus which includes a display configured to be operated in a three-dimensional (3D) mode and a two-dimensional (2D) mode, and at least one camera to capture an image in front of the display, the method comprising: identifying whether a user is positioned in front of the display based on an image captured by the at least one camera; when the user is identified as being positioned in front of the display, identifying whether a user gaze is directed toward a front of the display; when the user gaze is identified as being directed toward the front of the display, controlling the display to be operated in the 3D mode; and when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed toward the front of the display, controlling the display to be operated in the 2D mode.
  12. The method as claimed in claim 11, further comprising: when the user gaze is identified as being directed toward the front of the display, identifying a probability that content to be displayed is stereoscopic content for each content duration, controlling the display to be operated in the 3D mode in a content duration in which the identified probability of the stereoscopic content is a threshold value or more, and controlling the display to be operated in the 2D mode in a content duration in which the identified probability of the stereoscopic content is less than the threshold value.
  13. The method as claimed in claim 12, wherein the identifying of the probability that the content to be displayed is the stereoscopic content includes: inputting the content to be displayed into a trained artificial intelligence model trained for each content duration, and identifying the probability that the content to be displayed is the stereoscopic content based on information output from the trained artificial intelligence model.
  14. The method as claimed in claim 12, wherein the identifying of whether the user gaze is directed toward the front of the display includes: inputting the captured image into a trained artificial intelligence model, and identifying whether the user gaze is directed toward the front of the display based on information output from the trained artificial intelligence model.
  15. A non-transitory computer-readable medium which stores a computer instruction for causing an electronic apparatus to perform an operation in case of being executed by a processor of the electronic apparatus including a display configured to be operated in a three-dimensional (3D) mode and a two-dimensional (2D) mode, and at least one camera to capture an image in front of the display, wherein the operation includes: identifying whether a user is positioned in front of the display based on an image captured by the at least one camera; when the user is identified as being positioned in front of the display, identifying whether a user gaze is directed toward a front of the display; when the user gaze is identified as being directed toward the front of the display, controlling the display to be operated in the 3D mode; and when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed toward the front of the display, controlling the display to be operated in the 2D mode.

Description

[Technical Field] The present disclosure relates to an electronic apparatus and a control method thereof, and more particularly, to an electronic apparatus that provides a three-dimensional (3D) image, and a control method thereof. [Background Art] Various types of electronic devices have been developed and supplied in accordance with the development of electronic technology. In particular, display devices used in various places such as homes, offices, public places have been continuously developed over the recent years. Stereoscopy refers to three-dimensional (3D) technology. A 3D display, which is currently being commercialized, is mainly implemented using a binocular parallax method. The binocular parallax method may provide a three-dimensional effect on a single screen such as a television (TV) or theater screen. The binocular parallax method may be classified into a glasses method (stereoscopy) that uses an auxiliary device such as glasses and a glasses-free method (autostereocopy). Continuous research has been recently conducted on the commercialization of a glasses-free light field display and a glasses-free 3D display using eye-tracking. [Disclosure] [Technical Solution] Aspects of embodiments of the disclosure will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments. According to an embodiment of the disclosure, an electronic apparatus includes a display configured to be operated in a three-dimensional (3D) mode and a two-dimensional (2D) mode; at least one camera to capture an image in front of the display; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction to identify whether a user is positioned in front of the display based on the captured image, when the user is identified as being positioned in front of the display, identify whether a user gaze is directed toward a front of the display, when the user gaze is identified as being directed toward the front of the display, control the display to be operated in the 3D mode, and, when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed toward the front of the display, control the display to be operated in the 2D mode. According to an embodiment of the disclosure, the at least one processor may be configured to execute the at least one instruction to, when the user gaze is identified as being directed toward the front of the display, identify a probability that content to be displayed is stereoscopic content for each content duration, control the display to be operated in the 3D mode in a content duration in which the identified probability of the stereoscopic content is a threshold value or more, and control the display to be operated in the 2D mode in a content duration in which the identified probability of the stereoscopic content is less than the threshold value. According to an embodiment of the disclosure, the at least one processor may be configured to execute the at least one instruction to input the content to be displayed into a trained artificial intelligence model trained for each content duration, and identify the probability that the content to be displayed is the stereoscopic content based on information output from the trained artificial intelligence model. According to an embodiment of the disclosure, the at least one processor may be configured to execute the at least one instruction to input the captured image into a trained artificial intelligence model, and identify whether the user gaze is directed toward the front of the display based on information output from the trained artificial intelligence model. According to an embodiment of the disclosure, content to be displayed may include side-by-side content. The at least one processor may be configured to execute the at least one instruction to identify whether similarity between a left region of the side-by-side content and a right region of the side-by-side content is a threshold value for each side-by-side content duration, control the display to be operated in the 3D mode in the side-by-side content duration in which the similarity between the left region of the side-by-side content and the right region of the side-by-side content is the threshold value or more, and control the display to be operated in the 2D mode in the side-by-side content duration in which the similarity between the left region of the side-by-side and the right region of the side-by-side content is less than the threshold value. According to an embodiment of the disclosure, the at least one processor may be configured to execute the at least one instruction to, while the display is being operated in the 3D mode, when the user is not identified as being positioned in front of the display, or when the user gaze is identified as not being directed to