Search

EP-4582906-B1 - AUGMENTED REALITY OBJECT DISPLAY METHOD AND ELECTRONIC DEVICE SUPPORTING SAME

EP4582906B1EP 4582906 B1EP4582906 B1EP 4582906B1EP-4582906-B1

Inventors

  • PARK, DAEKEUN

Dates

Publication Date
20260506
Application Date
20230915

Claims (15)

  1. An electronic device (101a, 101b, 101c, 101, 901, 103, 902, 904) comprising: at least one camera (105, 133, 231); a display (103, 210); and at least one processor (921, 923, 920, 902) electrically coupled to the at least one camera and the display, wherein the at least one processor is configured to: acquire an image (300) by using the at least one camera; based on that the image is acquired, identify at least one of a count of an Augmented Reality (AR) object (2, 410, 430, 420) to be displayed by using the display, and a ratio of a display area of the AR object to a resolution of the display; based on that the at least one of the count of AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined first threshold, determine to display the AR object as an outline (413a, 411a, 433a, 431a) by using the display; characterized in that the at least one processor is further configure to: based on that the AR object is determined to be displayed as the outline, determine at least one first representative pixel value for the AR object; determine a second representative pixel value for presenting a first region (510, 530) of the image corresponding to a display position of the AR object by using the display; based on that a difference between the at least one first representative pixel value and the second representative pixel value is not included in a predetermined threshold range, display the AR object as the outline in accordance with a first display attribute which uses the at least one first representative pixel value by using the display; and based on that the difference between the at least one first representative pixel value and the second representative pixel value is included in the predetermined threshold range, display the AR object as the outline in accordance with a second display attribute different from the first display attribute by using the display.
  2. The electronic device of claim 1, wherein the at least one processor is configured to: divide the AR object into at least one section which is defined depending on the outline; and determine the first representative pixel value for each of the at least one section.
  3. The electronic device of claim 2, wherein the at least one processor is configured to: based on a representative value or average value of RGB values of the display for presenting each of the at least one section by using the display, determine the first representative pixel value for each of the at least one section; and based on a YCbCr value obtained converted from the representative value or average value of the RGB values, determine the first representative pixel value for each of the at least one section.
  4. The electronic device of claim 1, wherein the at least one processor is configured to: based on a representative value or average value of RGB values of the display for presenting the first region of the image by using the display, determine the second representative pixel value for the first region of the image; or based on a YCbCr value converted from the representative value or average value of the RGB values, determine the second representative pixel value for the first region of the image.
  5. The electronic device of claim 2, wherein the at least one section includes a first section and a second section, and wherein the at least one processor is configured to: determine whether a difference between the first representative pixel value determined for the first section and the second representative pixel value for the first region of the image is included in the predetermined threshold range; and determine whether the difference between the first representative pixel value determined for the second section and the second representative pixel value for the first region of the image is included in the predetermined threshold range.
  6. The electronic device of claim 5, wherein the at least one processor is configured to: based on that the difference between the first representative pixel value determined for the first section and the second representative pixel value for the first region of the image is not included in the predetermined threshold range, display a first outline defining the first section in accordance with the first display attribute; and based on that the first representative pixel value determined for the second section and the second representative pixel value for the first region of the image is included in the predetermined threshold range, display a second outline defining the second section in accordance with the second display attribute.
  7. The electronic device of claim 6, wherein the at least one processor is configured to: display the second outline defining the second section in accordance with the second display attribute which uses a color having a complementary color relationship with the first representative pixel value determined for the second section; display the second outline defining the second section in accordance with the second display attribute which uses a thicker thickness than the first outline displayed in accordance with the first display attribute; or display the second outline defining the second section in accordance with the second display attribute which uses a higher brightness or higher saturation than the first outline displayed in accordance with the first display attribute.
  8. The electronic device of claim 1, wherein the at least one processor is configured to: determine whether the at least one of the count of the AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined second threshold greater than the predetermined first threshold; based on that the at least one of the count of the AR object and the ratio of the display area of the AR object are greater than or equal to the predetermined second threshold, determine a third representative pixel value for the entire region of the image; and display the AR object as the outline in accordance with a third display attribute which uses a color having a complementary relationship with the third representative pixel value.
  9. A method of displaying an AR object (2, 410, 430, 420) of an electronic device (101a, 101b, 101c, 101, 901, 103, 902, 904), the method comprising: acquiring, by at least one processor (921, 923, 920, 902) of the electronic device, an image (300) by using at least one camera (105, 133, 231) of the electronic device; based on that the image is acquired, identifying, by the at least one processor, at least one of a count of the AR object to be displayed by using the display of the electronic device and a ratio of a display area (230, 510, 530) of the AR object to a resolution of the display; based on that the at least one of the count of AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined first threshold, determining, by the at least one processor, to display the AR object as an outline by using the display; the method being characterized by further comprising: based on that the AR object is determined to be displayed as the outline, determining, by the at least one processor, at least one first representative pixel value for the AR object; determining, by the at least one processor, a second representative pixel value for presenting a first region of the image corresponding to a display position of the AR object by using the display; based on that a difference between the at least one first representative pixel value and the second representative pixel value is not included in a predetermined threshold range, displaying, by the at least one processor, the AR object as the outline in accordance with a first display attribute which uses the at least one first representative pixel value by using the display; and based on that the difference between the at least one first representative pixel value and the second representative pixel value is included in the predetermined threshold range, displaying, by the at least one processor, the AR object as the outline in accordance with a second display attribute different from the first display attribute by using the display.
  10. The method of claim 9, wherein the determining of the at least one first representative pixel value for the AR object comprises: dividing, by the at least one processor, the AR object into at least one section which is defined depending on the outline; and determining, by the at least one processor, the first representative pixel value for each of the at least one section.
  11. The method of claim 10, wherein the determining of the first representative pixel value for each of the at least one section comprises: based on a representative value or average value of RGB values of the display for presenting each of the at least one section by using the display, determining, by the at least one processor; the first representative pixel value for each of the at least one section; and based on a YCbCr value obtained converted from the representative value or average value of the RGB values, determining, by the at least one processor, the first representative pixel value for each of the at least one section.
  12. The method of claim 9, wherein the determining of the second representative pixel value for the first region of the image comprises: based on a representative value or average value of RGB values of the display for presenting the first region of the image by using the display, determining, by the at least one processor, the second representative pixel value for the first region of the image; or based on a YCbCr value converted from the representative value or average value of the RGB values, determining, by the at least one processor, the second representative pixel value for the first region of the image.
  13. The method of claim 10, wherein the at least one section includes a first section and a second section, and wherein the determining of the first representative pixel value for each of the at least one section comprises: based on that the difference between the first representative pixel value determined for the first section and the second representative pixel value for the first region of the image is not included in the predetermined threshold range, displaying, by the at least one processor, a first outline defining the first section in accordance with the first display attribute; and based on that the first representative pixel value determined for the second section and the second representative pixel value for the first region of the image is included in the predetermined threshold range, displaying, by the at least one processor, a second outline defining the second section in accordance with the second display attribute.
  14. The method of claim 13, wherein the displaying of the second outline defining the second section in accordance with the second display attribute comprises: displaying, by the at least one processor, the second outline defining the second section in accordance with the second display attribute which uses a color having a complementary color relationship with the first representative pixel value determined for the second section; displaying, by the at least one processor, the second outline defining the second section in accordance with the second display attribute which uses a thicker thickness than the first outline displayed in accordance with the first display attribute; or displaying, by the at least one processor, the second outline defining the second section in accordance with the second display attribute which uses a higher brightness or higher saturation than the first outline displayed in accordance with the first display attribute.
  15. The method of claim 9, further comprising: determining, by the at least one processor, whether the at least one of the count of the AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined second threshold greater than the predetermined first threshold; based on that the at least one of the count of the AR object and the ratio of the display area of the AR object are greater than or equal to the predetermined second threshold, determining, by the at least one processor, a third representative pixel value for the entire region of the image; and displaying, by the at least one processor, the AR object as the outline in accordance with a third display attribute which uses a color having a complementary relationship with the third representative pixel value.

Description

[Technical Field] Embodiments of the disclosure relate to a method of displaying an augmented reality object, and an electronic device supporting the method. [Background Art] In response to the advance of digital convergence in which various information and communication technologies are combined, electronic devices provide various functions or services associated with pivotal functions of the electronic devices. For example, the electronic devices may provide an Augmented Reality (AR) environment, as part of efforts to promote user convenience or interaction with users. The AR environment may support diverse user experiences of a real world, since a virtual AR object is displayed in an overlaid manner on a scene of the real world or an image captured from the scene of the real world. US11423621B1 discloses a method, which involves displaying the augmented reality by a computing device, where a to-be-displayed virtual content with a scene of a real-world environment is determined. The image for depicting the virtual content is generated, where the image is provided with the first characteristics. The second characteristics of the scene of the real-world environment is detected using the sensors. The visually-enhanced image for depicting the virtual content is generated by applying the visual enhancement to the virtual content depicted in the image. The brightness of the scene of the real-world environment is reduced. The aforementioned content may be provided as background technologies for aiding understanding of the disclosure. [Disclosure of Invention] [Solution to Problem] An electronic device according to an embodiment of the disclosure may include at least one camera, a display, and at least one processor electrically coupled to the at least one camera and the display. According to an embodiment, the at least one processor may be configured to acquire an image by using the at least one camera, based on that the image is acquired, identify at least one of a count of an Augmented Reality (AR) object to be displayed by using the display and a ratio of a display area of the AR object to a resolution of the display, based on that the at least one of the count of AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined first threshold, determine to display the AR object as an outline by using the display, based on that the AR object is determined to be displayed as the outline, determine at least one first representative pixel value for the AR object, determine a second representative pixel value for presenting a first region of the image corresponding to a display position of the AR object by using the display, based on that a difference between the at least one first representative pixel value and the second representative pixel value is not included in a predetermined threshold range, display the AR object as the outline in accordance with a first display attribute which uses the at least one first representative pixel value by using the display, and based on that the difference between the at least one first representative pixel value and the second representative pixel value is included in the predetermined threshold range, display the AR object as the outline in accordance with a second display attribute different from the first display attribute by using the display. A method of displaying an AR object of an electronic device according to an embodiment of the disclosure may include, by at least one processor of the electronic device, acquiring an image by using at least one camera of the electronic device, based on that the image is acquired, identifying at least one of a count of the AR object to be displayed by using the display of the electronic device and a ratio of a display area of the AR object to a resolution of the display, based on that the at least one of the count of AR object and the ratio of the display area of the AR object are greater than or equal to a predetermined first threshold, determining to display the AR object as an outline by using the display, based on that the AR object is determined to be displayed as the outline, determining at least one first representative pixel value for the AR object, determining a second representative pixel value for presenting a first region of the image corresponding to a display position of the AR object by using the display, based on that a difference between the at least one first representative pixel value and the second representative pixel value is not included in a predetermined threshold range, displaying the AR object as the outline in accordance with a first display attribute which uses the at least one first representative pixel value by using the display, and based on that the difference between the at least one first representative pixel value and the second representative pixel value is included in the predetermined threshold range, displaying the AR object as the outline in accordanc