US-12626432-B2 - Electronic device and method for providing augmented reality content

US12626432B2US 12626432 B2US12626432 B2US 12626432B2US-12626432-B2

Abstract

An electronic device is provided. The electronic device includes a camera, a touch panel, a display, a communication circuit, at least one processor operatively connected with the camera, the touch panel, the display, and the communication circuit, and a memory operatively connected with the at least one processor The memory stores one or more instructions, when executed, causing the at least one processor to display a first image captured by the camera and a second image received from an external electronic device through the communication circuit on the display, display first augmented reality content on the first image, display second augmented reality content on the second image, and display an animation effect of the first augmented reality content using the second augmented reality content based on a user input through the touch panel.

Inventors

Yoonjung Choi
Jiyoung KANG
Younghak OH
Jaehyun HAN

Assignees

SAMSUNG ELECTRONICS CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20230425
Priority Date: 20201218

Claims (20)

1 . An electronic device, comprising: a camera; a touch panel; a display; a communication circuit; at least one processor operatively connected with the camera, the touch panel, the display, and the communication circuit; and a memory operatively connected with the at least one processor, wherein the memory stores one or more instructions, when executed, causing the at least one processor to: display a first image captured by the camera and a second image received from an external electronic device through the communication circuit on the display, receive a drawing input of a first user of the electronic device on the displayed first image, display first augmented reality content obtained by the electronic device based on the drawing input of the first user of the electronic device on the displayed first image, display second augmented reality content obtained by the external electronic device based on a drawing input of a second user of the external electronic device on the second image, and display an animation effect of the first augmented reality content using the second augmented reality content based on a user input through the touch panel.
2 . The electronic device of claim 1 , wherein the first augmented reality content is generated based on the drawing input of the first user, and wherein the second augmented reality content is generated based on the drawing input of the second user and is transmitted from the external electronic device through the communication circuit.
3 . The electronic device of claim 2 , wherein the drawing input of the first user or the drawing input of the second user comprises an input using a stylus pen.
4 . The electronic device of claim 1 , wherein the instructions further cause the at least one processor to: identify at least one object included in the first augmented reality content and the second augmented reality content, and display the animation effect corresponding to the identified at least one object among animation effects specified according to objects, in response to the user input.
5 . The electronic device of claim 1 , wherein the animation effect comprises at least one animation effect for the same object, and wherein the instructions further cause the at least one processor to: display the animation effect corresponding to the user input among the at least one animation effect.
6 . The electronic device of claim 1 , wherein the first image comprises a preview image obtained by the camera, and wherein the second image comprises a preview image obtained by a camera of the external electronic device.
7 . The electronic device of claim 1 , wherein the instructions further cause the at least one processor to: identify a body part of a first user where the first augmented reality content is displayed from the first image, and display the first augmented reality content on a body part of a second user, the body part corresponding to the body part of the first user, on the second image.
8 . The electronic device of claim 7 , wherein the instructions further cause the at least one processor to: identify a body part of the second user where the second augmented reality content is displayed from the second image, and display the second augmented reality content on a body part of the first user, the body part corresponding to the body part of the second user, on the first image.
9 . The electronic device of claim 1 , wherein the instructions further cause the at least one processor to: transmit the first augmented reality content to the external electronic device through the communication circuit.
10 . The electronic device of claim 1 , wherein the camera comprises a first camera disposed towards the same direction as a direction where a display area of the display is exposed and a second camera disposed towards a direction opposite to the direction of the first camera, and wherein the instructions further cause the at least one processor to: display a third image captured by the first camera, a fourth image captured by the second camera, and a fifth image in which the third image and the fourth image are synthesized with each other, display third augmented reality content on the fifth image as the third augmented reality content is displayed on the third image based on a user input through the touch panel and display fourth augmented reality content on the fifth image as the fourth augmented reality content is displayed on the fourth image based on a user input through the touch panel, and store the fifth image where at least one of the third augmented reality content or the fourth augmented reality content is displayed.
11 . The electronic device of claim 10 , wherein the instructions further cause the at least one processor to: recognize a specified body part of a user from the third image or the fourth image, and change a location where the third augmented reality content or the fourth augmented reality content is displayed on the fifth image based on interaction using the specified body part or display an animation effect of the third augmented reality content or an animation effect of the fourth augmented reality content.
12 . The electronic device of claim 1 , further comprising: a sensor, wherein the instructions further cause the at least one processor to: detect, by the sensor, proximity of a body part of a user or a stylus pen to the display using the sensor, and activate and display a user interface for generating augmented reality content on the display based on an input using the body part of the user or the stylus pen, based on the detected result of the sensor.
13 . The electronic device of claim 12 , wherein the user interface comprises a color selection element and a virtual pen selection element, and wherein the instructions further cause the at least one processor to: change at least one of a color or a line type of the augmented reality content based on a user input through the user interface.
14 . The electronic device of claim 12 , wherein the display comprises a flexible display, and wherein the instructions further cause the at least one processor to: sense a change in display size using the sensor, and adjust the user interface to correspond to the display size.
15 . The electronic device of claim 14 , wherein the instructions further cause the at least one processor to: change a size or layout of at least one element included in the user interface to correspond to the display size.
16 . A method for providing augmented reality content, performed by an electronic device, comprises: displaying a first image captured by a camera of the electronic device and a second image received from an external electronic device through a communication circuit of the electronic device; receiving a drawing input of a first user of the electronic device on the displayed first image, displaying first augmented reality content obtained by the electronic device based on the drawing input of the first user of the electronic device on the displayed first image on a display of the electronic device; displaying second augmented reality content obtained by the external electronic device based on a drawing input of a second user of the external electronic device on the second image; and displaying an animation effect of the first augmented reality content using the second augmented reality content based on a user input through a touch panel of the electronic device.
17 . The method of claim 16 , wherein the first augmented reality content is generated based on the drawing input of the first user, and wherein the second augmented reality content is generated based on the drawing input of the second user and is transmitted from the external electronic device through the communication circuit.
18 . The method of claim 17 , wherein the drawing input of the first user or the drawing input of the second user comprises an input using a stylus pen.
19 . The method of claim 16 , further comprising: identifying at least one object included in the first augmented reality content and the second augmented reality content; and displaying the animation effect corresponding to the identified at least one object among animation effects specified according to objects, in response to the user input.
20 . The method of claim 16 , wherein the animation effect comprises at least one animation effect for the same object, and wherein the displaying of the animation effect comprises a preview image obtained by a camera of the external electronic device.

Description

CROSS-REFERENCE TO RELATED APPLICATION(S) This application is a continuation application, claiming priority under § 365(c), of an International application No. PCT/KR2021/019060, filed on Dec. 15, 2021, which is based on and claims the benefit of a Korean patent application number 10-2020-0178885, filed on Dec. 18, 2020, in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference herein in its entirety. BACKGROUND 1. Field The disclosure relates to an electronic device and a method for providing augmented reality content. 2. Description of Related Art Augmented reality is a technology of synthesizing and showing virtual things or information with a real environment. Virtual reality for replacing a real world provides a user with a sense of immersion for a virtual environment, whereas augmented reality for complementing the real world by overlapping a virtual object with the real world may provide the user with a sense of presence for the virtual object. As an augmented reality technology is loaded into a portable electronic device, the electronic device may synthesize a virtual object with an image obtained by its camera to provide augmented reality content. The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure. SUMMARY Aspects of the disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect the disclosure is to provide an electronic device and a method for generating and sharing pieces of augmented reality content and supporting interaction between the pieces of augmented reality content to allow a plurality of users to visually transmit and receive an intention expression or an emotion expression therebetween in a situation where they communicate with one another using their electronic devices, each of which is loaded with a camera. Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments. In accordance with an aspect of the disclosure, an electronic device is provided. The electronic device includes a camera, a touch panel, a display, a communication circuit, at least one processor operatively connected with the camera, the touch panel, the display, and the communication circuit, and a memory operatively connected with the at least one processor. The memory may store one or more instructions, when executed, causing the at least one processor to display a first image captured by the camera and a second image received from an external electronic device through the communication circuit on the display, display first augmented reality content on the first image, display second augmented reality content on the second image, and display an animation effect of the first augmented reality content using the second augmented reality content based on a user input through the touch panel. In accordance with another aspect of the disclosure, a method for providing augmented reality content in an electronic device is provided. The method includes displaying a first image captured by a camera and a second image received from an external electronic device through a communication circuit on a display, displaying first augmented reality content on the first image, displaying second augmented reality content on the second image, and displaying an animation effect of the first augmented reality content using the second augmented reality content based on a user input through a touch panel. According to various embodiments disclosed in the disclosure, the electronic device and the method for generating and sharing pieces of augmented reality content and supporting interaction between the pieces of augmented reality content may be provided to allow a plurality of users to visually transmit and receive an intention expression or an emotion expression therebetween in a situation where they communicate with one another using their electronic devices, each of which is loaded with a camera. Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which: FIG. 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the disclosure; FIG. 2 is a block diagram of an elec