KR-102963007-B1 - ELECTRONIC DEVICE AND METHOD FOR CONTROLLING THE SAME

KR102963007B1KR 102963007 B1KR102963007 B1KR 102963007B1KR-102963007-B1

Abstract

According to one embodiment, the electronic device includes a microphone, a camera, a display, a speaker, and at least one processor operatively connected to the camera, the display, and the speaker. When a camera application is executed, the at least one processor displays a live view image acquired through the camera on the display, acquires at least one feature text for the live view image based on at least one object information included in the live view image, displays the at least one feature text together with the live view image, identifies at least one sound source among a plurality of sound sources whose metadata matches at least one feature text, displays information about the at least one sound source together with the live view image, and when a user operation for video recording is input, outputs a first sound source among at least one sound source through the speaker and can record a video through the microphone and the camera.

Inventors

김지연
신새벽
이재한
최나리

Assignees

삼성전자주식회사

Dates

Publication Date: 20260511
Application Date: 20210312

Claims (20)

In electronic devices, mike; camera; display; speaker; Memory for storing instructions; and The camera, the display, the speaker, and at least one processor operatively connected to the memory, When the above commands are executed by the above at least one processor, the electronic device: When the camera application is executed, the live view video acquired through the camera is displayed on the display, and Based on at least one object information included in the above live view image, at least one feature text for the above live view image is obtained, and Displaying at least one feature text together with the live view image, Identifying at least one sound source among multiple sound sources whose metadata matches the at least one feature text, and Information regarding at least one of the above sound sources is displayed together with the live view video, and When user operation for video recording is input, a first sound source among the at least one sound source is output through the speaker, and a video is recorded through the microphone and the camera. The first sound source is an electronic device that outputs from a portion of the first sound source having lyrics corresponding to at least one feature text.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: An electronic device that acquires at least one feature text by further considering at least one of location information, date information, or time information where the above live view image is acquired.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: An electronic device that displays at least one object information on the live view image.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: A list of sound sources including at least one sound source is generated based on the similarity between the at least one feature text and the metadata of the sound source, and An electronic device that identifies the sound source with the highest similarity among the above at least one sound source as the first sound source.
In paragraph 4, When the above commands are executed by the above at least one processor, the electronic device: When user operation to display the above audio list is input, the above audio list is displayed together with the above live view video, and, An electronic device that changes the first sound source to the second sound source when a user operation to select the second sound source from the above sound source list is input.
In paragraph 1, An electronic device in which at least one of the above sound sources is stored in the memory or obtained through a sound source application.
In paragraph 6, When the above commands are executed by the above at least one processor, the electronic device: An electronic device that displays a user interface for controlling the above-mentioned sound source application together with the above-mentioned live view video.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: An electronic device that lowers the volume of the first sound source when the magnitude of a sound signal other than the first sound source among the sounds acquired through the microphone during the above video recording is greater than or equal to a set value.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: An electronic device that changes at least one sound source in real time based on the changed live view video when the live view video is changed.
In paragraph 1, When the above commands are executed by the above at least one processor, the electronic device: When the above video recording is completed, a user interface for sharing the above-mentioned video via an SNS application is displayed, and An electronic device that allows the captured video to be shared via the SNS application when a user operation for sharing is input through the user interface.
In a method for controlling an electronic device, When the camera application is executed, the action of displaying a live view image acquired through the camera on the display; An operation to obtain at least one feature text for the live view image based on at least one object information included in the live view image; The operation of displaying at least one feature text together with the live view image; An operation to identify at least one sound source among a plurality of sound sources whose metadata matches the at least one feature text; The operation of displaying information about at least one sound source together with the live view video; and When user operation for video recording is input, the operation includes outputting a first sound source among the at least one sound source through a speaker and recording a video through a microphone and a camera. A control method for an electronic device in which the first sound source is output from a portion of the first sound source having lyrics corresponding to at least one feature text.
In Paragraph 11, The operation of acquiring at least one feature text above is, A control method for an electronic device that acquires at least one feature text by further considering at least one of location information, date information, or time information where the above live view image is acquired.
In Paragraph 11, A control method for an electronic device further comprising the operation of displaying at least one object information in the live view image.
In Paragraph 11, The operation of identifying at least one sound source is, The operation of generating a sound source list including the at least one sound source based on the similarity between the at least one feature text and the metadata of the sound source; and A control method for an electronic device comprising the operation of identifying the sound source with the highest similarity among the above at least one sound source as the first sound source.
In Paragraph 14, When a user operation to display the above sound source list is input, an operation to display the above sound source list together with the above live view video; and A control method for an electronic device that further includes an operation to change the first sound source to the second sound source when a user operation to select the second sound source from the above sound source list is input.
In Paragraph 11, A method for controlling an electronic device, wherein at least one sound source is stored in the memory of the electronic device or is obtained through a sound source application.
In Paragraph 16, A method for controlling an electronic device further comprising the operation of displaying a user interface for controlling the above-mentioned sound source application together with the above-mentioned live view video.
In Paragraph 11, A control method for an electronic device that further includes an operation to lower the volume of the first sound source when the magnitude of a sound signal other than the first sound source among the sounds acquired through the microphone during the above video recording is greater than or equal to a set value.
In Paragraph 11, A control method for an electronic device further comprising the operation of changing at least one sound source in real time based on the changed live view image when the live view image is changed.
In Paragraph 11, When the above video recording is completed, an operation to display a user interface for sharing the recorded video to an SNS application; and A control method for an electronic device that further includes the operation of sharing the captured video through the SNS application when a user operation for sharing is input through the user interface.

Description

Electronic device and method for controlling the same Embodiments of the present disclosure relate to an electronic device that provides a sound source based on a live view image and a method for controlling the same. Recently, the various services and additional functions provided by electronic devices are gradually expanding. In order to increase the utility value of these electronic devices and satisfy the diverse needs of users, various applications that can be executed on electronic devices are being developed. Among these applications, there is a camera function, and the user can use the camera mounted on the electronic device to capture images or videos of themselves or the background. FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a drawing for explaining the video recording operation of an electronic device according to various embodiments. FIG. 3a is a drawing for illustrating live view images according to various embodiments. FIG. 3b is a drawing for explaining object information included in a live view image according to various embodiments. FIG. 3c is a drawing for explaining at least one feature text of a live view image according to various embodiments. FIG. 3d is a diagram for explaining sound source information identified based on live view images according to various embodiments. FIG. 3e is a drawing for explaining video recording operations according to various embodiments. FIG. 4 is a drawing for explaining a list of sound sources according to various embodiments. FIG. 5 is a diagram illustrating the operation of changing a sound source application according to various embodiments. FIG. 6 is a diagram illustrating a sharing operation or an editing operation after video recording is completed according to various embodiments. FIG. 7 is a diagram illustrating a list of sound sources provided based on location information where a live view video is acquired according to various embodiments. FIG. 8a is a diagram illustrating the matching operation of metadata of a sound source and the features of a live view image according to various embodiments. FIG. 8b is a diagram illustrating the matching operation of metadata of a sound source and the features of a live view image according to various embodiments. FIG. 8c is a diagram illustrating the matching operation of metadata of a sound source and the features of a live view image according to various embodiments. FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)). The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a mai