US-12625759-B2 - Remediating characteristics of content captured by a recording application on a user device

US12625759B2US 12625759 B2US12625759 B2US 12625759B2US-12625759-B2

Abstract

Disclosed herein are system, method, and computer program product aspects for According to some aspects, a computing device (e.g., a server, a cloud-based device, an application-service device, etc.) may identify a characteristic of content received via a recording application on a user device (e.g., a mobile device, a smart device, a computing device, etc.). A type of the user device may be determined based on an identifier received with the content. Based on the type of the user device, an instruction may be sent to the user device that causes a change in an operational state of a component of the user device that is utilized by the recording application. Remediation instructions that remediate the characteristic of the content may be sent to the user device based on an indication of the change in the operation state of the audio component.

Inventors

CHRIS MANCHESTER
Mark Gill
Randal Leistikow

Assignees

SMULE, INC.

Dates

Publication Date: 20260512
Application Date: 20220815

Claims (20)

1 . A computer-implemented method for remediating characteristics of composite content generated by a recording application on a user device, the method comprising: generating the composite content by mixing audio content comprising voice data and background audio data; identifying an output silence condition for the composite content received via the recording application on the user device that is caused by a characteristic of the composite content; determining, based on an identifier received with the composite content, a type of the user device; sending, based on the type of the user device, an instruction to the user device that causes a change in an operational state of at least one of an audio data capturing component of the user device or a video data capturing component of the user device, wherein at least one of the audio data capturing component or the video data capturing component is utilized by the recording application; and sending, to the user device, based on an indication of the change in the operation state of at least one of the audio data capturing component or the video data capturing component, remediation instructions, the remediation instructions comprising at least one of: restarting the recording application or changing the audio data capturing component of the user device, wherein the audio data capturing component is a microphone, that remediate the characteristic of the composite content.
2 . The computer-implemented method of claim 1 , wherein the characteristic of the composite content comprises at least one of: an amount of zero values associated with the composite content received within a time period satisfy a threshold, an error caused by an overrun scenario for the composite content, an error caused by an underrun scenario for the composite content, or a direct current (DC) offset for the composite content received within another time period with a dynamic range below a threshold.
3 . The computer-implemented method of claim 1 , wherein the determining the type of the user device further comprises: accessing user device identification information that indicates types of a plurality of user devices and at least one of software version information for the plurality of user devices or device configuration information for the plurality of user devices, wherein the user device identification information comprises an identifier that indicates the type of the user device and at least one of a software version for the user device or a configuration for the user device; and matching, based on the user device identification information, the identifier received with the composite content to the identifier that indicates the type of the user device and at least one of the software version for the user device or the configuration for the user device.
4 . The computer-implemented method of claim 1 , further comprising causing, based on the identifying the characteristic of the composite content and the remediation instructions being unavailable for the user device, the user device to display a notification via the recording application that facilitates remediation of the characteristic of the composite content.
5 . The computer-implemented method of claim 1 , wherein the remediation instructions further comprise: changing a configuration setting for the user device, or selecting a content stream type for the user device.
6 . The computer-implemented method of claim 1 , further comprising: identifying a characteristic of additional content received via the recording application on another user device; determining, based on an identifier received with the additional content, a type of the another user device; sending, based on the type of the another user device, an instruction to the another user device that causes a change in an operational state of a component of the another user device, wherein the component of the another user device is utilized by the recording application; and sending, to the another user device, based on an indication of the change in the operation state of the component of the another user device, remediation instructions that remediate the characteristic of the additional content, wherein the remediation instructions that remediate the characteristic of the additional content is different from the remediation instructions that remediate the characteristic of the composite content.
7 . The computer-implemented method of claim 1 , further comprising: identifying a characteristic of at least a portion of additional content received via the recording application on another user device; determining, based on an identifier received with the additional content, a type of the another user device; and blocking, based on the type of the another user device being a type of device restricted from sending content via the recording application, the another user device from sending the portion of the additional content.
8 . A system for remediating characteristics of composite content generated by a recording application on a user device, the system comprising: a memory; and at least one processor configured to perform operations comprising: generating the composite content by mixing audio content comprising voice data and background audio data; identifying an output silence condition for content received via the recording application on the user device that is caused by a characteristic of the composite content; determining, based on an identifier received with the composite content, a type of the user device; sending, based on the type of the user device, an instruction to the user device that causes a change in an operational state of at least one of an audio data capturing component of the user device or a video data capturing component of the user device, wherein at least one of the audio data capturing component or the video data capturing component is utilized by the recording application; and sending, to the user device, based on an indication of the change in the operation state of at least one of the audio data capturing component or the video data capturing component, remediation instructions, the remediation instructions comprising at least one of: restarting the recording application or changing the audio data capturing component of the user device, wherein the audio data capturing component is a microphone, that remediate the characteristic of the composite content.
9 . The system of claim 8 , wherein the characteristic of the composite content comprises at least one of: an amount of zero values associated with the composite content received within a time period satisfy a threshold, an error caused by an overrun scenario for the composite content, an error caused by an underrun scenario for the composite content, or a direct current (DC) offset for the composite content received within another time period with a dynamic range below a threshold.
10 . The system of claim 8 , wherein the determining the type of the user device further comprises: accessing user device identification information that indicates types of a plurality of user devices and at least one of software version information for the plurality of user devices or device configuration information for the plurality of user devices, wherein the user device identification information comprises an identifier that indicates the type of the user device and at least one of a software version for the user device or a configuration for the user device; and matching, based on the user device identification information, the identifier received with the composite content to the identifier that indicates the type of the user device and at least one of the software version for the user device or the configuration for the user device.
11 . The system of claim 8 , the operations further comprising causing, based on the identifying the characteristic of the composite content and the remediation instructions being unavailable for the user device, the user device to display a notification via the recording application that facilitates remediation of the characteristic of the composite content.
12 . The system of claim 8 , the remediation instructions further comprising at least one of changing a configuration setting for the user device, or selecting a content stream type for the user device.
13 . The system of claim 8 , the operations further comprising: identifying a characteristic of additional content received via the recording application on another user device; determining, based on an identifier received with the additional content, a type of the another user device; sending, based on the type of the another user device, an instruction to the another user device that causes a change in an operational state of a component of the another user device, wherein the component of the another user device is utilized by the recording application; and sending, to the another user device, based on an indication of the change in the operation state of the component of the another user device, remediation instructions that remediate the characteristic of the additional content, wherein the remediation instructions that remediate the characteristic of the additional content is different from the remediation instructions that remediate the characteristic of the composite content.
14 . The system of claim 8 , the operations further comprising: identifying a characteristic of at least a portion of additional content received via the recording application on another user device; determining, based on an identifier received with the additional content, a type of the another user device; and blocking, based on the type of the another user device being a type of device restricted from sending content via the recording application, the another user device from sending the portion of the additional content.
15 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations for remediating characteristics of composite content generated by a recording application on a user device, the operations comprising: generating the composite content by mixing audio content comprising voice data and background audio data; identifying an output silence condition for the composite content received via the recording application on the user device that is caused by a characteristic of the composite content; determining, based on an identifier received with the composite content, a type of the user device; sending, based on the type of the user device, an instruction to the user device that causes a change in an operational state of at least one of an audio data capturing component of the user device or a video data capturing component of the user device, wherein at least one of the audio data capturing component or the video data capturing component is utilized by the recording application; and sending, to the user device, based on an indication of the change in the operation state of at least one of the audio data capturing component or the video data capturing component, remediation instructions, the remediation instructions comprising at least one of: restarting the recording application or changing the audio data capturing component of the user device, wherein the audio data capturing component is a microphone, that remediate the characteristic of the composite content.
16 . The non-transitory computer-readable medium of claim 15 , wherein the characteristic of the composite content comprises at least one of: an amount of zero values associated with the composite content received within a time period satisfy a threshold, an error caused by an overrun scenario for the composite content, an error caused by an underrun scenario for the composite content, or a direct current (DC) offset for the composite content received within another time period with a dynamic range below a threshold.
17 . The non-transitory computer-readable medium of claim 15 , wherein the determining the type of the user device further comprises: accessing user device identification information that indicates types of a plurality of user devices and at least one of software version information for the plurality of user devices or device configuration information for the plurality of user devices, wherein the user device identification information comprises an identifier that indicates the type of the user device and at least one of a software version for the user device or a configuration for the user device; and matching, based on the user device identification information, the identifier received with the composite content to the identifier that indicates the type of the user device and at least one of the software version for the user device or the configuration for the user device.
18 . The non-transitory computer-readable medium of claim 15 , the operations further comprising causing, based on the identifying the characteristic of the composite content and the remediation instructions being unavailable for the user device, the user device to display a notification via the recording application that facilitates remediation of the characteristic of the composite content.
19 . The non-transitory computer-readable medium of claim 15 , the remediation instructions further comprising: change changing a configuration setting for the user device, or selecting a content stream type for the user device.
20 . The non-transitory computer-readable medium of claim 15 , the operations further comprising: identifying a characteristic of at least a portion of additional content received via the recording application on another user device; determining, based on an identifier received with the additional content, a type of the another user device; and blocking, based on the type of the another user device being a type of device restricted from sending content via the recording application, the another user device from sending the portion of the additional content.

Description

BACKGROUND User devices (e.g., mobile devices, smart devices, computing devices, etc.) facilitate and/or enable musical experiences and performances for users, for example, via music applications (e.g., karaoke-based applications, recording applications, etc.) and/or the like that allows users to sing along to audio content. Conventionally, due to a disparity of device manufacturers and models, operating systems, audio hardware, available audio software subsystems, and/or the like, the behavior and final results of a real-time audio capture cannot be reliably predicted and/or controlled for user devices operating music applications and/or the like. Content capture/recording and/or performance behavior is routinely affected by content characteristics and/or issues including, but not limited to, variable latency (e.g., caused by requiring a user's audio performance and/or voice capture and an associated background music track to be time-aligned to yield the best final mixed performance, etc.), dropouts and/or missing content, background noise, distortion, overload, and/or the like. Conventional systems are unable to mitigate (or even recognize) the content characteristics and/or issues that routinely affect content capture/recording and/or performance behavior. The inability of conventional systems to mitigate (or even recognize) the content characteristics and/or issues that routinely affect content capture/recording and/or performance behavior affects the usability and/or experience of the user of conventional recording applications. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings are incorporated herein and form a part of the specification. FIG. 1 is a block diagram of an example system for remediating characteristics of content captured by a recording application on a user device, according to some aspects. FIGS. 2A-2B show an example user interface for remediating characteristics of content captured by a recording application on a user device, according to some aspects. FIG. 3 shows a flowchart of an example method for for remediating characteristics of content captured by a recording application on a user device, according to some aspects. FIG. 4 is an example computer system useful for implementing various aspects. In the drawings, like reference numbers generally indicate identical or similar elements. Additionally, generally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears. SUMMARY Provided herein are system, apparatus, article of manufacture, method and/or computer program product aspects, and/or combinations and sub-combinations thereof, for remediating characteristics of content captured by a recording application on a user device. According to some aspects, the system, apparatus, article of manufacture, method and/or computer program product aspects, and/or combinations and sub-combinations thereof, for remediating characteristics of content captured by a recording application on a user device provide a uniform experience (e.g., utilizing a recording application) across heterogeneous user devices (e.g., mobile devices, smart devices, etc.) and are not limited to any single type, class, configuration, and/or model user device. Remediation instructions may be identified (and/or curated) and provided to any user device. According to some aspects, different remediation instructions may be sent to different user devices, for example, based on the type, class, configuration, model, and/or the like. According to some aspects, a computing device (e.g., a server, a cloud-based device, an application-service device, etc.) may identify a characteristic of content received via a recording application on a user device (e.g., a mobile device, a smart device, a computing device, etc.). A type of the user device may be determined based on an identifier received with the content. Based on the type of the user device, an instruction may be sent to the user device that causes a change in an operational state of a component of the user device that is utilized by the recording application. Remediation instructions that remediate the characteristic of the content may be sent to the user device based on an indication of the change in the operation state of the audio component. DETAILED DESCRIPTION Provided herein are system, apparatus, device, method and/or computer program product aspects, and/or combinations and sub-combinations thereof, for remediating characteristics of content captured by a recording application on a user device. The system, apparatus, device, method, computer program product embodiments, and/or combinations and sub-combinations thereof for remediating characteristics of content captured by a recording application on a user device described herein enable a user of a user device (e.g., a user device operating and/or configured with a recording application, etc.) to be presented (e.g., via an interface of the user device, et