EP-4736403-A1 - SYSTEMS AND METHODS FOR RECEIVE-SIDE CUSTOMIZATION OF PRESENTATION OF MIXED MEDIA DATA

EP4736403A1EP 4736403 A1EP4736403 A1EP 4736403A1EP-4736403-A1

Abstract

Systems and methods for receive-side customization of presentation of mixed media data. Systems and methods focus on the receive path so that each participant in a video conference or other mixed media application can, as a receiver of mixed media data signals, customize the individual incoming mixed media data signals for display on the receiver's user device. User customization options include blocking video or avatars, converting (to avatars), and filtering distracting behavior. Embodiments enable all participating users (not just a host user) to respectively receive-side customize the presentation/display of the mixed media data. Additionally, systems and methods can be implemented in an existing server

Inventors

BINBOGA, EVRIM
BARAN, STANLEY J.
NGUYEN, ANH VIET
KENFACK SADATE, ALINE C.

Assignees

INTEL Corporation

Dates

Publication Date: 20260506
Application Date: 20231114

Claims (20)

1. An apparatus, comprising: a reference device; and a control circuit communicatively coupled to the reference device, wherein the control circuit is to: receive a mixed media data signal from an external device; receive a user preference to customize the mixed media data signal for display on the reference device; convert the mixed media data signal into a customized data stream based on the user preference; and display the customized data stream on the reference device.
2. The apparatus of claim 1, wherein the control circuit is further to: generate a prompt on the reference device responsive to receiving the mixed media data signal for a user to select block, pass, convert, or filter; and detect a user selection responsive to the prompt, wherein the user selection is the user preference to customize the mixed media data signal.
3. The apparatus of claim 2, wherein the user selection is convert, and the control circuit is further to create the customized data stream by converting the mixed media data signal to an avatar data stream.
4. The apparatus of claim 2, wherein the user selection is filter, and the control circuit is further to create the customized data stream by processing the mixed media data signal with an algorithm to remove distracting behavior.
5. The apparatus of claim 1 wherein the control circuit is further to: create the customized data stream on a cloud server; and transmit the customized data stream to the reference device via a network.
6. The apparatus of claim 1, wherein the control circuit is further to create the customized data stream on the reference device.
7. The apparatus of claim 1 wherein the mixed media data signal further comprises an audio signal, and the control circuit is further to: determine that the user preference is to convert the audio signal into an audio avatar data stream; and create the customized data stream as an audio avatar data stream.
8. The apparatus of claim 1, wherein the mixed media data signal is one of a plurality of mixed media data signals, and the control circuit is further to: receive the plurality of mixed media data signals; receive, for the plurality of mixed media data signal, a respective user preference to customize the mixed media data signal for display on the reference device; create a respective plurality of customized data streams; and display the respective plurality of customized data streams concurrently on the reference device.
9. A non-transitory computer-readable media comprising instructions that are, when executed by processing circuitry, to: receive a mixed media data signal from an external device; receive a user preference to customize the mixed media data signal for display on a reference device; convert the mixed media data signal into a customized data stream based on the user preference; and display the customized data stream on the reference device.
10. The non-transitory computer-readable media of claim 9, wherein the instructions are further to: generate a prompt on the reference device responsive to receiving the mixed media data signal, for a user to select block, pass, convert, or filter; and detect a user selection responsive to the prompt, wherein the user selection is the user preference to customize the mixed media data signal.
11. The non-transitory computer-readable media of claim 10, wherein the instructions are further to: determine that the user selection is convert; and create the customized data stream by converting the mixed media data signal to an avatar data stream, responsive to determining that the user selection is convert.
12. The non-transitory computer-readable media of claim 10, wherein the instructions are further to: determine that the user selection is filter; and create the customized data stream by processing the mixed media data signal with an algorithm to remove distracting behavior, responsive to determining that the user selection is filter.
13. The non-transitory computer-readable media of claim 9, wherein the instructions are further to: create the customized data stream on a cloud server; and transmit the customized data stream to the reference device via a network.
14. The non-transitory computer-readable media of claim 9, wherein the instructions are further to create the customized data stream on the reference device.
15. The non-transitory computer-readable media of claim 9, wherein the mixed media data signal further comprises an audio signal, and the instructions are further to: determine that the user preference is to convert the audio signal into an audio avatar data stream; and create the customized data stream as an audio avatar data stream.
16. The non-transitory computer-readable media of claim 9, wherein the mixed media data signal is one of a plurality of mixed media data signals, and the instructions are further to: receive the plurality of mixed media data signals; receive, for the plurality of mixed media data signal, a respective user preference to customize the mixed media data signal for display on the reference device; create a respective plurality of customized data streams; and display the respective plurality of customized data streams concurrently on the reference device.
17. A system, comprising: a reference device; and a means for receive-side customization, communicatively coupled to the reference device, wherein the means for receive-side customization is to: receive a mixed media data signal from an external device; receive a user preference to customize the mixed media data signal for display on the reference device; convert the mixed media data signal into a customized data stream based on the user preference; and display the customized data stream on the reference device.
18. The system of claim 17, wherein the means for receive-side customization is further to: generate a prompt on the reference device responsive to receiving the mixed media data signal, for a user to select block, pass, convert, or fdter; and detect a user selection responsive to the prompt, wherein the user selection is the user preference to customize the mixed media data signal.
19. The system of claim 18, wherein the means for receive-side customization is further to: determine that the user selection is convert; and create the customized data stream by converting the mixed media data signal to an avatar data stream.
20. The system of claim 18, wherein the means for receive-side customization is further to: determine that the user selection is filter; and create the customized data stream by processing the mixed media data signal with an algorithm to remove distracting behavior.

Description

SYSTEMS AND METHODS FOR RECETVE-SIDE CUSTOMIZATION OF PRESENTATION OF MIXED MEDIA DATA CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims priority to U.S. Patent Application Serial No. 18/343,593 filed on June 28, 2023, and entitled “SYSTEMS AND METHODS FOR RECEIVE-SIDE CUSTOMIZATION OF PRESENTATION OF MIXED MEDIA DATA”, which is hereby incorporated by reference in its entirety. BACKGROUND [0002] There has been an increasing reliance on mixed media applications, such as video conference applications and video chat applications, for communication between individuals and among groups of participants. Continued improvements to the user experience during operation of these applications are desirable. BRIEF DESCRIPTION OF THE DRAWINGS [0003] FIG. l is a schematic diagram illustrating an environment in which embodiments of the disclosure may be implemented. [0004] FIG. 2 is an architectural block diagram of one or more application modules that may be operating in a system for receive-side customization of presentation of mixed media data. [0005] FIG. 3 provides a flow chart depicting an example method for receive-side customization of presentation of mixed media data, in accordance with various embodiments. [0006] FIG. 4 is a block diagram of an example compute node that may include any of the embodiments disclosed herein. [0007] FIG. 5 illustrates a multi -processor environment in which embodiments may be implemented. [0008] FIG. 6 is a block diagram of an example processor unit to execute computer-executable instructions as part of implementing technologies described herein. DETAILED DESCRIPTION [0009] Mixed media applications, such as video conference applications and video chat applications, often combine video, audio, images (such as profile pictures) and computergenerated images. Over time, these applications have increasingly been employed for communication between individuals and among groups. Many available applications focus on the transmit path, allowing a sender to replace a video with an avatar, for example. However, a technical problem is presented, in that receive-side users do not have the ability to manage the receive-side of the mixed media presentation. [0010] Some solutions provide an ability on the receive-side to enable/disable all data streams, replacing them with profile pictures. However, this all-or-nothing solution can result in a negative receive-side user experience, cutting off valuable video information from all participants just to address a single participant. It is desirable to provide a more inclusive user experience. Receiveside users may have different sensitivities and/or sensory overload thresholds and could benefit from an ability to enable/disable individual streams or replace individual streams with avatars. [0011] Aspects of the present disclosure provide a technical solution to this technical problem and other related enhancements, in the form of systems and methods for receive-side customization of presentation of mixed media data. Provided embodiments advantageously focus on the receive path where each user/participant can enable/disable and/or customize individual incoming streams. Embodiments enable all participating users (not just a host user) to customize their receive-side mixed media presentation with preferences for individual video streams. Embodiments enable an organization to restrict available avatars to a pre-approved list. Additionally, embodiments can be implemented in an existing server. [0012] Embodiments may be detected by reviewing mixed media application documentation to look for instructions for disabling individual participants’ video streams and enabling customized avatars, per participant, and by viewing options available during operation of a video conference application (including Web and native Operating System applications). The feature of enabling an organization to restrict available avatars to a pre-approved list can also be detected in the product literature or operation. [0013] As used herein, the terms “processor unit,” “processing circuitry,” “processing unit,” or “processor” may refer to any device or portion of a device that processes electronic data from registers and/or memory to transform that electronic data into other electronic data that may be stored in registers and/or memory. A processor unit may be a system-on-a-chip (SOC), and/or include one or more digital signal processors (DSPs), application-specific integrated circuits (ASICs), central processing units (CPUs), graphics processing units (GPUs), general-purpose GPUs (GPGPUs), accelerated processing units (APUs), field-programmable gate arrays (FPGAs), neural network processing units (NPUs), data processor units (DPUs), accelerators (e.g., graphics accelerator, compression accelerator, artificial intelligence accelerator), controller cryptoprocessors (specialized processors that execute cryptographic algorithms within hardware), server processor