US-12627849-B1 - Dynamic multi-audio broadcasting

US12627849B1US 12627849 B1US12627849 B1US 12627849B1US-12627849-B1

Abstract

A media playback system may send video data to a first device and audio data to a second device. The second device may wirelessly transmit the audio data to one or more listening devices such as earbuds or headphones. The system may also send audio data to the first device for transmission to another listening device or devices. In an example operation, the system may send audio data representing a first language to the first device and a second language to the second device. In this manner, users can watch the same video while listening to audio in their chosen language. In some cases, one device may transmit audio data using a one-to-one wireless protocol while the other device uses a one-to-many wireless protocol. The first device may send synchronization data to the second device such that playback (e.g., transmission) of the audio data aligns with playback of the video.

Inventors

Nitin Srivastava
Muhaiyadeen Ansarullah Habibullah

Assignees

AMAZON TECHNOLOGIES, INC.

Dates

Publication Date: 20260512
Application Date: 20240318

Claims (18)

1 . A method comprising: receiving, at a first electronic device, a first advertisement message transmitted wirelessly by a second electronic device different from the first electronic device, the first advertisement message indicating audio output capabilities of the second electronic device; determining, at the first electronic device based on the first advertisement message, that the second electronic device is capable of communicating audio data using a first wireless protocol; based on the determining that the second electronic device is capable of communicating audio data using the first wireless protocol, sending, from the first electronic device to a remote system, stream coordination data comprising a first device identifier for the second electronic device; sending, from the first electronic device to the remote system, a request for media content corresponding to first audio data representing first audio and first video data representing first video; receiving, at the first electronic device, streaming data including the first video data; and causing display of the first video synchronized to transmission of the first audio data by the second electronic device.
2 . The method of claim 1 , wherein the first advertisement message further includes the first device identifier for the second electronic device, and wherein the method further comprises: determining that the first electronic device is associated with a first profile identifier; and determining that the second electronic device is associated with the first profile identifier.
3 . The method of claim 1 , wherein the streaming data further includes second audio data representing second audio, and further comprising: transmitting the second audio data to a first listening device using the first wireless protocol or a second wireless protocol.
4 . The method of claim 3 , further comprising: synchronizing the display of the first video to the transmitting of the second audio data; and sending, to the remote system, synchronization data corresponding to the display of the first video, the remote system using the synchronization data to cause the second electronic device to synchronize transmitting of the first audio data with the display of the first video.
5 . The method of claim 3 , further comprising: causing the second electronic device to send the first audio data using a one-to-many wireless protocol, wherein the first electronic device sends the second audio data to the first listening device using a one-to-one wireless protocol.
6 . The method of claim 3 , further comprising: causing the second electronic device to send first audio data using a one-to-many wireless protocol, wherein the first electronic device sends the second audio data to the first listening device using the one-to-many wireless protocol.
7 . The method of claim 1 , wherein the streaming data comprises further includes second audio data representing second audio, and further comprising: sending the second audio data to a first listening device using the first wireless protocol or a second wireless protocol; wherein the first audio includes speech in a first language and the second audio includes speech in a second language.
8 . The method of claim 1 , wherein causing presentation of the first video comprises causing display of the first video on a display of the first electronic device.
9 . The method of claim 1 , further comprising: receiving a command to scan output of the first video; and synchronizing playback of first audio by the second electronic device based at least in part on the command to scan.
10 . A first electronic device comprising: one or more processors; a wireless radio; and one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations comprising: periodically scanning for advertisement messages; in response to receiving a first advertisement message transmitted wirelessly by a second electronic device different from the first electronic device, determining based on the first advertisement message that the second electronic device is capable of communicating audio data using a first wireless protocol; based on the determining that the second electronic device is capable of communicating audio data using the first wireless protocol, sending, to a remote system, stream coordination data comprising a first device identifier for the second electronic device; sending, from the first electronic device to the remote system, a request for media content corresponding to first audio data representing first audio and first video data representing first video; receiving, at the first electronic device, streaming data including the first video data; and causing display of the first video synchronized to transmission of the first audio data by the second electronic device.
11 . The first electronic device of claim 10 , wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: determining that the first electronic device is associated with a first profile identifier; and determining that the second electronic device is associated with the first profile identifier.
12 . The first electronic device of claim 10 , wherein the streaming data further includes second audio data representing second audio, and wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: transmitting the second audio data to a first listening device using the first wireless protocol or a second wireless protocol.
13 . The first electronic device of claim 12 , wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: synchronizing the display of the first video to the transmitting of the second audio data; and sending, to the remote system, synchronization data corresponding to the display of the first video, the remote system using the synchronization data to cause the second electronic device to synchronize transmitting of the first audio data with the display of the first video.
14 . The first electronic device of claim 12 , wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: causing the second electronic device to send the first audio data using a one-to-many wireless protocol, wherein the first electronic device sends the second audio data to the first listening device using a one-to-one wireless protocol.
15 . The first electronic device of claim 12 , wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: causing the second electronic device to send the first audio data using a one-to-many wireless protocol, wherein the first electronic device sends the second audio data to the first listening device using the one-to-many wireless protocol.
16 . The first electronic device of claim 10 , wherein the streaming data further includes second audio data representing second audio, and wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations further comprising: sending the second audio data to a first listening device using the first wireless protocol or a second wireless protocol; wherein the first audio includes speech in a first language and the second audio includes speech in a second language.
17 . The first electronic device of claim 10 , wherein the first electronic device comprises a display and wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to present the first video on the display.
18 . The first electronic device of claim 10 , wherein the one or more computer readable media storing processor executable instructions which, when executed using the one or more processors, cause the first electronic device to perform operations comprising: receiving a command to scan output of the first video; and synchronizing playback of first audio by the second electronic device based at least in part on the command to scan.

Description

BACKGROUND Listening devices, such as earbuds, headphones, headsets, and/or other devices may be used to output audio using one or more speakers and, in some cases, capture audio using a microphone. The listening device may be configured to communicate via a wired and/or wireless connection with a personal device (e.g., a smart TV, a smartphone, laptop, etc.) and/or a one-to-many broadcast device (e.g., associated with a television, theater, conference facility, sports stadium, etc.). The listening device may receive audio data from the source device and output the corresponding audio. The audio may include, for example, music, sound effects, and/or speech from a movie, concert, meeting, sporting event, etc. In some cases, the source device may be able to send different audio content corresponding to, for example, different languages. BRIEF DESCRIPTION OF DRAWINGS For a more complete understanding of the present disclosure, reference is now made to the following description taken in conjunction with the accompanying drawings. FIG. 1 illustrates a system implementing dynamic multi-audio broadcasting, according to embodiments of the present disclosure. FIG. 2 is a diagram detailing example components of the dynamic multi-audio broadcasting system, according to embodiments of the present disclosure. FIG. 3 illustrates example operations of a primary device in the dynamic multi-audio broadcasting system, according to embodiments of the present disclosure. FIG. 4 illustrates example operations of system components of the dynamic multi-audio broadcasting system, according to embodiments of the present disclosure. FIG. 5 is a signal flow diagram illustrating example operations of initiating the dynamic multi-audio broadcasting system, according to embodiments of the present disclosure. FIG. 6 is a signal flow diagram illustrating example modes of operation of the dynamic multi-audio broadcasting system, according to embodiments of the present disclosure. FIG. 7 is a block diagram conceptually illustrating example components of a device, according to embodiments of the present disclosure. FIG. 8 is a block diagram conceptually illustrating example components of a system, according to embodiments of the present disclosure. FIG. 9 illustrates an example of a computer network for use with the overall system, according to embodiments of the present disclosure. DETAILED DESCRIPTION Personal audio output devices (e.g., “audio output devices” or “listening devices”) may be carried and/or worn by a user to improve the listening experience and/or increase privacy associated with playback of audio data. Listening devices may include earphones (e.g., which may include different types of headphones and earbuds), hearing aids, speakers (e.g., for outputting audio to a room or open area), bone-conduction headphones (e.g., for transmitting audio through bones in a user's skull instead of their car canal), etc. Headphones may include over-ear and on-car types, and may be open-back or closed-back. Earbuds may include in-car types, which may form a seal within the car canal, and “open” or “classic” earbuds, which may form only a partial seal or no seal with the ear canal. Speakers may include wireless and/or portable speakers for personal listening, as well as desk/floor/wall-mounted speakers, studio monitors, etc.). Listening devices may be used to audio data from another device; e.g., using one or more wireless communication protocols such as Bluetooth Classic Audio, which operates on the Bluetooth Classic radio, and/or Bluetooth LE Audio, which operates on the Bluetooth Low Energy (LE) radio. LE Audio offers LE Isochronous Channels, which enables Multi-Stream Audio and Broadcast Audio. Multi-Stream Audio involves a point-to-point bidirectional communication protocol with acknowledgment, and enables transmission of multiple, independent, synchronized audio streams between an audio device such as smartphone and one or more listening devices (e.g., a one-to-one wireless protocol). Broadcast Audio (e.g., Bluetooth Auracast broadcast audio) enables an audio source device to broadcast one or more audio streams to an unlimited number of listening devices (e.g., a one-to-many wireless protocol). Broadcast Audio involves a one-to-many broadcast packet transportation mechanism without acknowledgment. Some transmitting devices may be limited to transmitting a single audio track (e.g., a single monophonic or stereophonic signal). This may be because the device has a Bluetooth Classic radio but not a Bluetooth LE radio. It may also be due to a limitation of bandwidth; for example, the device may be capable of transmitting a single audio track at a higher bandwidth, but may be constrained to a lower bandwidth when transmitting multiple audio tracks. In many cases, however, multiple users may wish to watch media content while listening to different language audio tracks in high quality. Offered herein are systems and methods that allow a media