CN-122028161-A - Audio transmission method, audio equipment and wireless audio system

Abstract

The disclosure relates to the technical field of communication interaction, in particular to an audio transmission method, audio equipment and a wireless audio system. The audio transmission method comprises the steps of generating and caching first digital audio data based on collected first audio signals, transmitting the first digital audio data of the first preset quantity to a wireless transmission storage area when the accumulated quantity of the first digital audio data reaches the first preset quantity, determining first starting time for transmitting the first preset quantity of the first digital audio data, determining first transmission time to be used for data transmission with second audio equipment according to the first starting time, and transmitting a wireless frame to the second audio equipment based on a target wireless system and the first transmission time so that the second audio equipment aligns the second digital audio data with the first digital audio data on a time axis based on the received first digital audio data. The time sequence jitter in data transmission can be reduced, and the certainty and consistency of cross-equipment audio time alignment are improved.

Inventors

• TONG WEIFENG

Assignees

• 恒玄科技(北京)有限公司

Dates

Publication Date

20260512

Application Date

20260214

Claims (20)

1. 1. An audio transmission method applied to a first audio device in a wireless audio system, the first audio device being connected to a second audio device in the wireless audio system based on a target wireless system, the method comprising: generating and caching first digital audio data based on the acquired first audio signal; transmitting the first predetermined number of the first digital audio data to a wireless transmission storage area when the accumulated amount of the first digital audio data reaches a first predetermined number, and determining a first start time of transmitting the first predetermined number of the first digital audio data; Determining a first sending time to be used for carrying out data transmission with the second audio device according to the first starting time, wherein the first sending time is later than the latest arrival time of the first digital audio data of the first preset quantity transmitted to the wireless sending storage area; and transmitting a radio frame to the second audio device based on the target wireless system and the first transmission time, so that the second audio device aligns second digital audio data with the first digital audio data on a time axis based on the received first digital audio data, wherein the second digital audio data is generated by the second audio device based on the acquired second audio signal, and the radio frame is a carrier of the first predetermined number of the first digital audio data.
2. 2. The audio transmission method of claim 1, wherein determining a first start-up time to transmit the first predetermined amount of the first digital audio data when the accumulated amount of the first digital audio data reaches a first predetermined amount comprises: When the accumulated quantity of the first digital audio data reaches the first preset quantity, triggering and latching a first local hardware clock counter of the first audio device, and determining a first starting count value, wherein the first starting count value is used for marking the first starting moment.
3. 3. The audio transmission method of claim 2, wherein the method further comprises: In response to the target wireless system transmitting the wireless frame, triggering and latching the first local hardware clock counter, and determining a transmission count value, wherein the transmission count value is used for marking a first actual transmission moment of the wireless frame; And adjusting the first sending time based on the difference value between the first starting count value and the sending count value so that the time difference between the first starting time and the first sending time is in a specified time deviation interval.
4. 4. The audio transmission method according to claim 1, wherein the first audio device comprises a first analog-to-digital conversion module and at least one first filtering module and/or a first downsampling module, the generating and buffering the first digital audio data based on the acquired first audio signal comprising: performing analog-to-digital conversion processing on the acquired first audio signal through a first analog-to-digital conversion module to obtain an intermediate result; processing the intermediate result by at least one of the first filtering module and/or the first downsampling module, generating and buffering the first digital audio data at a first sampling rate.
5. 5. The audio transmission method according to claim 4, wherein the first sampling rate is smaller than a first master clock frequency of a first clock system corresponding to the first audio device, and working clocks of the first analog-to-digital conversion module, the at least one first filtering module and the first downsampling module all belong to the first clock system.
6. 6. The audio transmission method of claim 5, wherein the first clock system is at the same nominal frequency as a corresponding second clock system of the second audio device.
7. 7. The audio transmission method according to any one of claims 4 to 6, wherein the first audio device further includes a first direct memory access unit and a first buffer unit, and when an accumulated amount of the first digital audio data reaches a first predetermined amount, transmitting the first predetermined amount of the first digital audio data to a wireless transmission storage area, includes: counting an accumulated amount of the first digital audio data written in the first buffer unit; When the accumulated amount of the first digital audio data reaches a first preset amount, triggering the first direct memory access unit to execute a data transmission operation so as to transmit the first preset amount of the first digital audio data to the wireless transmission storage area in batches.
8. 8. The audio transmission method of claim 7, wherein the first buffer unit and the first direct memory access unit correspond to a same driving clock, and the driving clock and a sampling clock of the first analog-to-digital conversion module have a specified timing relationship.
9. 9. The audio transmission method of claim 1, wherein the target wireless system comprises an ultra-wideband wireless link, a wireless local area network link, or a bluetooth high throughput audio link.
10. 10. The audio transmission method according to claim 1, wherein the first audio device and the second audio device establish a bluetooth link with a sound source device based on a built-in bluetooth controller, for receiving a sound source audio signal transmitted by the sound source device.
11. 11. An audio transmission method applied to a second audio device in a wireless audio system, the second audio device being connected to a first audio device in the wireless audio system based on a target wireless system, the method comprising: generating and caching second digital audio data based on the acquired second audio signal; determining a second start-up time for transmitting a second predetermined number of the second digital audio data when the accumulated amount of the second digital audio data reaches a second predetermined number, and transmitting the second predetermined number of the second digital audio data to a data storage area; Receiving, based on the target wireless system, a wireless frame transmitted by the first audio device, wherein the wireless frame is a carrier of a first predetermined amount of first digital audio data, the first digital audio data being generated by the first audio device based on the acquired first audio signal; Determining a first starting time of the first digital audio data through the wireless frame, wherein the first starting time is determined when the accumulated amount of the first digital audio data in the first audio device reaches a first preset amount; and processing the second digital audio data in the data storage area based on the first starting time and the second starting time to obtain processed second digital audio data aligned with the first digital audio data on a time axis.
12. 12. The audio transmission method of claim 11, wherein the determining a second start-up time to transmit the second predetermined amount of the second digital audio data when the accumulated amount of the second digital audio data reaches a second predetermined amount comprises: And triggering and latching a second local hardware clock counter of the second audio device when the accumulated amount of the second digital audio data reaches the second preset amount, and determining a second starting count value, wherein the second starting count value is used for marking the second starting moment.
13. 13. The audio transmission method of claim 12, wherein the processing the second digital audio data in the data storage area based on the first start-up time and the second start-up time to obtain processed second digital audio data aligned with the first digital audio data on a time axis, comprises: determining a first start count value according to the first start time, wherein the first start count value is determined by triggering a first local hardware clock counter for latching the first audio device when the accumulated amount of the first digital audio data reaches the first preset amount, and the first start count value is used for marking the first start time; And resampling the second digital audio data in the data storage area based on the first starting count value and the second starting count value to obtain the processed second digital audio data aligned with the first digital audio data on a time axis.
14. 14. The audio transmission method according to claim 13, wherein the resampling the second digital audio data in the data storage area based on the first start count value and the second start count value to obtain the processed second digital audio data aligned with the first digital audio data on a time axis, comprises: Synchronizing, by the target wireless system, a first wireless clock of the first audio device with a second wireless clock of the second audio device; determining a phase difference of the first wireless clock and the second wireless clock under synchronization; determining a first target time offset based on the phase difference, the first start count value, and the second start count value; And resampling the second digital audio data in the data storage area based on the first target time deviation to obtain the processed second digital audio data aligned with the first digital audio data on a time axis.
15. 15. The audio transmission method of claim 13, wherein, The method further comprises the steps of: Triggering a second local hardware clock counter that latches the second audio device in response to receiving the wireless frame or based on a target bluetooth frame received with a bluetooth connection between the first audio device, determining a first receive count value, wherein the first receive count value is used to mark a time of receiving the wireless frame; Determining a transmission count value of the first digital audio data through the radio frame; the resampling process is performed on the second digital audio data in the data storage area based on the first start count value and the second start count value to obtain the processed second digital audio data aligned with the first digital audio data on a time axis, including: Determining a first clock offset between a first wireless clock of the first audio device and a second wireless clock of the second audio device according to a difference between the transmit count value and the first receive count value; Determining a second target time offset based on the first clock offset, the first start count value, and the second start count value; And carrying out resampling processing on the second digital audio data in the data storage area based on the second target time deviation to obtain the processed second digital audio data aligned with the first digital audio data on a time axis.
16. 16. The audio transmission method according to claim 13, wherein the second audio device is connected to the first audio device through a first bluetooth connection and receives a radio audio signal by establishing a second bluetooth connection with a sound source device or by listening to a second bluetooth connection established by the second audio device with the sound source device; the resampling process is performed on the second digital audio data in the data storage area based on the first start count value and the second start count value to obtain the processed second digital audio data aligned with the first digital audio data on a time axis, including: Determining a second receiving count value of the Bluetooth frame sent by the sound source equipment received by the first audio equipment based on the first Bluetooth connection; determining a third receiving count value of the Bluetooth frame sent by the sound source equipment based on the second Bluetooth connection; Determining a second clock offset between a first wireless clock of the first audio device and a second wireless clock of the second audio device based on a difference between the second received count value and the third received count value; determining a third target time offset based on the second clock offset, the first start count value, and the second start count value; And carrying out resampling processing on the second digital audio data in the data storage area based on the third target time deviation to obtain the processed second digital audio data aligned with the first digital audio data on a time axis.
17. 17. The audio transmission method according to claim 11, wherein the second audio device comprises a second analog-to-digital conversion module and at least one second filtering module and/or a second downsampling module, the generating and buffering the second digital audio data based on the acquired second audio signal comprising: performing analog-to-digital conversion processing on the acquired second audio signal through a second analog-to-digital conversion module to obtain an intermediate result; Processing the intermediate result by at least one of the second filtering module and/or the second downsampling module, generating and buffering the second digital audio data at a second sampling rate.
18. 18. The audio transmission method according to claim 17, wherein the second sampling rate is smaller than a second master clock frequency of a second clock hierarchy corresponding to the second audio device, and working clocks of the second analog-to-digital conversion module, the at least one second filtering module, and the second sampling module all belong to the second clock hierarchy.
19. 19. The audio transmission method of claim 18, wherein the second clock system is at the same nominal frequency as the first clock system to which the second audio device corresponds.
20. 20. An audio device, comprising: The first audio acquisition processing module is used for acquiring a first audio signal and generating first digital audio data based on the first audio signal; a first buffer unit for buffering the first digital audio data; A first data transmission unit, configured to transmit the first digital audio data of a first predetermined number to a wireless transmission storage area when the cumulative amount of the first digital audio data reaches the first predetermined number, determine a first start time of transmitting the first predetermined number of the first digital audio data, and determine a first transmission time to be transmitted with a second audio device according to the first start time, where the first transmission time is later than a latest arrival time of the first predetermined number of the first digital audio data transmitted to the wireless transmission storage area, and the second audio device is another device in a wireless audio system connected to the audio device based on a target wireless system; A first wireless unit, configured to send a wireless frame to the second audio device based on the target wireless system and the first sending time, so that the second audio device aligns second digital audio data with the first digital audio data on a time axis based on the received first digital audio data, where the second digital audio data is generated by the second audio device based on the collected second audio signal, and the wireless frame is a carrier of the first predetermined number of the first digital audio data.

Description

Audio transmission method, audio equipment and wireless audio system Technical Field The disclosure relates to the technical field of communication interaction, in particular to an audio transmission method, audio equipment and a wireless audio system. Background With the wide application of multi-audio devices such as real wireless headphones and intelligent glasses, the multi-device collaborative pickup and spatial audio processing gradually become important application scenes. In such applications, the audio signals collected by the different audio devices need to be kept highly uniform on the time axis to ensure subsequent audio fusion, beam forming and spatial localization effects. In the related art, a wireless audio system typically time-stamps and aligns audio data based on the transmission or reception timing of a wireless frame or by introducing a phase-locked loop in a plurality of devices to achieve sampling clock synchronization. However, since there is an internal processing delay of the audio data between the completion of the acquisition and entry into the wireless transmission buffer, and this delay is often accompanied by scheduling jitter, the above-described scheme has difficulty in accurately reflecting the real time of the completion of the audio acquisition, and it is easy to increase the delay of the transmission of the audio signal from one device to another. In addition, the introduction of a phase-locked loop increases hardware complexity and system power consumption, which is disadvantageous for the application of the low-power wearable device. Therefore, a new wireless audio system architecture is needed to achieve accurate time alignment between multiple audio devices based on real audio acquisition time without significantly increasing system power consumption and low latency. Disclosure of Invention To overcome the problems in the related art, exemplary embodiments of the present disclosure provide an audio transmission method applied to a first audio device in a wireless audio system, the first audio device being connected to a second audio device in the wireless audio system based on a target wireless system, the method including generating and buffering first digital audio data based on a collected first audio signal, transmitting the first predetermined number of the first digital audio data to a wireless transmission memory area when an accumulated amount of the first digital audio data reaches the first predetermined number, and determining a first start time at which the first predetermined number of the first digital audio data is transmitted, determining a first transmission time at which data transmission with the second audio device is to be performed, according to the first start time, wherein the first transmission time is later than a latest arrival time at which the first predetermined number of the first digital audio data is transmitted to the wireless transmission memory area, transmitting a radio frame to the second audio device based on the target wireless system and the first transmission time, so that the second audio device aligns the second digital audio data with the first audio data on a time axis based on the received first digital audio data, wherein the second digital audio data is the first predetermined number of the first audio signal, and the second audio carrier is generated based on the first predetermined number of the first audio data. In some embodiments, determining a first start-up time to transmit the first predetermined amount of the first digital audio data when the cumulative amount of the first digital audio data reaches the first predetermined amount includes triggering a first local hardware clock counter that latches the first audio device when the cumulative amount of the first digital audio data reaches the first predetermined amount, determining a first start-up count value, wherein the first start-up count value is used to flag the first start-up time. In some embodiments, the method further includes, in response to the target wireless system transmitting the wireless frame, triggering latching a first local hardware clock counter, determining a transmit count value, wherein the transmit count value is used to flag a first actual transmit time of the wireless frame, and adjusting the first transmit time based on a difference between the first start count value and the transmit count value such that a time difference between the first start time and the first transmit time is within a specified time offset interval. In some embodiments, the first audio device comprises a first analog-to-digital conversion module and at least one first filtering module and/or a first downsampling module, generates and buffers first digital audio data based on the collected first audio signal, and comprises performing analog-to-digital conversion processing on the collected first audio signal through the first analog-to-digital conversion modul