CN-118842783-B - Conference device, audio sharing method, electronic device and communication system

Abstract

The application discloses conference equipment, an audio sharing method, electronic equipment and a communication system, wherein the conference equipment performs audio data interaction with remote equipment corresponding to each audio application through at least two audio applications, the electronic equipment comprises a communication circuit and an execution circuit, the communication circuit is used for being in communication connection with the remote equipment, the execution circuit is coupled with the communication circuit, the execution circuit responds to the starting of the audio applications, acquires downlink audio data which are transmitted by the remote equipment through the corresponding audio applications through the communication circuit, and the execution circuit transmits the downlink audio data which are transmitted by other audio applications to the corresponding remote equipment through each audio application. By the method, the remote equipment of different audio applications can share the audio.

Inventors

• CHEN RUILONG

Assignees

• 安克创新科技股份有限公司

Dates

Publication Date

20260512

Application Date

20230425

Claims (20)

1. 1. A conference device for audio data interaction with a remote device corresponding to each of at least two audio applications, the conference device comprising: The communication circuit is used for being in communication connection with the remote equipment; An execution circuit coupled to the communication circuit, the execution circuit responding to the starting of the audio application, acquiring downlink audio data transmitted by the remote device through the corresponding audio application by the communication circuit, and transmitting the downlink audio data transmitted by other audio applications to the corresponding remote device by each audio application; the execution circuit caches the downlink audio data into a cache region corresponding to the audio application when acquiring the downlink audio data transmitted by the audio application; Writing the downlink audio data transmitted by each audio application into the buffer area corresponding to other audio applications; and sending the downlink audio data which are transmitted by other audio applications in the buffer area corresponding to each audio application to the corresponding remote equipment.
2. 2. The conference apparatus of claim 1, wherein, The buffer area comprises a first buffer area and a second buffer area; The execution circuit is used for correspondingly writing the downlink audio data transmitted by each audio application into the first buffer area corresponding to each audio application, writing the downlink audio data transmitted by each audio application into the second buffer areas corresponding to other audio applications, and correspondingly transmitting the downlink audio data stored in the second buffer areas corresponding to each audio application to the corresponding remote equipment.
3. 3. The conference apparatus of claim 2, wherein, The execution circuit is used for writing the downlink audio data cached in the first cache area corresponding to each audio application into the second cache areas corresponding to other audio applications.
4. 4. The conference apparatus of claim 2, wherein, The execution circuit applies for each audio application for the corresponding first buffer area and the corresponding second buffer area, records the memory index of the first buffer area and the memory index number of the second buffer area, and further writes the downlink audio data transmitted by each audio application into each first buffer area corresponding to the audio application and the second buffer areas corresponding to other audio applications.
5. 5. The conference apparatus of claim 2, wherein, And the execution circuit mixes the downlink audio data transmitted by other audio applications to obtain uplink audio data of each audio application, and correspondingly writes the uplink audio data into the second buffer area corresponding to each audio application.
6. 6. The conference apparatus of claim 5, wherein, The execution circuit monitors the number of the audio applications played by the audio tracks and the number of the corresponding first buffer areas, reads the downlink audio data buffered by the corresponding first buffer areas of each audio application, and mixes the downlink audio data transmitted by the audio applications except each audio application to obtain the uplink audio data.
7. 7. The conference apparatus of claim 6, wherein, The downlink audio data comprise audio parameters and downlink audio signal data; The execution circuit judges whether the audio parameters corresponding to the read other audio applications are matched with the audio parameters corresponding to each audio application or not; if the audio application is not matched with the downlink audio signal data, the execution circuit resamples the downlink audio signal data corresponding to the audio application which is not matched with the downlink audio signal data so that the audio parameters corresponding to the downlink audio signal data after resampling are matched with the audio parameters corresponding to each audio application; And the execution circuit mixes the resampled audio signal data corresponding to other audio applications with the audio signal data without resampling to obtain the uplink audio data.
8. 8. The conference apparatus of claim 1, wherein, The conference device further includes a microphone coupled to the execution circuit; the executing circuit sends the environmental audio data and the downlink audio data transmitted by other audio applications to the corresponding remote equipment through each audio application.
9. 9. The conference apparatus of claim 8, wherein, The execution circuit mixes the environment audio data with the downlink audio data transmitted by other audio applications to obtain uplink audio data of each audio application, and the uplink audio data of each audio application is transmitted to the corresponding remote equipment through each audio application.
10. 10. The conference apparatus of claim 9, wherein, The execution circuit correspondingly writes the downlink audio data transmitted by each audio application into a first buffer area corresponding to each audio application, reads the downlink audio data from the first buffer areas corresponding to other audio applications, mixes the downlink audio data transmitted by other audio applications with the environmental audio data to obtain the uplink audio data, writes the uplink audio data of each audio application into a corresponding second buffer area, and correspondingly transmits the uplink audio data buffered by the corresponding second buffer area to the corresponding remote equipment through each audio application.
11. 11. An audio sharing method of a conference device, wherein the conference device performs audio data interaction with a remote device corresponding to each audio application through at least two audio applications, and the audio sharing method comprises: Acquiring downlink audio data transmitted by the remote equipment through the corresponding audio application; Transmitting the downlink audio data transmitted by other audio applications to the corresponding remote equipment through each audio application; the obtaining downlink audio data transmitted by the remote device through the corresponding audio application includes: Writing the downlink audio data transmitted by each audio application into a buffer area corresponding to each audio application and the buffer areas corresponding to other audio applications; the sending, by each of the audio applications, the downstream audio data that is input by the other audio applications to the corresponding remote device includes: and transmitting the downlink audio data transmitted by other audio applications in the corresponding buffer area to the corresponding remote equipment through each audio application.
12. 12. The method of claim 11, wherein the step of determining the position of the probe is performed, The buffer area comprises a first buffer area and a second buffer area; The step of caching the downlink audio data transmitted by each audio application to a cache region corresponding to the audio application and the cache regions corresponding to other audio applications, includes: Correspondingly writing the downlink audio data transmitted by each audio application into the first buffer area corresponding to each audio application and the second buffer areas corresponding to other audio applications; The sending, by each of the audio applications, the downstream audio data that is input by the other audio applications in the corresponding buffer area to the corresponding remote device includes: And sending each downlink audio data cached in the corresponding second cache region to the corresponding remote equipment through each audio application.
13. 13. The method of claim 12, wherein the step of determining the position of the probe is performed, The writing the downlink audio data transmitted by each audio application into the first buffer corresponding to each audio and the second buffer corresponding to other audio applications includes: correspondingly writing the downlink audio data transmitted by each audio application into the first buffer area corresponding to each audio; and writing the downlink audio data cached in the first cache region corresponding to each audio application into the second cache regions corresponding to other audio applications.
14. 14. The method of claim 13, wherein the step of determining the position of the probe is performed, Before the downlink audio data transmitted by each audio application is correspondingly written into the first buffer area corresponding to each audio application, the method comprises the following steps: applying for the corresponding first buffer area for each audio application and recording the corresponding memory index number of the first buffer area; Before the downlink audio data buffered in the first buffer corresponding to each audio application is written into the second buffers corresponding to other audio applications, the method includes: Applying for the corresponding second buffer area for each audio application and recording the corresponding memory index number of the second buffer area.
15. 15. The method of claim 12, wherein the step of determining the position of the probe is performed, The writing the downlink audio data transmitted by each audio application into the first buffer corresponding to each audio application and the second buffers corresponding to other audio applications, including: And mixing the downlink audio data transmitted by other audio applications to obtain uplink audio data of each audio application, and writing the uplink audio data into the corresponding second buffer area.
16. 16. The method of claim 15, wherein the step of determining the position of the probe is performed, The step of mixing the downlink audio data transmitted by other audio applications to obtain uplink audio data of each audio application includes: Reading the downlink audio data cached in the first cache area corresponding to each audio application; And mixing the downlink audio data transmitted by the read other audio applications to obtain the uplink audio data.
17. 17. The method of claim 16, wherein the step of determining the position of the probe comprises, The reading the downlink audio data cached in the first cache area corresponding to each audio application includes: and monitoring the number of the audio applications played by the audio tracks and the number of the corresponding first buffer areas, and reading the monitored downlink audio data of the first buffer areas corresponding to each audio application.
18. 18. The method of claim 16, wherein the step of determining the position of the probe comprises, The downlink audio data comprise audio parameters and downlink audio signal data; the step of performing audio mixing processing on the downlink audio data corresponding to the other read audio applications to obtain the uplink audio data includes: Judging whether the read audio parameters transmitted by other audio applications except each audio application are matched with the audio parameters transmitted by each audio application or not; If not, resampling the downlink audio signal data transmitted by the audio application which is not matched, so that the audio parameters corresponding to the downlink audio signal data after resampling are matched with the audio parameters transmitted by each corresponding audio application; and mixing the resampled downlink audio signal data corresponding to other audio applications with the audio signal data without resampling to obtain the uplink audio data.
19. 19. The method of claim 11, wherein the step of determining the position of the probe is performed, The method further comprises the steps of: acquiring environmental audio data through a microphone; the sending, by each of the audio applications, the downstream audio data that is input by the other audio applications to the corresponding remote device includes: and transmitting the environmental audio data and the downlink audio data transmitted by other audio applications to the corresponding remote equipment through each audio application.
20. 20. The method of claim 19, wherein the step of determining the position of the probe comprises, The sending, via each of the audio applications, the environmental audio data and the downstream audio data incoming by the other audio applications to the corresponding remote device, comprising: mixing the environmental audio data and the downlink audio data transmitted by other audio applications to form uplink audio data of each audio application; and sending the uplink audio data of each audio application to the corresponding remote equipment through each audio application.

Description

Conference device, audio sharing method, electronic device and communication system Technical Field The present application relates to the field of audio data processing technologies, and in particular, to a conference device, an audio sharing method, an electronic device, and a communication system. Background With the development of internet technology and communication technology, society has entered the era of intelligent interconnection, and interaction, entertainment and work in the internet are becoming more and more common. Among these, it is common for users to interact, entertain and work through various audio applications or application programs in electronic devices. For example, a user may communicate with multiple parties online through an audio application, such as a meeting or game. Current multi-party remote interactions often must be based on the same audio application, i.e., each electronic device often only supports audio interactions between remote devices having the same audio application. If the audio applications among the plurality of remote devices are different, the inter-application audio data interaction cannot be realized. For example, if a conference is performed with a plurality of remote devices that install different audio applications (i.e., different audio applications are installed at different remote ends), it is only possible to use a plurality of electronic devices that are respectively loaded with references to different audio applications at the near end to simultaneously conference (the electronic devices and the remote devices are in one-to-one correspondence with each other through the audio applications), thereby affecting the user experience. Disclosure of Invention The embodiment of the application provides conference equipment, an audio sharing method, electronic equipment and a communication system, which can realize audio interaction between remote equipment corresponding to each audio application under the condition that different audio applications are multiple-opened in the conference equipment. In a first aspect, an embodiment of the present application provides a conference device, where the conference device performs audio data interaction with a remote device of each audio application through at least two audio applications, where the conference device includes a communication circuit configured to perform communication connection with the remote device, and an execution circuit coupled to the communication circuit, where the execution circuit, in response to starting of the audio applications, obtains, through the communication circuit, downlink audio data that is input by the remote device through the corresponding audio applications, and where the execution circuit sends, through each audio application, the downlink audio data that is input by other audio applications to the corresponding remote device. In a second aspect, an embodiment of the present application provides an audio sharing method for a conference device, where the conference device performs audio data interaction with a remote device corresponding to each audio application through at least two audio applications, where the audio sharing method includes obtaining downlink audio data transmitted by the remote device through the corresponding audio application, and transmitting the downlink audio data transmitted by other audio applications to the corresponding remote device through each audio application. In a third aspect, an embodiment of the present application provides an electronic device, where the electronic device includes an execution circuit, a memory, a communication circuit, a microphone, and a speaker, where the communication circuit, the memory, the microphone, and the speaker are coupled to the execution circuit, and the memory is configured to store a computer program, and the execution circuit is configured to execute the computer program to implement an audio sharing method of the electronic device according to the present application. In a fourth aspect, the present application provides a communication system comprising an electronic device as provided by the present application as described above and at least two remote devices, the electronic device being communicatively connected to the remote devices. The conference device has the advantages that, unlike the prior art, the conference device performs audio data interaction with the remote devices of each audio application through at least two audio applications, downlink audio data which are transmitted by each remote device through the corresponding audio application can be obtained, the downlink audio data which are transmitted by other audio applications are transmitted to the corresponding remote devices through each audio application, so that the remote devices of different audio applications can receive audio data of each other, audio interaction among different audio applications is realized, and compared