CN-122027973-A - Data processing method and device
Abstract
The application provides a data processing method and a data processing device. The data processing method comprises the steps of obtaining target direct sound corresponding to a target object and current space attribute information, determining at least one target reference space based on the current space attribute information, determining target audio modulation parameters corresponding to each target reference space, adjusting target reference reverberation audios corresponding to each target reference space based on each target audio modulation parameter to obtain target modulation reverberation audios, and generating target reverberation audios corresponding to the target object based on the target direct sound and the target modulation reverberation audios. The method and the device improve the generation efficiency and the authenticity of the target reverberation audio.
Inventors
- FENG JING
- ZHANG PENGYU
- ZHENG TINGTING
Assignees
- 珠海金山数字网络科技有限公司
- 广州西山居网络科技有限公司
Dates
- Publication Date
- 20260512
- Application Date
- 20260212
Claims (15)
- 1. A method of data processing, comprising: acquiring target direct sound corresponding to a target object and current space attribute information; determining at least one target reference space based on the current space attribute information, and determining target audio modulation parameters corresponding to each target reference space; Adjusting target reference reverberation audios corresponding to the target reference spaces based on the target audio modulation parameters to obtain target modulation reverberation audios; and generating target reverberation audio corresponding to the target object based on the target direct sound and the target modulation reverberation audio.
- 2. The method of claim 1, wherein determining target audio modulation parameters for each target reference space comprises: Acquiring current space parameters based on the current space attribute information, and acquiring reference space parameters corresponding to a target reference space to be processed, wherein the target reference space to be processed is any one of target reference spaces; Acquiring reference reverberation audio parameters corresponding to the target reference space to be processed based on a preset reverberation audio library; And adjusting the reference reverberation audio parameters based on the current space parameters and the reference space parameters to obtain target audio modulation parameters corresponding to the target reference space to be processed.
- 3. The method of claim 1, wherein adjusting the target reference reverberant audio corresponding to each target reference space based on each target audio modulation parameter to obtain a target modulated reverberant audio comprises: Adjusting target reference reverberation audios corresponding to the target reference spaces based on the target audio modulation parameters to obtain initial target modulation reverberation audios corresponding to the target reference spaces; And weighting the initial target modulation reverberant audios corresponding to each target reference space to obtain target modulation reverberant audios.
- 4. The method of claim 3, wherein weighting the initial target modulated reverberant audio corresponding to each target reference space to obtain target modulated reverberant audio, comprises: Determining the space matching degree between each target reference space and the current space; Determining weight coefficients corresponding to each target reference space based on the space matching degree; And weighting the initial target modulation reverberant audios corresponding to the target reference spaces based on the weight coefficients to obtain target modulation reverberant audios.
- 5. The method of claim 3, wherein adjusting the target reference reverberations corresponding to each target reference space based on each target audio modulation parameter to obtain an initial target modulated reverberations corresponding to each target reference space, comprises: Determining a target audio modulation parameter to be processed and a target reference reverberation audio to be processed corresponding to an initial target reference space, wherein the initial target reference space is any one of the target reference spaces; determining an initial adjustment strategy of the target reference reverberation audio to be processed based on the target audio modulation parameters to be processed; And adjusting the target reference reverberation audio to be processed based on the initial adjustment strategy to obtain initial target modulation reverberation audio corresponding to the initial target reference space.
- 6. The method of claim 1, wherein determining at least one target reference space based on the current spatial attribute information comprises: Determining a current space type and a current space parameter based on the current space attribute information; determining a reference space type which is the same as the current space type in a preset reverberation audio library, and acquiring at least one initial reference space corresponding to the reference space type, wherein the initial reference space corresponds to initial reference space parameters; calculating the space similarity between the current space parameter and each initial reference space parameter; And determining the initial reference space parameter meeting the space similarity threshold as a target reference space parameter, and determining the initial reference space corresponding to the target reference space parameter as a target reference space.
- 7. The method as recited in claim 2 or 6, wherein the pre-set reverberant audio library is determined by: determining at least one reference spatial type based on the different acoustic features; Acquiring at least one reference space corresponding to each reference space type; and determining reference space attribute information corresponding to each reference space based on each reference space, and obtaining a preset reverberation audio library by referencing the reverberation audio and the reference reverberation audio parameters.
- 8. The method of claim 7, wherein determining reference space attribute information corresponding to each reference space based on each reference space comprises: Determining an initial reference space, wherein the initial reference space is any one of the reference spaces; And acquiring a space volume parameter corresponding to the initial reference space and a material reflection characteristic parameter to obtain reference space attribute information corresponding to the initial reference space.
- 9. The method of claim 7, wherein determining the reference reverberant audio and the reference reverberant audio parameters corresponding to each reference space based on each reference space, comprises: Determining an acquisition condition of an initial reference space, wherein the initial reference space is any one of the reference spaces; Under the condition that the acquisition condition is a first acquisition condition, determining a reference reverberation audio corresponding to the initial reference space based on an acoustic acquisition strategy, and extracting parameters in the reference reverberation audio to obtain reference reverberation audio parameters; and under the condition that the acquisition condition is a second acquisition condition, determining the reference reverberation audio corresponding to the initial reference space based on an acoustic design strategy, and extracting parameters in the reference reverberation audio to obtain reference reverberation audio parameters.
- 10. The method of claim 1, wherein generating target reverberant audio corresponding to the target object based on the target direct sound and the target modulated reverberant audio, comprises: determining the audio configuration proportion of the target direct sound and the target modulated reverberant audio, which correspond to the target modulated reverberant audio respectively; And performing audio configuration on the target direct sound and the target modulation reverberant audio based on the audio configuration proportion, and generating target reverberant audio corresponding to the target object.
- 11. The method of claim 1, wherein obtaining target direct sound corresponding to a target object and current spatial attribute information comprises: determining a target sound source position corresponding to a target sound source, and determining the current position of a target object, wherein the target sound source is used for generating target direct sound to the target object; determining a current space corresponding to the current position based on the current position of the target object, and determining a current space type corresponding to the current space; Determining a relative position parameter of the target object in the current space and a relative motion speed parameter of a sound source based on the target sound source position and the current position of the target object; And adding the current space type corresponding to the current space, the relative position parameter and the sound source relative motion speed parameter to the current space attribute information.
- 12. A data processing apparatus, comprising: The acquisition unit is configured to acquire target direct sound corresponding to the target object and current space attribute information; A determining unit configured to determine at least one target reference space based on the current spatial attribute information, and determine target audio modulation parameters corresponding to each target reference space; The adjusting unit is configured to adjust target reference reverberation audios corresponding to the target reference spaces based on the target audio modulation parameters to obtain target modulation reverberation audios; And the generating unit is configured to generate target reverberation audio corresponding to the target object based on the target direct sound and the target modulation reverberation audio.
- 13. A computing device, comprising: A memory and a processor; the memory is adapted to store a computer program/instruction, the processor being adapted to execute the computer program/instruction, which when executed by the processor, implements the steps of the method according to any one of claims 1 to 11.
- 14. A computer readable storage medium storing a computer program/instruction, which when executed by a processor performs the steps of the method of any one of claims 1 to 11.
- 15. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method of any one of claims 1 to 11.
Description
Data processing method and device Technical Field The application relates to the technical field of computers, in particular to a data processing method. The application also relates to a data processing device, a computing device, a computer-readable storage medium and a computer program product. Background With the continuous development of computer technology, the processing requirements of people on audio data are also increasing. In the process of audio processing, in order to make an audio signal present a sense of reality matching a real scene, the reflection and attenuation processes of sound in different spaces need to be simulated by a reverberation simulation technology. In the course of reverberation simulation, a reverberation sample is usually preset to simulate an audio signal generated in a real scene. Or according to the principle of acoustic physics, the audio signal generated in the real scene is calculated in real time by establishing a space acoustic model. However, the manner of presetting the reverberation sample is difficult to flexibly adapt to the dynamically changing factors in different scenes, so that the reverberation effect is disjointed from the actual scene, and the reality is insufficient. In addition, according to the mode of the acoustic physical principle, the calculation process is complex, and the calculation force requirement is high. Therefore, how to consider the requirements of reverberation realism, memory occupation reduction and low computing cost in the reverberation simulation process is a problem to be solved. Disclosure of Invention In view of this, the embodiment of the application provides a data processing method. The present application is also directed to a data processing apparatus, a computing device, a computer readable storage medium and a computer program product for solving the above-mentioned problems occurring in the prior art. According to a first aspect of an embodiment of the present application, there is provided a data processing method, including: acquiring target direct sound corresponding to a target object and current space attribute information; determining at least one target reference space based on the current space attribute information, and determining target audio modulation parameters corresponding to each target reference space; Adjusting target reference reverberation audios corresponding to the target reference spaces based on the target audio modulation parameters to obtain target modulation reverberation audios; and generating target reverberation audio corresponding to the target object based on the target direct sound and the target modulation reverberation audio. According to a second aspect of an embodiment of the present application, there is provided a data processing apparatus including: The acquisition unit is configured to acquire target direct sound corresponding to the target object and current space attribute information; A determining unit configured to determine at least one target reference space based on the current spatial attribute information, and determine target audio modulation parameters corresponding to each target reference space; The adjusting unit is configured to adjust target reference reverberation audios corresponding to the target reference spaces based on the target audio modulation parameters to obtain target modulation reverberation audios; And the generating unit is configured to generate target reverberation audio corresponding to the target object based on the target direct sound and the target modulation reverberation audio. According to a third aspect of embodiments of the present application, there is provided a computing device comprising: A memory and a processor; The memory is used for storing computer programs/instructions, and the processor is used for executing the computer programs/instructions, and the computer programs/instructions realize the steps of the data processing method when being executed by the processor. According to a fourth aspect of embodiments of the present application, there is provided a computer readable storage medium storing a computer program/instruction which, when executed by a processor, implements the steps of the data processing method described above. According to a fifth aspect of embodiments of the present application, there is provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the data processing method described above. According to the data processing method provided by the embodiment of the application, the target direct sound generated on the target object is obtained, and the current spatial attribute information of the target object is obtained when the target direct sound is generated, so that the target reverberation audio generated later is more attached to the current scene. According to the current space attribute information, at least one target r