Search

CN-115119102-B - Sound signal processing method, sound signal processing device, and recording medium

CN115119102BCN 115119102 BCN115119102 BCN 115119102BCN-115119102-B

Abstract

The invention provides a sound signal processing method and a sound signal processing device, which can improve the tone quality of initial reflected sound. The audio signal processing method acquires an audio signal of an audio source, performs 1 st filtering processing of a virtual audio source for generating a virtual space on the audio signal, performs 2 nd filtering processing of adjusting a tone color of the virtual audio source on the audio signal, and outputs an initial reflected sound control signal generated by the audio signal subjected to the 1 st filtering processing and the 2 nd filtering processing.

Inventors

  • Watake Takayuki
  • KAJIMOTO YASUSHI
  • Four scout ministers

Assignees

  • 雅马哈株式会社

Dates

Publication Date
20260512
Application Date
20220314
Priority Date
20210319

Claims (11)

  1. 1. A sound signal processing method, wherein, A sound signal of a sound source is acquired, A1 st filtering process of generating virtual sound sources of the virtual space is performed, A2 nd filtering process of adjusting the tone color of the initial reflected sound is performed, Outputting an initial reflected sound control signal generated by the sound signal after the 1 st filtering process and the 2 nd filtering process is performed, outputting the initial reflected sound control signal to a speaker to simulate an initial reflected sound of a virtual space in a play space, The 2 nd filtering process is performed on the audio signal, the 1 st filtering process is performed on the audio signal subjected to the 2 nd filtering process, or The 1 st filtering process is performed on the audio signal, the 2 nd filtering process is performed on the audio signal after the 1 st filtering process is performed, The 1 st filtering process is a process of setting a gain value and a delay amount for an input sound signal using a geometry of the virtual space and a position of the virtual sound source, The 2 nd filtering process is an FIR filter for performing convolution operation on the input sound signal, The component number per unit time generated by the 2 nd filter processing is greater than the component number per unit time generated by the 1 st filter processing.
  2. 2. The sound signal processing method according to claim 1, wherein, The temporal resolution of the 2 nd filtering process is higher than the temporal resolution of the 1 st filtering process.
  3. 3. The sound signal processing method according to claim 1 or 2, wherein, The component of the initial reflected sound control signal obtained based on the 1 st filtering process and the component of the initial reflected sound control signal obtained based on the 2 nd filtering process are different components on the time axis.
  4. 4. The sound signal processing method according to claim 1 or 2, wherein, The 2 nd filtering process can set a filter characteristic including at least one of a sampling frequency, a filter length, and a filter coefficient.
  5. 5. The sound signal processing method according to claim 4, wherein, The filter characteristic of the 2 nd filter process can be set by an operation input from the outside.
  6. 6. An audio signal processing apparatus, comprising: a sound signal acquisition unit that acquires a sound signal of a sound source; a1 st filtering unit that performs a1 st filtering process for generating a virtual sound source in the virtual space; A2 nd filter processing unit for performing a2 nd filter processing for adjusting the tone of the initial reflected sound, and An initial reflection sound control signal output unit that outputs an initial reflection sound control signal generated by the sound signal subjected to the 1 st filtering process and the 2 nd filtering process, and outputs the initial reflection sound control signal to a speaker to simulate an initial reflection sound of a virtual space in a playback space, The 2 nd filter processing unit applies the 2 nd filter processing to the sound signal, and the 1 st filter processing unit applies the 1 st filter processing to the sound signal subjected to the 2 nd filter processing, or The 1 st filter processing unit performs the 1 st filter processing on the sound signal, the 2 nd filter processing unit performs the 2 nd filter processing on the sound signal subjected to the 1 st filter processing, The 1 st filtering processing unit performs processing for setting a gain value and a delay amount for an input sound signal using a geometry of the virtual space and a position of the virtual sound source, The 2 nd filtering processing part is an FIR filter for performing convolution operation on the input sound signal, The component number per unit time generated by the 2 nd filter processing is greater than the component number per unit time generated by the 1 st filter processing.
  7. 7. The sound signal processing apparatus according to claim 6, wherein, The temporal resolution of the 2 nd filtering process is higher than the temporal resolution of the 1 st filtering process.
  8. 8. The sound signal processing apparatus according to claim 6 or 7, wherein, The component of the initial reflected sound control signal obtained by the 1st filtering process in the 1st filtering process section and the component of the initial reflected sound control signal obtained by the 2 nd filtering process in the 2 nd filtering process section are different components on the time axis.
  9. 9. The sound signal processing apparatus according to claim 6 or 7, wherein, The 2 nd filter processing unit may set a filter characteristic including at least one of a sampling frequency, a filter length, and a filter coefficient.
  10. 10. The sound signal processing apparatus according to claim 9, wherein, An operation unit is provided, which receives an operation input of the filter characteristic of the 2 nd filter processing.
  11. 11. A recording medium, which is a nonvolatile computer-readable recording medium, recorded with a program for causing a computer to execute: A sound signal of a sound source is acquired, A1 st filtering process of generating virtual sound sources of the virtual space is performed, A2 nd filtering process of adjusting the tone color of the initial reflected sound is performed, Outputting an initial reflected sound control signal generated by the sound signal after the 1 st filtering process and the 2 nd filtering process is performed, outputting the initial reflected sound control signal to a speaker to simulate an initial reflected sound of a virtual space in a play space, The 2 nd filtering process is performed on the audio signal, the 1 st filtering process is performed on the audio signal subjected to the 2 nd filtering process, or The 1 st filtering process is performed on the audio signal, the 2 nd filtering process is performed on the audio signal after the 1 st filtering process is performed, The 1 st filtering process is a process of setting a gain value and a delay amount for an input sound signal using a geometry of the virtual space and a position of the virtual sound source, The 2 nd filtering process is an FIR filter for performing convolution operation on the input sound signal, The component number per unit time generated by the 2 nd filter processing is greater than the component number per unit time generated by the 1 st filter processing.

Description

Sound signal processing method, sound signal processing device, and recording medium Technical Field One embodiment of the present invention relates to a sound signal processing method and a sound signal processing apparatus for performing predetermined processing on a sound input from a sound source. Background A technique for controlling a reflected sound in an acoustic system such as a hall is put into practical use in various ways. For example, the reflected sound generating apparatus described in patent document 1 includes a1 st FIR filter and a2 nd FIR filter. The 1 st FIR filter carries out convolution operation on the voice signal through the 1 st reflected sound parameter to generate 1 st reflected sound data. The 2 nd FIR filter carries out convolution operation on the 1 st reflected sound data through the 2 nd reflected sound parameter to generate the 2 nd reflected sound data. Thus, the reflected sound generating apparatus described in patent document 1 generates a reflected sound composed of an initial reflected sound and a rear reverberation sound. Patent document 1 Japanese patent laid-open No. 2000-163086 However, in the above-described conventional structure, it is difficult to improve the quality of the initial reflected sound. Disclosure of Invention Accordingly, an object of one embodiment of the present invention is to improve the quality of an initial reflected sound. The audio signal processing method acquires an audio signal of an audio source, performs 1 st filtering processing of a virtual audio source for generating a virtual space on the audio signal, performs 2 nd filtering processing of adjusting a tone color of the virtual audio source on the audio signal, and outputs an initial reflected sound control signal generated by the audio signal subjected to the 1 st filtering processing and the 2 nd filtering processing. ADVANTAGEOUS EFFECTS OF INVENTION The sound signal processing method can improve the quality of the initial reflected sound. Drawings Fig. 1 is a functional block diagram showing a configuration of an audio system including an audio signal processing device according to an embodiment of the present invention. Fig. 2 is a flowchart of a sound signal processing method according to an embodiment of the present invention. Fig. 3 is a diagram showing discrete waveforms of sound including a normal direct sound, an initial reflected sound, and a reverberation sound (rear reverberation sound). Fig. 4 (a) and 4 (B) are diagrams showing the concept of setting a virtual sound source. Fig. 5 is a functional block diagram showing an example of the structure of the grouping unit 40. Fig. 6 is a flowchart showing a grouping method of sound sources. Fig. 7 is a diagram showing a concept of grouping a plurality of sound sources into a plurality of areas. Fig. 8 (a) is a flowchart showing a grouping method of sound sources using representative points, and fig. 8 (B) is a flowchart showing a grouping method of sound sources using boundaries of areas. Fig. 9 is a flowchart showing an example of a grouping method by movement of a sound source. Fig. 10 is a functional block diagram showing an example of the configuration of the initial reflected sound control signal generating section 50. Fig. 11 is a diagram showing an example of a GUI. Fig. 12 is a flowchart showing an example of the virtual sound source setting process. Fig. 13 (a) and 13 (B) are diagrams showing setting examples of virtual sound sources when the geometric shapes are different. Fig. 14 (a), 14 (B) and 14 (C) are diagrams showing examples of setting of virtual sound sources. Fig. 15 (a), 15 (B) and 15 (C) are diagrams showing examples of setting of virtual sound sources. Fig. 16 is a flowchart showing a process of assigning virtual sound sources to speakers. Fig. 17 (a) and 17 (B) are diagrams showing a concept of assigning virtual sound sources to speakers. Fig. 18 is a flowchart showing the coefficient setting process of LDtap. Fig. 19 (a) and 19 (B) are diagrams for explaining the concept of coefficient setting. Fig. 20 (a) shows an example of LDtap coefficients in the case where the virtual space shape is large, and fig. 20 (B) shows an example of LDtap coefficients in the case where the virtual space shape is small. Fig. 21 is a diagram showing waveforms of the initial reflected sound control signals generated by the initial reflected sound control signal generating unit 50. Fig. 22 is a functional block diagram showing an example of the configuration of the echo control signal generating unit 70. Fig. 23 is a flowchart showing an example of processing for generating a echo control signal. Fig. 24 is a graph showing examples of waveforms of the direct sound, the initial reflected sound control signal, and the reverberant sound control signal. Fig. 25 is a diagram showing an example of setting the area for the echo sound. Fig. 26 is a functional block diagram showing an example of the configuration of the output ad