CN-115315747-B - Signal processing device, method, and program
Abstract
The present technology relates to a signal processing device and method, and a program, which can obtain a high-quality sound signal even with a small processing amount. The signal processing apparatus includes a selection section that is provided with a plurality of audio signals and selects an audio signal to be subjected to sound quality enhancement processing, and a sound quality enhancement processing section that performs sound quality enhancement processing on the audio signal selected by the selection section. The present technology is applicable to portable terminals.
Inventors
- FUKUI TOKAO
- CHINEN SATOSHI
Assignees
- 索尼集团公司
Dates
- Publication Date
- 20260505
- Application Date
- 20210319
- Priority Date
- 20200401
Claims (10)
- 1.A signal processing apparatus comprising: A selecting section that is provided with a plurality of audio signals and selects an audio signal to be subjected to sound quality enhancement processing including high-load sound quality enhancement processing, low-load sound quality enhancement processing, and medium-load sound quality enhancement processing, wherein for each audio signal, the selecting section selects sound quality enhancement processing to be performed on the audio signal from among the high-load sound quality enhancement processing, the low-load sound quality enhancement processing, and the medium-load sound quality enhancement processing; A sound quality enhancement processing section that performs the selected sound quality enhancement processing on the audio signal selected by the selecting section, Wherein the sound quality enhancement processing includes a dynamic range expansion processing or a bandwidth expansion processing based on a prediction coefficient obtained by machine learning and the audio signal, and A coefficient selection section that holds a prediction coefficient for each type of audio signal, and selects a prediction coefficient to be used for the high-load sound quality enhancement processing from among the held plurality of prediction coefficients based on type information indicating a type of the audio signal.
- 2. The signal processing apparatus according to claim 1, wherein the selecting section selects the audio signal to be subjected to the sound quality enhancement processing based on metadata of the audio signal.
- 3. The signal processing apparatus of claim 2, wherein the metadata includes priority information indicating a priority of the audio signal.
- 4. The signal processing apparatus of claim 2, wherein the metadata includes type information indicating a type of the audio signal.
- 5. The signal processing apparatus of claim 2, further comprising: And a metadata generation unit that generates the metadata based on the audio signal.
- 6. The signal processing apparatus according to claim 1, wherein the sound quality enhancement processing includes bandwidth extension processing that generates a high-frequency component by linear prediction based on the audio signal.
- 7. The signal processing apparatus according to claim 1, wherein the sound quality enhancement process includes a bandwidth expansion process that adds white noise to the audio signal.
- 8. The signal processing apparatus of claim 1, wherein the audio signal comprises an audio signal of a channel or an audio signal of an audio target.
- 9. A signal processing method performed by a signal processing apparatus, the signal processing method comprising: providing a plurality of audio signals, and selecting an audio signal to be subjected to sound quality enhancement processing including high-load sound quality enhancement processing, low-load sound quality enhancement processing, and medium-load sound quality enhancement processing, For each audio signal, selecting a sound quality enhancement process to be performed on the audio signal from among the high-load sound quality enhancement process, the low-load sound quality enhancement process, and the medium-load sound quality enhancement process; the selected sound quality enhancement process is performed on the selected audio signal, Wherein the sound quality enhancement processing includes a dynamic range expansion processing or a bandwidth expansion processing based on a prediction coefficient obtained by machine learning and the audio signal, and A prediction coefficient for each type of audio signal is held, and a prediction coefficient to be used for the high-load sound quality enhancement processing is selected from among the held plurality of prediction coefficients based on type information indicating the type of the audio signal.
- 10. A computer-readable storage medium storing a program for causing a computer to execute the signal processing method according to claim 9.
Description
Signal processing device, method, and program Technical Field The present technology relates to a signal processing apparatus and method and a program, and in particular, to a signal processing apparatus and method and a program that can obtain a high sound quality signal even with a small processing amount. Background In the past, as a process for sound quality enhancement of an audio signal, that is, as a process for sound quality improvement, a bandwidth expansion process and a dynamic range expansion process are known. For example, as such bandwidth extension processing, there has been proposed a technique in which, based on a low-frequency subband signal, a filter coefficient of a band-pass filter whose passband is a high frequency is calculated, and filtering of a flattening signal obtained from the low-frequency subband signal is performed by using the filter coefficient, thereby generating a high-frequency signal (for example, see PTL 1). [ Reference List ] [ Patent literature ] [ PTL1]: U.S. Pat. No. 9922660 Disclosure of Invention [ Technical problem ] Incidentally, if an attempt is made to perform processing for sound quality enhancement on target audio sounds including audio signals, each corresponding to one of a plurality of targets, so that the processing is uniformly performed on the audio signals of all the targets, it is necessary to perform the processing as many times as the number of targets. Thus, for example, in some cases, it is not possible for a currently available platform (e.g., smart phone, portable player, sound amplifier, etc.) to fully perform this process. For example, in the case where the number of targets is relatively small 12, if an attempt is made to perform sound quality enhancement processing on all 12 targets, the processing amount becomes undesirably high as 1GCPS (cycles per second) to 3GCPS. The present technology has been made in view of such a situation, and an object of the present technology is to be able to obtain a high sound quality signal even with a small processing amount. [ Solution to the problem ] The signal processing apparatus according to one aspect of the present technology includes a selection section that is supplied with a plurality of audio signals and selects an audio signal to be subjected to sound quality enhancement processing, and a sound quality enhancement processing section that performs sound quality enhancement processing on the audio signal selected by the selection section. A signal processing method or program according to one aspect of the present technology includes the steps of providing a plurality of audio signals, and selecting an audio signal to be subjected to sound quality enhancement processing, and performing sound quality enhancement processing on the selected audio signal. In one aspect of the present technology, a plurality of audio signals are provided, an audio signal to be subjected to sound quality enhancement processing is selected, and sound quality enhancement processing is performed on the selected audio signal. Drawings Fig. 1 is a diagram depicting a configuration example of a signal processing apparatus. Fig. 2 is a diagram describing a configuration example of the sound quality enhancement processing section. Fig. 3 is a diagram depicting a configuration example of the dynamic range expansion section. Fig. 4 is a diagram depicting a configuration example of the bandwidth extension section. Fig. 5 is a diagram depicting a configuration example of the dynamic range expansion section. Fig. 6 is a diagram depicting a configuration example of the bandwidth extension section. Fig. 7 is a diagram depicting a configuration example of the bandwidth extension section. Fig. 8 is a flowchart for explaining a reproduction signal generation process. Fig. 9 is a flowchart for explaining the high-load sound quality enhancement processing. Fig. 10 is a flowchart for explaining the medium-load sound quality enhancement processing. Fig. 11 is a flowchart for explaining the low-load sound quality enhancement processing. Fig. 12 is a diagram showing a configuration example of the signal processing apparatus. Fig. 13 is a flowchart for explaining a reproduction signal generation process. Fig. 14 is a diagram depicting a configuration example of a signal processing apparatus. Fig. 15 is a diagram depicting a configuration example of the signal processing apparatus. Fig. 16 is a flowchart for explaining a reproduction signal generation process. Fig. 17 is a diagram describing a configuration example of a computer. Detailed Description Embodiments to which the present technology is applied are described below with reference to the drawings. < First embodiment > < Related to the present technology > The present technology is intended to make it possible to obtain a high sound quality signal even with a small processing amount by selecting different processing as processing to be performed on an audio signal using metadata or the