US-12626682-B2 - Directionality induced robust acoustic echo canceler adaptation

US12626682B2US 12626682 B2US12626682 B2US 12626682B2US-12626682-B2

Abstract

An example vehicle audio system includes a vehicle speaker configured to generate audio, multiple microphones, and a vehicle control module configured to receive an input signal via the multiple microphones, split the input signal into a parallel domain signal and an orthogonal domain signal, select a constant step size value for an orthogonal domain filter weight and a variable step size value for a parallel domain filter weight, adapt the orthogonal domain filter weight according to the orthogonal domain signal and the constant step size value, adapt the parallel domain filter weight according to the parallel domain signal and the variable step size value, combine the adapted orthogonal domain filter weight and the adapted parallel domain filter weight to define a total filter weight, and apply the total filter weight to the received input signal to perform a signal processing operation on the received input signal.

Inventors

Amos Schreibman
Elior Hadad
Gaurav Talwar

Assignees

GM Global Technology Operations LLC

Dates

Publication Date: 20260512
Application Date: 20240515

Claims (20)

1 . A vehicle audio system comprising: at least one vehicle speaker configured to generate audio in an interior of a vehicle; multiple microphones each configured to obtain audio within the interior of the vehicle; and a vehicle control module configured to: receive an input signal via the multiple microphones; split the input signal received via the multiple microphones into a parallel domain signal and an orthogonal domain signal; select a constant step size value for an orthogonal domain filter weight and a variable step size value for a parallel domain filter weight; adapt the orthogonal domain filter weight according to the orthogonal domain signal and the constant step size value; adapt the parallel domain filter weight according to the parallel domain signal and the variable step size value; combine the adapted orthogonal domain filter weight and the adapted parallel domain filter weight to define a total filter weight; and apply the total filter weight to the received input signal to perform a signal processing operation on the received input signal, prior to audio output of the received input signal.
2 . The vehicle audio system of claim 1 , wherein the vehicle control module is configured to control the at least one vehicle speaker to output an audio signal based on the input signal as modified by the total filter weight.
3 . The vehicle audio system of claim 1 , wherein the vehicle control module is configured to split the input signal into the parallel domain signal and the orthogonal domain signal by: applying a parallel projection to the input signal received via the multiple microphones; and applying an orthogonal projection to the input signal received via the multiple microphones.
4 . The vehicle audio system of claim 3 , wherein the vehicle control module is configured to: obtain a source signal steering vector according to at least one of a beamformer parameter and a specified tuning state parameter; and calculate the parallel projection and the orthogonal projection based on the source signal steering vector.
5 . The vehicle audio system of claim 3 , wherein the parallel projection is defined parallel to a target near end audio source.
6 . The vehicle audio system of claim 3 , wherein the orthogonal projection is defined orthogonal to a target near end audio source.
7 . The vehicle audio system of claim 1 , wherein the vehicle control module is configured to apply a greater variable step size value during a first time period where a double talk condition is present in the input signal, compared to a second time period where the double talk condition is present in the input signal.
8 . The vehicle audio system of claim 1 , wherein the vehicle control module is configured to execute an acoustic echo canceler (AEC) operation to determine a residual echo value, by subtracting a product of the total filter weight and a reference signal from the input signal received via the multiple microphones.
9 . The vehicle audio system of claim 1 , wherein the vehicle control module is configured to adapt the orthogonal domain filter weight and adapt the parallel domain filter weight using at least one of a normalized least mean square (NLMS), a recursive least squares (RLS) or an affine projection.
10 . The vehicle audio system of claim 1 , wherein the multiple microphones are arranged in a linear array within the vehicle.
11 . A method of processing audio signals in a vehicle interior, the method comprising: receiving, by a vehicle control module, an input signal from multiple microphones, each of the multiple microphones configured to obtain audio within an interior of a vehicle; splitting the input signal received via the multiple microphones into a parallel domain signal and an orthogonal domain signal; selecting a constant step size value for an orthogonal domain filter weight and a variable step size value for a parallel domain filter weight; adapting the orthogonal domain filter weight according to the orthogonal domain signal and the constant step size value; adapting the parallel domain filter weight according to the parallel domain signal and the variable step size value; combining the adapted orthogonal domain filter weight and the adapted parallel domain filter weight to define a total filter weight; and applying the total filter weight to the received input signal to perform a signal processing operation on the received input signal, prior to audio output of the received input signal.
12 . The method of claim 11 , further comprising controlling at least one vehicle speaker to output an audio signal based on the input signal as modified by the total filter weight.
13 . The method of claim 11 , wherein splitting the input signal into the parallel domain signal and the orthogonal domain signal includes: applying a parallel projection to the input signal received via the multiple microphones; and applying an orthogonal projection to the input signal received via the multiple microphones.
14 . The method of claim 13 , further comprising: obtaining a source signal steering vector according to at least one of a beamformer parameter and a specified tuning state parameter; and calculating the parallel projection and the orthogonal projection based on the source signal steering vector.
15 . The method of claim 13 , wherein the parallel projection is defined parallel to a target near end audio source.
16 . The method of claim 13 , wherein the orthogonal projection is defined orthogonal to a target near end audio source.
17 . The method of claim 11 , wherein adapting the parallel domain filter weight includes applying a greater variable step size value during a first time period where a double talk condition is present in the input signal, compared to a second time period where the double talk condition is present in the input signal.
18 . The method of claim 11 , further comprising executing an acoustic echo canceler (AEC) operation to determine a residual echo value, by subtracting a product of the total filter weight and a reference signal from the input signal received via the multiple microphones.
19 . The method of claim 11 , wherein adapting the orthogonal domain filter weight and adapting the parallel domain filter weight includes using at least one of a normalized least mean square (NLMS), a recursive least squares (RLS) or an affine projection.
20 . The method of claim 11 , wherein the multiple microphones are arranged in a linear array within the vehicle.

Description

INTRODUCTION The information provided in this section is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present disclosure. The present disclosure generally relates to vehicle audio systems, including audio signal processing using parallel and orthogonal domain filter weights. During a phone call, a double talk scenario may occur when both a far end talker and a near end talker speak simultaneously. During a double talk event, an acoustic echo canceler in a speech processing chain may converge to a wrong solution, which may cause artifacts such as cancellation of a desired signal, musical tones, and a reverberation effect on an output of the acoustic echo canceler where the original sound is heard along with a delayed version of the same sound. SUMMARY An example vehicle audio system includes at least one vehicle speaker configured to generate audio in an interior of a vehicle, multiple microphones each configured to obtain audio within the interior of the vehicle, and a vehicle control module configured to receive an input signal via the multiple microphones, split the input signal received via the multiple microphones into a parallel domain signal and an orthogonal domain signal, select a constant step size value for an orthogonal domain filter weight and a variable step size value for a parallel domain filter weight, adapt the orthogonal domain filter weight according to the orthogonal domain signal and the constant step size value, adapt the parallel domain filter weight according to the parallel domain signal and the variable step size value, combine the adapted orthogonal domain filter weight and the adapted parallel domain filter weight to define a total filter weight, and apply the total filter weight to the received input signal to perform a signal processing operation on the received input signal, prior to audio output of the received input signal. In some examples, the vehicle control module is configured to control the at least one vehicle speaker to output an audio signal based on the input signal as modified by the total filter weight. In some examples, the vehicle control module is configured to split the input signal into the parallel domain signal and the orthogonal domain signal by applying a parallel projection to the input signal received via the multiple microphones, and applying an orthogonal projection to the input signal received via the multiple microphones. In some examples, the vehicle control module is configured to obtain a source signal steering vector according to at least one of a beamformer parameter and a specified tuning state parameter, and calculate the parallel projection and the orthogonal projection based on the source signal steering vector. In some examples, the parallel projection is defined parallel to a target near end audio source. In some examples, the orthogonal projection is defined orthogonal to a target near end audio source. In some examples, the vehicle control module is configured to apply a greater variable step size value during a first time period where a double talk condition is present in the input signal, compared to a second time period where the double talk condition is present in the input signal. In some examples, the vehicle control module is configured to execute an acoustic echo canceler (AEC) operation to determine a residual echo value, by subtracting a product of the total filter weight and a reference signal from the input signal received via the multiple microphones. In some examples, the vehicle control module is configured to adapt the orthogonal domain filter weight and adapt the parallel domain filter weight using at least one of a normalized least mean square (NLMS), a recursive least squares (RLS) or an affine projection. In some examples, the multiple microphones are arranged in a linear array within the vehicle. An example method of processing audio signals in a vehicle interior includes receiving, by a vehicle control module, an input signal from multiple microphones, each of the multiple microphones configured to obtain audio within an interior of a vehicle, splitting the input signal received via the multiple microphones into a parallel domain signal and an orthogonal domain signal, selecting a constant step size value for an orthogonal domain filter weight and a variable step size value for a parallel domain filter weight, adapting the orthogonal domain filter weight according to the orthogonal domain signal and the constant step size value, adapting the parallel domain filter weight according to the parallel domain signal and the variable step size value, combining the adapted orthogonal domain filter weight and the adapted parallel domain filt