US-12621628-B2 - Systems and methods for providing augmented audio

Abstract

A system for providing spatialized audio in a vehicle, including a vehicle orientation sensor outputting a vehicle orientation signal and being disposed on the vehicle and a controller configured to receive a user orientation signal output from a user orientation sensor being on a wearable that, during use, moves with a first user's head, wherein the controller is further configured to determine an orientation of the user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the user orientation signal, the controller being further configured to output to a first binaural device, according to the orientation of the user's head relative to the vehicle, a first spatial audio signal, such that the first binaural device produces a first spatial acoustic signal perceived by the user as originating from a first virtual source location within a cabin of the vehicle.

Inventors

• Charles Oswald
• Michael S. Dublin

Assignees

• BOSE CORPORATION

Dates

Publication Date

20260505

Application Date

20230613

Claims (18)

1. 1 . A system for providing spatialized audio in a vehicle, comprising: a vehicle orientation sensor outputting a vehicle orientation signal and being disposed on the vehicle; a controller configured to receive a user orientation signal output from a user orientation sensor being disposed on a wearable that, during use, moves with a first user's head, wherein the controller is further configured to determine an orientation of the user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the user orientation signal, the controller being further configured to output to a first binaural device, according to the orientation of the user's head relative to the vehicle, a first spatial audio signal, such that the first binaural device produces a first spatial acoustic signal perceived by the user as originating from a first virtual source location within a cabin of the vehicle; and an error sensor configured to detect the orientation of the user's head relative to the vehicle and to output an error sensor signal, wherein the controller is further configured to correct a drift between the user orientation signal and the vehicle orientation signal according to the orientation of the user's head detected by the error sensor.
2. 2 . The system of claim 1 , wherein the error sensor includes at least one of: time-of-flight sensor, a LIDAR device, a camera, or a microphone disposed on the user's head.
3. 3 . The system of claim 1 , wherein the controller samples the error sensor signal at a rate slower than the rates at which the vehicle orientation signal and the user orientation signal are sampled.
4. 4 . The system of claim 1 , wherein the vehicle orientation sensor comprises a first plurality of sensors, wherein the user orientation sensor comprises a second plurality of sensors, wherein the controller is further configured to correct a drift between the user orientation signal and the vehicle orientation signal according to a measure of similarity between at least one sensor of the first plurality of sensors and one sensor of the second plurality of sensors.
5. 5 . The system of claim 1 , wherein the controller comprises a first controller and a second controller, the first controller receiving the vehicle orientation signal and the user orientation signal and determining the orientation of the user's head relative to the vehicle and outputting a position signal to the second controller, the second controller, receiving the position signal, outputting to the first spatial acoustic signal to the first binaural device.
6. 6 . The system of claim 1 , wherein the wearable is the first binaural device.
7. 7 . The system of claim 1 , further comprising: a plurality of speakers disposed in a perimeter of a cabin of the vehicle, wherein the first spatial audio signal comprises at least an upper range of a first content signal, wherein the controller is further configured to drive the plurality of speakers with a driving signal such that a first bass content of the first content signal is produced in the cabin.
8. 8 . The system of claim 7 , wherein the controller is configured to receive a second user orientation signal output from a second user orientation sensor being disposed on a second wearable that, during use, moves with a second user's head, wherein the controller is further configured to determine an orientation of the second user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the second user orientation signal, the controller being further configured to output to a second binaural device, according to the orientation of the second user's head relative to the vehicle, a second spatial audio signal, such that the second binaural device produces a second spatial acoustic signal perceived by the second user as originating from the first or a second virtual source location within a cabin of the vehicle.
9. 9 . The system of claim 8 , wherein the second spatial audio signal comprises at least an upper range of a second content signal, wherein the controller is further configured to drive the plurality of speakers in accordance with a first array configuration such that the first bass content is produced in a first listening zone within the cabin and in accordance with a second array configuration such that a second bass content of the second content signal produced in a second listening zone within the cabin, wherein in the first listening zone a magnitude of the first bass content is greater than a magnitude of the second bass content and in the second listening zone the magnitude of the second bass content is greater than the magnitude of the first bass content.
10. 10 . The system of claim 1 , wherein the vehicle orientation sensor is: integrated with the vehicle or brought into and fixed to the vehicle by a user.
11. 11 . A method for providing spatialized audio in a vehicle, comprising: receiving a user orientation signal output from a user orientation sensor being disposed on a wearable that, during use, moves with a first user's head; receiving a vehicle orientation signal from a vehicle orientation sensor being disposed on the vehicle; determining an orientation of the user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the user orientation signal; outputting to a first binaural device, according to the orientation of the user's head relative to the vehicle, a first spatial audio signal, such that the first binaural device produces a first spatial acoustic signal perceived by the user as originating from a first virtual source location within a cabin of the vehicle; receiving an error sensor signal output from an error sensor configured to detect the orientation of the user's head relative to the vehicle; and correcting a drift between the user orientation signal and the vehicle orientation signal according to the orientation of the user's head detected by the error sensor.
12. 12 . The method of claim 11 , wherein the error sensor includes at least one of: a time-of-flight sensor, a LIDAR device, a camera, or a microphone disposed on the user's head.
13. 13 . The method of claim 11 , wherein the error sensor signal is sampled at a rate slower than the rates at which the vehicle orientation signal and the user orientation signal are sampled.
14. 14 . The method of claim 11 , further comprising the step of correcting a drift between the user orientation signal and the vehicle orientation signal, wherein the vehicle orientation sensor comprises a first plurality of sensors, wherein the user orientation sensor comprises a second plurality of sensors, wherein the drift is corrected according to a measure of similarity between at least one sensor of the first plurality of sensors and one sensor of the second plurality of sensors.
15. 15 . The method of claim 11 , wherein the wearable is the first binaural device.
16. 16 . The method of claim 11 , further comprising: driving a plurality of speakers with a driving signal such that a first bass content of the first spatial audio signal is produced in the cabin.
17. 17 . The method of claim 16 , further comprising receiving a second user orientation signal output from a second user orientation sensor being disposed on a second wearable that, during use, moves with a second user's head, determining an orientation of the second user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the second user orientation signal, outputting to a second binaural device, according to the orientation of the second user's head relative to the vehicle, a second spatial audio signal, such that the second binaural device produces a second spatial acoustic signal perceived by the second user as originating from the first or a second virtual source location within a cabin of the vehicle.
18. 18 . The method of claim 17 , further comprising: driving the plurality of speakers in accordance with a first array configuration such that the first bass content is produced in a first listening zone within the cabin and in accordance with a second array configuration such that a second bass content of the second spatial audio signal is produced in a second listening zone within the cabin, wherein in the first listening zone a magnitude of the first bass content is greater than a magnitude of the second bass content and in the second listening zone the magnitude of the second bass content is greater than the magnitude of the first bass content.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application Ser. No. 63/366,294, filed on Jun. 13, 2022, and titled “Systems and Methods for Providing Augmented Audio,” which application is herein incorporated by reference in its entirety. BACKGROUND This disclosure generally relates to systems and method for providing augmented audio in a vehicle cabin, and, particularly, to a method of augmenting the bass response of at least one binaural device disposed in a vehicle cabin. SUMMARY All examples and features mentioned below can be combined in any technically possible way. A system for providing spatialized audio in a vehicle, includes: a vehicle orientation sensor outputting a vehicle orientation signal and being disposed on the vehicle; and a controller configured to receive a user orientation signal output from a user orientation sensor being disposed on a wearable that, during use, moves with a first user's head, wherein the controller is further configured to determine an orientation of the user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the user orientation signal, the controller being further configured to output to a first binaural device, according to the orientation of the user's head relative to the vehicle, a first spatial audio signal, such that the first binaural device produces a first spatial acoustic signal perceived by the user as originating from a first virtual source location within a cabin of the vehicle. In an example, the system further includes an error sensor configured to detect the orientation of the user's head relative to the vehicle and to output an error sensor signal, wherein the controller is further configured to correct a drift between the user orientation signal and the vehicle orientation signal according to the orientation of the user's head detected by the error sensor. In an example, the error sensor includes at least one of: a time-of-flight sensor, a LIDAR device, a camera, or a microphone disposed on the user's head. In an example, the controller samples the error sensor signal at a rate slower than the rates at which the vehicle orientation signal and the user orientation signal are sampled. In an example, the vehicle orientation sensor comprises a first plurality of sensors, wherein the user orientation sensor comprises a second plurality of sensors, wherein the controller is further configured to correct a drift between the user orientation signal and the vehicle orientation signal according to a measure of similarity between at least one sensor of the first plurality of sensors and one sensor of the second plurality of sensors. In an example, the controller comprises a first controller and a second controller, the first controller receiving the vehicle orientation signal and the user orientation signal and determining the orientation of the user's head relative to the vehicle and outputting a position signal to the second controller, the second controller, receiving the position signal, outputting to the first spatial acoustic signal to the first binaural device. In an example, the wearable is the first binaural device. In an example, the system further includes a plurality of speakers disposed in a perimeter of a cabin of the vehicle, wherein the first spatial audio signal comprises at least an upper range of a first content signal, wherein the controller is further configured to drive the plurality of speakers with a driving signal such that a first bass content of the first content signal is produced in the cabin. In an example, the controller is configured to receive a second user orientation signal output from a second user orientation sensor being disposed on a second wearable that, during use, moves with a second user's head, wherein the controller is further configured to determine an orientation of the second user's head relative to the vehicle based, at least, on a difference between the vehicle orientation signal and the second user orientation signal, the controller being further configured to output to a second binaural device, according to the orientation of the second user's head relative to the vehicle, a second spatial audio signal, such that the second binaural device produces a second spatial acoustic signal perceived by the second user as originating from the first or a second virtual source location within a cabin of the vehicle. In an example, the second spatial audio signal comprises at least an upper range of a second content signal, wherein the controller is further configured to drive the plurality of speakers in accordance with a first array configuration such that the first bass content is produced in a first listening zone within the cabin and in accordance with a second array configuration such that a second bass content of the second content signal produced in a second listening zone within the cabin, wherein in the