JP-2026514450-A - Method and apparatus for external direction control for conversational immersive audio

Abstract

Various embodiments describe methods and apparatus for external direction control for conversational immersive audio. An exemplary apparatus includes at least one processor and at least one non-temporary memory for storing instructions, which, when executed by at least one processor, cause the apparatus to: receive external direction information, receive external direction control information, select an external direction modification, modify the rendering direction of the spatially rendered direction according to the selected external direction modification, and render the spatial audio according to the modified rendering direction.

Inventors

• メイト スジート シャームスンダール
• パユネン ラウロス
• ラークソネン ラッセ ユハニ

Assignees

• ノキア テクノロジーズ オサケユイチア

Dates

Publication Date

20260511

Application Date

20240312

Priority Date

20230406

Claims (20)

1. It is a device, At least one processor, The device comprises at least one non-temporary memory for storing instructions, and when an instruction is executed by the at least one processor, the device: Receiving external information, Receiving external direction control information, Selecting external direction correction, In accordance with the selected external direction correction, the rendering direction of the spatially rendered direction is corrected, and A device for rendering spatial audio according to the aforementioned modified rendering direction.
2. The apparatus according to claim 1, wherein the external direction control information includes interactive interaction signals for enabling, disabling, or freezing the application of the external direction information.
3. The apparatus according to claim 1, further configured to receive head tracking information, wherein the spatial audio is further rendered based on the head tracking information.
4. The apparatus according to claim 1, wherein the external direction control information includes a head direction flag for freezing the head direction in the last rendered spatial audio direction.
5. The apparatus according to claim 1 or 4, wherein the external direction control information includes a head direction flag for enabling or disabling head tracking.
6. The apparatus according to claim 4, wherein when the head direction flag is set to disable head tracking, head tracking is disabled, and audio is rendered using the disabled head tracking and the corresponding forward direction default.
7. The apparatus according to claim 4, wherein when the head direction flag is set to enable head tracking, head tracking is enabled and audio is rendered based on the head direction.
8. moreover, Reference data is received to define the scene orientation. The apparatus according to claim 1, to which the aforementioned scene direction data can be applied.
9. Furthermore, the apparatus according to any one of claims 1 to 8, which can combine the external direction data and head tracking data.
10. Furthermore, the apparatus according to any one of claims 1 to 9, which can receive an external direction activation time indicating that the external direction information is applied to the current frame or a future frame.
11. Furthermore, the apparatus according to any one of claims 1 to 10, wherein the apparatus receives combined information that affects the external directional information, and the combined information includes two or more combinations of scene directional information provided by a transmitting user device (UE), device directional data provided by the transmitting UE, or local scene directional information provided by a receiving UE.
12. Receiving external information, Receiving external direction control information, Choosing external direction correction, The rendering direction of the spatially rendered direction is modified according to the selected external direction modification, A method comprising rendering spatial audio according to the aforementioned modified rendering direction.
13. The method according to claim 12, wherein the external direction control information includes interactive interaction signals for enabling, disabling, or freezing the application of the external direction information.
14. The method according to claim 12, further comprising receiving head tracking information, wherein the spatial audio is further rendered based on the head tracking information.
15. The method according to claim 12, wherein the external direction control information includes a head direction flag for freezing the head direction in the last rendered spatial audio direction.
16. The method according to claim 12 or 15, wherein the external direction control information includes a head direction flag for enabling or disabling head tracking.
17. The method according to claim 16, wherein when the head direction flag is set to disable head tracking, head tracking is disabled, and audio is rendered using disabled head tracking and the default or corresponding forward direction.
18. The method according to claim 16, wherein when the head direction flag is set to enable head tracking, head tracking is enabled and audio is rendered based on the head direction.
19. Receiving reference data to define the scene orientation, The method according to claim 12, further comprising applying the scene direction data.
20. The method according to any one of claims 12 to 19, further comprising combining the external direction data with head tracking data.

Description

Exemplary and non-limiting embodiments generally relate to immersive audio, and more specifically to external orientation control for conversational immersive audio. It is known for providing immersive audio. The following summary is intended to be illustrative only. This summary is not intended to limit the scope of the claims. The device comprises at least one processor and at least one non-temporary memory for storing instructions. When an instruction is executed by at least one processor, it causes the device to: receive external direction information, receive external direction control information, select an external direction modification, modify the rendering direction of the spatially rendered direction according to the selected external direction modification, and render the spatial audio according to the modified rendering direction. The exemplary device may further include an interactive interaction signal for enabling, disabling, or freezing the application of the external direction information. The exemplary device may further include the device being made to receive head tracking information, and the spatial audio being rendered based on that head tracking information. The exemplary device may further include external directional control information containing a head direction flag for freezing the head direction in the last rendered spatial audio direction. In one embodiment, head tracking is frozen/maintained, and the audio is rendered using the default or corresponding head-tracked forward direction at the time the disabled head tracking and freeze operation is applied. For example, this may be either the previously head-tracked direction when the previous state was enabled, or the default forward direction when the previous state was disabled, in which case there is no change to the rendering. The exemplary device may further include external direction control information that includes a head direction flag to enable or disable head tracking. The exemplary device may further include the fact that, when the head direction flag is set to disable head tracking, head tracking is disabled and audio is rendered using disabled head tracking and the default or corresponding forward direction. The exemplary device may further include the fact that when the head orientation flag is set to enable head tracking, head tracking is enabled and audio is rendered based on head orientation. The exemplary apparatus may further include receiving and applying reference data for defining the scene orientation. The exemplary apparatus may further include the ability to combine external orientation data and head tracking data. The exemplary device may further include receiving an external directional activation time to indicate that external directional information is applied to the current frame or a future frame. The exemplary apparatus may further include the apparatus receiving combined information that affects external directional information, wherein the combined information includes two or more combinations of scene directional information provided by a sender user device (UE), device directional data provided by the sender UE, or local scene directional information provided by a receiver UE. The method includes receiving external direction information, receiving external direction control information, selecting an external direction modification, modifying the rendering direction of the spatially rendered direction according to the selected external direction modification, and rendering the spatial audio according to the modified rendering direction. An exemplary method may further include the external direction control information including interactive interaction signals to enable, disable, or freeze the application of the external direction information. In one embodiment, the external direction control information may be applied by end-user interaction or via application preferences. Examples of interactive interaction signals include, but are not limited to, interactive Boolean interaction signals. The exemplary method may further include receiving head tracking information, and the spatial audio is further rendered based on the head tracking information. An exemplary method may further include external direction control information containing a head direction flag for freezing the head direction in the last rendered spatial audio direction. In one embodiment, head tracking is frozen/maintained, and the audio is rendered using the default or corresponding head-tracked forward direction at the time the disabled head tracking and freeze operation is applied. For example, this may be either the previously head-tracked direction when the previous state was enabled, or the default forward direction when the previous state was disabled, in which case there is no change to the rendering. The exemplary method may further include the external direction control information including a head direction flag to ena