CN-122003880-A - Sound signal processing method, computer program, and sound signal processing device

CN122003880ACN 122003880 ACN122003880 ACN 122003880ACN-122003880-A

Abstract

A sound signal processing method is a sound signal processing method executed by a sound signal processing apparatus, and includes an acquisition step of acquiring a sound signal whose attribute includes information indicating an indirect sound, a1 st calculation step of calculating a1 st sound volume based on the indirect sound volume obtained by correcting gain characteristics of each predetermined frequency bandwidth of the indirect sound by frequency characteristics indicating auditory sensitivity based on the 1 st correction characteristics and the acquired sound signal, a2 nd calculation step of calculating a2 nd sound volume based on the direct sound volume when the indirect sound reaches a listening position, the direct sound volume being a sound volume when the direct sound reaches the listening position, based on the calculated 2 nd sound volume to the calculated 1 st sound volume ratio, and a time difference between the direct sound and the indirect sound arrival, and a reproduction step of selecting whether to output an output signal based on the acquired sound signal, and outputting the output signal when the output signal is selected.

Inventors

MIYASAKA SHUJI
Nakayasu Kota
ISHIKAWA TOMOKAZU
EHARA HIROYUKI
Yu Zuo see the sun
Sakamoto Naritsugu

Assignees

松下电器（美国）知识产权公司

Dates

Publication Date: 20260508
Application Date: 20241004
Priority Date: 20231006

Claims (13)

1. A sound signal processing method performed by a sound signal processing apparatus, comprising: An acquisition step of acquiring a sound signal including attribute information for specifying an attribute of the sound signal, the attribute including information indicating indirect sound; A1 st calculation step of calculating a1 st sound volume based on an indirect sound volume obtained by correcting gain characteristics for each predetermined frequency bandwidth of the indirect sound by frequency characteristics indicating auditory sensitivity, based on a1 st correction characteristic obtained by the indirect sound volume when the indirect sound reaches a listening position, which is a position where a listener is located, and the acquired sound signal; A 2 nd calculation step of calculating a 2 nd sound volume based on a direct sound volume, the direct sound volume being a sound volume at which a direct sound related to the indirect sound reaches the listening position; a selection processing step of selecting whether to output an output signal based on the acquired sound signal based on a volume ratio of the calculated 2 nd volume to the calculated 1 st volume and a time difference between arrival of the direct sound and the indirect sound, and And a reproduction step of outputting the output signal when the output signal is selected.
2. The sound signal processing method according to claim 1, wherein, In the 2 nd calculation step, the 2 nd sound volume is calculated based on a2 nd correction characteristic obtained by correcting gain characteristics for each prescribed frequency bandwidth of the direct sound by frequency characteristics representing auditory sensitivity.
3. The sound signal processing method according to claim 1 or 2, wherein, The frequency characteristic representing the hearing sensitivity is a frequency characteristic representing the volume sensitivity of the listener.
4. A sound signal processing method according to claim 3, wherein, The frequency characteristic representing the volume sensitivity is a frequency characteristic corresponding to the inverse of an equal loudness curve.
5. A sound signal processing method according to claim 3, wherein, The frequency characteristic representing the volume sensitivity is an a characteristic.
6. A sound signal processing method according to claim 3, wherein, The frequency characteristic representing the volume sensitivity is an inverse characteristic of a frequency characteristic of a minimum discrimination angle of a sound source position.
7. A sound signal processing method performed by a sound signal processing apparatus, comprising: An acquisition step of acquiring a sound signal including attribute information for specifying an attribute of the sound signal, the attribute including information indicating a reflected sound that is a sound reflected by a reflecting object; A selection processing step of selecting whether or not to output an output signal based on the acquired sound signal based on a volume ratio of a volume of the reflected sound when the acquired sound signal indicates that the reflected sound reaches a listening position, which is a position where a listener is located, to a volume of the direct sound when the direct sound reaches the listening position, a time difference between the arrival of the direct sound and the reflected sound, and a reflection coefficient feature amount determined based on a reflection coefficient of the reflection object, and And a reproduction step of outputting the output signal when the output signal is selected.
8. The sound signal processing method according to claim 7, wherein, The reflection coefficient characteristic amount is a characteristic amount indicating the degree of flatness of the frequency characteristic of the reflection coefficient.
9. A sound signal processing method performed by a sound signal processing apparatus, comprising: An acquisition step of acquiring a sound signal; A 3 rd calculation step of calculating a predetermined sound volume based on a sound volume at a listening position, which is a position where the sound arrives at the listener, based on a predetermined correction characteristic obtained by correcting gain characteristics for each predetermined frequency bandwidth of the sound represented by the acquired sound signal by a frequency characteristic representing auditory sensitivity, and the acquired sound signal; A selection processing step of selecting whether to output an output signal based on the acquired sound signal based on the calculated predetermined volume, and And a reproduction step of outputting the output signal when the output signal is selected.
10. A sound signal processing method performed by a sound signal processing apparatus, comprising: An acquisition step of acquiring a sound signal including attribute information for specifying an attribute of the sound signal; A1 st calculation step of calculating a1 st sound volume based on an indirect sound volume based on a1 st correction characteristic obtained by correcting gain characteristics for each predetermined frequency bandwidth of a sound signal obtained by obtaining attribute information of the sound signal including information indicating the indirect sound, based on frequency characteristics indicating auditory sensitivity, and gain information of the indirect sound, the indirect sound volume being a sound volume at which the indirect sound reaches a listening position which is a position where a listener is located; A 2 nd calculation step of calculating a 2 nd sound volume based on a direct sound volume when the listening position is reached, based on a 2 nd correction characteristic obtained by correcting gain characteristics of each prescribed frequency bandwidth of the direct sound with respect to the indirect sound by a frequency characteristic indicating auditory sensitivity and gain information of the direct sound; a selection processing step of selecting whether to output an output signal based on the acquired sound signal based on a volume ratio of the calculated 2 nd volume to the calculated 1 st volume and a time difference between arrival of the direct sound and the indirect sound, and And a reproduction step of outputting the output signal when the output signal is selected.
11. The sound signal processing method as claimed in claim 10, wherein, Gain characteristics for each prescribed frequency bandwidth of the indirect sound are maintained as the attribute information for the indirect sound, Gain information about the indirect sound is held as the attribute information about the indirect sound, Gain characteristics for each prescribed frequency bandwidth of the direct sound are maintained as the attribute information for the direct sound, Gain information about the direct sound is held as the attribute information about the direct sound.
12. A computer program for causing a computer to execute the sound signal processing method according to any one of claims 1 to 11.
13. A sound signal processing device is provided with: an acquisition unit that acquires a sound signal including attribute information for specifying an attribute of the sound signal, the attribute including information indicating indirect sound; a1 st calculation unit that calculates a1 st sound volume based on an indirect sound volume obtained by correcting gain characteristics for each predetermined frequency bandwidth of the indirect sound by frequency characteristics indicating auditory sensitivity, based on a1 st correction characteristic obtained by the indirect sound volume when the indirect sound reaches a listening position, which is a position where a listener is located, and the acquired sound signal; a2 nd calculation unit that calculates a2 nd sound volume based on a direct sound volume at which the direct sound of the indirect sound reaches the listening position; A selection processing unit for selecting whether to output an output signal based on the acquired sound signal based on a volume ratio of the calculated 2 nd volume to the calculated 1 st volume and a time difference between arrival of the direct sound and the indirect sound, and And a reproduction unit which outputs the output signal when the output signal is selected.

Description

Sound signal processing method, computer program, and sound signal processing device Technical Field The present disclosure relates to a sound signal processing method and the like. Background In recent years, products and services using ER (Extended Reality) including VR (Virtual Reality), AR (Augmented Reality: augmented Reality) and MR (Mixed Reality) (which may also be expressed as XR) are becoming popular. Accordingly, in a virtual space or a real space, an importance of a sound signal processing technique for providing an immersive audio (IMMERSIVE AUDIO) to a listener by giving an acoustic effect to sound emitted from a virtual sound source according to an environment of the space is increasing. In addition, the listener may also appear as a listener (listener) or user. Further, patent document 1, patent document 2, patent document 3, and non-patent document 1 show techniques related to the audio signal processing method and the like of the present disclosure. Prior art literature Patent literature Patent document 1 Japanese patent application No. 6288100 Patent document 2 Japanese patent application laid-open No. 2019-22049 Patent document 3 International publication No. 2021/180938 Non-patent literature Non-patent document 1, B.C.J.Moore, auditory psychology outline, chengsu study, 1994/4/20, chapter 6: spatial perception, p.225 Disclosure of Invention Problems to be solved by the invention However, in the technique disclosed in patent document 1, it is sometimes difficult to appropriately reduce the amount of computation and the computation load in consideration of the auditory sensitivity. Accordingly, an object of the present disclosure is to provide a sound signal processing method and the like capable of appropriately reducing the amount of computation and the computation load in consideration of the auditory sensitivity. Means for solving the problems A sound signal processing method according to one embodiment of the present disclosure is a sound signal processing method executed by a sound signal processing apparatus, and includes an acquisition step of acquiring a sound signal including attribute information for specifying an attribute of the sound signal, the attribute including information indicating an indirect sound, a1 st calculation step of calculating a1 st sound volume based on an indirect sound volume obtained by correcting gain characteristics for each predetermined frequency bandwidth related to the indirect sound by frequency characteristics indicating auditory sensitivity based on a1 st correction characteristic and the acquired sound signal, the indirect sound volume being a sound volume when the indirect sound reaches a listening position, a2 nd calculation step of calculating a2 nd sound volume based on a direct sound volume when the indirect sound reaches the listening position, a selection processing step of selecting whether or not to output the acquired sound signal based on a calculated volume ratio of the 2 nd sound volume to the calculated 1 st sound volume and a time difference between the direct sound and the indirect sound arrival, and a selection processing step of outputting the output signal based on the output condition of the acquired sound signal. The sound signal processing method according to one aspect of the present disclosure is a sound signal processing method executed by a sound signal processing apparatus, and includes an acquisition step of acquiring a sound signal including attribute information for specifying an attribute of the sound signal, the attribute including information indicating a reflected sound that is a sound reflected by a reflection object, a selection processing step of selecting whether to output an output signal based on the acquired sound signal, based on a volume ratio of a reflected sound volume when the reflected sound indicated by the acquired sound signal reaches a listening position, which is a position where a listener is located, to a direct sound volume when the direct sound reaches the listening position, a time difference between arrival of the direct sound and the reflected sound, and a reflection coefficient feature amount determined based on a reflection coefficient of the reflection object, and a reproduction step of outputting the output signal when the output signal is selected. The sound signal processing method according to one embodiment of the present disclosure is a sound signal processing method executed by a sound signal processing apparatus, and includes an acquisition step of acquiring a sound signal, a3 rd calculation step of calculating a predetermined sound volume based on a sound volume at a listening position, which is a position where the sound arrives at a listener, based on a predetermined correction characteristic obtained by correcting a gain characteristic for each predetermined frequency bandwidth of the sound represented by the acquired sound signal with respect to a frequency characteristi