CN-122027972-A - Audio playing method and VR system
Abstract
The present disclosure relates to an audio playing method and VR system, the method comprising a processing device determining an original audio; the original audio is audio played when the VR headset is located at a reference position, the processing device determines the position relation between the VR headset and the reference position, the target playing parameters of the original audio are determined based on the position relation between the VR headset and the reference position, the processing device adjusts the original audio based on the target playing parameters to obtain target audio, the processing device sends the target audio to the playing device, the playing device comprises sound equipment and/or a built-in earphone in the VR headset, and the playing device plays the target audio. The method can realize that no matter which position in the target physical space the user is located, the sound heard by the user is always consistent with the sound source position and the spatial characteristic in the virtual scene, thereby forming a vivid hearing effect and improving the immersion of the user in virtual reality experience.
Inventors
- WANG JIAQI
- MA XIAOXIONG
- SUN FENGGUO
Assignees
- 北京奇艺世纪科技有限公司
Dates
- Publication Date
- 20260512
- Application Date
- 20260116
Claims (11)
- 1. The audio playing method is suitable for a VR system, the VR system comprises VR head-mounted equipment, processing equipment and sound equipment, the VR head-mounted equipment is in communication connection with the processing equipment, the processing equipment is in communication connection with the sound equipment, the sound equipment is deployed in a target physical space, the target physical space comprises a reference position, and the method comprises the following steps: the processing device determines original audio, wherein the original audio is audio played when the VR headset is positioned at the reference position; The processing device determines the position relation between the VR headset and the reference position, and determines target playing parameters of the original audio based on the position relation between the VR headset and the reference position; the processing equipment adjusts the original audio based on the target playing parameters to obtain target audio; The processing device sends the target audio to a playing device, wherein the playing device comprises an audio device and/or a built-in earphone in the VR headphone; The playing device plays the target audio.
- 2. The method of claim 1, wherein the reference location has an associated reference pose, wherein the processing device determining target playback parameters for the original audio based on a positional relationship of the VR headset and the reference location comprises: The processing device determining a pose of the VR headset; the processing device determining a difference in the pose of the VR headset and the reference pose; the processing device determines target playback parameters of the original audio based on a positional relationship of the VR headset and the reference position and a difference in pose of the VR headset and the reference pose.
- 3. The method of claim 2, wherein the reference pose comprises a reference orientation, wherein the pose of the VR headset comprises an orientation of the VR headset, wherein the positional relationship of the VR headset and the reference position comprises a distance of the VR headset from the reference position; the processing device determining a difference between the pose of the VR headset and the reference pose includes the processing device determining an included angle of an orientation of the VR headset and the reference orientation; The processing device determines target playing parameters of the original audio based on the position relation between the VR head-mounted device and the reference position and the difference between the gesture of the VR head-mounted device and the reference gesture, and the processing device determines the target playing parameters of the original audio based on the distance between the VR head-mounted device and the reference position and the included angle between the direction of the VR head-mounted device and the reference direction.
- 4. A method according to claim 3, wherein the target play parameter comprises volume; The smaller the distance between the VR headset and the reference position, the larger the volume under the condition that the included angle between the VR headset and the reference direction is fixed; And under the condition that the distance between the VR headset and the reference position is fixed, the smaller the included angle between the direction of the VR headset and the reference direction is, the larger the volume is.
- 5. The method of claim 1, wherein the target playback parameters include a volume, wherein the number of playback devices is greater than or equal to 2, wherein the processing device determining the target playback parameters for the original audio based on the positional relationship of the VR headset and the reference location comprises: The processing device determines a first volume of the original audio based on a positional relationship of the VR headset and the reference location: The processing equipment projects a target sounding object in the target physical space to obtain the position of the target sounding object in the target physical space, wherein the target sounding object is a sounding object simulated by original audio; the processing device determines a first device and a second device in the playing device based on the position of the target sound generating object in the target physical space and the position of the playing device in the target physical space, wherein the first device and the target sound generating object are positioned on the same side of the VR headset device; the processing equipment increases the first volume to obtain a second volume, and adjusts the original audio based on the second volume to obtain a first target audio; the processing equipment reduces the first volume to obtain a third volume, and adjusts the original audio based on the third volume to obtain a second target audio; The processing device sends the first target audio to the first device and the second target audio to the second device; The playing device plays the target audio, wherein the playing device comprises the first device playing the first target audio and the second device playing the second target audio.
- 6. The method of claim 1, wherein the number of playback devices is a plurality, wherein the locations of the plurality of playback devices in the target physical space are different, and wherein the method further comprises: the processing equipment projects a target sounding object in the target physical space to obtain the position of the target sounding object in the target physical space, wherein the target sounding object is a sounding object simulated by the original audio; The processing device determines a space range corresponding to each playing device based on the position of each playing device in the target physical space; The processing device determines a target playing device in the playing device based on the position of the target sounding object in the target physical space, wherein the target sounding object is in a space range corresponding to the target playing device; The processing device sends the target audio to the playing device, and the processing device sends the target audio to the target playing device; the target audio is played by the playing device, wherein the target audio is played by the target playing device.
- 7. The method of claim 1, wherein the number of original audio is a plurality of, wherein the plurality of original audio correspond to different reference positions, wherein the processing device determines a positional relationship between the VR headset and the reference positions, and wherein the processing device determines a target playing parameter of the original audio based on the positional relationship between the VR headset and the reference positions, wherein the processing device adjusts the original audio based on the target playing parameter to obtain target audio, and wherein the processing device comprises: The processing device respectively determines corresponding target playing parameters for the original audios based on the position relation between the VR headset and the reference positions, and adjusts the original audios based on the target playing parameters; And the processing equipment synthesizes the second audio which is required to be played by the same playing equipment to obtain target audio.
- 8. The method of claim 1, wherein the virtual scene and/or the target physical space comprises at least one trigger source, the trigger source having first audio bound thereto, the virtual scene being a scene created by an image displayed by the VR headset, the processing device determining the original audio comprising: the processing device responds to the triggering operation of the triggering source by a user, and takes the first audio bound by the triggering source triggered by the user as original audio.
- 9. The method of claim 1, wherein the VR system includes a plurality of VR headsets, wherein the processing device determines a positional relationship of the VR headsets to the reference position, and wherein determining the target play parameters of the original audio based on the positional relationship of the VR headsets to the reference position comprises: The processing device determines a reference position based on the positions of the VR headsets in a target physical space, wherein the reference position is the position of one of the VR headsets in the target physical space, or is the average position of the VR headsets in the target physical space; The processing device determines a target playing parameter of the original audio based on the position relation between the reference position and the reference position.
- 10. The method of claim 1, wherein the step of determining the position of the substrate comprises, The processing device is integrated in the VR headset, the VR headset itself performs the relevant computation of the virtual reality function, or The processing device is integrated in a computing device which is separated from the VR head-mounted device and is in communication connection with the VR head-mounted device, the computing device executes relevant computation of the virtual reality function, and the computing result is provided to the VR head-mounted device.
- 11. The VR system is characterized by comprising VR head-mounted equipment, processing equipment and sound equipment, wherein the VR head-mounted equipment is in communication connection with the processing equipment, and the processing equipment is in communication connection with the sound equipment; the processing device determines original audio, wherein the original audio is audio played when the VR headset is positioned at the reference position; The processing device determines the position relation between the VR headset and the reference position, and determines target playing parameters of the original audio based on the position relation between the VR headset and the reference position; the processing equipment adjusts the original audio based on the target playing parameters to obtain target audio; The processing device sends the target audio to a playing device, wherein the playing device comprises an audio device and/or a built-in earphone in the VR headphone; The playing device plays the target audio.
Description
Audio playing method and VR system Technical Field The disclosure relates to the technical field of virtual reality, in particular to an audio playing method and a VR system. Background VR large space experience items (such as VR theme parks, large-scale close-room escapes, full-feeling movies, interactive exhibitions, etc.) are a novel entertainment way based on virtual reality technology. It allows the user to move freely in a large physical space while wearing VR devices, enjoying the exploration process in the virtual environment. In related art, VR large space experience projects typically rely on VR devices to play directional or ambient sound effects with their own headphones. The sound effect formed by the method cannot simulate the natural diffusion and attenuation effects of sound in a large space, and cannot simulate the sound effect change perceived by a user along with human body movement in a physical space, so that the sound is disjointed from a virtual scene, the shock and the presence are lacked, and the immersion of the user in the virtual reality experience is weakened. Disclosure of Invention In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an audio playing method and a VR system. In a first aspect, the present disclosure provides an audio playing method, where the audio playing method is applicable to a VR system, where the VR system includes a VR headset, a processing device, and an audio device, where the VR headset is communicatively connected to the processing device, and the processing device is communicatively connected to the audio device, where the audio device is deployed in a target physical space, and where the target physical space includes a reference position, and where the method includes: the processing device determines original audio, wherein the original audio is audio played when the VR headset is positioned at the reference position; The processing device determines the position relation between the VR headset and the reference position, and determines target playing parameters of the original audio based on the position relation between the VR headset and the reference position; the processing equipment adjusts the original audio based on the target playing parameters to obtain target audio; The processing device sends the target audio to a playing device, wherein the playing device comprises an audio device and/or a built-in earphone in the VR headphone; The playing device plays the target audio. In a second aspect, the disclosure further provides a VR system, which includes a VR headset, a processing device, and an audio device, where the VR headset is communicatively connected with the processing device, and the processing device is communicatively connected with the audio device; the processing device determines original audio, wherein the original audio is audio played when the VR headset is positioned at the reference position; The processing device determines the position relation between the VR headset and the reference position, and determines target playing parameters of the original audio based on the position relation between the VR headset and the reference position; the processing equipment adjusts the original audio based on the target playing parameters to obtain target audio; The processing device sends the target audio to a playing device, wherein the playing device comprises an audio device and/or a built-in earphone in the VR headphone; The playing device plays the target audio. Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: According to the technical scheme, the processing device is arranged to determine original audio, the original audio is audio played when the VR headset is located at a reference position, the processing device determines the position relation between the VR headset and the reference position, the processing device determines target playing parameters of the original audio based on the position relation between the VR headset and the reference position, the processing device adjusts the original audio based on the target playing parameters to obtain target audio, the processing device sends the target audio to the playing device, the playing device comprises sound equipment and/or built-in headphones in the VR headset, and the playing device plays the target audio. The essence of the method is that the original audio is dynamically adjusted according to the position relation between the actual position of the user and the reference position, so that no matter where the user is located in the target physical space, the sound heard by the user is always consistent with the position of the sound source and the spatial characteristics in the virtual scene, a vivid hearing effect is formed, and the immersion of the user in the virtual reality experience is improved.