Search

CN-121570818-B - Real-time feedback method of drifting river game system based on holographic image interaction

CN121570818BCN 121570818 BCN121570818 BCN 121570818BCN-121570818-B

Abstract

The invention discloses a real-time feedback method of a drifting river game system based on holographic image interaction, which relates to the technical field of virtual interaction, and comprises the steps of calling a graphic rendering tool to render a virtual interaction object which is collided in real time according to ambient light data, calculating pixel-level color and brightness values of the virtual interaction object to generate a target holographic image frame, calculating a mechanical effect when a virtual interaction ray collides with the virtual interaction object according to collision point coordinate information, mapping the mechanical effect into a physical disturbance parameter of a drifting river game carrier, generating a physical feedback control instruction, sending the physical feedback control instruction to physical feedback equipment, driving the physical feedback equipment to generate physical environment disturbance synchronous with the target holographic image frame and acting on the drifting river game carrier.

Inventors

  • CHEN XU

Assignees

  • 北京湖升控股集团有限公司

Dates

Publication Date
20260512
Application Date
20251125

Claims (9)

  1. 1. The real-time feedback method of the drifting river game system based on holographic image interaction is characterized by comprising the following steps of, Collecting three-dimensional point cloud data of the drifting river, modeling the three-dimensional point cloud data of the drifting river into a virtual scene model of the drifting river by using a curved surface reconstruction algorithm, and collecting environment light data on the drifting river and interaction data of tourists and an interaction device; Based on the interaction data of the tourist and the interaction device, identifying the interaction action of the tourist and judging the occurrence of an interaction event, and generating a virtual interaction ray by taking the position of the interaction device as a starting point when judging the occurrence of the interaction event; performing collision detection on the virtual interaction rays and virtual interaction objects in the drift river virtual scene model, and recording coordinate information of collision points when collision is detected; According to the ambient light data, calling a graphic rendering tool to render the virtual interactive object which is collided in real time, calculating the pixel-level color and brightness value of the virtual interactive object, and generating a target holographic image frame; according to the coordinate information of the collision point, calculating the mechanical effect when the virtual interaction ray collides with the virtual interaction object, wherein the mechanical effect specifically comprises the following steps: Collecting normal vectors of the virtual interactive object surface at the collision point from the coordinate information of the collision point, and calculating impulse generated by collision by combining impulse theorem, wherein the method specifically comprises the following steps: positioning a triangular patch where the collision point is located in the drifting river virtual scene model according to the coordinate information of the collision point; Determining a normal vector of a virtual interaction object surface at the collision point according to the geometric definition of the triangular patch where the collision point is located, and then calculating impulse generated by collision by applying impulse theorem; Calculating the change of the linear speed and the angular speed of the virtual interactive object by using impulse generated by collision, and obtaining a mechanical effect, wherein the method specifically comprises the following steps of: Multiplying impulse generated by collision with a normal vector of the surface of the virtual interactive object at the collision point to obtain linear momentum change, and carrying out quotient operation on the linear momentum change and the mass of the virtual interactive object to obtain linear speed change of the virtual interactive object, wherein the moment is equal to a cross product of the vector of the collision point and the impulse; Performing quotient operation on the moment and the moment inertia of the virtual interactive object to obtain angular acceleration change of the virtual interactive object, and performing time integration on the angular acceleration change to obtain angular velocity change of the virtual interactive object; the linear velocity change and the angular velocity change of the virtual interactive object together form a mechanical effect describing the change of the motion state of the virtual interactive object; mapping the mechanical effect into a physical disturbance parameter to the drifting river playing carrier to generate a physical feedback control instruction; And sending a physical feedback control instruction to physical feedback equipment, driving the physical feedback equipment to generate physical environment disturbance synchronous with the target holographic image frame, and acting on the drifting river playing carrier.
  2. 2. The method for real-time feedback of a drifting river game system based on holographic image interaction of claim 1, wherein the method is characterized in that three-dimensional point cloud data of the drifting river are collected, and the three-dimensional point cloud data of the drifting river are modeled as a drifting river virtual scene model by using a curved surface reconstruction algorithm, and specifically comprises the following steps: In the initial stage of the drifting river game, a three-dimensional laser scanner is used for carrying out multi-site scanning on a real drifting river channel, three-dimensional point cloud data of the drifting river are obtained, and registration processing is carried out on the three-dimensional point cloud data of the drifting river; Reconstructing the three-dimensional point cloud data of the drifting river after registration into a three-dimensional grid model of the drifting river by using a poisson curved surface reconstruction algorithm; Simplifying the three-dimensional grid model of the drifting river, reducing the number of triangular patches on the premise of maintaining geometric characteristics, marking the boundaries of the virtual interaction area and the feasible area on the simplified three-dimensional grid model of the drifting river, and obtaining the virtual scene model of the drifting river.
  3. 3. The method for real-time feedback of a drifting river game system based on holographic image interaction of claim 2, wherein said ambient light data on the drifting river comprises illumination intensity, light source main direction vector and color temperature; The interaction data of the tourist and the interaction device comprise space pose data and interaction trigger signals of the interaction device.
  4. 4. The method for real-time feedback of a drift river game system based on holographic image interaction of claim 3, wherein the interactive data based on the tourist and the interactive device identifies the interaction of the tourist and judges the occurrence of the interaction event, and when judging the occurrence of the interaction event, the method generates a virtual interaction ray by taking the position of the interactive device as a starting point, specifically comprises the following steps: continuously monitoring the state of the interaction trigger signal according to the interaction data of the tourist and the interaction device, and judging the occurrence of an interaction event when the interaction trigger signal is detected to be converted from an invalid state to an effective state; After the interaction event occurs, reading space pose data of the interaction device; the space pose data of the interaction device comprise position coordinates and orientation angles; And taking the position coordinates as the origin of the virtual interaction rays, taking the direction of the orientation angle as the direction of the virtual interaction rays, and generating the virtual interaction rays by instantiation in the virtual scene model of the drifting river.
  5. 5. The method for real-time feedback of a drifting river game system based on holographic image interaction of claim 4, wherein said collision detection is performed between the virtual interaction ray and the virtual interaction object in the drifting river virtual scene model, and when the collision is detected, the coordinate information of the collision point is recorded, specifically: performing collision detection on the virtual interaction rays and virtual interaction objects in the drift river virtual scene model; In the collision detection process, calculating the spatial position relation between a mathematical equation of the virtual interaction ray and the triangular patch geometry of the virtual interaction object, and judging that the collision is detected when the calculation result shows that the intersection point exists between the virtual interaction ray and the triangular patch geometry of the virtual interaction object; After collision occurs, calculating the intersection point coordinates of the virtual interaction ray and the triangular patch geometry of the virtual interaction object, and recording the intersection point coordinates as collision point coordinate information.
  6. 6. The method for real-time feedback of a drift river game system based on holographic image interaction of claim 5, wherein said generating a target holographic image frame comprises calling a graphic rendering tool to render a virtual interactive object in real time according to ambient light data, and calculating pixel-level color and brightness values of the virtual interactive object, specifically: Calculating diffuse reflection illumination components of each pixel point on the surface of the virtual interactive object according to the main direction vector of the light source; and according to the diffuse reflection illumination component, adjusting the spectral energy distribution of the pixel points by using the color temperature, integrating the ambient light shielding and specular reflection component by using a graphic rendering tool, and calculating the final pixel-level color and brightness value of the virtual interactive object surface pixel by pixel to obtain the target holographic image frame.
  7. 7. The method for real-time feedback of a drift river game system based on holographic image interaction of claim 6, wherein said mapping the mechanical effect to a physical disturbance parameter of the drift river play carrier is calculating the physical disturbance parameter of the drift river play carrier in the virtual water body according to the linear velocity change and the angular velocity change of the virtual interactive object in the mechanical effect.
  8. 8. The method for real-time feedback of a drift river game system based on holographic image interaction of claim 7, wherein said generating physical feedback control instructions is encoding physical disturbance parameters as instructions recognizable and executable by a physical feedback device.
  9. 9. The method for real-time feedback of a drift river game system based on holographic image interaction of claim 8, wherein the sending of the physical feedback control command to the physical feedback device drives the physical feedback device to generate physical environment disturbance synchronous with the target holographic image frame and acts on the drift river play carrier comprises the following steps: transmitting the physical feedback control instruction to the physical feedback equipment through a wireless communication link; After receiving and analyzing the physical feedback control instruction, the physical feedback equipment forms a wave sequence in the river channel, and after synchronizing the target holographic image frame with the wave sequence, the physical feedback equipment generates thrust and shaking effects on the drifting river playing carrier.

Description

Real-time feedback method of drifting river game system based on holographic image interaction Technical Field The invention relates to the technical field of virtual interaction, in particular to a real-time feedback method of a drifting river game system based on holographic image interaction. Background With the continuous breakthrough of virtual reality, augmented reality and holographic display methods, immersive interactive entertainment is increasingly wide, a drifting river is used as a classical water project with leisure and interestingness, advanced digital interaction methods are gradually fused in recent years, the method evolves towards the intelligent and interactive directions, currently, a mainstream scheme provides dynamic visual contents for tourists through high-brightness projection mapping, meanwhile, an underwater vibration unit, a directional jet device and a motion platform are integrated, touch and kinesthesia stimulation can be triggered at a specific time sequence, the perception reality of a user on virtual events is enhanced, the interactive dimension and visual expressive force of entertainment are improved, and solid technical support is provided for an immersive drifting river game system. Nevertheless, the real-time feedback method of the existing drifting river game system still has improvement, a fixed animation sequence is adopted to respond to user input, a holographic image cannot be generated according to the interaction position and ambient light, so that visual feedback is disjointed with user operation, and meanwhile, a mapping mechanism of collision mechanics is lacking, so that the motion state of an object in the holographic image is not matched with disturbance of an actual carrier, and immersion experience is destroyed. Disclosure of Invention The present invention has been made in view of the above-described problems occurring in the prior art. Therefore, the invention provides a real-time feedback method of a drifting river game system based on holographic image interaction, which solves the problem of disjoint between visual feedback and user operation. In order to solve the technical problems, the invention provides the following technical scheme: the invention provides a real-time feedback method of a drifting river game system based on holographic image interaction, which comprises the following steps of, Collecting three-dimensional point cloud data of the drifting river, modeling the three-dimensional point cloud data of the drifting river into a virtual scene model of the drifting river by using a curved surface reconstruction algorithm, and collecting environment light data on the drifting river and interaction data of tourists and an interaction device; Based on the interaction data of the tourist and the interaction device, identifying the interaction action of the tourist and judging the occurrence of an interaction event, and generating a virtual interaction ray by taking the position of the interaction device as a starting point when judging the occurrence of the interaction event; performing collision detection on the virtual interaction rays and virtual interaction objects in the drift river virtual scene model, and recording coordinate information of collision points when collision is detected; According to the ambient light data, calling a graphic rendering tool to render the virtual interactive object which is collided in real time, calculating the pixel-level color and brightness value of the virtual interactive object, and generating a target holographic image frame; According to the coordinate information of the collision point, calculating the mechanical effect when the virtual interaction ray collides with the virtual interaction object; mapping the mechanical effect into a physical disturbance parameter to the drifting river playing carrier to generate a physical feedback control instruction; And sending a physical feedback control instruction to physical feedback equipment, driving the physical feedback equipment to generate physical environment disturbance synchronous with the target holographic image frame, and acting on the drifting river playing carrier. The invention relates to a real-time feedback method of a drifting river game system based on holographic image interaction, which comprises the following steps of collecting three-dimensional point cloud data of a drifting river, modeling the three-dimensional point cloud data of the drifting river into a drifting river virtual scene model by using a curved surface reconstruction algorithm, wherein the method comprises the following specific steps: In the initial stage of the drifting river game, a three-dimensional laser scanner is used for carrying out multi-site scanning on a real drifting river channel, three-dimensional point cloud data of the drifting river are obtained, and registration processing is carried out on the three-dimensional point cloud data of the drifting ri