CN-122023621-A - Processing method and system for three-dimensional rendering interactive data

CN122023621ACN 122023621 ACN122023621 ACN 122023621ACN-122023621-A

Abstract

The invention relates to a three-dimensional rendering and interactive data processing technology, in particular to a processing method and a processing system of three-dimensional rendering interactive data, comprising the following steps of collecting operation information of a user in a three-dimensional scene and converting the operation information into standardized interactive data; and the optical signals are stored in an optical domain buffer module, and the buffer module consists of a delay line and a writable optical storage unit. According to the invention, the operation information of the user in the three-dimensional scene is converted into the standardized interaction data, so that the problems of interaction response lag and low rendering efficiency caused by the fact that pure electric domain calculation is adopted in the traditional three-dimensional interaction data processing are solved.

Inventors

WANG HAICHAO
LIU JIAOHONG
GAO YANQIU

Assignees

艾迪普科技股份有限公司

Dates

Publication Date: 20260512
Application Date: 20251226

Claims (10)

1. A processing method of three-dimensional rendering interactive data is characterized by comprising the following steps: collecting operation information of a user in a three-dimensional scene, and converting the operation information into standardized interaction data; Processing the standardized interaction data by utilizing a self-adaptive photoelectric interface, selecting an optical channel for signal distribution according to an interaction data load, and generating an optical signal, wherein the photoelectric interface comprises a programmable phase modulator and a bandwidth tuner; Storing the optical signals in an optical domain buffer module, wherein the buffer module consists of a delay line and a writable optical storage unit and supports multi-level access and pipeline connection with an optical domain compression module; Performing compression processing on the optical signals stored in the optical domain buffer module through optical Fourier transform, differential encoding and key data screening to obtain optical signals after the optical domain compression processing; based on a control and scheduling algorithm, adjusting compression processing time sequences of an optical domain cache and an optical domain compression module through delay compensation, compression window synchronization and triggering correction operation according to an optical domain signal state; The optical domain compressed optical signals are mapped to a rendering pipeline.
2. The method for processing three-dimensional rendering interaction data according to claim 1, wherein the step of collecting operation information of a user in a three-dimensional scene comprises: Collecting pose, hand motion, visual angle change and other operation signals of a user by using a sensor array or input equipment; Performing time synchronization processing on operation information from different sensors and input devices; and carrying out outlier rejection and filtering processing on the collected operation information.
3. The method for processing three-dimensional rendering interactive data according to claim 1, wherein said step of converting said operation information into standardized interactive data comprises: Mapping the collected operation information into a unified data structure, wherein the unified data structure comprises a time stamp, an operation type, a numerical vector and a device identifier; performing quantization encoding on the continuous numerical data, and converting a floating point value into an integer representation with a fixed bit width; Ordering the quantized operation information according to time sequence to form a data set of continuous frames or time windows; and extracting characteristics of the operation information, including calculating pose change vectors, speeds and accelerations, and adding the results to the standardized data.
4. The method for processing three-dimensional rendering interactive data according to claim 1, wherein said step of processing said standardized interactive data using an adaptive optoelectronic interface comprises: mapping the standardized interaction data into a unified data structure identifiable by the optical signal, wherein the unified data structure comprises a time stamp, an operation type, a numerical vector and a device identifier; selecting optical channels for distribution according to the interactive data types and the loads, and determining corresponding modulation modes; And organizing the mapped unified data structure into a continuous data unit sequence according to the time sequence.
5. The method for processing three-dimensional rendering interactive data according to claim 4, wherein the step of selecting the optical channel for signal distribution according to the interactive data load, and generating the optical signal comprises: Phase modulating each coding unit in the sequence of consecutive data units with a programmable phase modulator; adjusting a signal bandwidth by a bandwidth tuner according to the rate of the sequence of consecutive data units and the selected optical channel; distributing the modulated optical signals to the selected optical channels to realize multi-channel parallel transmission; And outputting the optical signal to an optical domain buffer module to form a continuous optical signal.
6. The method of claim 1, wherein the step of storing the optical signal in an optical domain buffer module comprises: The generated optical signal is guided to the input end of the optical domain buffer module through an optical waveguide or an optical fiber, and an optical switch or an optical splitter is used for selecting an optical channel; injecting an optical signal into the optical delay line to enable the optical signal to be circularly transmitted in a delay line path; writing optical signals to writable optical storage units located in different storage layers; scheduling, by a controller, read and write operations of the optical delay line and the writable optical storage unit for access in time sequence or data priority; And the optical domain buffer module is connected with the optical domain compression module through an optical waveguide or an optical fiber to form a continuous optical signal stream.
7. The method for processing three-dimensional rendering interactive data according to claim 1, wherein the step of performing compression processing on the optical signal stored in the optical domain buffer module comprises: Extracting optical signals from a delay line or a writable optical storage unit of the optical domain cache module, and introducing the optical signals into the optical domain compression module through an optical switch or a waveguide splitter; Performing frequency domain mapping on the optical signals through an optical Fourier transform unit, and outputting frequency domain optical signals; Performing differential operation of adjacent coding units on the frequency domain optical signals to generate differential optical signals; Screening key data units in the frequency domain or the differential optical signals according to a preset rule; and outputting the optical signals subjected to the optical domain compression processing to a next processing unit.
8. The method for processing three-dimensional rendering interactive data according to claim 1, wherein the step of adjusting the compression processing timing of the optical domain buffer and the optical domain compression module by delay compensation, compression window synchronization, and triggering correction operation according to the optical domain signal state based on the control and scheduling algorithm comprises: Sampling optical signal states in an optical domain buffer module and an optical domain compression module by using an optical detector array, wherein the optical signal states comprise amplitude, phase and arrival time; calculating time deviation between the optical domain buffer and the reference clock and between the optical domain compression module and the reference clock according to the sampling data by the control module, and determining delay compensation quantity and compression window adjustment quantity; Adjusting the length of the adjustable delay line to adjust the transmission delay of the optical signal; The control module sends a trigger signal to the compression module to determine the starting and ending moments of the compression operation; triggering correction operation when the state of the optical signal deviates from a preset threshold value, wherein the correction operation comprises readjusting a delay line and resetting the starting and ending time of a compression window; the control module records the adjusted time sequence parameters.
9. The method for processing three-dimensional rendering interaction data according to claim 1, wherein the step of mapping the optical signal after the optical domain compression processing to the rendering pipeline comprises: converting the optical signals subjected to optical domain compression treatment into electric signals through an optical detector array or a photoelectric converter, and outputting the electric signals unit by unit; inputting the electric signal into a digital decoding module, and performing inverse operation on differential encoding or frequency domain encoding to generate an interactive data unit stream; Writing the decoded data into a digital buffer area, and sequencing according to a data unit sequence or a time stamp; buffer data is transmitted to the rendering engine through the rendering pipeline interface, and data streaming is scheduled by the controller.
10. A processing system for three-dimensional rendering interaction data, characterized in that it is used for a processing method of three-dimensional rendering interaction data according to any of claims 1-9, said system comprising: The interactive data acquisition module is used for acquiring the operation information of a user in a three-dimensional scene and converting the operation information into standardized interactive data; The optical signal generation module is used for processing the standardized interaction data by utilizing a self-adaptive optical interface, selecting an optical channel for signal distribution according to an interaction data load, and generating an optical signal, wherein the optical interface comprises a programmable phase modulator and a bandwidth tuner; The optical domain buffer module is used for storing the optical signals in the optical domain buffer module, and the buffer module consists of a delay line and a writable optical storage unit and supports multi-level access and pipeline connection with the optical domain compression module; The optical domain compression module is used for performing compression processing on the optical signals stored in the optical domain cache module through optical Fourier transform, differential encoding and key data screening to obtain optical signals after the optical domain compression processing; The photoelectric control module is used for adjusting compression processing time sequences of the optical domain buffer and the optical domain compression module through delay compensation, compression window synchronization and triggering correction operation according to the state of the optical domain signal based on a control and scheduling algorithm; and the rendering data output module is used for mapping the optical signals subjected to the optical domain compression processing to a rendering pipeline.

Description

Processing method and system for three-dimensional rendering interactive data Technical Field The present invention relates to a three-dimensional rendering and interactive data processing technology, and in particular, to a method and a system for processing three-dimensional rendering interactive data. Background With the rapid development of virtual reality, augmented reality, immersive three-dimensional interactive systems and digital twin technologies, three-dimensional rendering has been widely applied to the fields of game entertainment, industrial design, building visualization, medical imaging, remote collaboration, virtual training, simulation, and the like. In the fields of games and entertainment, high-precision three-dimensional rendering can provide immersive visual experience, and real-time scene interaction and dynamic content display are realized. In industrial design and building visualization, three-dimensional rendering helps designers preview and modify complex models in real time, improving design efficiency. In medical imaging and operation simulation, three-dimensional rendering and interaction data are combined to reconstruct the anatomy structure of a patient, so that virtual operation training and auxiliary diagnosis are realized. In remote collaboration and virtual training, three-dimensional rendering can synchronously display multi-user operation, and real-time interaction and simulation experiments across regions are realized. The traditional three-dimensional interactive data processing mostly adopts pure electronic domain calculation, and the problems of interaction response lag and low rendering efficiency are caused due to limited electronic domain processing bandwidth and higher delay. Disclosure of Invention In order to make up for the defects, the invention provides a processing method and a system for three-dimensional rendering interactive data, which aim to solve the problems of interaction response lag and low rendering efficiency caused by limited processing bandwidth and higher delay of an electronic domain because pure electronic domain calculation is adopted in the traditional three-dimensional interactive data processing. In a first aspect, the present invention provides a method for processing three-dimensional rendering interactive data, including the following steps: collecting operation information of a user in a three-dimensional scene, and converting the operation information into standardized interaction data; Processing the standardized interaction data by utilizing a self-adaptive photoelectric interface, selecting an optical channel for signal distribution according to an interaction data load, and generating an optical signal, wherein the photoelectric interface comprises a programmable phase modulator and a bandwidth tuner; Storing the optical signals in an optical domain buffer module, wherein the buffer module consists of a delay line and a writable optical storage unit and supports multi-level access and pipeline connection with an optical domain compression module; Performing compression processing on the optical signals stored in the optical domain buffer module through optical Fourier transform, differential encoding and key data screening to obtain optical signals after the optical domain compression processing; based on a control and scheduling algorithm, adjusting compression processing time sequences of an optical domain cache and an optical domain compression module through delay compensation, compression window synchronization and triggering correction operation according to an optical domain signal state; The optical domain compressed optical signals are mapped to a rendering pipeline. By adopting the technical scheme, the operation information of the user in the three-dimensional scene is converted into the standardized interaction data, the self-adaptive photoelectric interface is utilized to generate the optical signal, the optical signal is stored in the optical domain buffer module and is subjected to optical domain compression processing, and then the optical signal is mapped to the rendering pipeline to update the three-dimensional scene, so that the problems of interaction response lag and low rendering efficiency caused by limited electronic domain processing bandwidth and high delay in the traditional three-dimensional interaction data processing are solved. Further, the step of collecting operation information of the user in the three-dimensional scene comprises the following steps: Collecting pose, hand motion, visual angle change and other operation signals of a user by using a sensor array or input equipment; Performing time synchronization processing on operation information from different sensors and input devices; and carrying out outlier rejection and filtering processing on the collected operation information. Further, the step of converting the operation information into standardized interaction data includes: Mappin