CN-120070602-B - Data processing method, device, equipment and computer storage medium

CN120070602BCN 120070602 BCN120070602 BCN 120070602BCN-120070602-B

Abstract

The embodiment of the application provides a data processing method, a device, equipment and a computer storage medium. The data processing method comprises the steps of determining a reference acquisition device and a compensation acquisition device in a plurality of acquisition devices, wherein the reference acquisition device is an acquisition device which realizes virtual-real color alignment, acquiring a color mapping relation between the reference acquisition device and the compensation acquisition device, representing a mapping relation between a reference color value obtained after picture acquisition by the reference acquisition device and a compensation color value obtained after picture acquisition by the compensation acquisition device for the same display color, and carrying out acquired image color compensation in the process of carrying out virtual-real picture acquisition by the compensation acquisition device based on the color mapping relation to obtain a compensated image. The embodiment of the application can realize virtual and real color alignment in the compensation acquisition equipment, and improves the shooting quality of virtual shooting.

Inventors

LI XIAOYANG
CHEN SHIPING
Chen Aoran
ZHANG HUAN
LIU JIE
ZHANG ZHONGJIE

Assignees

优酷文化科技(北京)有限公司

Dates

Publication Date: 20260512
Application Date: 20241227

Claims (11)

1. A data processing method, comprising: Determining reference acquisition equipment and compensation acquisition equipment in a plurality of acquisition equipment, wherein the reference acquisition equipment is acquisition equipment for realizing virtual-real color alignment, and the compensation acquisition equipment is other acquisition equipment except the reference acquisition equipment; The method comprises the steps of acquiring a color mapping relation between a reference acquisition device and a compensation acquisition device, wherein the color mapping relation represents a mapping relation between a reference color value obtained after a target object is subjected to picture acquisition by the reference acquisition device and a compensation color value obtained after the target object is subjected to picture acquisition by the compensation acquisition device for the same display color; and based on the color mapping relation, carrying out color compensation on the acquired image in the process of carrying out virtual and real picture acquisition by the compensation acquisition equipment, and obtaining a compensated image.
2. The method of claim 1, wherein the acquiring a color mapping relationship between the reference acquisition device and the compensation acquisition device comprises: Acquiring a reference acquisition image, wherein the reference acquisition image is an image obtained by picture acquisition of a target object by reference acquisition equipment; acquiring a compensation acquisition image, wherein the compensation acquisition image is an image obtained by picture acquisition of the target object by compensation acquisition equipment; Respectively acquiring a reference color value of the target object in the reference acquisition image and a compensation color value of the target object in the compensation acquisition image; and calculating to obtain the color mapping relation between the reference acquisition equipment and the compensation acquisition equipment according to the reference color value and the compensation color value.
3. The method of claim 2, wherein the separately acquiring reference color values of the target object in the reference acquisition image and compensating color values of the target object in the compensating acquisition image comprises: Acquiring a reference real scene color value of the real scene object in the reference acquisition image and a compensation real scene color value of the real scene object in the compensation acquisition image; obtaining a reference virtual color value of the virtual object in the reference acquisition image, and a compensation virtual color value of the virtual object in the compensation acquisition image; the calculating to obtain the color mapping relationship between the reference acquisition device and the compensation acquisition device according to the reference color value and the compensation color value comprises the following steps: Calculating to obtain a real scene color mapping relation between the reference acquisition equipment and the compensation acquisition equipment according to the reference real scene color value and the compensation real scene color value; And fusing the real-scene color mapping relation and the virtual color mapping relation to obtain the color mapping relation between the reference acquisition equipment and the compensation acquisition equipment.
4. The method of claim 2, wherein the separately acquiring reference color values of the target object in the reference acquisition image and compensating color values of the target object in the compensating acquisition image comprises: respectively judging whether the reference acquired image and the compensation acquired image meet preset image quality conditions or not; And if the reference acquired image and the compensation acquired image both meet the image quality condition, respectively acquiring a reference color value of the target object in the reference acquired image and a compensation color value of the target object in the compensation acquired image.
5. The method according to any one of claims 1-4, wherein performing color compensation of the acquired image during the process of performing virtual-real picture acquisition by the compensation acquisition device based on the color mapping relationship to obtain a compensated image, includes: the method comprises the steps of obtaining an original compensation virtual-real image, wherein the original compensation virtual-real image is an image obtained by carrying out virtual-real picture acquisition by the compensation acquisition equipment after carrying out color calibration on a virtual rendering engine according to a color calibration mapping relation corresponding to the compensation acquisition equipment; And correcting and compensating the color value of each pixel point in the original compensation virtual-real image according to the color mapping relation to obtain a compensated image.
6. The method according to any one of claims 1-4, wherein performing color compensation of the acquired image during the process of performing virtual-real picture acquisition by the compensation acquisition device based on the color mapping relationship to obtain a compensated image, includes: Acquiring a compensation virtual-real image acquired by compensation acquisition equipment as a compensated image; The compensation virtual-real image is an image obtained by performing virtual-real picture acquisition by the compensation acquisition equipment after performing color calibration on the virtual rendering engine according to the color calibration mapping relation and the color mapping relation corresponding to the compensation acquisition equipment.
7. The method of claim 5, wherein the correcting and compensating the color value of each pixel point in the original compensated virtual-real image according to the color mapping relation to obtain a compensated image includes: Downsampling the original compensation virtual-real image to obtain a sampled image; Correcting and compensating the color value of each pixel point in the sampling image according to the color mapping relation to obtain a compensated sampling image; Calculating a first pixel value difference between the compensated sampling image and a reference virtual-real image and a second pixel value difference between the original compensated virtual-real image and the reference virtual-real image, wherein the reference virtual-real image is an image obtained by performing virtual-real picture acquisition by reference acquisition equipment; and if the first pixel value difference and the second pixel value difference meet the preset difference condition, correcting and compensating the color value of each pixel point in the original compensation virtual-real image according to the color mapping relation to obtain a compensated image.
8. A data processing apparatus comprising: The device determining module is used for determining reference acquisition devices and compensation acquisition devices in the plurality of acquisition devices, wherein the reference acquisition devices are acquisition devices with virtual and real colors aligned, and the compensation acquisition devices are other acquisition devices except the reference acquisition devices; The system comprises a reference acquisition device, a compensation acquisition device, a mapping relation acquisition module, a display module and a display module, wherein the reference acquisition device is used for acquiring a reference color value of a target object, the reference color value is acquired by the reference acquisition device according to the same display color, and the compensation color value is acquired by the compensation acquisition device according to the target object; and the compensation module is used for carrying out color compensation on the acquired image in the process of carrying out virtual and real picture acquisition by the compensation acquisition equipment based on the color mapping relation to obtain a compensated image.
9. An electronic device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus; The memory is configured to store at least one executable instruction that causes the processor to perform operations corresponding to the method according to any one of claims 1-7.
10. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1-7.
11. A computer program product comprising computer instructions that instruct a computing device to perform the method of any one of claims 1-7.

Description

Data processing method, device, equipment and computer storage medium Technical Field Embodiments of the present application relate to the field of computer technologies, and in particular, to a data processing method, an apparatus, an electronic device, a computer storage medium, and a computer program product. Background The XR (Extended Reality) virtual shooting is to throw a rendering scene graph rendered by a virtual engine onto an LED screen for display, then the actor performs performance by using the LED screen as a background, an image acquisition device (such as a camera) shoots the actor and the LED screen simultaneously, and then the shot camera picture (acquired image) and the rendering scene graph are synthesized, so that the real actor is placed in the virtual scene, and the effect of shooting the external scene or the science fiction background in a film studio is achieved. Due to the influence of internal factors of the image acquisition equipment and the like, certain difference exists between the color value in the original rendering scene graph rendered by the virtual rendering engine and the color value in the image finally acquired by the image acquisition equipment, namely certain color distortion exists. Therefore, color calibration is typically performed on color values in the original rendered scene graph and color values in the image ultimately acquired by the image acquisition device to eliminate the differences. Further, in order to avoid chromatic aberration between an actual scene and a virtual scene in a picture shot by the image acquisition equipment, the virtual rendering engine is further subjected to color adjustment so as to realize virtual-actual color alignment and improve shooting effect. In the actual shooting process, different image acquisition devices are usually arranged at different positions in consideration of shooting requirements, picture shooting is performed through a plurality of image acquisition devices respectively, and then post-processing such as editing is performed on pictures shot by the image acquisition devices, so that a product meeting the requirements is generated. However, in a multi-device acquisition scene, there will typically be image acquisition devices that cannot achieve virtual-to-real color alignment. Disclosure of Invention Accordingly, embodiments of the present application provide a data processing scheme to at least partially solve the above-mentioned problems. According to a first aspect of an embodiment of the present application, there is provided a data processing method, including: Determining reference acquisition equipment and compensation acquisition equipment in a plurality of acquisition equipment, wherein the reference acquisition equipment is acquisition equipment for realizing virtual-real color alignment, and the compensation acquisition equipment is other acquisition equipment except the reference acquisition equipment; The method comprises the steps of acquiring a color mapping relation between a reference acquisition device and a compensation acquisition device, wherein the color mapping relation represents a mapping relation between a reference color value obtained after picture acquisition by the reference acquisition device and a compensation color value obtained after picture acquisition by the compensation acquisition device for the same display color; and based on the color mapping relation, carrying out color compensation on the acquired image in the process of carrying out virtual and real picture acquisition by the compensation acquisition equipment, and obtaining a compensated image. According to a second aspect of an embodiment of the present application, there is provided a data processing apparatus including: The device determining module is used for determining reference acquisition devices and compensation acquisition devices in the plurality of acquisition devices, wherein the reference acquisition devices are acquisition devices with virtual and real colors aligned, and the compensation acquisition devices are other acquisition devices except the reference acquisition devices; the system comprises a mapping relation acquisition module, a compensation acquisition device and a reference acquisition device, wherein the mapping relation acquisition module is used for acquiring a color mapping relation between the reference acquisition device and the compensation acquisition device; and the compensation module is used for carrying out color compensation on the acquired image in the process of carrying out virtual and real picture acquisition by the compensation acquisition equipment based on the color mapping relation to obtain a compensated image. According to a third aspect of the embodiment of the application, there is provided an electronic device, including a processor, a memory, a communication interface and a communication bus, where the processor, the memory and the communication interface co