Search

CN-115220744-B - Data processing method and device, storage medium and electronic equipment

CN115220744BCN 115220744 BCN115220744 BCN 115220744BCN-115220744-B

Abstract

The invention discloses a data processing method and device related to a container of a computer, a storage medium and electronic equipment. The method comprises the steps of responding to an acquired container creation request, creating a container of a target graphic processor, acquiring first-level data of a target image file from locally pre-deployed data of a terminal, acquiring second-level data of the target image file except the first-level data from a server, wherein the target image file is one image file of a plurality of image files corresponding to services provided by the server, the file size of each image file is larger than a first threshold value, the pre-deployed data is the level data of at least two image files in the plurality of image files, and processing the first-level data and the second-level data in the container of the target graphic processor to obtain a processing result. The invention solves the technical problem of low data processing efficiency.

Inventors

  • ZHA CHONG

Assignees

  • 腾讯科技（深圳）有限公司

Dates

Publication Date
20260512
Application Date
20210420

Claims (15)

  1. 1. A method of data processing, comprising: responding to the acquired container creation request, and creating a container of a target graphic processor, wherein the container of the target graphic processor is used for processing a target image file; Acquiring first level data of the target image file from data which are locally pre-deployed at a terminal, and acquiring second level data of the target image file except the first level data from a server, wherein the target image file is one image file of a plurality of image files corresponding to services provided by the server, the file size of each image file of the plurality of image files is larger than a first threshold, and the pre-deployed data are level data which are included in at least two image files of the plurality of image files; And processing the first-level data and the second-level data in a container of the target graphic processor to obtain a processing result.
  2. 2. The method of claim 1, wherein obtaining first-level data of the target image file from data pre-deployed locally at a terminal and obtaining second-level data of the target image file, other than the first-level data, from a server comprises: Analyzing the file identification of the target image file to be processed by the container of the target graphic processor from the container creation request; searching the first-level data of the target image file corresponding to the file identifier in the data of the terminal local pre-deployment; Pulling the searched first-level data under the condition of searching the first-level data; sending a data acquisition request to the server, wherein the data acquisition request is used for requesting to acquire the second-level data of the target image file except the first-level data; and acquiring the second-level data from the server.
  3. 3. The method of claim 2, wherein the searching the first level data of the target image file corresponding to the file identifier in the data pre-deployed locally at the terminal comprises: acquiring a data hierarchy relation in the target image file; determining each layer in the data hierarchy as a current layer, and executing the following operations on the current layer: Searching data corresponding to the current layer in the data locally pre-deployed by the terminal; and under the condition that the data corresponding to the current layer is found, determining the data corresponding to the current layer as the data in the first-level data.
  4. 4. The method of claim 3, further comprising, after searching the data corresponding to the current layer in the data pre-deployed locally by the terminal: And under the condition that the data corresponding to the current layer is not found, determining the data corresponding to the current layer as the data in the second-level data.
  5. 5. The method of claim 1, further comprising, prior to creating the container of the target graphics processor in response to the acquired container creation request: Acquiring hierarchical data included in at least two image files in the plurality of image files from the server under the condition that the real-time data transmission quantity between the server and the local terminal is smaller than a second threshold value; And deploying the hierarchical data contained in at least two image files in the plurality of image files as the pre-deployed data in the terminal.
  6. 6. The method of claim 5, wherein the obtaining, from the server, hierarchical data included in at least two image files of the plurality of image files, in a case where an amount of data transferred in real time between the server and the terminal locally is less than a second threshold, comprises: The method comprises the steps of sending a data deployment request to the server, acquiring hierarchical data contained in at least two image files sent by the server in response to the data deployment request, or And receiving the hierarchical data which are transmitted by the server and are included in the at least two image files.
  7. 7. The method according to any one of claims 1 to 6, wherein processing the first level data and the second level data in the container of the target graphics processor, after obtaining a processing result, further comprises: Acquiring the changed first-level data from the server under the condition that the first-level data in the server is changed; And storing the changed first-level data in the local of the terminal.
  8. 8. The method of claim 7, wherein the saving the changed first-level data locally at the terminal comprises: Monitoring the residual storage space of the storage space used for storing the first-level data and local to the terminal; searching the latest first-level data in the storage space under the condition that the residual storage space is smaller than a third threshold value; deleting all the first-level data except the latest first-level data from the storage space, or And deleting the first-level data with the longest storage time from the storage space in all the first-level data except the latest first-level data.
  9. 9. A method of data processing, comprising: acquiring a data acquisition request sent by a terminal, wherein the data acquisition request is used for requesting to acquire second-level data of a target image file, the target image file is one image file in a plurality of image files corresponding to a service provided by a server, the file size of each image file in the plurality of image files is larger than a first threshold, the second-level data is data except the first-level data in the target image file, the first-level data is data pre-deployed on the terminal, and the data pre-deployed on the terminal is level data included in at least two image files in the plurality of image files; And sending the second-level data to the terminal so that the terminal processes the first-level data acquired locally from the terminal and the second-level data acquired from the server through the created GPU container.
  10. 10. The method of claim 9, wherein the transmitting the second-level data to the terminal comprises: Acquiring hierarchical data included in at least two image files in the plurality of image files from the server under the condition that the real-time data transmission quantity between the server and the local terminal is smaller than a second threshold value; and deploying the hierarchical data contained in at least two image files in the plurality of image files as the data pre-deployed on the terminal on the local side of the terminal.
  11. 11. The method of claim 10, wherein the obtaining, from the server, hierarchical data included in at least two image files of the plurality of image files, in a case where an amount of data transferred in real time between the server and the terminal locally is less than a second threshold, comprises: Receiving a data deployment request sent by the terminal, responding to the data deployment request and sending hierarchical data contained in at least two image files to the terminal, or And sending the hierarchical data contained in the at least two image files to the terminal.
  12. 12. A data processing apparatus, comprising: The creating unit is used for responding to the acquired container creating request and creating a container of the target graphic processor, wherein the container of the target graphic processor is used for processing the target image file; A first obtaining unit, configured to obtain first level data of the target image file from data that is locally pre-deployed in the terminal, and obtain second level data, except for the first level data, of the target image file from a server, where the target image file is one image file of a plurality of image files corresponding to a service provided by the server, a file size of each image file of the plurality of image files is greater than a first threshold, and the pre-deployed data is level data that is included in at least two image files of the plurality of image files; and the processing unit is used for processing the first-level data and the second-level data in the container of the target graphic processor to obtain a processing result.
  13. 13. A data processing apparatus, comprising: An obtaining unit, configured to obtain a data obtaining request sent by a terminal, where the data obtaining request is used to request to obtain second-level data of a target image file, where the target image file is one image file of a plurality of image files corresponding to a service provided by a server, a file size of each image file of the plurality of image files is greater than a first threshold, the second-level data is data, except for first-level data, in the target image file, the first-level data is data pre-deployed on the terminal, and the data pre-deployed on the terminal is level data included in at least two image files in the plurality of image files; And the sending unit is used for sending the second-level data to the terminal so that the terminal can process the first-level data locally acquired from the terminal and the second-level data acquired from the server through the created GPU container.
  14. 14. A computer readable storage medium storing a computer program, characterized in that the computer program when run performs the method of any one of claims 1 to 8 or 9 to 13.
  15. 15. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of the claims 1-8 or 9-13 by means of the computer program.

Description

Data processing method and device, storage medium and electronic equipment Technical Field The present invention relates to the field of computer computing, and in particular, to a data processing method and apparatus, a storage medium, and an electronic device. Background In the prior art, it is often necessary to create a container of a graphics processor (Graphics Processing Unit, abbreviated as GPU) on the local side of the terminal device, with the GPU container providing computing power support for the image file on the server. In actual use, a GPU container is created at the local of the terminal equipment, an image file is pulled to the local of the terminal equipment on a server, and then the image file is processed by the GPU container, so that a processing result is obtained. However, since the volume of the image file is usually large, the method is sampled, and in the process of processing the image file, the image file is pulled for a long time under the condition of poor network conditions, the failure rate is high, and the data processing efficiency is further low. In view of the above problems, no effective solution has been proposed at present. Disclosure of Invention The embodiment of the invention provides a data processing method and device, a storage medium and electronic equipment, which are used for at least solving the technical problem of low data processing efficiency. According to one aspect of the embodiment of the invention, a data processing method is provided, which comprises the steps of responding to an acquired container creation request, creating a container of a target graphic processor, acquiring first-level data of the target image file from locally pre-deployed data of a terminal, acquiring second-level data of the target image file except the first-level data from a server, wherein the target image file is one image file of a plurality of image files corresponding to services provided by the server, the file size of each image file of the plurality of image files is larger than a first threshold, the pre-deployed data is level data included in at least two image files of the plurality of image files, and processing the first-level data and the second-level data in the container of the target graphic processor to obtain a processing result. According to another aspect of the embodiment of the present invention, there is provided a data processing method, including acquiring a data acquisition request sent by a terminal, where the data acquisition request is used to request to acquire second-level data of a target image file, where the target image file is one image file of a plurality of image files corresponding to a service provided by a server, a file size of each image file of the plurality of image files is greater than a first threshold, the second-level data is data in the target image file except for first-level data, the first-level data is data pre-deployed on the terminal, the data pre-deployed on the terminal is level data included in at least two image files of the plurality of image files, and sending the second-level data to the terminal, so that the terminal processes the first-level data locally acquired from the terminal and the second-level data acquired from the server through a created GPU container. According to still another aspect of the embodiment of the present invention, there is provided a data processing apparatus, including a creating unit configured to create a container of a target graphics processor in response to an acquired container creation request, where the container of the target graphics processor is configured to process a target image file, a first acquiring unit configured to acquire first level data of the target image file from data locally pre-deployed by a terminal, and acquire second level data of the target image file other than the first level data from a server, where the target image file is one image file of a plurality of image files corresponding to a service provided by the server, a file size of each image file of the plurality of image files is greater than a first threshold, and the pre-deployed data is level data included in at least two image files of the plurality of image files, and a processing unit configured to process the first level data and the second level data in the container of the target graphics processor, to obtain a processing result. As an optional example, the first obtaining unit includes an parsing module configured to parse a file identifier of the target image file to be processed by the container of the target graphics processor from the container creation request, a first searching module configured to search, in data locally pre-deployed by the terminal, the first hierarchical data of the target image file corresponding to the file identifier, a pulling module configured to pull the first hierarchical data found when the first hierarchical data is found, and a first sending module c