CN-116015925-B - Data transmission method, device, equipment and medium
Abstract
The invention discloses a data transmission method, a device, equipment and a medium. The data transmission method comprises the steps of responding to a data request sent by a second data platform, obtaining data to be transmitted, which is matched with the data request, searching a data auditing rule corresponding to a first data platform from a target data gateway, configuring the target data gateway in a data sandbox provided by the first data platform to the second data platform, auditing the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data, and sending the target transmission data to the second data platform. The method and the device solve the technical problems that the data validity detection in the prior art does not have universality and the data processing efficiency is low, realize automatic real-time audit of data needing to cross the environment, and process the data to be transmitted according to different data audit rules corresponding to the first data platform, thereby being applicable to any data platform and ensuring the universality of data audit.
Inventors
- LIU WANGGEN
- PENG HUAN
- GU YISHENG
Assignees
- 星环信息科技(上海)股份有限公司
Dates
- Publication Date
- 20260505
- Application Date
- 20221229
Claims (9)
- 1. A data transmission method, applied to a first data platform, comprising: Responding to a data request sent by a second data platform, and acquiring data to be transmitted matched with the data request, wherein the second data platform and the first data platform belong to different areas; Searching a data audit rule corresponding to the first data platform from a target data gateway, wherein the target data gateway is configured in a data sandbox provided by the first data platform to the second data platform; Auditing the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data, wherein the target transmission data is a subset of the data to be transmitted and only contains data conforming to the data auditing rule; Transmitting target transmission data conforming to the data auditing rule to the second data platform, storing data not conforming to the data auditing rule in the data sandbox, setting a data validity period, and automatically destroying the data not conforming to the data auditing rule after the data not conforming to the data auditing rule reaches the data validity period; the auditing of the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data comprises the following steps: Screening to obtain sensitive data in the data to be transmitted; and executing a truncation operation and/or a desensitization operation on the sensitive data according to the data audit rule to obtain corresponding target transmission data.
- 2. The method as recited in claim 1, further comprising: Acquiring a data security policy corresponding to a first data platform from a data supervision platform associated with the first data platform; Storing the data security policy into a target database of the target data gateway, so that each instance node in the target data gateway obtains the data security policy from the target database, and updating a data audit rule according to the data security policy.
- 3. The method of claim 1, further comprising, after said responding to the data request sent by the second data platform: Acquiring the current running state of each instance node in the target data gateway; and determining a target instance node corresponding to the data request based on a load balancing principle and the current running state of each instance node so as to process the data request through the target instance node.
- 4. The method as recited in claim 1, further comprising: auditing the data to be transmitted according to the data auditing rule to obtain a corresponding data auditing result; And feeding the data auditing result back to a data supervision platform associated with the first data platform, so that the data supervision platform adjusts the corresponding data security policy in real time according to the data auditing result.
- 5. The method of claim 4, wherein the feeding back the data audit results to a supervisory platform associated with the first data platform comprises: Updating the data audit result to the corresponding blockchain; and feeding the data audit result back to the data supervision platform through the blockchain.
- 6. The method of claim 1, wherein the data auditing rules and data security policies are presented in the instance node in plug-in form, the method further comprising: Responding to an updating instruction of the data security policy corresponding to the first data platform in the data supervision platform, and updating the data security policy corresponding to the first data platform on the blockchain; and updating the plug-in of the corresponding data security policy in the target database of the target data gateway in real time based on the data security policy updated on the blockchain.
- 7. A data transmission device, for use with a first data platform, comprising: the first acquisition module is used for responding to a data request sent by a second data platform and acquiring data to be transmitted matched with the data request, wherein the second data platform and the first data platform belong to different areas; The searching module is used for searching the data auditing rule corresponding to the first data platform from the target data gateway; the target data gateway is configured in a data sandbox provided by the first data platform to the second data platform; The auditing module is used for auditing the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data, wherein the target transmission data is a subset of the data to be transmitted and only contains data conforming to the data auditing rule; The transmission module is used for sending target transmission data conforming to the data auditing rule to the second data platform, storing data not conforming to the data auditing rule in the data sandbox, setting a data validity period, and automatically destroying the data not conforming to the data auditing rule after the data not conforming to the data auditing rule reaches the data validity period; Wherein, the audit module includes: The screening unit is used for screening and obtaining sensitive data in the data to be transmitted; And the processing unit is used for executing a truncation operation and/or a desensitization operation on the sensitive data according to the data audit rule to obtain corresponding target transmission data.
- 8. An electronic device, the electronic device comprising: at least one processor, and A memory communicatively coupled to the at least one processor, wherein, The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data transmission method of any one of claims 1-6.
- 9. A computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, the computer instructions for causing a processor to perform the data transmission method of any one of claims 1-6.
Description
Data transmission method, device, equipment and medium Technical Field The present invention relates to the field of computer technologies, and in particular, to a data transmission method, apparatus, device, and medium. Background As regulations of data outbound of each country come out successively, when facing a data cross-border scene, it is difficult to detect whether privacy data which does not allow cross-border is contained in data to be cross-border because compliance requirements of each country are different. Most of the current compliance detection schemes are based on manual or batch detection of whether the data contains confidential information, and have high requirements on the efficiency and time of data auditing for big data and streaming data, so that the current schemes are difficult to meet the requirements. Disclosure of Invention The invention provides a data transmission method, a device, equipment and a medium, which are used for solving the technical problems that the data validity detection in the prior art does not have universality and the data processing efficiency is low. According to an aspect of the present invention, there is provided a data transmission method applied to a first data platform, including: Responding to a data request sent by a second data platform, and acquiring data to be transmitted, which is matched with the data request; Searching a data audit rule corresponding to the first data platform from a target data gateway, wherein the target data gateway is configured in a data sandbox provided by the first data platform to the second data platform; auditing the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data, wherein the target transmission data is a subset of the data to be transmitted; And sending the target transmission data to the second data platform. According to another aspect of the present invention, there is provided a data transmission apparatus, which is applied to a first data platform, including: the first acquisition module is used for responding to a data request sent by the second data platform and acquiring data to be transmitted, which is matched with the data request; The searching module is used for searching the data auditing rule corresponding to the first data platform from the target data gateway; the target data gateway is configured in a data sandbox provided by the first data platform to the second data platform; the auditing module is used for auditing the data to be transmitted according to the data auditing rule to obtain corresponding target transmission data, wherein the target transmission data is a subset of the data to be transmitted; and the transmission module is used for sending the target transmission data to the second data platform. According to another aspect of the present invention, there is provided an electronic apparatus including: at least one processor, and A memory communicatively coupled to the at least one processor, wherein, The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data transmission method according to any one of the embodiments of the present invention. According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a data transmission method according to any one of the embodiments of the present invention. According to the technical scheme, when the data request of the second data platform is received, the data to be transmitted, which is matched with the data request, is obtained, the data auditing rule corresponding to the first data platform is searched from the target data gateway, and the data to be transmitted is automatically audited according to the data auditing rule, so that target transmission data meeting the requirements is obtained, the target transmission data is sent to the second data platform, the technical problems that the data validity detection in the prior art does not have universality and the data processing efficiency is low are solved, automatic real-time audit of data needing to cross the border is realized, the data to be transmitted is processed according to different data auditing rules corresponding to the first data platform, and therefore the method is applicable to any data platform, and the universality of data auditing is ensured. It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows. Drawings In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described bel