CN-115048458-B - Block chain-based data processing method, apparatus, device, medium and program product

CN115048458BCN 115048458 BCN115048458 BCN 115048458BCN-115048458-B

Abstract

The disclosure provides a data processing method based on a blockchain, which can be applied to the technical field of blockchains. The data processing method based on the blockchain comprises the steps of executing a lake entering intelligent contract based on a business blockchain, executing a writing operation on collected source data, writing the obtained source data into a decentralizing database, executing a data processing intelligent contract based on the business blockchain, processing the source data in the decentralizing database to form outgoing data, executing the writing operation on the outgoing data, writing the obtained outgoing data into the decentralizing database, generating an intelligent contract based on a business blockchain execution file, generating an outgoing file, and transmitting the outgoing file to a target end. The present disclosure also provides a blockchain-based data processing system, device, storage medium, and program product.

Inventors

Zeng Zhaochuang
WANG LINGFANG
LUO QIANG
LIN JIAWEN

Assignees

中国工商银行股份有限公司
中国工商银行股份有限公司

Dates

Publication Date: 20260421
Application Date: 20220610
Priority Date: 20220610

Claims (10)

1. A blockchain-based data processing method, comprising: Executing intelligent contracts for entering lakes based on service block chains, executing writing operation on collected source data, and writing the writing operation into an decentralised database, wherein the decentralised database does not have a decentralised management node; Performing a data processing intelligence contract based on the service blockchain, processing source data in the de-centralized database to form outgoing data, performing the write operation on the outgoing data, writing to the de-centralized database, and Generating an intelligent contract based on the service block chain execution file, generating an outgoing file, and Transmitting the outgoing file to a target end; The decentralizing database comprises a first decentralizing database and a second decentralizing database, wherein the source data is written into the first decentralizing database, and the outgoing data is written into the second decentralizing database.
2. The method of claim 1, wherein the source data and the outgoing data are binned data, The write operation includes: dividing the binned data into a first predetermined number of sub-data blocks, and And writing the first preset number of data blocks into a second preset number of data blocks by adopting erasure code coding, wherein the second preset number of data blocks have a third preset number of redundant data blocks compared with the first preset number of sub-data blocks.
3. The method of claim 2, wherein after writing the first predetermined number of data blocks into a second predetermined number of data blocks using erasure code coding, the write operation further comprises: identifying content in the sub-data block based on multiple hashes, and And storing the identified sub data blocks into a decentralised node based on a distributed hash table.
4. The method of claim 1, wherein the performing a lake-entering smart contract based on a traffic blockchain comprises: and periodically executing the intelligent contract entering the lake based on the preset collection time.
5. The method of claim 4, wherein performing a data processing intelligence contract based on the traffic blockchain, processing source data in the de-centralized database to form outgoing data, and storing the outgoing data to the de-centralized database, comprises: performing mapping operation on the source data in a first decentralised node to obtain data to be processed, wherein the first decentralised node is a node in the first decentralised database, and the mapping operation is used for rearranging data blocks; Temporarily storing the data to be processed to a second decentralised node, wherein the second decentralised node is a node in the first decentralised database, and the second decentralised node is a neighboring node of the first decentralised node; based on preset calculation logic, performing a reduction operation on the data to be processed on the second decentralised node to obtain the outgoing data, and And storing the outgoing data to a third decentralised node, wherein the third decentralised node is a node in the second decentralised database.
6. The method of claim 1, wherein after the source data is written to the de-centralized database, or after the outgoing data is written to the de-centralized database, the method further comprises monitoring a binning status of the source data, and/or monitoring the binning status of the outgoing data; if the warehouse-in state is successful, a warehouse-in success instruction is sent out, and And if the warehouse-in state is failure, sending a warehouse-in failure instruction to finish alarming.
7. A data processing device based on a block chain is characterized by comprising a data acquisition module, a data processing module, a file generation module and a file transmission module, Wherein, the The data acquisition module is used for executing intelligent contracts for entering lakes based on service block chains, executing writing operation on acquired source data, and writing the acquired source data into an decentralized database, wherein the decentralized database does not have a centralized management node; The data processing module is used for executing a data processing intelligent contract based on the service block chain, processing the source data in the decentralization database to form outgoing data, executing the writing operation on the outgoing data, and writing the writing operation into the decentralization database; the file generation module is used for generating intelligent contracts based on the service block chain execution file to generate an outgoing file, and The file transmission module is used for transmitting the outgoing file to a target end; The decentralizing database comprises a first decentralizing database and a second decentralizing database, wherein the source data is written into the first decentralizing database, and the outgoing data is written into the second decentralizing database.
8. An electronic device, comprising: One or more processors; Storage means for storing one or more programs, Wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-6.
9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method according to any of claims 1-6.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-6.

Description

Block chain-based data processing method, apparatus, device, medium and program product Technical Field The present disclosure relates to the field of blockchain technologies, and in particular, to a data processing method, apparatus, device, medium, and program product for a blockchain. Background With the gradual perfection of financial systems in China and the rapid increase of management risks, banks are particularly important in analyzing business data of the banks facing the impact of internet finance and big data. With the continuous development and increasing maturity of technologies such as data lakes, banks have put higher demands on analysis of customer information and transaction business data. The traditional bank data supervision report adopts a centralized data lake to store the source pasting data, and uses a big data processing engine to clean and process the source pasting data according to the data standard of a specific business scene to form supervision index data and detail data. And transmitted to the mechanism corresponding to the specific service scene. In the process of realizing the disclosed conception, the inventor finds that at least the following problems exist in the related art, and the centralized cluster has the technical problems of easy failure, untimely data processing, incomplete data, easy attack of metadata nodes and the like. Disclosure of Invention In view of the foregoing, the present disclosure provides blockchain-based data processing methods, apparatus, devices, media, and program products that improve data processing security and efficiency. According to a first aspect of the disclosure, a data processing method based on a blockchain is provided, which comprises the steps of executing a lake entering intelligent contract based on a business blockchain, executing a writing operation on collected source data, writing the obtained source data into a decentralization database, executing a data processing intelligent contract based on the business blockchain, processing the source data in the decentralization database to form outgoing data, executing the writing operation on the outgoing data, writing the obtained outgoing data into the decentralization database, generating an intelligent contract based on a business blockchain execution file, generating an outgoing file, and transmitting the outgoing file to a target end. According to the embodiment of the disclosure, the source data and the outgoing data are warehouse-in data, and the write operation comprises dividing the warehouse-in data into a first preset number of sub-data blocks, and writing the first preset number of data blocks into a second preset number of data blocks by adopting erasure coding, wherein the second preset number of data blocks have a third preset number of redundant data blocks compared with the first preset number of sub-data blocks. According to the embodiment of the disclosure, after the first preset number of data blocks are written into the second preset number of data blocks by adopting erasure code coding, the writing operation further comprises the steps of identifying the content in the sub-data blocks based on multiple hash, and storing the identified sub-data blocks into a decentralizing node based on a distributed hash table. According to the embodiment of the disclosure, the intelligent contract for entering the lake is executed based on the service block chain, and the intelligent contract for entering the lake is executed periodically based on preset acquisition time. According to an embodiment of the disclosure, the decentralised databases comprise a first decentralised database and a second decentralised database, wherein the source data is written to the first decentralised database and the outgoing data is written to the second decentralised database. According to the embodiment of the disclosure, the processing of source data in the decentralised database based on the service block chain to form outgoing data comprises the steps of performing mapping operation on the source data in a first decentralised node to obtain data to be processed, wherein the first decentralised node is a node in the first decentralised database, the mapping operation is used for rearranging data blocks, temporarily storing the data to be processed to a second decentralised node, wherein the second decentralised node is a node in the first decentralised database, the second decentralised node is a neighboring node of the first decentralised node, performing simplification operation on the data to be processed on the second decentralised node based on preset calculation logic to obtain the outgoing data, and storing the outgoing data to a third decentralised node, wherein the third decentralised node is the second decentralised node. According to the embodiment of the disclosure, after the source data is written into the decentralised database or after the outgoing data is written into the de