Search

CN-122022730-A - Data processing method, apparatus, device, medium, and program product

CN122022730ACN 122022730 ACN122022730 ACN 122022730ACN-122022730-A

Abstract

The application provides a data processing method, a device, equipment, a storage medium and a program product, which can be applied to the technical field of big data and the technical field of financial science and technology. The data processing method comprises the steps of receiving a data processing instruction aiming at target service data, determining a target storage unit for storing the target service data from a plurality of storage units according to the target service and a target mechanism, dividing a preset storage space into a plurality of logic areas according to the service and the mechanism corresponding to the plurality of service data, determining a target storage subunit from a preset mapping relation set according to data identification information, determining a target data table corresponding to the target dimension identification from a plurality of data tables of the target storage subunit according to the target dimension identification, reading the target service data from the target data table, and executing a target processing strategy on the target service data.

Inventors

  • CUI JIA

Assignees

  • 中国工商银行股份有限公司

Dates

Publication Date
20260512
Application Date
20260130

Claims (12)

  1. 1. A method of data processing, the method comprising: receiving a data processing instruction aiming at target service data, wherein the target service data is multidimensional data, and the data processing instruction comprises target service, target mechanism and data identification information corresponding to the target service data; Determining a target storage unit for storing the target service data from a plurality of storage units according to the target service and the target mechanism, wherein the plurality of storage units are obtained by dividing a preset storage space into a plurality of logic areas according to the service and the mechanism corresponding to the plurality of service data; determining a target storage subunit from a preset mapping relation set according to the data identification information, wherein the mapping relation set comprises the corresponding relation between a plurality of data identification information and at least one first storage subunit in the target storage unit; Determining a target data table corresponding to the target dimension identifier from a plurality of data tables of the target storage subunit according to the target dimension identifier; and reading the target service data from the target data table, and executing a target processing strategy on the target service data.
  2. 2. The method of claim 1, wherein the target data table is used to store at least two business data corresponding to at least two business items; The target data table comprises a fixed field set and a dynamic field set, wherein the fixed field set is used for storing common field information between the at least two business data, and the dynamic field set is used for storing difference field information between the at least two business data.
  3. 3. The method of claim 2, wherein the reading the target traffic data from the target data table comprises: Reading first business sub-data from the fixed field set of the target data table according to fixed field information to be read specified by the data processing instruction; Determining at least one dynamic field number corresponding to the dynamic field information from a preset field mapping information set according to the dynamic field information to be read and the business item information designated by the data processing instruction; Determining at least one dynamic field corresponding to the at least one dynamic field number in the target data table, and reading second business sub-data corresponding to the at least one dynamic field; And integrating the first service sub-data and the second service sub-data to obtain the target service data.
  4. 4. The method of claim 1, wherein the digital identification information comprises at least one of a service type, a service execution time period, a service lot number; the target dimension identification comprises at least one of a data sensitivity level identification, a service creation time identification, a service execution state identification and a service level identification.
  5. 5. The method according to claim 1, wherein the method further comprises: for a plurality of service data in the target storage unit, periodically determining respective data validity period ranges of the plurality of service data, and determining first service data of which the data validity period ranges do not include the current period from the plurality of service data; and migrating the first business data from the first storage subunit to a pre-built second storage subunit.
  6. 6. The method of claim 5, wherein the method further comprises: Determining at least one second service data of which the data validity period range includes a current period from the plurality of service data; Determining the respective data access frequency of the at least one second service data within a preset period; And migrating the second business data with the data access frequency smaller than a preset threshold value to the second storage subunit.
  7. 7. The method according to claim 1, wherein the method further comprises: For a plurality of service data in the target storage unit, periodically determining the total data amount of the plurality of service data; determining service data exceeding the total data amount in the plurality of service data according to the data index of each service data; And migrating the business data exceeding the total data amount from the first storage subunit to a pre-built third storage subunit.
  8. 8. The method according to claim 1, wherein the method further comprises: Responding to a data storage instruction aiming at data to be stored, and determining a storage unit corresponding to the data to be stored according to a mechanism and a service corresponding to the data to be stored; Determining a storage subunit corresponding to the data to be stored from the storage unit according to the data identification information corresponding to the data to be stored; Determining at least one data table corresponding to the data to be stored from the storage subunit according to at least one dimension information corresponding to the data to be stored; And storing the data to be stored into the at least one data table, wherein the at least one data table is used for storing information of at least one dimension of the data to be stored respectively.
  9. 9. A data processing apparatus, the apparatus comprising: the receiving module is used for receiving a data processing instruction aiming at target service data, wherein the target service data is multi-dimensional data, and the data processing instruction comprises target service, target mechanism and data identification information corresponding to the target service data; The first determining module is used for determining a target storage unit for storing the target service data from a plurality of storage units according to the target service and the target mechanism, wherein the plurality of storage units are obtained by dividing a preset storage space into a plurality of logic areas according to the service and the mechanism corresponding to the plurality of service data; The second determining module is used for determining a target storage subunit from a preset mapping relation set according to the data identification information, wherein the mapping relation set comprises the corresponding relation between a plurality of data identification information and at least one first storage subunit in the target storage unit; A third determining module, configured to determine, according to the target dimension identifier, a target data table corresponding to the target dimension identifier from a plurality of data tables in the target storage subunit; and the execution module is used for reading the target service data from the target data table and executing a target processing strategy on the target service data.
  10. 10. An electronic device, comprising: one or more processors; A memory for storing one or more computer programs, Characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1-8.
  11. 11. A computer-readable storage medium, on which a computer program or instructions is stored, which, when executed by a processor, carries out the steps of the method according to any one of claims 1-8.
  12. 12. A computer program product comprising a computer program or instructions which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 8.

Description

Data processing method, apparatus, device, medium, and program product Technical Field The application relates to the technical field of big data and financial science and technology, in particular to a data processing method, a device, equipment, a medium and a program product. Background Currently, in industries relying on large-scale active customer contact, such as banks and finance, outbound service management generally faces core challenges, such as flow splitting, manual operation, data island, and the like. The traditional outbound mode generally relies on offline mail approval, manual file transfer and scattered functional modules to carry out outbound project management, so that project starting period is long, customer data security is low, risk is high, cross-department resources cannot be comprehensively arranged, system expansibility is poor, and the method is difficult to adapt to rapidly-changing business requirements and requirements of digital transformation on security. Disclosure of Invention In view of the foregoing, the present application provides a data processing method, apparatus, device, medium, and program product. According to a first aspect of the application, a data processing method is provided, which comprises the steps of receiving a data processing instruction aiming at target service data, wherein the target service data is multi-dimensional data, the data processing instruction comprises target service corresponding to the target service data, a target mechanism and data identification information, determining target storage units for storing the target service data from a plurality of storage units according to the target service and the target mechanism, wherein the plurality of storage units are obtained by dividing a preset storage space into a plurality of logic areas according to the service corresponding to the plurality of service data, determining target storage subunits from a preset mapping relation set according to the data identification information, wherein the mapping relation set comprises the corresponding relation between the plurality of data identification information and at least one first storage subunit in the target storage units, determining a target data table corresponding to the target dimension identification from a plurality of data tables of the target storage subunits according to the target dimension identification, reading the target service data from the target data table, and executing a target processing strategy on the target service data. The application provides a data processing device, which comprises a receiving module, a first determining module and an executing module, wherein the receiving module is used for receiving a data processing instruction aiming at target service data, the target service data is multi-dimensional data, the data processing instruction comprises target service corresponding to the target service data, a target mechanism and data identification information, the first determining module is used for determining a target storage unit used for storing the target service data from a plurality of storage units according to the target service and the target mechanism, the plurality of storage units are obtained by dividing a preset storage space into a plurality of logic areas according to the service corresponding to the plurality of service data, the second determining module is used for determining a target storage subunit from a preset mapping relation set according to the data identification information, the mapping relation set comprises a plurality of data identification information and at least one first storage subunit in the target storage unit, the third determining module is used for determining a target data table corresponding to the target dimension identification from a plurality of data tables of the target storage subunit according to the target dimension identification, and executing a target processing strategy on the target service data from the target data table. A third aspect of the application provides an electronic device comprising one or more processors and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the method. A fourth aspect of the application also provides a computer readable storage medium having stored thereon a computer program or instructions which when executed by a processor performs the steps of the above method. The fifth aspect of the application also provides a computer program product comprising a computer program or instructions which, when executed by a processor, carries out the steps of the method described above. According to the embodiment of the application, at the data security level, the client data is constrained in different storage spaces by logically dividing the storage units based on service and mechanism identification and physically dividing