CN-121979895-A - Data filling management method, system, equipment and storage medium

CN121979895ACN 121979895 ACN121979895 ACN 121979895ACN-121979895-A

Abstract

The invention relates to the technical field of data processing, in particular to a data filling management method, a system, equipment and a storage medium, which comprise the steps of responding to the operation of version updating of a dynamic service index library, obtaining a new version draft and a current effective version of the dynamic service index library; the method comprises the steps of comparing a new version draft with a current effective version, identifying changed indexes, analyzing the influence range of the changed indexes in a data filling management system based on the changed indexes, wherein the influence range at least comprises associated filling tasks and early warning rules, and carrying out linkage updating on corresponding modules in the data filling management system according to the influence range, wherein the linkage updating at least comprises updating index definitions in the associated filling tasks and updating associated early warning rules. The invention avoids the problem of data caliber confusion caused by rule change, and remarkably enhances the self-adaptive capacity and the long-term data management level of the system.

Inventors

ZHOU YONGJIE
XU HONGWEI
LUO CHAO

Assignees

浪潮卓数大数据产业发展有限公司

Dates

Publication Date: 20260505
Application Date: 20260109

Claims (10)

1. A data-filling management method, comprising: responding to the operation of version updating of the dynamic service index library, and acquiring a new version draft and a current effective version of the dynamic service index library; Comparing the new version draft with the current effective version, and identifying the index which is changed; analyzing the influence range of the index in the data filling management system based on the changed index, wherein the influence range at least comprises an associated filling task and an associated early warning rule; and carrying out linkage updating on the corresponding modules in the data filling management system according to the influence range, wherein the linkage updating at least comprises updating index definition in associated filling tasks and updating associated early warning rules.
2. The method of claim 1, wherein obtaining a new version draft and a current effective version of the dynamic business index library in response to an operation for version update of the dynamic business index library comprises: Receiving an attribute modification instruction for at least one indicator; generating a new version draft of the dynamic business index library based on the attribute modification instruction, wherein the new version draft is in an isolated state before release, and does not influence any reporting task and early warning rule running in the system; and reading the version marked as the current effective version from the database as the current effective version.
3. The method of claim 2, wherein generating a new version draft of the dynamic business index base comprises: creating a new record containing a new version number for the at least one index in an index information table of the database, wherein the new record contains index attributes updated according to the attribute modification instruction; And keeping the version number and the effective state of the original records in the index information table unchanged.
4. The method of claim 1, wherein comparing the new version draft with the current effective version identifies an index of change comprising: invoking a difference comparison unit to carry out traversal comparison on the new version draft and the index set in the current effective version; Classifying the changed index into a new index, a deletion index or an attribute modification index based on the comparison result; the difference comparison unit realizes traversal comparison by performing the following operations: Extracting a unique identifier and an attribute set of each index in the new version draft, and calculating a first characteristic value of the unique identifier and the attribute set; Extracting a unique identifier and an attribute set of each index in the current effective version, and calculating a second characteristic value of the unique identifier and the attribute set; and identifying the index which is changed and the change type thereof by comparing the first characteristic value with the second characteristic value or directly comparing the field content of the attribute set.
5. The method of claim 1, wherein analyzing the range of impact in the data-filling management system based on the changed indicator comprises: inquiring and filling a task list, and screening out a task record which refers to the unique identifier of the index changed in the task configuration information and has a task state of being in progress or not started; querying an early warning rule table, and screening rule records of unique identifiers of the changed indexes in rule definition; querying a historical data table, screening out a data record of which the data content contains a unique identifier of the changed index and the version number of the associated business index library is the current effective version; according to the query result, determining the influence range, wherein the influence range specifically comprises: An associated fill task whose status is a task that is in progress or not started and that references the index that changed; an associated early warning rule based on an anomaly detection or data verification rule defined by the changed index; And the associated historical data is a historical report data record which is generated under the current effective version and contains the changed index.
6. The method of claim 1, wherein the performing, according to the impact range, the linkage update on the corresponding module in the data filling management system includes: triggering a background linkage update job which performs at least one of the following operations based on the affected objects identified in the scope of influence: The task module updates, namely, for the associated filling task, automatically updating definition, calculation formula or check logic corresponding to the changed index in a task template or configuration of the task module; The performance module updates, namely, for the associated early warning rule, automatically updating the calculation parameter, threshold value or judging condition corresponding to the changed index in the rule configuration; And updating the data storage module, namely relating to the related historical data and marking the corresponding historical version identification of the dynamic business index library for the related or marked historical data.
7. The method of claim 6, wherein the corresponding module, after the linkage update is completed, is based on the updated configuration management data, comprising: The task module is used for automatically generating or adapting to a filling report template of a subsequent period based on the updated index definition and providing a filling interface containing a new calculation formula or check logic for a filling user; the performance module is used for automatically executing abnormal monitoring and quality checking on the filled data submitted according to the new version business index library based on the updated early warning rule; and the data storage module is used for distinguishing and prompting data under different version rules when providing historical data inquiry or comparison analysis according to the marked historical data version identification.
8. A data-filling management system, comprising: The index updating module is used for responding to the operation of version updating of the dynamic service index library and obtaining a new version draft and a current effective version of the dynamic service index library; the change identification module is used for comparing the new version draft with the current effective version and identifying the index with change; the influence analysis module is used for analyzing the influence range of the changed index in the data filling management system based on the changed index, wherein the influence range at least comprises an associated filling task and an associated early warning rule; and the linkage updating module is used for carrying out linkage updating on the corresponding module in the data filling management system according to the influence range, and the linkage updating at least comprises updating the index definition in the associated filling task and updating the associated early warning rule.
9. A data-filling management apparatus, comprising: the memory is used for storing a data filling management program; a processor for implementing the steps of the data reclamation management method according to any of claims 1-7 when executing the data reclamation management program.
10. A computer readable storage medium storing a computer program, characterized in that the readable storage medium has stored thereon a data-filling management program, which, when executed by a processor, implements the steps of the data-filling management method according to any of claims 1-7.

Description

Data filling management method, system, equipment and storage medium Technical Field The invention belongs to the technical field of data processing, and particularly relates to a data filling management method, a system, equipment and a storage medium. Background Conventional data-filling management systems typically employ a static index library. When the business rule changes and index definition needs to be adjusted, an administrator needs to manually search and update related filling tasks, report templates and early warning rules in a plurality of modules respectively. The process is tedious and low-efficiency, and is easy to miss or error, so that task execution and rule requirements are disjointed. Meanwhile, the history data is lack of a correlation record with index definition change, so that caliber confusion is easy to generate in subsequent analysis, and decision accuracy is affected. The prior art lacks an intelligent management mechanism capable of automatically sensing the influence range and updating the relevant system configuration in parallel when the index is changed. Disclosure of Invention In order to solve the above-mentioned shortcomings of the prior art, the present invention provides a data filling management method, system, device and storage medium, so as to solve the above-mentioned technical problems. In a first aspect, the present invention provides a data filling management method, including: responding to the operation of version updating of the dynamic service index library, and acquiring a new version draft and a current effective version of the dynamic service index library; Comparing the new version draft with the current effective version, and identifying the index which is changed; analyzing the influence range of the index in the data filling management system based on the changed index, wherein the influence range at least comprises an associated filling task and an associated early warning rule; and carrying out linkage updating on the corresponding modules in the data filling management system according to the influence range, wherein the linkage updating at least comprises updating index definition in associated filling tasks and updating associated early warning rules. In an alternative embodiment, in response to an operation of updating a version of the dynamic business index library, obtaining a new version draft and a current effective version of the dynamic business index library includes: Receiving an attribute modification instruction for at least one indicator; generating a new version draft of the dynamic business index library based on the attribute modification instruction, wherein the new version draft is in an isolated state before release, and does not influence any reporting task and early warning rule running in the system; and reading the version marked as the current effective version from the database as the current effective version. In an alternative embodiment, generating a new version draft of the dynamic business index base includes: creating a new record containing a new version number for the at least one index in an index information table of the database, wherein the new record contains index attributes updated according to the attribute modification instruction; And keeping the version number and the effective state of the original records in the index information table unchanged. In an alternative embodiment, comparing the new version draft with the current effective version, and identifying the changed index includes: invoking a difference comparison unit to carry out traversal comparison on the new version draft and the index set in the current effective version; Classifying the changed index into a new index, a deletion index or an attribute modification index based on the comparison result; the difference comparison unit realizes traversal comparison by performing the following operations: Extracting a unique identifier and an attribute set of each index in the new version draft, and calculating a first characteristic value of the unique identifier and the attribute set; Extracting a unique identifier and an attribute set of each index in the current effective version, and calculating a second characteristic value of the unique identifier and the attribute set; and identifying the index which is changed and the change type thereof by comparing the first characteristic value with the second characteristic value or directly comparing the field content of the attribute set. In an alternative embodiment, analyzing the influence range of the change in the data filling management system based on the changed index includes: inquiring and filling a task list, and screening out a task record which refers to the unique identifier of the index changed in the task configuration information and has a task state of being in progress or not started; querying an early warning rule table, and screening rule records of unique identifiers of the ch