CN-116594990-B - Cross-database data management method, device, equipment and computer storage medium

Abstract

The embodiment of the invention relates to the technical field of databases and discloses a method, a device, equipment and a computer storage medium for managing data across databases, wherein the method comprises the steps of receiving analysis object configuration information generated by a user based on a database configuration template; according to the method, the device and the system, the data to be analyzed are respectively extracted from a plurality of target databases according to the information of the data to be analyzed, and are converted into target data in a standard database, the target data analysis rule corresponding to the target data is determined according to analysis rule configuration information generated by a user based on a data analysis rule configuration template corresponding to the standard database, the target data is subjected to data analysis in the standard database according to the target data analysis rule, and data analysis results are obtained and returned to the user.

Inventors

• LI MINGJUN
• Zuo Yinkang

Assignees

• 国信证券股份有限公司

Dates

Publication Date

20260512

Application Date

20230524

Claims (10)

1. 1. A method of cross-database data management, the method comprising: Receiving analysis object configuration information generated by a user based on a database configuration template, wherein the database configuration template comprises information configuration items of a plurality of selectable databases; determining a plurality of target databases and information of data to be analyzed in the plurality of target databases from a plurality of selectable databases according to the analysis object configuration information, and respectively extracting the data to be analyzed from the plurality of target databases according to the information of the data to be analyzed; Converting the data to be analyzed into target data in a standard database; Determining a target data analysis rule corresponding to the target data according to analysis rule configuration information generated by a user based on a data analysis rule configuration template corresponding to the standard database, wherein the data analysis rule configuration template comprises a plurality of selectable data analysis rules, the analysis rule configuration information comprises rule selection information of the user for the plurality of selectable data analysis rules, the selectable data analysis rules are predetermined according to historical data management requirements and data processing specifications of the standard database, the data analysis rule configuration template further comprises a plurality of selectable service analysis types, the analysis rule configuration information further comprises service selection information of the user for the plurality of selectable service analysis types, the analysis rule configuration information further comprises service threshold setting information, and the analysis rule configuration information comprises rule execution action triggering conditions; Performing data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result; And returning the data analysis result to the user.
2. 2. The method of claim 1, wherein the analysis object configuration information includes database selection information, database connection parameters, and analysis object selection information, wherein the determining a plurality of target databases from a plurality of selectable databases according to the analysis object configuration information and information of data to be analyzed in the plurality of target databases, and the extracting the data to be analyzed from the plurality of target databases according to the information of the data to be analyzed respectively includes: determining the target databases from the selectable databases according to the database selection information; Respectively connecting the plurality of target databases according to the database connection parameters respectively corresponding to the plurality of target databases, and displaying optional data in the plurality of target databases to the user; Acquiring the analysis object selection information of the user aiming at the selectable data input of each target database; searching in the multiple target databases according to the analysis object selection information to obtain the information of the data to be analyzed.
3. 3. The method of claim 1, wherein the plurality of target databases are heterogeneous databases, and wherein converting the data to be analyzed to target data in a standard database comprises: performing association analysis on the data to be analyzed to obtain a data association relationship; carrying out data fusion on the data to be analyzed according to the data association relation to obtain data to be stored corresponding to a target field in the standard database; And storing the data to be stored according to the data storage type corresponding to the target field to obtain the target data.
4. 4. The method according to claim 1, wherein the determining the target data analysis rule corresponding to the target data according to analysis rule configuration information generated by a user based on the data analysis rule configuration template corresponding to the standard database includes: And determining the target data analysis rule from the plurality of selectable data analysis rules according to the rule selection information.
5. 5. The method of claim 4, wherein the performing data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result comprises: Determining rule execution sequences between a data preprocessing rule and the target data analysis rule according to the service selection information; Preprocessing the target data according to the data preprocessing rule to obtain preprocessed data; And executing the target data analysis rule on the preprocessed data according to the rule execution sequence to obtain the data analysis result.
6. 6. The method according to claim 5, wherein the performing data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result includes: And carrying out alarm analysis on the data analysis result according to the service threshold setting information.
7. 7. The method according to claim 1, wherein the performing data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result includes: detecting current scene information in real time; And when the current scene information is determined to meet the rule execution action triggering condition, carrying out data analysis on the data to be analyzed according to the target data analysis rule to obtain a data analysis result.
8. 8. A data management apparatus across a database, the apparatus comprising: The system comprises a first configuration module, a second configuration module and a third configuration module, wherein the first configuration module is used for receiving analysis object configuration information generated by a user based on a database configuration template, and the database configuration template comprises information configuration items of a plurality of selectable databases; The extraction module is used for determining a plurality of target databases and information of data to be analyzed in the plurality of target databases from a plurality of selectable databases according to the analysis object configuration information, and respectively extracting the data to be analyzed from the plurality of target databases according to the information of the data to be analyzed; The conversion module is used for converting the data to be analyzed into target data in a standard database; The system comprises a standard database, a second configuration module, an analysis rule configuration module and a service threshold setting module, wherein the standard database is used for storing a plurality of standard data, the second configuration module is used for determining a target data analysis rule corresponding to target data according to analysis rule configuration information generated by a user based on a data analysis rule configuration template corresponding to the standard database, the data analysis rule configuration template comprises a plurality of selectable data analysis rules, the analysis rule configuration information comprises rule selection information of the user for the plurality of selectable data analysis rules, the selectable data analysis rules are predetermined according to historical data management requirements and data processing specifications of the standard database, the data analysis rule configuration template further comprises a plurality of selectable service analysis types, the analysis rule configuration information further comprises service selection information of the user for the plurality of selectable service analysis types, and the analysis rule configuration information further comprises service threshold setting information; The analysis module is used for carrying out data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result; and the return module is used for returning the data analysis result to the user.
9. 9. The data management device crossing the database is characterized by comprising a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete mutual communication through the communication bus; the memory is configured to store at least one executable instruction that causes the processor to perform the operations of the cross-database data management method of any one of claims 1-7.
10. 10. A computer readable storage medium having stored therein at least one executable instruction which, when run on a data management device across databases, causes the data management device across databases to perform the operations of the data management method across databases of any of claims 1-7.

Description

Cross-database data management method, device, equipment and computer storage medium Technical Field The embodiment of the invention relates to the technical field of databases, in particular to a method, a device and equipment for managing data across databases and a computer storage medium. Background As the concept of redemption of data elements and data values continues to go deep, high quality data has become an essential element in driving enterprise strategy, decision making, marketing, wind control, research processes. In particular, in data-intensive industries such as the financial industry, data quality is related to each system, report, and business decision. Therefore, data quality management for databases is critical. The existing data distribution forms are various, the data scale is huge, the data sensitivity is high, the data application scene is complex, and in order to ensure the data quality, each system generally develops a data quality check task aiming at the database. The inventor finds that when there is a data management requirement of crossing databases, especially heterogeneous databases, if data of multiple databases need to be compared to determine whether the data are consistent, isolation exists between the databases due to deployment positions or network non-intercommunication among the databases, and the code languages and management rules of the heterogeneous databases are different, so that the data management of the multiple databases cannot be simultaneously realized through independent data management codes, which results in lower data management efficiency of crossing databases of the multiple databases. In addition, when managing a plurality of databases, a database manager is often required to write data management codes manually, which requires the manager to master related technologies of the databases at the same time, so that the requirements of the manager are high, and the code reusability is low, thereby resulting in low efficiency of the existing data management across databases. Thus, there is a need for a more efficient and practical method of data management across databases. Disclosure of Invention In view of the above problems, embodiments of the present invention provide a method for managing data across databases, which is used to solve the problem in the prior art that the efficiency of data management across databases is low. According to an aspect of an embodiment of the present invention, there is provided a data management method across databases, the method including: Receiving analysis object configuration information generated by a user based on a database configuration template, wherein the database configuration template comprises information configuration items of a plurality of selectable databases; determining a plurality of target databases and information of data to be analyzed in the plurality of target databases from a plurality of selectable databases according to the analysis object configuration information, and respectively extracting the data to be analyzed from the plurality of target databases according to the information of the data to be analyzed; Converting the data to be analyzed into target data in a standard database; determining a target data analysis rule corresponding to the target data according to analysis rule configuration information generated by a user based on a data analysis rule configuration template corresponding to the standard database; Performing data analysis on the target data in the standard database according to the target data analysis rule to obtain a data analysis result; And returning the data analysis result to the user. In an optional manner, the analysis object configuration information includes database selection information, database connection parameters, and analysis object selection information, and the method further includes: determining the target databases from the selectable databases according to the database selection information; Respectively connecting the plurality of target databases according to the database connection parameters respectively corresponding to the plurality of target databases, and displaying optional data in the plurality of target databases to the user; Acquiring the analysis object selection information of the user aiming at the selectable data input of each target database; searching in the multiple target databases according to the analysis object selection information to obtain the information of the data to be analyzed. In an alternative way, the plurality of target databases are heterogeneous databases, and the method further comprises: performing association analysis on the data to be analyzed to obtain a data association relationship; carrying out data fusion on the data to be analyzed according to the data association relation to obtain data to be stored corresponding to a target field in the standard database; And storing the data to be stored accord