Search

CN-121979953-A - Data synchronization method and computing device

CN121979953ACN 121979953 ACN121979953 ACN 121979953ACN-121979953-A

Abstract

The application relates to the field of computing, in particular to a data synchronization method and a computing device, which are applied to the computing device, wherein the computing device comprises at least one driving program; determining a target driver matched with the data source to be synchronized from the at least one driver according to the data source type of the data source to be synchronized, acquiring the data of the field to be synchronized based on the target driver, processing the data of the field to be synchronized based on a preset data processing rule to obtain target data, and synchronizing the target data to target equipment.

Inventors

  • Cai Laishi

Assignees

  • 超聚变数字技术股份有限公司

Dates

Publication Date
20260505
Application Date
20260113

Claims (10)

  1. 1. A method of data synchronization, the method being applied to a computing device, the computing device including at least one driver, the method comprising: Receiving a synchronization request, wherein the synchronization request comprises a data source type of a data source to be synchronized and a field to be synchronized of the data source to be synchronized; determining a target driver matched with the data source to be synchronized from the at least one driver according to the data source type of the data source to be synchronized; Acquiring the data of the field to be synchronized based on the target driver; processing the data of the field to be synchronized based on a preset data processing rule to obtain target data; And synchronizing the target data to target equipment.
  2. 2. The method of claim 1, wherein the obtaining the data of the field to be synchronized based on the target driver comprises: Determining configuration parameters corresponding to the data source types of the data sources to be synchronized; and operating the target driver to acquire the data of the field to be synchronized based on the configuration parameters.
  3. 3. The method of claim 2, wherein the determining configuration parameters corresponding to the type of the data source to be synchronized comprises: inquiring configuration parameters corresponding to the data source types of the data sources to be synchronized based on a preset mapping table, wherein the mapping table comprises at least one mapping relation corresponding to the data source types, and the mapping relation comprises the data source types and the configuration parameters corresponding to the data source types.
  4. 4. A method according to any one of claims 1-3, further comprising: Receiving a registration request, wherein the registration request comprises driver information corresponding to an unregistered data source type; And in response to the registration request, registering a driver corresponding to the driver information, and storing the driver into the computing device.
  5. 5. The method of any one of claims 1-4, further comprising: Reading the current metadata of the data source to be synchronized; and if the current metadata are different from the metadata of the history of the data source to be synchronized, updating the metadata of the history based on the current metadata.
  6. 6. The method of any one of claims 1-5, wherein the data processing rules include data governance rules; The processing the data of the field to be synchronized based on the preset data processing rule to obtain target data includes: And carrying out data management on the data of the field to be synchronized based on a preset data management rule to obtain the target data.
  7. 7. The method of claim 6, wherein the performing data governance on the data of the field to be synchronized based on a preset data governance rule to obtain the target data comprises: Filtering error data in the data of the field to be synchronized and data which do not accord with a preset check rule to obtain filtered data; and converting the data which does not accord with the preset standard format in the filtered data into the data which accords with the standard format, and obtaining the target data.
  8. 8. The method according to any one of claims 1-7, wherein the processing the data of the field to be synchronized based on a preset data processing rule to obtain target data includes: And carrying out semantic mapping processing on the data of the field to be synchronized based on a preset semantic mapping rule to obtain the target data.
  9. 9. The method of claim 8, wherein the performing semantic mapping on the data of the field to be synchronized based on a preset semantic mapping rule to obtain the target data comprises: uniformly mapping the fields to be synchronized into standard semantic fields at different names of different data sources to obtain the values of the standard semantic fields, wherein the target data comprises the values of the standard semantic fields; And/or mapping different values of the same field to be synchronized in different data sources into standard values to obtain the standard values of the field to be synchronized, wherein the target data comprises the standard values of the field to be synchronized; And/or, if the field to be synchronized is updated in the data source to be synchronized, updating the value of the field to be synchronized in local synchronization to obtain the value of the field to be synchronized after being updated in synchronization, wherein the target data comprises the value of the field to be synchronized after being updated in synchronization; And/or if the field to be synchronized involves multiple times of computation of the same data object, executing one time of computation of the target value of the data object according to the data related to the data object in the data of the field to be synchronized, so as to obtain the computation result of the data object, wherein the target data comprises the computation result of the data object.
  10. 10. A computing device comprising a processor and a memory, the memory storing a computer program for use by the processor to invoke to perform the data synchronization method of any of claims 1-9.

Description

Data synchronization method and computing device Technical Field The present application relates to the field of computing, and in particular, to a data synchronization method and computing device. Background At present, some application management software/platforms/systems can provide high-performance data query service, support users to query and analyze a large amount of service data, do not need to perform modeling, aggregation and other processes on the service data, and greatly improve the query and management efficiency of the users on the service data. Whereas the business data required by the application management software/platform/system is typically sourced from a source system, the data stored in the source system may also be referred to as a data source. Application management software/platform/systems typically rely on ETL (Extract-Transform-Load) tools when synchronizing business data from a data source. That is, the ETL tool may extract business data from the data source and synchronize the extracted business data to the application management software, which is supplied to the application management software/platform/system to perform data processing, data presentation, drawing, etc. However, in the data synchronization mode completed by the traditional ETL tool, only one fixed data source can be synchronized in the data source synchronization process, so that the data synchronization application scene is limited, and the efficiency is low. Disclosure of Invention The embodiment of the application provides a data synchronization method and computing equipment, which realize dynamic access and data inquiry of a data source by dynamic access of the data source and automatic synchronization of data, expand a data synchronization scene and improve data synchronization efficiency. According to a first aspect of an embodiment of the present application, there is provided a data synchronization method applied to a computing device including at least one driver, the method including: A synchronization request is received, the synchronization request including a data source type of a data source to be synchronized and a field to be synchronized of the data source to be synchronized. And determining a target driver matched with the data source to be synchronized from at least one driver according to the data source type of the data source to be synchronized. Acquiring data of a field to be synchronized based on a target driver; And processing the data of the field to be synchronized based on a preset data processing rule to obtain target data. And synchronizing the target data to the target terminal. In the embodiment of the application, at least one driver is firstly configured in the computing device, and the driver can be used for accessing a data source and inquiring data in the data source. And receiving a synchronization request, wherein the synchronization request can comprise a data source type of a data source to be synchronized and a field to be synchronized, and the data source type is related to a driver of the data source, so that a target driver matched with the data source to be synchronized can be determined from at least one driver, the data source to be synchronized is connected based on the target driver, and the data of the field to be synchronized is read, thereby realizing automatic matching and quick connection of data source access, further improving the standardization, maintainability and expandability of the data source access, reducing the access difficulty of the data source, and improving the access efficiency. In addition, through setting of preset data processing rules, the data of the fields to be synchronized are subjected to regularization processing, so that target data are normalized and standardized, data with higher quality are provided for target equipment, and data effectiveness is improved. In addition, whether the data source to be synchronized is one or a plurality of data sources, whether the data source to be synchronized is a single type data source or a plurality of types of data sources, the data query and the synchronization can be completed through the automatic adaptation of the target driver of each data source, the problem of limitation of the traditional data synchronization mode is solved, and the data synchronization has higher expandability and high efficiency. With reference to the first aspect, in some implementations of the first aspect, acquiring, based on the target driver, data of a field to be synchronized includes: determining configuration parameters corresponding to the data source types of the data sources to be synchronized; And based on the configuration parameters, operating the target driver to acquire the data of the field to be synchronized. In the embodiment of the application, the configuration parameters corresponding to the data source type of the data source to be synchronized are determined, the configuration parameter