CN-122019506-A - Information integration service data migration representation method based on multi-mode migration learning

CN122019506ACN 122019506 ACN122019506 ACN 122019506ACN-122019506-A

Abstract

The invention discloses an information integration service data migration representation method based on multi-mode migration learning, which relates to the technical field of electric data processing and comprises the steps of obtaining information integration service data conforming to migration standards, and carrying out data classification processing on the information integration service data conforming to the migration standards by taking data types as references to obtain different types of information service data. The method comprises the steps of firstly screening the information integration service data to be migrated, removing the information integration service data with serious defects, guaranteeing the integrity of the data, reducing the storage pressure of the data storage device, then carrying out feature matching on the information integration service data meeting the migration standard, storing the information integration service data with the same features in the same position, and when the information integration service data with the same features is subsequently called, calling the information integration service data with all the features in a short time, thereby shortening the calling time of the information integration service data.

Inventors

WANG ZHENYU
LV JIESHENG

Assignees

深圳市宇昇宝电子有限公司

Dates

Publication Date: 20260512
Application Date: 20260203

Claims (9)

1. The information integration service data migration representation method based on multi-mode migration learning is characterized by comprising the following steps of: Acquiring information integration service data to be migrated, and performing data screening processing on the information integration service data to be migrated based on a data management terminal to acquire information integration service data meeting migration standards; based on the data management terminal, carrying out data classification processing on the information integration service data meeting the migration standard by taking the data type as a reference to obtain different types of information service data, wherein the data type comprises image data, voice data and text data; based on the data management terminal, carrying out data content analysis on different types of information service data to obtain different types of data content characteristics; Based on the data management terminal, carrying out feature matching processing on the features of different types of data content, and determining different types of information service data of similar content; based on the data management terminal, a parent folder is established in the storage device with similar contents, and different types of information service data of the similar contents are stored in the parent folder.
2. The method for representing the information integration service data migration based on the multi-mode migration learning according to claim 1, wherein the step of obtaining the information integration service data to be migrated, based on the data management terminal, performs data screening processing on the information integration service data to be migrated, and obtains the information integration service data meeting the migration standard specifically comprises the following steps: Based on the data management terminal, carrying out data calling processing on the database system to obtain information integration service data to be migrated; based on the data management terminal, carrying out data analysis processing on the information integration service data to be migrated, and obtaining the proportion of clear data and the proportion of unclear data; And based on the data management terminal, comparing and analyzing the proportion of the clear data and the proportion of the unclear data to obtain the information integration service data meeting the migration standard.
3. The method for representing the data migration of the information integration service based on the multi-mode migration learning according to claim 2, wherein the data analysis processing is performed on the data of the information integration service to be migrated based on the data management terminal, and the proportion of clear data and the proportion of unclear data are obtained specifically comprises the following steps: Based on the data management terminal, marking the data content in the information integration service data to be migrated, and determining the position of the clear data and the position of the unclear data; Based on the data management terminal, respectively carrying out data calculation processing on the position of the clear data and the position of the unclear data to obtain clear data memory information and unclear data memory information; Based on the data management terminal, performing data reading processing on attribute information of the information integration service data to be migrated, and acquiring memory information of the information integration service data to be migrated; based on the data management terminal, the memory information of the clear data and the memory information of the unclear data are respectively calculated according to the memory information of the information integrated service data to be migrated, and the proportion of the clear data and the proportion of the unclear data are determined.
4. The method for data migration and expression of information integration service based on multi-modal migration learning of claim 3, wherein the data management terminal performs a comparative analysis process on the proportion of clear data and the proportion of unclear data to obtain information integration service data meeting migration standards, and the method specifically comprises the following steps: based on the data management terminal, calculating the proportion of clear data and the proportion of unclear data to obtain a data loss factor of the information integration service data; Based on the data management terminal, judging and processing the data deletion degree coefficient of the information integration service data and the set data deletion threshold value; If the data missing degree coefficient of the information integration service data is larger than or equal to a set data missing threshold value, the information integration service data to be migrated is seriously missing and does not accord with the data migration standard; If the data missing degree coefficient of the information integration service data is smaller than the set data missing threshold, the data missing degree coefficient accords with the data migration standard, and the data smaller than the set data missing threshold is set as the information integration service data which accords with the migration standard.
5. The method for data migration and representation of information integration service based on multi-modal migration learning according to claim 1, wherein the data content analysis is performed on different types of information service data based on the data management terminal, and the step of obtaining different types of data content features specifically includes the following steps: Based on the data management terminal, carrying out content analysis processing on different types of information service data to acquire all characteristic information in the information service data; Based on the data management terminal, carrying out characteristic duty ratio calculation processing on different types of information service data by taking all characteristic information in the information service data as reference, and determining the proportion of different characteristic information; based on the maximum function, carrying out feature sorting processing on the proportion of different feature information, and determining the maximum value of the proportion of different feature information; and setting the characteristic information corresponding to the maximum value of the proportion of the different characteristic information as different types of data content characteristics based on the data management terminal.
6. The method for representing the data migration of the information integration service based on the multi-modal migration learning of claim 5, wherein the feature matching process is performed on the features of the data content of different types based on the data management terminal, and the determining of the data of the information service of different types of similar content specifically includes the following steps: based on the data management terminal, carrying out intersection processing on different types of data content characteristics, and determining information service data with the same main data characteristics; based on the data management terminal, carrying out information reading processing on attribute data of information service data with the same main data characteristics, and obtaining memory information of the information service data with the same main data characteristics; Based on the data management terminal, carrying out data grading processing according to the memory information of the information service data with the same main data characteristics, and determining the information service data with different memory grades; And carrying out feature matching processing on the information service data with different memory grades based on the data management terminal, and determining different types of information service data with similar contents.
7. The method for representing the information integration service data migration based on the multi-modal migration learning of claim 6, wherein the feature matching processing is performed on the information service data with different memory levels based on the data management terminal, and the determining of the information service data with different types of similar contents specifically includes the following steps: Based on the data management terminal, performing intersection processing on all feature information corresponding to the information service data with different memory grades, and determining the information service data with the same data feature; Based on the data management terminal, carrying out data analysis processing on the information service data with the same data characteristics, and obtaining the proportion of the same data characteristics in the information service data; based on the data management terminal, comparing and analyzing the proportion of the same data characteristic in the information service data, and determining different types of information service data with similar content.
8. The method for data migration and representation of information integration service based on multi-modal migration learning according to claim 8, wherein the data management terminal performs a comparative analysis process on the proportion of the same data feature in the information service data, and determines different types of information service data of similar content specifically includes the following steps: based on the data management terminal, judging the proportion of the same data features in the information service data and setting a proportion threshold; if the proportion of the same data features in the information service data is greater than or equal to the set proportion threshold, setting the information service data which is greater than or equal to the set proportion threshold as different types of information service data with similar content; If the proportion of the same data features in the information service data is smaller than the set proportion threshold, the information service data smaller than the set proportion threshold is stored independently based on the data management terminal.
9. An information integration service data migration representation system based on multi-modal migration learning, which is used for realizing the information integration service data migration representation method based on multi-modal migration learning as set forth in any one of claims 1-8, and is characterized by comprising: the data management terminal is used for controlling the data transmission and information interaction among the modules, and is used for controlling the modules to perform data screening, data classification, data content analysis and feature matching on the information integration service data to be migrated, and determining different types of information service data of similar content; The database system is used for storing information integration service data to be migrated; The data screening module is used for carrying out missing degree comparison processing on the information integration service data to be migrated to obtain information integration service data meeting migration standards; The data classification module is used for carrying out data classification processing on the information integration service data meeting the migration standard according to the data types to obtain information service data of different types; the data characteristic determining module is used for carrying out content analysis and characteristic sequencing on different types of information service data to obtain different types of data content characteristics; And the data characteristic matching module is used for carrying out data calculation and data comparison on the data content characteristics of different types and determining the information service data of different types of similar contents.

Description

Information integration service data migration representation method based on multi-mode migration learning Technical Field The invention relates to the technical field of electric data processing, in particular to an information integration service data migration representation method based on multi-mode migration learning. Background The information integration service data refers to a data set collected, integrated, converted, transmitted and managed through the information integration service. Such data is typically characterized by multi-source heterogeneous, standardized integration, unified views, etc., and is a core data asset supporting the scenarios of enterprise data middle tables, data warehouse, business analysis, etc. When information integration service data of the data storage device are migrated, if data with similar characteristics are not stored in the same position, and then when the data with the characteristics need to be fetched, data retrieval is needed from different positions of the data storage device, so that the fetching time of the data is prolonged. Disclosure of Invention In order to solve the technical problems, the technical scheme solves the problems in the background technology by providing an information integration service data migration representation method based on multi-mode migration learning. In order to achieve the above purpose, the invention adopts the following technical scheme: the information integration service data migration representation method based on multi-mode migration learning comprises the following steps: Acquiring information integration service data to be migrated, and performing data screening processing on the information integration service data to be migrated based on a data management terminal to acquire information integration service data meeting migration standards; based on the data management terminal, carrying out data classification processing on the information integration service data meeting the migration standard by taking the data type as a reference to obtain different types of information service data, wherein the data type comprises image data, voice data and text data; based on the data management terminal, carrying out data content analysis on different types of information service data to obtain different types of data content characteristics; Based on the data management terminal, carrying out feature matching processing on the features of different types of data content, and determining different types of information service data of similar content; based on the data management terminal, a parent folder is established in the storage device with similar contents, and different types of information service data of the similar contents are stored in the parent folder. Preferably, the obtaining the information integration service data to be migrated, based on the data management terminal, performs data screening processing on the information integration service data to be migrated, and obtains the information integration service data meeting the migration standard specifically includes the following steps: Based on the data management terminal, carrying out data calling processing on the database system to obtain information integration service data to be migrated; based on the data management terminal, carrying out data analysis processing on the information integration service data to be migrated, and obtaining the proportion of clear data and the proportion of unclear data; And based on the data management terminal, comparing and analyzing the proportion of the clear data and the proportion of the unclear data to obtain the information integration service data meeting the migration standard. Preferably, the data analysis processing is performed on the information integration service data to be migrated based on the data management terminal, and the proportion of clear data and the proportion of unclear data are obtained, which specifically comprises the following steps: Based on the data management terminal, marking the data content in the information integration service data to be migrated, and determining the position of the clear data and the position of the unclear data; Based on the data management terminal, respectively carrying out data calculation processing on the position of the clear data and the position of the unclear data to obtain clear data memory information and unclear data memory information; Based on the data management terminal, performing data reading processing on attribute information of the information integration service data to be migrated, and acquiring memory information of the information integration service data to be migrated; based on the data management terminal, the memory information of the clear data and the memory information of the unclear data are respectively calculated according to the memory information of the information integrated service data to be migrated, and the proportio