CN-121858307-B - Dynamic mapping and project resource scheduling method and system based on meta-protocol

CN121858307BCN 121858307 BCN121858307 BCN 121858307BCN-121858307-B

Abstract

The invention discloses a dynamic mapping and project resource scheduling method and system based on meta-protocol, the method generates a standard meta-protocol file by defining a unified meta-protocol specification, configuring and checking the core and extension information of an algorithm. Based on the method, an algorithm adaptation plug-in is automatically matched or generated, repairing operation dependence is detected, and an intelligent calling agent is generated and tested by combining data interaction rules and historical fault records to complete algorithm access. In the data interaction stage, the conversion parameters are dynamically optimized by utilizing the trained parameter prediction model, and accurate data mapping and iterative optimization are executed. And in the resource scheduling stage, integrating the running environment demand, the resource consumption trend and the real-time state, actively predicting the resource demand peak value through a time sequence prediction model, and executing dynamic resource allocation and isolation based on the prediction result. The invention realizes the automation of algorithm access, the intellectualization of data interaction and the forecast of resource scheduling, and remarkably improves the integration efficiency, the data accuracy and the system stability.

Inventors

DOU YAJIE
XIE YUWEN
DAI YULONG
CHEN HAOXUAN
LI JIAQING
Kang Weifan
XIONG BINGCHENG
SUN JIANBIN
Tang Shuaiwen

Assignees

中国人民解放军国防科技大学

Dates

Publication Date: 20260512
Application Date: 20260317

Claims (10)

1. A dynamic mapping and project resource scheduling method based on meta-protocol is characterized by comprising the following steps: Configuring a target algorithm according to a preset meta-protocol specification to generate a meta-protocol initial configuration file, and checking the meta-protocol initial configuration file; Analyzing the standard meta-protocol file, extracting core information and extension information from the standard meta-protocol file, and storing the core information and the extension information into a meta-information library; Matching or generating a corresponding algorithm adaptation plug-in based on the algorithm language type in the core information, and automatically detecting and repairing the dependence of the operation environment based on the operation environment demand in the core information; generating a call agent corresponding to the algorithm adaptation plug-in based on the data interaction rule in the core information and the historical fault record in the extension information, and testing the call agent; Responding to the accessed data interaction request of the target algorithm, acquiring a corresponding data interaction rule from the meta information library, executing data conversion and dynamic mapping based on the data interaction rule, the trained parameter prediction model and the data characteristics of the current interaction data, and recording mapping deviation to iteratively optimize subsequent mapping; Responding to a resource scheduling request aiming at the target algorithm, based on the running environment demand and the resource consumption trend data stored in the meta-information base, combining the current node real-time resource state and the real-time resource demand of the data conversion and dynamic mapping process, utilizing a preset time sequence prediction model to predict the resource demand, and executing dynamic resource scheduling based on the prediction result and the real-time resource state.
2. The method for dynamically mapping and scheduling project resources based on meta-protocol according to claim 1, wherein the core information at least comprises unique identification of the target algorithm, algorithm language type, data interaction rule, running environment requirement and version number; the extension information at least comprises algorithm interaction frequency, historical fault records and resource consumption trend data.
3. The dynamic mapping and project resource scheduling method based on meta-protocol according to claim 1, wherein the matching or generating the corresponding algorithm adaptation plug-in based on the algorithm language type in the core information, and automatically detecting and repairing the running environment dependency based on the running environment requirement in the core information, comprises the following steps: based on the algorithm language type, searching matched algorithm adaptation plugins from a preset adaptation plugin library; If the search is successful, loading a matched algorithm adaptation plug-in unit, if the search is failed, analyzing an interface of the target algorithm through a grammar tree according to the algorithm language type and the data interaction rule, matching a preset language template, and injecting data verification logic defined by the data interaction rule to generate a new algorithm adaptation plug-in unit; After loading or generating the algorithm adaptation plug-in, detecting whether the current running environment meets the running environment requirements, and executing automatic repair on missing or unmatched dependent items.
4. The method for dynamically mapping and scheduling project resources based on meta-protocol according to claim 3, wherein said generating a call agent corresponding to said algorithm adaptation plug-in based on data interaction rules in said core information and history fault records in said extension information, testing said call agent, registering said call agent to an agent management library after the test is passed, completing the access of said target algorithm comprises the steps of: Invoking a proxy template corresponding to the algorithm language type, injecting a invoking rule and data checking logic defined by the data interaction rule into the proxy template, and injecting fault tolerant logic based on the fault type indicated by the historical fault record to generate an executable invoking proxy code; Based on the call agent code, performing parameter interception, data compliance and connectivity testing; and if the test is passed, registering the calling agent to an agent management library to complete the access of the target algorithm.
5. The meta-protocol based dynamic mapping and project resource scheduling method of claim 1, wherein the obtaining the corresponding data interaction rule from the meta-information base in response to the data interaction request for the accessed target algorithm, and performing data conversion and dynamic mapping based on the data interaction rule, the trained parameter prediction model and the data characteristics of the current interaction data, while recording mapping deviation to iteratively optimize the subsequent mapping, comprises the steps of: responding to the data interaction request, and extracting the data characteristics of the current interaction data; inputting the data characteristics into the trained parameter prediction model, and outputting optimal data conversion parameters; Matching a corresponding mapping rule in a dynamic mapping library according to the data interaction rule, and performing type conversion and format adaptation on the current interaction data based on the mapping rule and the optimal data conversion parameter to generate adaptation data conforming to the data interaction rule; And calculating the mapping deviation rate of the data conversion, and iteratively updating the mapping rule in the dynamic mapping library based on the mapping deviation rate.
6. The meta-protocol based dynamic mapping and project resource scheduling method of claim 5, wherein the trained parametric prediction model is obtained by: Performing iterative training on a linear regression model fitted by a least square method by using historical mapping data and using a gradient descent method to obtain the target of minimizing the conversion deviation; Wherein the data features include at least data type encoding and interactive scene encoding.
7. The dynamic mapping and project resource scheduling method based on meta-protocol according to claim 1, wherein the responding to the resource scheduling request for the target algorithm, based on the running environment demand and the resource consumption trend data stored in the meta-information base, combines the current node real-time resource status and the real-time resource demand of the data conversion and dynamic mapping process, performs resource demand prediction by using a preset time sequence prediction model, and performs dynamic resource scheduling based on the prediction result and the real-time resource status, and comprises the following steps: Responding to a resource scheduling request, and forming resource scheduling decision data according to the running environment demand and the historical consumption mode represented by the resource consumption trend data by combining the real-time resource state and the real-time resource demand of the data conversion process; Invoking the preset time sequence prediction model, and predicting a resource demand peak value of an future period based on historical consumption data in the resource scheduling decision data; Generating a resource allocation scheme based on the resource demand peak and the real-time resource status; And allocating and isolating exclusive computing resources and operating environments for the target algorithm and the data conversion process through a resource isolation mechanism.
8. The method for dynamic mapping and project resource scheduling based on meta-protocol as claimed in claim 7, wherein the preset time sequence prediction model adopts a moving average method, which calculates the predicted value of resource demand in the same period in the future based on the actual consumption value of the resource in the same period in the past N periods, wherein N is a positive integer.
9. The meta-protocol based dynamic mapping and project resource scheduling method according to claim 8, wherein the resource demand prediction formula of the preset time sequence prediction model is: ; Wherein, the For a predicted value of resource demand for a future period, For the past first With the same period of time Is a value of the actual consumption of resources of (a), The number of cycles used to calculate the average value is a positive integer.
10. A meta-protocol based dynamic mapping and project resource scheduling system, comprising: the verification and protocol generation module is used for configuring a target algorithm according to a preset meta-protocol specification to generate a meta-protocol initial configuration file, and verifying the meta-protocol initial configuration file; The information extraction and storage module is used for analyzing the standard meta-protocol file, extracting core information and extension information in the standard meta-protocol file and storing the core information and the extension information into a meta-information base; The plug-in adaptation and dependency management module is used for matching or generating a corresponding algorithm adaptation plug-in based on the algorithm language type in the core information, and automatically detecting and repairing the dependency of the operation environment based on the operation environment demand in the core information; The agent generation and access module is used for generating a call agent corresponding to the algorithm adaptation plug-in based on the data interaction rule in the core information and the history fault record in the extension information, and testing the call agent; The data mapping and optimizing module is used for responding to the accessed data interaction request of the target algorithm, acquiring a corresponding data interaction rule from the meta information base, executing data conversion and dynamic mapping based on the data interaction rule, the trained parameter prediction model and the data characteristics of the current interaction data, and recording mapping deviation to iteratively optimize subsequent mapping; And the resource prediction and scheduling module is used for responding to a resource scheduling request aiming at the target algorithm, performing resource demand prediction by utilizing a preset time sequence prediction model based on the running environment demand and the resource consumption trend data stored in the meta-information base and combining the real-time resource state of the current node and the real-time resource demand of the data conversion and dynamic mapping process, and performing dynamic resource scheduling based on the prediction result and the real-time resource state.

Description

Dynamic mapping and project resource scheduling method and system based on meta-protocol Technical Field The invention belongs to the technical field of computer algorithm integration, and particularly relates to a dynamic mapping and project resource scheduling method and system based on a meta-protocol. Background In the business deepening process of the enterprise-level project management platform, algorithm integration is used as a key link for supporting business data processing, improving business efficiency, enabling intelligent decision making and boosting business expansion, and collaborative closed loop of an integrated algorithm and an existing business module is needed to be realized. However, the current algorithm access has the problems of poor compatibility, disordered data interaction format, non-uniform rule of integration, dynamic adaptation, scheduling missing and the like. (1) The algorithm has poor access compatibility and high adaptation cost The method not only consumes a large amount of development resources, but also prolongs the iteration period of the platform and severely restricts the landing efficiency of the algorithm. (2) Data interaction format is chaotic and coordination efficiency is low The algorithm and the service module lack of unified data interaction rules, analysis errors are easy to occur in data transmission, and in a high-frequency interaction scene, data format conversion redundancy is easy to cause data response delay to influence real-time service decision. (3) Integrated non-uniform rule, insufficient normalization The links of algorithm integration, environment configuration and the like lack unified standards, the algorithm is required to be manually checked to rely on and manually configure the operation environment, the algorithm iteration has no version management mechanism, and the service processing result error is easy to be caused by calling the old version algorithm. (4) Dynamic adaptation and scheduling lack, slow iterative response The service iteration needs to update the algorithm synchronously, and the existing scheme needs to manually modify the mapping relation between the algorithm and the service module and input the check code, so that service faults are easy to occur, one-time adaptation and multiple multiplexing cannot be realized, and the service iteration response efficiency is low. The existing containerized deployment only solves the problem of environmental isolation, a remote interface is required for calling a non-local scene, and the static protocol docking lacks dynamic adaptation, so that the integrated requirements of multi-type algorithm self-adaptive access, cross-module standardized interaction and business iteration dynamic adaptation cannot be met. Therefore, providing a dynamic mapping and project resource scheduling method and system based on meta-protocol for solving the above-mentioned problems is a technical problem to be solved by those skilled in the art. Disclosure of Invention In order to solve the technical problems, the invention aims to provide a dynamic mapping and project resource scheduling method based on meta-protocols, which effectively solves the problems of poor access compatibility, disordered data interaction, insufficient integration standardization, dynamic adaptation and scheduling missing and the like in the existing multi-language algorithm integration process, realizes zero preset self-adaptive access, intelligent enhanced data interaction, predicted resource scheduling and version conflict self-repairing of a multi-type algorithm in a platform, and improves the intellectualization and high efficiency of algorithm integration. The technical scheme provided by the invention is as follows: a dynamic mapping and project resource scheduling method based on meta-protocol includes the following steps: Configuring a target algorithm according to a preset meta-protocol specification to generate a meta-protocol initial configuration file, and checking the meta-protocol initial configuration file; Analyzing the standard meta-protocol file, extracting core information and extension information from the standard meta-protocol file, and storing the core information and the extension information into a meta-information library; Matching or generating a corresponding algorithm adaptation plug-in based on the algorithm language type in the core information, and automatically detecting and repairing the dependence of the operation environment based on the operation environment demand in the core information; generating a call agent corresponding to the algorithm adaptation plug-in based on the data interaction rule in the core information and the historical fault record in the extension information, and testing the call agent; Responding to the accessed data interaction request of the target algorithm, acquiring a corresponding data interaction rule from the meta information library, executing data conversion a