CN-122001787-A - Data processing method and system

CN122001787ACN 122001787 ACN122001787 ACN 122001787ACN-122001787-A

Abstract

The embodiment of the specification provides a data processing method and a data processing system, wherein the data processing method comprises the steps of determining to-be-detected data associated with a target service, wherein the to-be-detected data comprises source end data and target end data, and end-to-end connectivity detection can be realized based on the to-be-detected data, the source end data and the target end data. A logical detection path of a user view of the target service and a transmission detection path of a service provider view of the target service are constructed based on the data to be detected. And acquiring detection auxiliary data aiming at a detection item of the target service, and carrying out path detection on a logic detection path and a transmission detection path based on the detection auxiliary data to obtain detection data, so as to realize connectivity detection from a source end to a target end and quickly obtain an accurate detection result. And analyzing the detection data in at least one analysis dimension to obtain an analysis result, wherein the analysis result can be a detection result displayed in an analysis report form, so that the readability of the detection result is improved.

Inventors

Zheng Naigong
SONG YANG
WEN RONG
LI XING
ZONG ZHIGANG
LV BIAO
ZHU SHUNMIN
LI FULIANG
ZHANG SHIZE
LIU CHENYANG
LI RENKE
Tian Yuanhan
SHEN XIANGZHONG
HAN ZEJUN
SHAO ZHOU
XIAO XIONG

Assignees

阿里云计算有限公司

Dates

Publication Date: 20260508
Application Date: 20241101

Claims (15)

1. A data processing method, comprising: Determining target service associated data to be detected, wherein the data to be detected comprises source end data and target end data; Constructing a logic detection path and a transmission detection path based on the data to be detected; acquiring detection auxiliary data aiming at a detection item of the target service, and carrying out path detection on the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data; and analyzing the detection data in at least one analysis dimension to obtain an analysis result.
2. The data processing method according to claim 1, wherein the determining the data to be detected associated with the target service, the data to be detected including source data and target data, includes: determining a source end and a target end corresponding to the communication service in the target service; acquiring communication data of the communication service, and determining source end data of the source end and target end data of the target end; And taking the communication data, the source terminal data and the target terminal data as the data to be detected.
3. The data processing method of claim 2, the obtaining connectivity data of the connectivity service, comprising: determining a source type of the source terminal, and selecting a target state machine from a state machine set based on the source type; And acquiring virtual switch data, gateway data corresponding to the virtual switch data and network data corresponding to the gateway data by using the target state machine, and generating the communication data of the communication service based on the virtual switch data, the gateway data and the network data.
4. A data processing method according to claim 3, said constructing a logical detection path and a transmission detection path based on said data to be detected, comprising: Constructing a virtual switch path, a gateway path and a network path based on the virtual switch data, the gateway data and the network data contained in the data to be detected respectively; determining logical nodes and transmission nodes in the virtual switch path, the gateway path and the network path; the logical detection path is constructed based on the logical node, and the transmission detection path is constructed based on the transmission node.
5. The data processing method according to claim 4, wherein the constructing a virtual switch path, a gateway path, and a network path based on the virtual switch data, the gateway data, and the network data, respectively, included in the data to be detected, includes: determining at least one virtual switch node based on the virtual switch data contained in the data to be detected, and constructing a virtual switch path based on the at least one virtual switch node; determining at least one gateway node based on the gateway data contained in the data to be detected, and constructing a gateway path based on the at least one gateway node and a tail node of the virtual switch path; And determining at least one network node based on the network data contained in the data to be detected, and constructing a network path based on the at least one network node and a tail node of the gateway path.
6. The data processing method of claim 1, the acquisition of detection assistance data for detection items of the target service, comprising: Determining a detection item of the target service based on the operation experience data and the historical event data of the target service; collecting operation auxiliary data and event auxiliary data corresponding to the detection items; The detection assistance data is generated based on the operation assistance data and the event assistance data.
7. The data processing method according to claim 1, wherein the path detection is performed on the logical detection path and the transmission detection path based on the detection assistance data to obtain detection data, comprising: Performing path connectivity detection on the logic detection path and the transmission detection path based on path connectivity data contained in the detection auxiliary data to obtain logic connectivity data of the logic detection path and transmission connectivity data of the transmission detection path; Node detection is carried out on the logic detection path and the transmission detection path based on node data contained in the detection auxiliary data, so that logic diagnosis data of the logic detection path and transmission diagnosis data of the transmission detection path are obtained; And taking the logic communication data, the transmission communication data, the logic diagnosis data and the transmission diagnosis data as the detection data.
8. The data processing method according to claim 1, wherein the analyzing the detection data in at least one analysis dimension to obtain an analysis result includes: Determining a large language model for analyzing the target service, and a scheme analysis module and an abnormality analysis module corresponding to the large language model; Inputting the detection data to the scheme analysis module for scheme analysis to obtain scheme analysis data, and/or inputting the detection data to the anomaly analysis module for anomaly analysis to obtain anomaly analysis data; The analysis result is generated based on the protocol analysis data and/or the anomaly analysis data.
9. The data processing method according to claim 8, wherein the analyzing the detection data in a solution dimension by using the solution analysis module to obtain solution analysis data includes: determining a knowledge base, a scheme controller, a scheme template and a scheme base large model which are associated with the scheme analysis module; determining a target file associated with the detection data in the knowledge base by using the scheme controller; updating the scheme template to a target scheme template based on the detection data and the target file; and inputting the target scheme template into the scheme base large model to obtain the scheme analysis data.
10. The data processing method according to claim 8, wherein the analyzing the detection data in the anomaly dimension by using the anomaly analysis module to obtain anomaly analysis data comprises: determining an abnormality information base, an abnormality controller, an abnormality template and an abnormality base large model which are associated with the abnormality analysis module; Determining abnormality information associated with the detection data in the abnormality information base by using the abnormality controller; updating the abnormal template to be a target abnormal template based on the detection data and the abnormal information; And inputting the target abnormal template into the abnormal base large model to obtain the abnormal analysis data.
11. The data processing method is applied to cloud side equipment and comprises the following steps: Receiving a service detection request submitted by the terminal side equipment aiming at a target service; Determining to-be-detected data associated with the target service based on the service detection request, wherein the to-be-detected data comprises source end data and target end data; Constructing a logic detection path and a transmission detection path based on the data to be detected; acquiring detection auxiliary data aiming at a detection item of the target service, and carrying out path detection on the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data; analyzing the detection data in at least one analysis dimension to obtain an analysis result, and feeding back the analysis result to the end-side equipment.
12. A data processing system comprises a client and a server; the client is used for submitting a service detection request to the server aiming at a target service; The server side is used for determining to-be-detected data associated with the target service based on the service detection request, wherein the to-be-detected data comprises source end data and target end data, constructing a logic detection path and a transmission detection path based on the to-be-detected data, collecting detection auxiliary data for detection items of the target service, detecting the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data, analyzing the detection data in at least one analysis dimension to obtain an analysis result, and feeding the analysis result back to the client side.
13. A computing device, comprising: A memory and a processor; the memory is adapted to store a computer program or instructions, the processor being adapted to execute the computer program or instructions, which when executed by the processor, implement the steps of the data processing method of any of claims 1-10.
14. A computer readable storage medium storing a computer program or instructions which, when executed by a processor, carries out the steps of the data processing method of any one of claims 1 to 10.
15. A computer program product comprising a computer program or instructions which, when executed by a processor, carries out the steps of the data processing method of any of claims 1 to 10.

Description

Data processing method and system Technical Field Embodiments of the present disclosure relate to the field of computer technologies, and in particular, to a data processing method and system. Background With the development of cloud computing technology, in a cloud service scene, the problem of network connectivity gradually becomes a problem of high frequency occurrence in the problem of network stability. The service provider needs to cope with network service detection requests frequently initiated by the user. In the prior art, network connectivity detection is typically implemented based on network configuration verification. However, this method requires that the model needs to be recalculated every time the configuration is changed, and the detection efficiency is low, so that the detection requirement of the user under the large-scale network service cannot be met. Therefore, a more efficient data processing method is needed to solve the above-mentioned problems. Disclosure of Invention In view of this, the present embodiment provides a data processing method. One or more embodiments of the present specification are also directed to a data processing system, data processing apparatus, a computing device, a computer readable storage medium, and a computer program product that address the deficiencies of the prior art. According to a first aspect of embodiments of the present specification, there is provided a data processing method, including: Determining target service associated data to be detected, wherein the data to be detected comprises source end data and target end data; Constructing a logic detection path and a transmission detection path based on the data to be detected; acquiring detection auxiliary data aiming at a detection item of the target service, and carrying out path detection on the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data; and analyzing the detection data in at least one analysis dimension to obtain an analysis result. According to a second aspect of embodiments of the present disclosure, there is provided another data processing method, applied to a cloud-side device, including: Receiving a service detection request submitted by the terminal side equipment aiming at a target service; Determining to-be-detected data associated with the target service based on the service detection request, wherein the to-be-detected data comprises source end data and target end data; Constructing a logic detection path and a transmission detection path based on the data to be detected; acquiring detection auxiliary data aiming at a detection item of the target service, and carrying out path detection on the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data; analyzing the detection data in at least one analysis dimension to obtain an analysis result, and feeding back the analysis result to the end-side equipment. According to a third aspect of embodiments of the present specification, there is provided a data processing system, comprising a client and a server; the client is used for submitting a service detection request to the server aiming at a target service; The server side is used for determining to-be-detected data associated with the target service based on the service detection request, wherein the to-be-detected data comprises source end data and target end data, constructing a logic detection path and a transmission detection path based on the to-be-detected data, collecting detection auxiliary data for detection items of the target service, detecting the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data, analyzing the detection data in at least one analysis dimension to obtain an analysis result, and feeding the analysis result back to the client side. According to a fourth aspect of embodiments of the present specification, there is provided a data processing apparatus comprising: the determining module is configured to determine to-be-detected data associated with the target service, wherein the to-be-detected data comprises source end data and target end data; a construction module configured to construct a logic detection path and a transmission detection path based on the data to be detected; The acquisition module is configured to acquire detection auxiliary data aiming at the detection item of the target service, and perform path detection on the logic detection path and the transmission detection path based on the detection auxiliary data to obtain detection data; and the analysis module is configured to analyze the detection data in at least one analysis dimension to obtain an analysis result. According to a fifth aspect of embodiments of the present specification, there is provided another data processing apparatus comprising: the receiving module is configure