CN-121979769-A - Performance test method, device, apparatus, storage medium and program product

CN121979769ACN 121979769 ACN121979769 ACN 121979769ACN-121979769-A

Abstract

The embodiment of the application provides a performance test method, a performance test device, performance test equipment, a storage medium and a program product, and relates to the field of distribution. The method comprises the steps of obtaining performance test data of a system to be tested, obtaining production operation performance data of the system to be tested, carrying out association processing on the performance test data and the production operation performance data to obtain at least one group of association data, wherein each group of association data comprises performance test association data and production performance test association data corresponding to the same performance type, carrying out quantization calculation processing on the association data to obtain deviation degree of the association data, and determining a performance test improvement strategy aiming at the system to be tested according to the deviation degree. The method improves the performance test process, thereby improving the accuracy of the performance test result and reducing the production running risk.

Inventors

ZHONG RUI
LI YUANHUA
ZHENG ZHONG
YANG SHENGJIE

Assignees

中国工商银行股份有限公司

Dates

Publication Date: 20260505
Application Date: 20250626

Claims (14)

1. A performance testing method, comprising: Acquiring performance test data of a system to be tested; Acquiring production operation performance data of the system to be tested; Carrying out association processing on the performance test data and the production operation performance data to obtain at least one group of association data, wherein each group of association data comprises performance test association data and production performance test association data corresponding to the same performance type; carrying out quantization calculation processing on the associated data to obtain the deviation degree of the associated data; and determining a performance test improvement strategy for the system to be tested according to the deviation degree.
2. The method of claim 1, wherein the acquiring performance test data of the system under test comprises: acquiring at least one of a performance test requirement, a performance test scene and a performance type of a performance test; performing a performance test on the system to be tested according to at least one of the performance test requirements, the performance test scene and the performance type of the performance test; and in the performance test process, collecting performance test data of the system to be tested.
3. The method of claim 1, wherein the obtaining production run performance data of the system under test comprises: Acquiring acquisition parameters of the performance test data; And acquiring production running performance data of the system to be tested according to the acquisition parameters.
4. A method according to any one of claims 1 to 3, wherein the performance types include a service performance index type and a system performance index type; The service performance index type comprises at least one of throughput, response time and success rate, and the system performance index type comprises at least one of central processing unit utilization rate, memory and network traffic.
5. The method of claim 4, wherein the service performance indicator type comprises throughput; correspondingly, the quantization calculation processing is performed on the associated data to obtain the deviation degree of the associated data, which comprises the following steps: determining the maximum throughput of the test according to the performance test associated data; determining the maximum throughput of production according to the production performance test associated data; Calculating a ratio of the production maximum throughput to the test maximum throughput; Calculating a first difference between the ratio of the production maximum throughput and the test maximum throughput and 1; and determining the deviation degree of the associated data corresponding to the throughput according to the first difference value.
6. The method of claim 4, wherein the service performance indicator type comprises a response time; correspondingly, the quantization calculation processing is performed on the associated data to obtain the deviation degree of the associated data, which comprises the following steps: determining a response time test reference value according to the performance test associated data; Determining a response time production reference value according to the production performance test associated data; Calculating a second difference between the response time production reference value and the response time test reference value; And determining the deviation degree of the associated data corresponding to the response time according to the ratio of the second difference value to the response time test reference value.
7. The method of claim 4, wherein the service performance indicator type comprises a success rate; correspondingly, the quantization calculation processing is performed on the associated data to obtain the deviation degree of the associated data, which comprises the following steps: Determining a performance test success rate according to the performance test associated data; Determining the success rate of production operation according to the production performance test related data; Calculating a third difference between the production run success rate and the performance test success rate; and determining the deviation degree of the associated data corresponding to the success rate according to the third difference value.
8. The method of claim 4, wherein said performing a quantization process on said associated data to obtain a degree of deviation of said associated data comprises: When the performance type corresponding to the associated data is a system performance index type, determining estimated peak value variation data and actual peak value variation data corresponding to the system performance index type according to the performance test associated data and production performance test associated data; And determining the deviation degree of the associated data corresponding to the system performance index type according to the fourth difference value of the actual peak variation data and the estimated peak variation data.
9. The method according to any one of claims 5 to 8, wherein said determining a performance test improvement strategy for the system under test based on the degree of deviation comprises: acquiring a deviation improvement threshold corresponding to the performance type; and determining the improvement priority and the improvement direction of the performance type according to the deviation degree improvement threshold corresponding to the performance type and the deviation degree corresponding to the performance type.
10. The method according to claim 9, further comprising, after said subjecting said associated data to a quantization calculation process to obtain a degree of deviation of said associated data: acquiring a deviation alarm threshold corresponding to the performance type; And determining whether to execute an alarm strategy and an emergency treatment strategy aiming at the performance type according to the deviation alarm threshold corresponding to the performance type and the deviation corresponding to the performance type.
11. A performance testing apparatus, comprising: the first acquisition module is used for acquiring performance test data of the system to be tested; The second acquisition module is used for acquiring production running performance data of the system to be tested; The first processing module is used for carrying out association processing on the performance test data and the production operation performance data to obtain at least one group of association data, wherein each group of association data comprises performance test association data and production performance test association data corresponding to the same performance type; the second processing module is used for carrying out quantization calculation processing on the associated data so as to obtain the deviation degree of the associated data; and the determining module is used for determining a performance test improvement strategy aiming at the system to be tested according to the deviation degree.
12. An electronic device is characterized by comprising a memory and a processor; the memory stores computer-executable instructions; the processor executing computer-executable instructions stored in the memory, causing the processor to perform the method of any one of claims 1 to 10.
13. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1 to 10.
14. A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1 to 10.

Description

Performance test method, device, apparatus, storage medium and program product Technical Field The present application relates to the distributed field, and in particular, to a performance testing method, apparatus, device, storage medium, and program product. Background With the continuous abundance of banking business, the performance stability of the system is more challenged in combination with the transformation of technical architecture such as distributed architecture. The performance test is particularly important as an important support for ensuring stable production. At present, performance testing of distributed services mainly includes testing a plurality of key performance indexes before and after production, and performing performance evaluation on the distributed services according to testing results of the performance indexes. However, due to the high complexity and the constantly changing production runs, the accuracy of the performance test results of the prior art is low, resulting in a high risk of production runs. Disclosure of Invention The application provides a performance test method, a performance test device, performance test equipment, a storage medium and a program product, which are used for solving the technical problem that the production running risk is high due to low accuracy of performance test results in the prior art. In a first aspect, the present application provides a performance testing method, including: Acquiring performance test data of a system to be tested; Acquiring production operation performance data of the system to be tested; Carrying out association processing on the performance test data and the production operation performance data to obtain at least one group of association data, wherein each group of association data comprises performance test association data and production performance test association data corresponding to the same performance type; carrying out quantization calculation processing on the associated data to obtain the deviation degree of the associated data; and determining a performance test improvement strategy for the system to be tested according to the deviation degree. In one possible implementation manner, the performance test data of the system to be tested is obtained, wherein the performance test data comprises at least one of performance test requirements, performance test scenes and performance types of performance tests, the performance test is executed on the system to be tested according to at least one of the performance test requirements, the performance test scenes and the performance types of the performance tests, and the performance test data of the system to be tested is collected in the performance test process. In one possible implementation manner, the acquiring the production operation performance data of the system to be tested comprises acquiring acquisition parameters of the performance test data, and acquiring the production operation performance data of the system to be tested according to the acquisition parameters. In one possible implementation, the performance types include a service performance index type and a system performance index type, wherein the service performance index type includes at least one of throughput, response time and success rate, and the system performance index type includes at least one of central processing unit usage, memory and network traffic. In one possible implementation manner, the service performance index type comprises throughput, correspondingly, the quantization calculation processing is carried out on the associated data to obtain the deviation degree of the associated data, wherein the quantization calculation processing comprises the steps of determining the maximum throughput according to the performance test associated data, determining the maximum throughput according to the production performance test associated data, calculating the ratio of the maximum throughput to the maximum throughput, calculating the first difference value of the ratio of the maximum throughput to 1, and determining the deviation degree of the associated data corresponding to the throughput according to the first difference value. In one possible implementation, the service performance index type includes response time, and accordingly, the performing quantization calculation processing on the associated data to obtain the deviation degree of the associated data includes determining a response time test reference value according to the performance test associated data, determining a response time production reference value according to the production performance test associated data, calculating a second difference value between the response time production reference value and the response time test reference value, and determining the deviation degree of the associated data corresponding to the response time according to the ratio of the second difference value to the response ti