CN-122027516-A - Performance test method and device of heterogeneous server, electronic equipment and storage medium

CN122027516ACN 122027516 ACN122027516 ACN 122027516ACN-122027516-A

Abstract

The application provides a performance test method and device of a heterogeneous server, electronic equipment and a storage medium, and relates to the technical field of performance test. The method comprises the steps of responding to performance test requests initiated for a plurality of heterogeneous servers, determining at least one server performance to be tested from the performance test requests, performing performance test on the plurality of heterogeneous servers based on target data processing tasks submitted by target terminals and performance test strategies respectively set for the at least one server performance to obtain a plurality of performance test results, wherein each performance test strategy at least comprises at least one server resource configuration associated with the corresponding server performance, and each performance test result comprises a performance test value of the at least one server performance of the corresponding heterogeneous server. In this way, server performance testing can be accurately performed on heterogeneous servers included in the Hadoop cluster.

Inventors

ZHOU YONGJIANG
FENG CHUNFENG

Assignees

度小满科技(北京)有限公司

Dates

Publication Date: 20260512
Application Date: 20260224

Claims (10)

1. The performance test method of the heterogeneous server is characterized by being applied to a Hadoop cluster comprising a plurality of heterogeneous servers, and comprising the following steps of: determining at least one server performance to be tested from performance test requests initiated for the plurality of heterogeneous servers in response to the performance test requests; And performing performance testing on the heterogeneous servers based on target data processing tasks submitted by the target terminals and performance testing strategies respectively set for the performance of the at least one server to obtain a plurality of performance testing results, wherein each performance testing strategy at least comprises at least one server resource configuration associated with the corresponding server performance, and each performance testing result comprises a performance testing value of the at least one server performance of the corresponding heterogeneous server.
2. The method of claim 1, wherein the at least one server capability comprises any one or a combination of: The processing speed of a central processing unit CPU of the heterogeneous server; sequential read-write speed and random read-write speed of the memory of the heterogeneous server; sequential read-write speed and random read-write speed of the disk of the heterogeneous server.
3. The method of claim 2, wherein prior to responding to the performance test requests initiated for the plurality of heterogeneous servers, further comprising: For various server performances, the following operations are respectively executed: Determining at least one server configuration item corresponding to the target server performance when the Hadoop cluster executes the historical data processing task, wherein the target server performance is any one of the plurality of server performances, and the at least one server configuration item at least comprises at least one server resource configuration item; setting server configuration content for the at least one server configuration item respectively, and generating a performance test strategy of the target server performance based on the at least one server configuration item and the server configuration content corresponding to the at least one server configuration item respectively.
4. The method of claim 3, wherein if the target server performance is a processing speed of a CPU of the heterogeneous server, the at least one server configuration item includes a number of threads required to test the CPU; If the target server performance is the sequential read-write speed and the random read-write speed of the memory of the heterogeneous server, the at least one server configuration item includes the number of threads required for testing the memory, the memory operation mode of the memory, the memory access mode of the memory, the total memory amount of the memory and the minimum unit size of the memory; And if the target server performance is the sequential read-write speed and the random read-write speed of the disk of the heterogeneous server, the at least one server configuration item comprises the number of threads required for testing the disk, the disk operation mode of the disk, the disk access mode of the disk, the total disk amount of the disk and the minimum unit size of the disk.
5. The method according to any one of claims 1-4, wherein performing performance testing on the plurality of heterogeneous servers based on the target data processing task submitted by the target terminal and the performance testing policy set for the performance of the at least one server, respectively, to obtain a plurality of performance test results, includes: for the plurality of heterogeneous servers, respectively performing the following operations: Acquiring task execution data generated in the process that a target heterogeneous server executes the target data processing task according to at least one performance test strategy, wherein the target heterogeneous server is any one of the heterogeneous servers; analyzing the task execution data to obtain a plurality of server performance representation values corresponding to the at least one server performance, wherein each server performance representation value is used for representing the data processing capacity of the target heterogeneous server under the corresponding server performance; and obtaining a performance test result of the target heterogeneous server based on the server performance representation values respectively corresponding to the at least one server performance.
6. The method according to any one of claims 1 to 4, wherein the performance testing is performed on the heterogeneous servers based on the target data processing task submitted by the target terminal and the performance testing policy set for the performance of the at least one server, and after obtaining a plurality of performance test results, further includes: and sending a first data display request carrying the performance test results to the target terminal so that the target terminal presents a first interface to a target object, wherein the first interface is used for displaying the performance test results.
7. The method of claim 6, wherein the method further comprises: Determining comprehensive performance evaluation values respectively corresponding to the heterogeneous servers based on the performance test results and the server costs respectively corresponding to the heterogeneous servers; Based on the comprehensive performance evaluation values, recommending and sorting the heterogeneous servers to obtain server recommendation sequences of the heterogeneous servers; And sending a second data display request carrying the server recommendation sequence to the target terminal so that the target terminal presents a second interface to the target object, wherein the second interface is used for displaying the server recommendation sequence.
8. A performance testing apparatus for heterogeneous servers, applied to a Hadoop cluster including a plurality of heterogeneous servers, comprising: A request transceiver module, configured to determine, in response to performance test requests initiated for the plurality of heterogeneous servers, at least one server performance to be tested from the performance test requests; The performance testing module is used for carrying out performance testing on the heterogeneous servers based on target data processing tasks submitted by the target terminals and performance testing strategies respectively set for the performance of the at least one server to obtain a plurality of performance testing results, wherein each performance testing strategy at least comprises at least one server resource configuration associated with the corresponding server performance, and each performance testing result comprises a performance testing value of the at least one server performance of the corresponding heterogeneous server.
9. An electronic device, comprising: A processor; A memory storing a program, wherein the program comprises instructions that when executed by the processor cause the processor to perform the method of any of claims 1-7.
10. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-7.

Description

Performance test method and device of heterogeneous server, electronic equipment and storage medium Technical Field The present application relates to the field of performance testing technologies, and in particular, to a performance testing method and apparatus for a heterogeneous server, an electronic device, and a storage medium. Background With the rapid development of big data technology, hadoop as a core distributed computing framework is widely applied to various industries. In an actual production environment, due to historical purchasing, cost control, technology iteration and other reasons, the Hadoop cluster is generally formed by mixing a plurality of servers with different generations, models and configurations. At present, the server performance test method of the Hadoop cluster is mainly aimed at isomorphic servers (namely servers with the same hardware configuration and software configuration), and theoretical peak performance of each server in the Hadoop cluster under the combination of scale linear expansion, task scheduling balance and default parameters is verified in a concentrated mode. In addition, when performance testing is performed on each server, performance testing results of each server are generally obtained by testing performance of each server one by one. Therefore, by adopting the server performance test mode, the performance test result of the server is not accurate enough due to the large difference between the test environment and the real working environment of the server. In addition, the server performance test method may not be well adapted to the heterogeneous server. Therefore, how to accurately perform server performance testing on heterogeneous servers included in the Hadoop cluster is a problem that needs to be solved at present. Disclosure of Invention The embodiment of the application provides a performance test method and device of a heterogeneous server, electronic equipment and a storage medium, which are used for accurately testing the performance of the server on the heterogeneous server included in a Hadoop cluster. In a first aspect, an embodiment of the present application provides a performance testing method of a heterogeneous server, which is applied to a Hadoop cluster including a plurality of heterogeneous servers, where the method includes: In response to performance test requests initiated for a plurality of heterogeneous servers, determining at least one server performance to be tested from the performance test requests; And performing performance testing on the heterogeneous servers based on target data processing tasks submitted by the target terminals and performance testing strategies respectively set for at least one server performance to obtain a plurality of performance testing results, wherein each performance testing strategy at least comprises at least one server resource configuration associated with the corresponding server performance, and each performance testing result comprises a performance testing value of at least one server performance of the corresponding heterogeneous server. In an alternative embodiment, the at least one server capability includes any one or a combination of the following: Processing speed of CPU of heterogeneous server; sequential read-write speed and random read-write speed of the memory of the heterogeneous server; sequential read-write speed and random read-write speed of the disk of the heterogeneous server. In an alternative embodiment, before responding to performance test requests initiated for multiple heterogeneous servers, further comprising: For various server performances, the following operations are respectively executed: Determining at least one server configuration item corresponding to the target server performance when the Hadoop cluster executes the historical data processing task, wherein the target server performance is any one of a plurality of server performances, and the at least one server configuration item at least comprises at least one server resource configuration item; And setting server configuration contents for at least one server configuration item respectively, and generating a performance test strategy of the target server performance based on the at least one server configuration item and the server configuration contents corresponding to the at least one server configuration item respectively. In an alternative embodiment, if the target server performance is the processing speed of the CPU of the heterogeneous server, the at least one server configuration item includes the number of threads required to test the CPU; If the performance of the target server is the sequential read-write speed and the random read-write speed of the memory of the heterogeneous server, at least one server configuration item comprises the number of threads required by the test memory, the memory operation mode of the memory, the memory access mode of the memory, the total memory amount of