CN-121996547-A - Operating point-oriented automatic test evaluation quantification method and device

CN121996547ACN 121996547 ACN121996547 ACN 121996547ACN-121996547-A

Abstract

The application provides an operation point-oriented automatic test evaluation quantification method and device, and relates to the technical field of automatic test evaluation, wherein the method comprises the steps of obtaining a function case text and a mapping table of keywords and operation point types; the method comprises the steps of extracting function operation point data from a function case text according to a mapping table of keywords and operation point types to generate a function operation point table, analyzing operation point information sent by a received automatic program to update the automatic operation point table, matching the automatic operation points with the function operation points according to the function operation point table and the automatic operation point table to generate a mapping table of the automatic operation points and the function operation points, and generating an evaluation quantization result of an automatic test according to the function operation point table, the automatic operation point table and the mapping table of the automatic operation points and the function operation points. The application realizes objective quantification of the automatic test coverage, real-time updating and accurate output of the evaluation result, and greatly improves the efficiency and reliability of test effect evaluation.

Inventors

WANG KAIBIN
CHEN HAO
CHEN YINGYING
GAO YIJIAN

Assignees

兴业银行股份有限公司
兴业数字金融服务（上海）股份有限公司

Dates

Publication Date: 20260508
Application Date: 20251231

Claims (11)

1. An operating point-oriented automated test evaluation quantification method, comprising: obtaining a mapping table of a functional case text, keywords and operation point types; extracting functional operation point data from the functional case text according to the mapping table of the keywords and the operation point types, and generating a functional operation point table; analyzing the received operation point message sent by the automatic program, and updating the automatic operation point table; Matching the automatic operation points with the functional operation points according to the functional operation point table and the automatic operation point table to generate a mapping table of the automatic operation points and the functional operation points; And generating an evaluation quantification result of the automatic test according to the function operation point table, the automatic operation point table and the mapping table of the automatic operation points and the function operation points.
2. The method for quantifying operation-point-oriented automated test evaluation according to claim 1, wherein the extracting functional operation point data from the functional case text according to the mapping table of the keyword and the operation point type, and generating a functional operation point table, comprises: reading a mapping table of the keywords and the operation point types, wherein the mapping table of the keywords and the operation point types comprises keyword numbers, keyword names, keyword hit rules and operation point type numbers; Performing text recognition on the functional case text based on the keyword hit rule to obtain functional operation point data; And generating a function operation point table according to the function operation point data, wherein the function operation point table comprises a function operation point unique number, a case number, an operation point type number and operation point detail content.
3. The method for quantifying operation point-oriented automated test evaluation according to claim 1, wherein the parsing the received operation point message sent by the automated program and updating the automated operation point table comprises: the automatic operation point table comprises a case number, an operation point type number, an automatic operation point unique number, operation point detail content, an automatic operation point encryption text, generation time and update time; Writing the encrypted text of the automatic operation point into a first cache; Receiving an operation point message sent by the automatic program, and judging whether an automatic operation point encryption text of the operation point message exists in the first cache; If the operation point information exists, the generation time of the operation point information is used as the attribute of the encrypted text of the automatic operation point to be written into the first cache; If not, judging whether an automatic operation point unique number of the operation point message exists in the automatic operation point table; if so, updating the automatic operation point table according to the operation point message; If not, the operation point information is inserted into the automatic operation point table as new data, the corresponding automatic operation point encryption text is written into a first buffer memory, and the case number and the generation time are written into a second buffer memory.
4. The method for quantifying operation point-oriented automation test assessment according to claim 1, wherein the matching the automation operation point with the function operation point according to the function operation point table and the automation operation point table, and generating a mapping table of the automation operation point and the function operation point comprises: Acquiring corresponding functional operation point data from the functional operation point table according to the case number and the operation point type number of the automatic operation point data in the automatic operation point table; Matching the automatic operation points with the functional operation points according to a preset matching rule, the operation point detailed content of the automatic operation point data and the operation point detailed content of the corresponding functional operation point data to generate a mapping table of the automatic operation points and the functional operation points, wherein the mapping table of the automatic operation points and the functional operation points comprises an automatic operation point unique number, a functional operation point unique number and a case number.
5. The method for quantifying the evaluation of an automation test for an operation point according to claim 1, wherein generating the quantified result of the evaluation of the automation test according to the function operation point table, the automation operation point table, and the mapping table of the automation operation point and the function operation point comprises: extracting the mapping relation between the automatic operation point and the functional operation point from the mapping table of the automatic operation point and the functional operation point; judging whether the automatic operation point exists in the automatic operation point table and whether the corresponding functional operation point exists in the functional operation point table; If the automatic operation point exists in the automatic operation point table but the corresponding functional operation point does not exist in the functional operation point table, determining operation point redundancy; And if the function operation point exists in the function operation point table but the corresponding automatic operation point does not exist in the automatic operation point table, determining that the operation point is absent.
6. The method for quantifying operation point oriented automated test evaluation of claim 1, further comprising: and deleting the abandoned automatic operation point data based on the generation time recorded in the second cache and the attribute of the automatic operation point encrypted text recorded in the first cache.
7. The method for quantifying operation point oriented automated test evaluation according to claim 6, wherein deleting discarded automated operation point data based on a generation time recorded in the second cache and an attribute of the automated operation point encrypted text recorded in the first cache comprises: Judging whether the automatic case is executed or not according to the case number read from the second buffer memory and the generation time at preset time intervals; If the automatic case is executed, screening an automatic operation point which is not updated within a preset time range from the automatic operation point table; reading the attribute of the encrypted text of the automatic operation point corresponding to the automatic operation point which is not updated from the first cache; judging whether the automatic operation point which is not updated in the automatic case is generated or not based on the generation time in the second cache and the attribute; and if the data is not generated, deleting the corresponding automatic operation point data from the automatic operation point table and the mapping tables of the automatic operation points and the functional operation points.
8. An operation point-oriented automated test evaluation quantification apparatus, comprising: The data acquisition unit is used for acquiring the functional case text and the mapping table of the keywords and the operation point types; A function operation point table generating unit, configured to extract function operation point data from the function case text according to the mapping table of the keyword and the operation point type, and generate a function operation point table; the automatic operating point table updating unit is used for analyzing the received operating point message sent by the automatic program and updating the automatic operating point table; The mapping table generating unit is used for matching the automatic operation points with the functional operation points according to the functional operation point table and the automatic operation point table to generate a mapping table of the automatic operation points and the functional operation points; And the evaluation and quantification result generation unit is used for generating an evaluation and quantification result of the automatic test according to the function operation point table, the automatic operation point table and the mapping table of the automatic operation points and the function operation points.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by the processor.
10. A computer readable storage medium having stored thereon a computer program/instruction, which when executed by a processor, implements the steps of the method of any of claims 1 to 7.
11. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method of any of claims 1 to 7.

Description

Operating point-oriented automatic test evaluation quantification method and device Technical Field The application relates to the technical field of automatic test evaluation, in particular to an operation point-oriented automatic test evaluation quantification method and device. Background In the field of software testing, automated testing has become the mainstream means for improving test efficiency and reducing labor cost. The existing automatic test effectiveness quantification mode mainly depends on an index of the number of automatic cases, namely, the greater the number of automatic cases is, the higher the coverage degree of the automatic test is generally considered. However, this case-based manner of assessment has significant limitations in that it does not reflect the actual coverage of functional cases by automated testing. In the actual testing process, each functional case usually contains a precondition, an operation step and a plurality of operation points, and it is not possible to determine whether the automation script actually performs all the key operations in the functional cases by only counting the number of the automation cases. Therefore, it is difficult to objectively evaluate the coverage degree of the automatic test on each operation (including the preconditions, the case running operation and the operation points) of the functional cases in the current technology, and the missing or redundant problem of the operation points cannot be accurately identified, so that the evaluation of the automatic test results is not accurate enough. This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section. Disclosure of Invention Aiming at the problems in the prior art, the embodiment of the application provides an operation point-oriented automatic test evaluation quantification method and device, which can solve the problems that the existing automatic test cannot accurately judge whether an automatic case really covers each operation point of a functional case and real-time monitoring and quantification evaluation on an automatic execution process are lacked. In one aspect of the present invention, there is provided an operation point-oriented automated test evaluation quantification method, the method comprising: obtaining a mapping table of a functional case text, keywords and operation point types; extracting functional operation point data from the functional case text according to the mapping table of the keywords and the operation point types, and generating a functional operation point table; analyzing the received operation point message sent by the automatic program, and updating the automatic operation point table; Matching the automatic operation points with the functional operation points according to the functional operation point table and the automatic operation point table to generate a mapping table of the automatic operation points and the functional operation points; And generating an evaluation quantification result of the automatic test according to the function operation point table, the automatic operation point table and the mapping table of the automatic operation points and the function operation points. Further, the extracting function operation point data from the function case text according to the mapping table of the keyword and the operation point type, and generating a function operation point table includes: reading a mapping table of the keywords and the operation point types, wherein the mapping table of the keywords and the operation point types comprises keyword numbers, keyword names, keyword hit rules and operation point type numbers; Performing text recognition on the functional case text based on the keyword hit rule to obtain functional operation point data; And generating a function operation point table according to the function operation point data, wherein the function operation point table comprises a function operation point unique number, a case number, an operation point type number and operation point detail content. Further, the analyzing the received operation point message sent by the automation program, updating the automation operation point table, includes: the automatic operation point table comprises a case number, an operation point type number, an automatic operation point unique number, operation point detail content, an automatic operation point encryption text, generation time and update time; Writing the encrypted text of the automatic operation point into a first cache; Receiving an operation point message sent by the automatic program, and judging whether an automatic operation point encryption text of the operation point message exists in the first cache; If the operation point information exists, the generation time of the operation point information is used as the att