CN-121998480-A - Multi-attribute comprehensive test and evaluation method for man-machine interaction behavior

CN121998480ACN 121998480 ACN121998480 ACN 121998480ACN-121998480-A

Abstract

The application provides a multi-attribute comprehensive test and evaluation method for human-computer interaction behavior, which comprises the steps of determining a human-computer interaction behavior evaluation index according to human-computer interaction behavior influence factors and index determination principles, determining weight coefficients of all evaluation indexes according to multi-attribute characteristics of human-computer interaction behavior evaluation index measurement values, establishing a multi-attribute comprehensive evaluation mathematical model, determining a human-computer interaction behavior test task section according to a human-computer interaction process and typical operation, and determining a human-computer interaction behavior test program according to the human-computer interaction behavior task section and the evaluation indexes. The application can form a multi-attribute comprehensive test and evaluation technology of human-computer interaction behaviors and is used for human-computer interaction behavior test and evaluation work.

Inventors

LV BAO
CHEN XINGXING
JIAO YI
HAN YAJIE
CHEN WENDUO

Assignees

中国飞行试验研究院

Dates

Publication Date: 20260508
Application Date: 20251227

Claims (8)

1. A man-machine interaction behavior multi-attribute comprehensive test and evaluation method is characterized by comprising the following steps: S101, according to a human-computer interaction behavior influence factor and an index determination principle, giving a human-computer interaction behavior evaluation index; S102, determining weight coefficients of all evaluation indexes according to the multi-attribute characteristics of the measured values of the human-computer interaction behavior evaluation indexes; S103, establishing a multi-attribute comprehensive evaluation mathematical model according to the multi-attribute characteristics of the measured values of the human-computer interaction behavior evaluation indexes, and evaluating the human-computer interaction behavior according to the weight coefficient of each evaluation index and the multi-attribute comprehensive evaluation mathematical model.
2. The method according to claim 1, wherein the method further comprises: s104, determining a human-computer interaction behavior test task section according to a human-computer interaction process and typical operation; s105, testing the human-computer interaction behavior according to the human-computer interaction behavior testing task section and the human-computer interaction behavior evaluation index.
3. The method according to claim 2, wherein the human-computer interaction behavior evaluation index determined in S101 is determined based on NASA-TLX scale method by comprehensively considering human-computer interaction behavior influence factors and index determination principles, and is a two-stage evaluation index.
4. The method of claim 3, wherein the first level of human interaction behavior assessment metrics determined in S101 include mental load, physical load, temporal performance, operational performance, effort level, and confusion level.
5. The method of claim 4, wherein the determining of the weight coefficient of each evaluation index in S102 uses a weighting method of comprehensive integrated features, i.e. a method of combining subjective weighting and objective weighting to give the weight coefficient of each evaluation index.
6. The method according to claim 5, wherein the mathematical model is evaluated in S103 by using a multi-dimensional feature hierarchical fusion evaluation method, that is, feature indexes related to corresponding dimensions are fused by using a multivariate statistical analysis method, and main commonality trends are extracted therefrom to implement evaluation analysis on human-computer interaction behaviors of the corresponding dimensions.
7. The method of claim 6, wherein the human interaction behavior test tasks in S104 include normal operation program flight tasks and emergency operation program flight tasks.
8. The method of claim 7, wherein the human-computer interaction behavior test program in S105 includes a test means, a test method, a test flow design, and a test criterion.

Description

Multi-attribute comprehensive test and evaluation method for man-machine interaction behavior Technical Field The application belongs to the technical field of human-computer interaction evaluation, and particularly relates to a human-computer interaction behavior multi-attribute comprehensive test and evaluation method. Background The good man-machine interaction plays a role in normal operation of the aircraft, and is an important component of aircraft design. In the performance identification test stage of the aviation equipment, the man-machine interaction behavior is tested and evaluated, so that the performance of the work of the person is improved, the operation errors are reduced, and the safe operation is realized. The traditional human-computer interaction evaluation belongs to a static, functional and subjective evaluation-based evaluation system, and detailed processes of human-computer interaction behaviors cannot be described and evaluated in detail. In addition, the evaluation system is generally used for analyzing and evaluating in isolation at a certain design node, and is lack of comprehensive consideration on human-computer interaction behavior based on mission tasks. Therefore, it is highly desirable to construct a human-computer interaction behavior testing and evaluating system that can be combined with human-centered, subjective evaluation and objective measurement. At present, how to determine the evaluation index of the human-computer interaction behavior, evaluate the model, formulate the human-computer interaction behavior test scheme and the like are the problems to be solved in developing the human-computer interaction behavior test and evaluation work. Disclosure of Invention The invention aims to design a multi-attribute comprehensive test and evaluation method for human-computer interaction behavior, guide the human-computer interaction behavior test and evaluation work, evaluate whether the human-computer interaction level of aviation equipment meets the development requirement, simultaneously provide problems and defects in the aspects of aviation equipment design, use maintenance and the like, provide basis for design change and realize the improvement of the efficiency of an aviation equipment system. The application provides a multi-attribute comprehensive test and evaluation method for man-machine interaction behavior, which comprises the following steps: S101, according to a human-computer interaction behavior influence factor and an index determination principle, giving a human-computer interaction behavior evaluation index; S102, determining weight coefficients of all evaluation indexes according to the multi-attribute characteristics of the measured values of the human-computer interaction behavior evaluation indexes; S103, establishing a multi-attribute comprehensive evaluation mathematical model according to the multi-attribute characteristics of the measured values of the human-computer interaction behavior evaluation indexes, and evaluating the human-computer interaction behavior according to the weight coefficient of each evaluation index and the multi-attribute comprehensive evaluation mathematical model. Preferably, the method further comprises: s104, determining a human-computer interaction behavior test task section according to a human-computer interaction process and typical operation; s105, testing the human-computer interaction behavior according to the human-computer interaction behavior testing task section and the human-computer interaction behavior evaluation index. Preferably, the human-computer interaction behavior evaluation index determined in S101 is determined by comprehensively considering the human-computer interaction behavior influence factor and the index determination principle based on NASA-TLX scale method, and is a two-stage evaluation index. Preferably, the first level evaluation indexes of the human-computer interaction behavior determined in S101 include mental load, physical load, time performance, operation performance, effort level and confusion level. Preferably, in S102, the determination of each evaluation index weight coefficient adopts a weighting method of comprehensive integrated features, i.e. a determination method of each evaluation index weight coefficient is given by combining subjective weighting and objective weighting. Preferably, in S103, the evaluation mathematical model adopts a multi-dimensional feature hierarchical fusion evaluation method, that is, feature indexes related to corresponding dimensions are fused through a multivariate statistical analysis method, and main commonalities are extracted therefrom to realize evaluation analysis of man-machine interaction behaviors of the corresponding dimensions. Preferably, the human-computer interaction behavior test tasks in S104 include a normal operation program flight task and an emergency operation program flight task. Preferably, the man-machine interaction