KR-20260064172-A - Method for warn drone pilots of collision hazards using mutually complementary visual and haptic feedback, control apparatus and computer program for performing the method

KR20260064172AKR 20260064172 AKR20260064172 AKR 20260064172AKR-20260064172-A

Abstract

A method for transmitting drone collision risks to a pilot in a complementary manner using visual warnings and tactile vibrations, a control device, and a computer program for performing this method can transmit collision risks to a pilot more effectively by simultaneously using tactile vibration feedback compared to when drone collision risks are transmitted to a pilot only through conventional visual ring-shaped feedback. Even in actual drone mission situations where the pilot is under a heavy cognitive load due to various simultaneous tasks, the pilot can effectively receive information about drone collisions through strong vibrations transmitted to the neck, thereby preventing drone collisions more effectively during the mission.

Inventors

박휘성
이기혁
김태준
김재현

Assignees

국방과학연구소

Dates

Publication Date: 20260507
Application Date: 20241031

Claims (10)

A step of receiving a drone collision risk message from the drone, including the distance between the drone and the obstacle; and A step of transmitting the drone collision risk to the drone operator through visual feedback and tactile vibration feedback based on the distance upon receiving the above drone collision risk message; A method for conveying drone collision risks, including [ ], to the operator complementarily through visual warnings and tactile vibrations.
In paragraph 1, The above drone collision risk transmission step is, Composed of transmitting the tactile vibration feedback to the controller using a binary transfer function based on the distance. A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
In paragraph 2, The above binary transformation function is, A function that transmits the tactile vibration feedback to the operator if the distance is within a preset threshold distance, and does not transmit the tactile vibration feedback to the operator if the distance is greater than or equal to the threshold distance. A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
In Paragraph 3, The above tactile vibration feedback is, Indicating vibrations generated by a vibration feedback module worn around the neck of the aforementioned operator, A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
In paragraph 2, The above drone collision risk transmission step is, The method comprises transmitting the visual feedback to the controller using a gradual transfer function based on the distance. A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
In paragraph 5, The above gradual transformation function is, A function in which the intensity of the visual feedback changes according to the distance, A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
In paragraph 6, The above visual feedback is, Displaying a visual ring whose color changes based on the above distance, A method of conveying drone collision risks to the operator complementarily through visual warnings and tactile vibrations.
A computer program stored on a computer-readable storage medium for executing on a computer a method of transmitting a drone collision risk described in any one of paragraphs 1 through 7 to complementarily convey a visual warning and tactile vibration to the operator.
Memory for storing one or more programs for conveying the risk of drone collision to the drone operator through visual warnings and tactile vibrations; and One or more processors that perform operations to transmit a drone collision risk to the operator as a visual warning and tactile vibration according to one or more programs stored in the memory; Includes, The above processor is, A drone collision risk message including the distance between the drone and the obstacle is received from the drone, and Upon receiving the above drone collision risk message, the drone collision risk is conveyed to the operator of the drone through visual feedback and haptic vibration feedback based on the distance. Control device.
In Paragraph 9, The above processor is, Transmitting the tactile vibration feedback to the controller using a binary transfer function based on the distance, Control device.

Description

Method for warning drone pilots of collision hazards using mutually complementary visual and haptic feedback, control apparatus and computer program for performing the method This document relates to a method for transmitting drone collision risks to a pilot in a complementary manner through visual warnings and tactile vibrations, a control device and a computer program for performing this. As the use of drones becomes increasingly active in various industrial fields (aerial photography, search, surveillance, monitoring, etc.), the number of drone collision accidents has recently been on the rise. In the case of recent representative drone models (such as the DJI Mavic 3), a distance sensor capable of measuring the distance to obstacles around the drone is installed to prevent collisions, and a visual warning is delivered to the operator in the form of a ring based on real-time sensor values. However, in situations where the operator is focusing on various tasks in addition to controlling the drone, warnings through already overloaded visual channels may not be effectively delivered. For example, a firefighting drone pilot deployed for search operations must fly carefully while focusing on the camera screen to locate people who have not escaped while navigating narrow indoor paths, while simultaneously performing multiple tasks such as rapidly conveying search information to fellow firefighters. In this situation, the operator may not be able to react quickly to the visual ring on the drone camera feed, which is provided through various cognitive loads and especially visual channels already focused on other tasks, potentially leading to a collision of the drone. FIG. 1 is a block diagram illustrating a control device according to one embodiment of the present document. FIG. 2 is a block diagram for explaining the configuration of the control device illustrated in FIG. 1. FIG. 3 is a flowchart illustrating a method for conveying drone collision risks to a pilot complementarily through visual warnings and tactile vibrations according to one embodiment of the present document. FIG. 4 is a flowchart illustrating an example of an operation that conveys a drone collision risk to a pilot complementarily through visual warnings and tactile vibrations according to one embodiment of the present document. FIG. 5 is a diagram illustrating a progressive transformation function and a binary transformation function according to one embodiment of the present document. Hereinafter, embodiments of this document will be described in detail with reference to the attached drawings. The advantages and features of the embodiments of this document, and the methods for achieving them, will become clear by referring to the details described below in conjunction with the attached drawings. However, the embodiments of this document are not limited to those disclosed below but can be implemented in various different forms, and the embodiments of this document are defined only by the scope of the claims. Throughout the specification, the same reference numerals refer to the same components. Unless otherwise defined, all terms used in this specification (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which the embodiments of this document pertain. Additionally, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise. In this specification, terms such as "first," "second," etc. are used to distinguish one component from another, and the scope of rights shall not be limited by these terms. For example, the first component may be named the second component, and similarly, the second component may be named the first component. In this specification, identification symbols (e.g., a, b, c, etc.) for each step are used for convenience of explanation and do not indicate the order of the steps; the steps may occur differently from the specified order unless the context clearly indicates a specific order. That is, the steps may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order. In this specification, expressions such as “have,” “may have,” “include,” or “may include” refer to the existence of the relevant feature (e.g., a numerical value, function, operation, or component, etc.) and do not exclude the existence of additional features. A method for transmitting a drone collision risk to a pilot in a complementary manner through visual warnings and tactile vibrations according to one embodiment of the present document, a control device for performing the same, and a computer program are described in detail below with reference to the attached drawings. First, a control device according to one embodiment of the present document will be described with reference to FIG. 1. FIG. 1 is a block diagram illustrating a contro