JP-2026076126-A - System and method for visualizing automated actions using holographic agents

Abstract

[Problem] A system and method for visualizing automated actions using a holographic agent are provided. [Solution] A selection of the holographic format of a holographic agent is received. An auto-control notification associated with an auto-control action is received in a first time. The auto-control action is scheduled to be performed by the vehicle's autopilot system in a second time. An agent action is generated based at least in part on the auto-control action. A command is sent to the hologram generation system in the first time to generate a holographic agent in the selected holographic format involved in the agent action. The agent action is a visual representation of the autopilot system performing the auto-control action prior to the performance of the first auto-control action in the second time. [Selection Diagram] Figure 1

Inventors

• ニコラ ルボルド
• トール フィンセス
• ロバート デ マース

Assignees

• ハネウェル・インターナショナル・インコーポレーテッド

Dates

Publication Date

20260511

Application Date

20251017

Priority Date

20241023

Claims (3)

1. A system for visualizing automated actions using holographic agents, At least one processor, The system comprises at least one memory communicably coupled to the at least one processor, the at least one memory containing instructions, and the instructions, when executed by the at least one processor, Receiving the selection of the holographic format for the holographic agent via the user interface, Receiving a first automatic control notification associated with a first automatic control action at a first time, wherein the first automatic control action is scheduled to be performed by the vehicle's autopilot system at a second time, and the second time is after the first time. To generate a first agent action based at least in part on the first automatic control action, A system that transmits a first command to a hologram generation system to generate the selected holographic form of the holographic agent involved in the first agent action at the first time, wherein the first agent action is a visual representation of the autopilot system performing the first automatic control action prior to the performance of the first automatic control action at the second time.
2. The at least one memory includes an instruction, and when the instruction is executed by the at least one processor, the at least one processor receives the instruction. Receiving a second auto-control notification associated with a second auto-control action in a third time, wherein the second auto-control action is scheduled to be performed by the autopilot system in a fourth time, and the second auto-control action is in response to a first manual control action performed via a control interface after the execution of the first auto-control action, and the fourth time is after the third time. The second agent action is generated based at least in part on the second automatic control action, The system according to claim 1, which transmits a second command to the hologram generation system to generate the selected holographic form of the holographic agent involved in the second agent action in the third time, wherein the second agent action is a visual representation of the autopilot system performing the second automatic control action prior to the performance of the second automatic control action in the fourth time.
3. The at least one memory includes an instruction, and when the instruction is executed by the at least one processor, the at least one processor receives the instruction. Receiving a third auto-control notification associated with a third auto-control action in a fifth time, wherein the third auto-control action is scheduled to be performed by the autopilot system in a sixth time, and the second auto-control action is in response to a second manual control action performed via the control interface before the execution of the first auto-control action in the second time, wherein the second manual control action is operated to override the first auto-control action. The third agent action is generated based at least in part on the third automatic control action, Sending a third command to the hologram generation system to generate the selected holographic form of the holographic agent involved in the third agent action in the fifth time, wherein the third agent action is a visual representation of the autopilot system performing the third automatic control action prior to the performance of the third automatic control action in the sixth time, The system according to claim 1, which transmits a second command to the hologram generation system to generate the selected holographic form of the holographic agent involved in the second agent action in the third time, wherein the second agent action is a visual representation of the autopilot system performing the second automatic control action prior to the performance of the second automatic control action in the fourth time.

Description

This invention relates generally to aircraft operation, and more specifically to a system and method for visualizing automated actions using holographic agents. Face-to-face interaction between crew members typically uses continuous gestures, expressions, and vocalizations to communicate the intent and execution of vehicle operational actions. Automated systems often communicate their intent to perform automated actions via individual mode notifications and flat displays. The execution of automated actions by the cockpit and avionics control systems can be difficult to trust, monitor, and interact with under challenging vehicle operating conditions. Notifications associated with automated actions can suffer from a lack of information related to the state of the vehicle systems and underlying situations that pose challenges to crew intervention that may halt or interfere with automated actions. Therefore, there is a need for systems and methods to visualize automated actions using holographic agents. This summary is provided to illustrate, in a simplified form, the selected concepts, which are further described in the following "Modes for Carrying Out the Invention." This summary is not intended to identify the main or essential features of the claimed subject matter, nor is it intended to be used to assist in determining the scope of the claimed subject matter. In various embodiments, a system for visualizing automated actions using a holographic agent includes at least one processor and at least one memory communicatively coupled to the at least one processor. The at least one memory includes instructions, which, when executed by the at least one processor, cause the at least one processor to: receive a selection of a holographic form of a holographic agent via a user interface; receive a first auto-control notification associated with a first automated control action at a first time, the first automated control action being scheduled to be performed by the vehicle's autopilot system at a second time, the second time being after the first time; generate a first agent action at least partially based on the first automated control action; and transmit a first command to a hologram generation system to generate a holographic agent in the selected holographic form involved in the first agent action at the first time, the first agent action being a visual representation of the autopilot system's performance of the first automated control action prior to its performance at the second time. In various embodiments, a method for visualizing an automated action using a holographic agent includes receiving a selection of the holographic form of a holographic agent via a user interface; receiving a first automated control notification associated with a first automated control action at a first time, the first automated control action being scheduled to be performed by the vehicle's autopilot system at a second time, the second time being after the first time; generating a first agent action at least in part based on the first automated control action; and transmitting a first command to a hologram generation system to generate a holographic agent in the selected holographic form involved in the first agent action at the first time, the first agent action being a visual representation of the autopilot system performing the first automated control action before it is performed at the second time. In various embodiments, an aircraft including a system for visualizing automated actions using a holographic agent includes at least one processor and at least one memory communicatively coupled to the at least one processor. The at least one memory includes instructions, which, when executed by the at least one processor, cause the at least one processor to: receive a selection of a holographic form of a holographic agent via a user interface; receive a first auto-control notification associated with a first automated control action at a first time, the first automated control action being scheduled to be performed by the vehicle's autopilot system at a second time, the second time being after the first time; generate a first agent action at least partially based on the first automated control action; and transmit a first command to a hologram generation system to generate a holographic agent in the selected holographic form involved in the first agent action at the first time, the first agent action being a visual representation of the autopilot system's performance of the first automated control action prior to its performance at the second time. Furthermore, other desirable functions and features of systems and methods for visualizing automated actions using holographic agents will become apparent from the subsequent detailed description and the attached claims, in conjunction with the attached drawings and the aforementioned background. The present invention may be described hereafter in conjunction with the figures shown