Search

JP-2026074765-A - System and method for detecting foreign objects on a runway

JP2026074765AJP 2026074765 AJP2026074765 AJP 2026074765AJP-2026074765-A

Abstract

[Problem] To provide a solution that can detect FODs even under poor visibility conditions such as bad weather, and prevent or minimize false detections of FODs. [Solution] This system includes a thermal camera that captures a thermal image of a first view of a target area of a runway, a visible light camera that has a second field of view and captures a visible light image of the first view, a processor, and memory. The processor is configured to determine that the converted visible light image and the converted thermal image are images of the second view of the target area, to detect thermal object images in the thermal image, to detect visible light object images in the visible light image, and to determine that a foreign object has been detected when a thermal object image and a visible light object image are detected in the thermal image and visible light object image, respectively. [Selection Diagram] Figure 1

Inventors

  • チュウ ロン－ジー デイビッド
  • チュウ ロン－キ フィービー
  • チュウ キエン ミャオ デイビッド

Assignees

  • チュウ キエン ミャオ デイビッド
  • チュウ ロン－キ フィービー

Dates

Publication Date
20260507
Application Date
20241021

Claims (20)

  1. A method for detecting foreign objects on a runway divided into multiple sectors, Multiple thermal images of the first view of the multiple sectors of the runway are taken from one side of the runway, The method involves capturing multiple visible light images of the first view of the multiple sectors of the runway from one side of the runway, wherein the first view overlaps with the second view. To detect thermal object images within the aforementioned plurality of thermal images, To detect visible light object images within the aforementioned plurality of visible light images, In one of the plurality of thermal images and one of the plurality of visible light images, if the thermal object image and the visible light object image are detected, it is determined that the foreign object has been detected. The process involves converting the plurality of visible light images and the plurality of thermal images into a plurality of converted visible light images and a plurality of converted thermal images, wherein the plurality of converted visible light images and the plurality of converted thermal images are cockpit view images, and the cockpit view is a view of the runway from the cockpit of an aircraft. The process involves combining the multiple converted visible light images to form a single visible light image, The process involves combining the multiple converted thermal images to form a single thermal image, A method comprising transmitting the single thermal image and the single visible light image to a display in the cockpit of the aircraft.
  2. The method according to claim 1, wherein the first view includes a perspective view.
  3. The method according to claim 1 or 2, wherein the second view includes a cockpit view as seen from the cockpit of an aircraft.
  4. The method according to any one of claims 1 to 3, wherein the conversion of the plurality of visible light images includes rotating the plurality of visible light images.
  5. The method according to any one of claims 1 to 4, wherein the conversion of the plurality of thermal images includes rotating the plurality of thermal images.
  6. The method according to any one of claims 1 to 5, wherein the conversion of the plurality of visible light images includes distorting the plurality of visible light images.
  7. The method according to any one of claims 1 to 6, wherein the conversion of the plurality of thermal images includes distorting the plurality of thermal images.
  8. The method according to any one of claims 1 to 7, wherein determining the foreign object includes generating at least one attribute of the foreign object in each of the thermal object image and the visible light object image, comparing the at least one attribute of the foreign object in the thermal object image and the visible light object image, and detecting the foreign object if the at least one attribute of the foreign object in the thermal object image and the visible light object image are the same.
  9. The method according to claim 8, wherein the at least one attribute of the foreign object includes the position of the thermal object image in the thermal image and the position of the visible light object image in the visible light image.
  10. The method according to claim 9, wherein, if the distance between the position of the thermal object image in the thermal image and the position of the visible light object image in the visible light image is within the position parameter, then at least one attribute of the foreign object in the thermal object image and the visible light object image is the same.
  11. The method according to any one of claims 8 to 10, wherein the at least one attribute of the foreign object includes the size of the thermal object image and the visible light object image.
  12. The method according to claim 11, wherein, if the difference between the size of the thermal object image in the thermal image and the size of the visible light object image in the visible light image is within the size parameter, then at least one attribute of the foreign object in the thermal object image and the visible light object image is the same.
  13. A system for detecting foreign objects on a runway divided into multiple sectors, Multiple camera sets arranged at intervals from each other, A thermal camera having a first field of view and configured to capture a thermal image of a first view of one of the plurality of sectors of the runway from one side of the runway, A plurality of camera sets each having a visible light camera having a second field of view and configured to capture a visible light image of the first view of one of the plurality of sectors of the runway from one side of the runway, wherein the first field of view overlaps with the second field of view. A processor that communicates with the aforementioned multiple camera sets, The system includes a memory that communicates with the processor and stores instructions that can be executed by the processor, The aforementioned processor, Detecting thermal object images within multiple thermal images, Detecting visible light object images within multiple visible light images, In one of the plurality of thermal images and one of the plurality of visible light images, if the thermal object image and the visible light object image are detected, it is determined that the foreign object has been detected. The process involves converting the plurality of visible light images and the plurality of thermal images into a plurality of converted visible light images and a plurality of converted thermal images, wherein the plurality of converted visible light images and the plurality of converted thermal images are cockpit view images, and the cockpit view is a view of the runway from the cockpit of an aircraft. The process involves combining the multiple converted visible light images from the multiple camera sets to form a single visible light image. The process involves combining the multiple converted thermal images from the multiple camera sets to form a single thermal image. A system configured to transmit the single thermal image and the single visible light image to a display in the cockpit of the aircraft.
  14. The system according to claim 13, wherein the first view includes a perspective view.
  15. The system according to claim 13 or 14, wherein the processor is configured to rotate the visible light image in order to convert the visible light image.
  16. The system according to any one of claims 13 to 15, wherein the processor is configured to rotate the thermal image in order to convert the thermal image.
  17. The system according to any one of claims 14 to 16, wherein the processor is configured to distort the visible light image in order to convert the visible light image.
  18. The system according to any one of claims 13 to 17, wherein the processor is configured to distort the thermal image in order to convert the thermal image.
  19. The system according to any one of claims 13 to 18, wherein, in order to determine the foreign object, the processor is configured to generate at least one attribute of the foreign object in each of the thermal object image and the visible light object image, and to compare the at least one attribute of the foreign object in the thermal object image and the visible light object image, and the foreign object is detected if the at least one attribute of the foreign object in the thermal object image and the visible light object image are the same.
  20. The system according to claim 19, wherein the at least one attribute of the foreign object includes the position of the thermal object image in the thermal image and the position of the visible light object image in the visible light image.

Description

This invention relates to a system for detecting foreign objects on a runway and a method for implementing such a system. Foreign object debris (FOD) on airport runways poses a danger to aircraft landings and takeoffs. To reliably detect FOD under normal clear weather conditions, FOD detection systems using visible light spectrum cameras are employed. Under normal clear weather conditions, such as when there is no fog, FOD detection systems can detect FOD with high accuracy by capturing and processing high-resolution images of the FOD. Examples of FOD include engine and aircraft parts, tools, construction waste, rubber materials, and natural substances. However, in adverse weather conditions, especially foggy conditions, the operation of the FOD detection system may be negatively affected and reduced. Because the FOD detection system operates only in the visible light spectrum, it may not be able to reliably detect FODs in foggy weather conditions, i.e., under poor visibility conditions. Under such conditions due to fog, visibility on the runway typically drops to less than 1 km, making it impossible to "see" the FOD. Visibility conditions are classified into several categories. For example, Cat II represents standard operations corresponding to runway visual range (RVR) in the range of 550 meters (1,800 feet) to 300 meters (1,000 feet). Cat IIIa represents precision instrument approach and landing operations with an RVR of 175 meters (600 feet) or more. Cat IIIb represents precision instrument approach and landing operations with an RVR of less than 175 meters (600 feet) and 50 meters (200 feet) or more. Cat IIIc represents precision instrument approach and landing operations with no RVR restrictions, including cases with zero visibility. Airport runway visibility varies depending on the airport's geographical location and is classified accordingly. Many FOD detection systems can detect FOD within an airport with Cat II visibility, but cannot be used at airports with Cat IIIa, Cat IIIb, or Cat IIIc visibility. Furthermore, FOD detection systems often generate false alarms or incorrect warnings. These false warnings can be caused by phenomena such as light reflection from artificial light sources, including nearby buildings or runway lights. When such artificial light reflects off the smooth surface of the runway, or off puddles or standing water on the runway surface, the FOD detection system may identify it as an FOD and issue a false warning. The number of such false warnings due to reflection often increases significantly after rainfall, when puddles or standing water form on the runway surface. While such reflections occur during the day, they are even more frequent at night, and during the early morning and evening hours. When an aircraft is landing on a runway, the presence of FODs (Foreign Object Deposition) can make it impossible for the aircraft to land safely. As an aircraft approaches a runway, it flies along the "final approach" of its flight path before reaching the landing zone. At this point, the aircraft is positioned close to the runway. The final approach is the last section of the flight path that an aircraft approaches in order to land on the runway. The final approach flight path is a flight path that descends in the direction of landing from the base leg towards the runway along the extension of the runway centerline. The aircraft needs to align itself with the extension of the runway centerline in preparation for the subsequent descent and landing on the runway. The aircraft typically turns from the base leg to the final approach within approximately 1,609 meters (1 mile) to 3,218 meters (2 miles) from the airport. Typically, the aircraft proceeds along the approach descent path on the final approach flight path and eventually lands in the runway landing zone. The approach descent path is generally at a 3-degree angle from the horizontal. Poor runway visibility may prevent pilots from seeing FODs (Foreign Object Debris) on the runway. If an aircraft collides with an FOD or if an aircraft engine ingests an FOD, it could lead to a major disaster. Therefore, it is crucial to provide a solution that can detect FODs even under poor visibility conditions such as bad weather, and prevent or minimize false FOD detections. Various embodiments provide a method for detecting foreign objects on a runway. This method comprises: capturing a thermal image of a first view of a target area of the runway from one side of the runway; capturing a visible light image of the first view of the target area of the runway from the other side of the runway; converting at least one of the visible light image and the thermal image into a converted visible light image and a converted thermal image, respectively, wherein the converted visible light image and the converted thermal image are images of a second view of the target area; detecting a thermal object image within the thermal image; detecting a visible lig