EP-4735333-A1 - SYSTEMS AND METHODS FOR CLOUD AVOIDANCE

Abstract

Systems and methods for cloud avoidance are presented. For example, a computing system (107) may be configured to obtain image data from a forward-looking sensor (101) of a satellite, wherein the satellite is traveling along a current trajectory. The computing system (107) may be configured to determine, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target. The computing system (107) may be configured to determine a comparison between the cloud coverage associated with the imaging target and a threshold level of cloud coverage. The computing system (107) may be configured to determine an updated trajectory for the satellite based on the current trajectory and the comparison. The computing system (107) may be configured to generate one or more command instructions to control a motion of the satellite based on the updated trajectory.

Inventors

• DEVARAJ, Kiruthika
• KACKER, Shreeyam

Assignees

• Planet Labs PBC

Dates

Publication Date

20260506

Application Date

20240628

Claims (20)

1. 1. A computing system of a satellite comprising: one or more sensors comprising a forward-looking sensor; one or more processors; and one or more tangible, non-transitory. computer-readable media storing instructions executable by the one or more processors to cause the computing system to perform operations, the operations comprising: obtaining image data from the forw ard-looking sensor of the satellite, wherein the satellite is traveling along a current trajectory; determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target; determining a comparison between the cloud coverage associated with the imaging target and a threshold level of cloud coverage; determining an updated trajectory for the satellite based on the current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage; and generating one or more command instructions to control a motion of the satellite based on the updated trajectory.
2. 2. The computing system of claim 1, wherein the operations further comprise accessing metadata associated with one or more environmental conditions.
3. 3. The computing system of claim 2, wherein the metadata comprises at least one of (i) a sensor temperature, (ii) a sun angle, (iii) an earth surface angle, or (iv) a slew angle.
4. 4. The computing system of any of claims 1 to 3. wherein the operations further comprise receiving a request for imagery of a geographic region, the request for imagery associated with the imaging target and the threshold level of cloud coverage.
5. 5. The computing system of any of claims 1 to 4, wherein the operations further comprise: determining, based on the current trajectory, a probability of the satellite passing over the imaging target; and determining an updated imaging target based on the probability.
6. 6. The computing system of any of claims 1 to 5, wherein the model is a convolutional neural network.
7. 7. The computing system of any of claims 1 to 6. wherein the one or more sensors comprises at least one of (i) a VIS camera (ii), or (li) a LWIR camera.
8. 8. The computing system of any of claims 1 to 7, wherein the updated trajectory' is a slew trajectory.
9. 9. A computer-implemented method comprising: obtaining image data from one or more sensors of a satellite comprising a forward-looking sensor, wherein the satellite is traveling along a current trajectory; determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target; determining a comparison between the cloud coverage associated with the imaging target a threshold level of cloud coverage; determining an updated trajectory for the satellite based on the current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage; and generating one or more command instructions to control a motion of the satellite based on the updated trajectory.
10. 10. The computer-implemented method of claim 9 further comprising accessing metadata associated with one or more environmental conditions.
11. 11. The computer-implemented method of claim 10, wherein the metadata comprises at least one of (i) a sensor temperature, (ii) a sun angle, (iii) an earth surface angle, or (iv) a slew angle.
12. 12. The computer-implemented method of any of claims 9 to 11, further comprising receiving a request for imagery of a geographic region, the request for imagery associated with the imaging target and the threshold level of cloud coverage.
13. 13. The computer-implemented method of any of claims 9 to 12, further comprising: determining, based on the current trajectory, a probability of the satellite passing over the imaging target; and determining an updated imaging target based on the probability.
14. 14. The computer-implemented method of any of claims 9 to 13 further comprising: controlling the motion of the satellite to pass over the imaging target, wherein passing over the imaging target is indicative of a nadir position or an off-nadir position; and obtaining, using a sensor of the one or more sensors, imagery of the imaging target.
15. 15. The computer-implemented method of any of claims 9 to 14, wherein the model is a convolutional neural network.
16. 16. The computer-implemented method of any of claims 9 to 15, wherein the one or more sensors comprises at least one of (i) a VIS camera (ii), or (ii) a LWIR camera.
17. 17. The computer-implemented method of any of claims 9 to 16, wherein the updated trajectory is a slew trajectory.
18. 18. A non-transitory computer-readable media storing instructions that are executable by one or more processors to cause the one or more processors to perform operations, the operations comprising: obtaining image data from a forward-looking sensor of a satellite, wherein the satellite is traveling along a current trajectory; determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target; determining a comparison between the cloud coverage associated with the imaging target a threshold level of cloud coverage; and determining an updated trajectory for the satellite based on the current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage; and generating one or more command instructions to control a motion of the satellite based on the updated trajectory.
19. 19. A computer-implemented method comprising: obtaining image data from a forward-looking sensor of a satellite; determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target, comprising: analyzing, using the model, an image frame of the image data; generating, using the model, a pl ural i ty of image segments, wherein the plurality of image segments is associated with one or more clouds depicted in the image frame; generating, using the model, a plurality of blurred image segments, wherein the plurality of blurred image segments are indicative of cloud characteristics; and determining, using the model, the cloud coverage associated with respective blurred image segments of the plurality of blurred image segments.
20. 20. The computer-implemented method of claim 19. further comprising: determining a comparison between the cloud coverage associated with the imaging target a threshold level of cloud coverage; and determining an updated trajectory' for the satellite based on a current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage.

Description

SYSTEMS AND METHODS FOR CLOUD AVOIDANCE PRIORITY CLAIM [0001] This application is based upon and claims the benefit of priority to U.S. Patent Application No. 18/345,883, filed on June 30, 2023. The present application claims priority to, benefit of, and incorporates by reference the entirety of the contents of the cited application. FIELD [0002] The present disclosure relates generally to techniques to avoid clouds on slew trajectories of satellites. More particularly, the present disclosure relates to systems and methods for avoiding cloud cover using a forward-looking sensor and a model to determine target geographic regions along a trajectory of a satellite. BACKGROUND [0003] A constellation of imaging satellites can be utilized to acquire imagery. The satellites can be controlled to acquire the imagery by, for example, a ground-based control center. The control center can uplink commands to the satellites and receive imagery via a satellite downlink. SUMMARY [0004] Aspects and advantages of embodiments of the present disclosure will be set forth in part in the following description, or can be learned from the description, or can be learned through practice of the embodiments. [0005] One example embodiment of the present disclosure is directed to a computing system of a satellite. The computing system includes one or more sensors including a forward-looking sensor. The computing system includes one or more processors and one or more tangible, non-transitory, computer-readable media storing instructions executable by the one or more processors cause the computing system to perform operations. The operations include obtaining image data from the forward-looking sensor of the satellite, wherein the satellite is traveling along a current trajectory. The operations include determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target. The operations include determining a comparison between the cloud coverage associated with the imaging target and a threshold level of cloud coverage. The operations include determining an updated trajectory for the satellite based on the current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage. The operations include generating one or more command instructions to control a motion of the satellite based on the updated trajectory. [0006] In some implementations, the operations include accessing metadata associated with one or more environmental conditions. [0007] In some implementations the example metadata includes at least one of (i) a sensor temperature, (ii) a sun angle, (iii) an earth surface angle, or (iv) a slew angle. [0008] In some implementations, the operations include receiving a request for imagery' of a geographic region, the request for imagery associated with the imaging target and the threshold level of cloud coverage. [0009] In some implementations, the operations include determining, based on the current trajectory', a probability of the satellite passing over the imaging target. In some implementations, the operations include determining an updated imaging target based on the probability. [0010] In some implementations the example model is a convolutional neural network. [0011] In some implementations, the one or more sensors includes at least one of (i) a VIS camera, or (ii) a LWIR camera. [0012] In some implementations the updated trajectory is a slew trajectory. [0013] Another example embodiment of the present disclosure is directed to a computer-implemented method. The method includes obtaining image data from one or more sensors of a satellite including a forward-looking sensor, wherein the satellite is traveling along a current trajectory’. The method includes determining, using a model and based on the image data, an imaging target and cloud coverage associated with the imaging target. The method includes determining a comparison between the cloud coverage associated with the imaging target and a threshold level of cloud coverage. The method includes determining an updated trajectory for the satellite based on the current trajectory and the comparison between the cloud coverage associated with the imaging target and the threshold level of cloud coverage. The method includes generating one or more command instructions to control a motion of the satellite based on the updated trajectory'. [0014] In some examples, the method includes accessing metadata associated with one or more environmental conditions. [0015] In some examples, the metadata includes at least one of (i) a sensor temperature, (ii) a sun angle, (iii) an earth surface angle, or (iv) a slew angle. [0016] In some examples, the method includes receiving a request for imagery of a geographic region, the request for imagery associated with the imaging target and the threshold level of cloud coverage. [0017] In some examples, the method include