US-20260129279-A1 - POWER STATE ADJUSTMENT BASED ON EVENT MAPPING

US20260129279A1US 20260129279 A1US20260129279 A1US 20260129279A1US-20260129279-A1

Abstract

Systems, methods, and non-transitory media are provided for adjusting camera settings based on event data. An example method can include obtaining, via an image capture device of a mobile device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe; and based on the match, adjusting one or more settings of the image capture device.

Inventors

WESLEY JAMES HOLLAND
Seyfullah Halit Oguz

Assignees

QUALCOMM INCORPORATED

Dates

Publication Date: 20260507
Application Date: 20260105

Claims (20)

1 . An apparatus for obtaining an image, the apparatus comprising: memory; and one or more processors coupled to the memory, the one or more processors being configured to: obtain, via an image capture device of the apparatus, a keyframe depicting at least a portion of an environment; identify a detection event associated with the apparatus; generate an event entry in the memory based on the keyframe and the detection event; determine a match between one or more visual features extracted from a first image obtained via the image capture device and one or more visual features associated with the keyframe; and based on the match and the event entry, adjust a power state of the apparatus.
2 . The apparatus of claim 1 , wherein the event entry is stored in event data, and wherein the event data contains a number of keyframes from detection events associated with the image capture device.
3 . The apparatus of claim 2 , wherein the one or more processors are configured to: determine a likelihood of an event of interest occurring in the environment based on the match.
4 . The apparatus of claim 3 , wherein the one or more processors are configured to: adjust the power state of the apparatus based on the likelihood of the event of interest occurring in the environment.
5 . The apparatus of claim 3 , wherein the one or more processors are further configured to: determine the likelihood of the event further based on data from a non-image capture device of the apparatus.
6 . The apparatus of claim 5 , wherein the one or more processors are further configured to: adjust the power state of the apparatus further based on the data from the non-image capture device of the apparatus.
7 . The apparatus of claim 1 , wherein the one or more processors are configured to: obtain, via the image capture device, a different image depicting at least a portion of a different environment; determine that one or more visual features extracted from the different image do not match visual features associated with any event entry in the memory; and create a second event entry in the memory corresponding to the different image in response to the determination that the one or more visual features extracted from the different image do not match visual features associated with any event entry in the memory.
8 . The apparatus of claim 7 , wherein the one or more processors are configured to: create the second event entry in the memory corresponding to the different image further in response to at least one of a determination that an event of interest was detected in the different image, a time elapsed since a last time a respective keyframe in event data was created, or a time elapsed since a last time a respective match was identified between a particular keyframe in the event data and a particular image captured by the image capture device.
9 . The apparatus of claim 8 , wherein the one or more processors are configured to: determine that the event of interest was detected in the different image; based on the determination that the event of interest was detected in the different image, determine a likelihood of an additional event of interest occurring in the different environment; and adjust the power state of the apparatus based on the likelihood of the additional event of interest occurring in the different environment.
10 . The apparatus of claim 1 , wherein the power state of the apparatus includes at least one of a setting of the image capture device, a setting of an active depth transmitter of the apparatus, a setting of an audio algorithm, a setting of a location service associated with at least one of a global navigation satellite (GNSS) system, a wireless location area network connection, or a setting of a global positioning system (GPS).
11 . The apparatus of claim 10 , wherein, to adjust the power state of the apparatus, the one or more processors are configured to turn off or implement at least one of the active depth transmitter, the audio algorithm, or the location service.
12 . The apparatus of claim 1 , wherein the detection event comprises a detection of at least one of a face depicted by the keyframe, a hand gesture depicted by the keyframe, an emotion depicted by the keyframe, a scene depicted by the keyframe, one or more people depicted by the keyframe, an animal depicted by the keyframe, a machine-readable code depicted by the keyframe, an infrared light depicted by the keyframe, a two-dimensional surface depicted by the keyframe, or text depicted by the keyframe.
13 . The apparatus of claim 1 , wherein the power state includes a power mode of the image capture device.
14 . The apparatus of claim 13 , wherein the one or more processors are configured to obtain a second image via the image capture device, the second image being based on the adjusted power mode of the image capture device.
15 . The apparatus of claim 13 , wherein, to modify the power mode of the image capture device, the one or more processors are configured to modify at least one of a framerate of the image capture device, a resolution of the image capture device, a binning mode of the image capture device, an imaging mode of the image capture device, or a number of image sensors invoked by at least one of the image capture device and the apparatus.
16 . The apparatus of claim 1 , wherein the image capture device comprises a first image capture device, and wherein, to modify the power state of the apparatus, the one or more processors are configured to: increase a power mode of a second image capture device of the apparatus, wherein the second image capture device employs at least one of a higher-power mode than the first image capture device, a higher framerate than the first image capture device, a higher resolution than the first image capture device, a higher number of image sensors than the first image capture device, or a higher-power processing pipeline than a processing pipeline associated with the first image capture device.
17 . The apparatus of claim 1 , wherein the power state of the apparatus comprise a framerate of the image capture device, and wherein the one or more processors are configured to: determine the framerate based on a pre-determined framerate for detection events and a likelihood of an event of interest occurring in the environment; and maintain the framerate until at least one of an expiration of a configured period of time or a determination of a subsequent match between a different image captured by the image capture device and at least one event entry.
18 . The apparatus of claim 17 , wherein the one or more processors are configured to: after expiration of the configured period of time or the determination of the subsequent match, adjust the framerate of the image capture device to a different framerate.
19 . The apparatus of claim 18 , wherein the different framerate comprises a default framerate or a particular framerate determined based on the pre-determined framerate and a second likelihood of detecting a particular event of interest associated with the subsequent match.
20 . The apparatus of claim 1 , wherein the one or more processors are configured to generate the event entry in the memory further based on a user input.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. Non-Provisional application Ser. No. 18/494,081, filed Oct. 25, 2023, which is a continuation of U.S. Non-Provisional application Ser. No. 17/395,348, filed Aug. 5, 2021, the disclosure of which are hereby incorporated by reference, in their entirety and for all purposes. TECHNICAL FIELD The present disclosure generally relates to camera setting adjustments. For example, aspects of the present disclosure relate to camera setting adjustments based on event mapping. BACKGROUND Electronic devices are increasingly equipped with camera hardware to capture images and/or videos for consumption. For example, a computing device can include a camera (e.g., a mobile device such as a mobile telephone or smartphone including one or more cameras) to allow the computing device to capture a video or image of a scene, a person, an object, etc. The image or video can be captured and processed by the computing device (e.g., a mobile device, an IP camera, extended reality device, connected device, etc.) and stored or output for consumption (e.g., displayed on the device and/or another device). In some cases, the image or video can be further processed for effects (e.g., compression, image enhancement, image restoration, scaling, framerate conversion, etc.) and/or certain applications such as computer vision, extended reality (e.g., augmented reality, virtual reality, and the like), object detection, image recognition (e.g., face recognition, object recognition, scene recognition, etc.), feature extraction, authentication, and automation, among others. In some cases, an electronic device can process images to detect objects, faces, and/or any other items captured by the images. The object detection can be useful for various applications such as, for example, authentication, automation, gesture recognition, surveillance, extended reality, computer vision, among others. In some examples, the electronic device can implement a lower-power or “always-on” (AON) camera that persistently or periodically operates to automatically detect certain objects in an environment. The lower-power camera can be implemented for a variety of use cases such as, for example, persistent gesture detection, persistent object (e.g., face/person, animal, vehicle, device, plane, etc.) detection, persistent object scanning (e.g., quick response (QR) code scanning, barcode scanning, etc.), persistent facial recognition for authentication, etc. However, the persistent operation and/or more frequent operation of lower-power cameras and other camera setups can result in high overall power consumption. Moreover, mobile devices implementing such lower-power cameras can suffer from a reduced battery life, and stationary devices may demand more complex heat dissipation designs and/or exhibit an unacceptable low power efficiency during long term usage. Accordingly, a significantly higher power consumption can negatively impact use of the electronic device, the device's performance, and the user experience. BRIEF SUMMARY Systems and techniques are described herein for camera setting adjustments based on event mapping. According to at least one example, a method is provided for adjusting camera settings based on event data. The method can include obtaining, via an image capture device of an electronic device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe associated with one or more detection events; and based on the match, adjusting one or more settings of the image capture device. According to at least one example, a non-transitory computer-readable medium is provided for adjusting camera settings based on event data. The non-transitory computer-readable medium can include instructions stored thereon which, when executed by one or more processors, cause the one or more processors to obtain, via an image capture device of an electronic device, an image depicting at least a portion of an environment; determine a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe associated with one or more detection events; and based on the match, adjust one or more settings of the image capture device. According to at least one example, an apparatus is provided for adjusting camera settings based on event data. The apparatus can include memory and one or more processors configured to obtain, via an image capture device of the apparatus, an image depicting at least a portion of an environment; determine a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe associated with one or more detection events; and based on the match, adjust one or more settings of the image capture device. According to at least one exam