Search

KR-102962790-B1 - Methods and devices for object detection and object color determination

KR102962790B1KR 102962790 B1KR102962790 B1KR 102962790B1KR-102962790-B1

Abstract

The device may include an anti-color filter array adjacent to an array of optical sensor pixels. The anti-color filter array may include first anti-color filters. Each of the first anti-color filters may be located near a corresponding instance (or group of instances) of a first plurality of optical sensor pixels and may be configured to at least partially suppress the transmission of light in a first optical wavelength range. In some examples, the first optical wavelength range may correspond to a first color. The anti-color filter array may include second anti-color filter regions, each of which may be located near a corresponding instance of a second plurality of optical sensor pixels. In some such examples, each of the second anti-color filter regions may be configured to at least partially suppress the transmission of light in a second optical wavelength range.

Inventors

  • 박 에드윈 청우

Assignees

  • 퀄컴 인코포레이티드

Dates

Publication Date
20260508
Application Date
20210318
Priority Date
20200319

Claims (20)

  1. As a system (100) for object detection and object color determination, Array of optical sensor pixels (105); As an anti-color filter array (107) adjacent to the array (105) of the optical sensor pixels, the anti-color filter array (107) is, A first plurality of first anti-color filters (405a), wherein each of the first anti-color filters (405a) is positioned near a corresponding instance of a first plurality of optical sensor pixels, and each of the first anti-color filters (405a) is configured to at least partially suppress the transmission of light in a first optical wavelength range; and A second plurality of second anti-color filter regions (405b), wherein each of the second anti-color filter regions (405b) is close to a corresponding instance of the second plurality of optical sensor pixels, and each of the second anti-color filter regions (405b) is not configured to suppress the transmission of light of the first light wavelength range, the second plurality of second anti-color filter regions (405b). Includes the anti-color filter array (107) including; The above system is, Interface system (112); and It further includes a control system (110), and the control system (110) is, Receiving a request for optical sensor pixel values from an array (105) of optical sensor pixels from a device and through the interface system (112), wherein the optical sensor pixel values include first optical sensor pixel values corresponding to the first plurality of optical sensor pixels and second optical sensor pixel values corresponding to the second plurality of optical sensor pixels; Through the above interface system (112), the optical sensor pixel values are transmitted to the device; Receive optical sensor pixel values from the array (105) of the optical sensor pixels; Analyze the optical sensor pixel values to detect at least a first object; and To determine the first object color information The one configured to determine the first object color information is, Acquiring at least one first optical sensor value from at least one first optical sensor pixel corresponding to the first object, wherein the at least one first optical sensor pixel is at least one instance of the first plurality of optical sensor pixels; Acquiring at least one second optical sensor value from at least one second optical sensor pixel corresponding to the first object, wherein the at least one second optical sensor pixel is not at least one instance of the first plurality of optical sensor pixels, and acquiring the at least one second optical sensor value; and Comparing the value of at least one first optical sensor and the value of at least one second optical sensor A system for object detection and object color determination, including
  2. In Article 1, A system for object detection and object color determination, wherein the second plurality of second anti-color filter regions include the second plurality of second anti-color filters, each of the second anti-color filters is located near a corresponding instance of the second plurality of optical sensor pixels, and each of the second anti-color filters is configured to at least partially suppress the transmission of light in a second optical wavelength range.
  3. In Article 2, A system for object detection and object color determination, wherein the at least one second optical sensor pixel is at least one instance of the second plurality of optical sensor pixels.
  4. In Article 2, A system for object detection and object color determination, wherein the anti-color filter array comprises groups of identical anti-color filter patterns, and each of the identical anti-color filter patterns comprises at least one instance of the first anti-color filters and at least one instance of the second anti-color filters.
  5. In Article 2, A system for object detection and object color determination, wherein the anti-color filter array comprises a third plurality of third anti-color filters, each of the third anti-color filters is positioned in proximity to a corresponding instance of a third plurality of optical sensor pixels, and each of the third anti-color filters is configured to at least partially suppress the transmission of light in a third optical wavelength range.
  6. In Article 5, The above control system is configured to obtain at least one third optical sensor value from at least one third optical sensor pixel corresponding to the first object, and the at least one third optical sensor pixel is at least one instance of the third plurality of optical sensor pixels, a system for object detection and object color determination.
  7. In Article 6, A system for object detection and object color determination, wherein determining the first object color information includes comparing the at least one third optical sensor value with the at least one first optical sensor value and the at least one second optical sensor value.
  8. In Article 5, A system for object detection and object color determination, wherein the anti-color filter array comprises groups of identical anti-color filter patterns, and each of the identical anti-color filter patterns comprises at least one instance of the first anti-color filters, at least one instance of the second anti-color filters, and at least one instance of the third anti-color filters.
  9. In Article 1, A system for object detection and object color determination, wherein determining the first object color information involves aggregating optical sensor pixel values.
  10. In Article 1, A system for object detection and object color determination, wherein analyzing the optical sensor pixel values to detect at least a first object involves comparing the optical sensor pixel values with a background model.
  11. In Article 1, The above anti-color filter array comprises a plurality of transparent or substantially transparent regions, a system for object detection and object color determination.
  12. As a method for object detection and object color determination, A step of receiving a request for optical sensor pixel values from an array (105) of optical sensor pixels from a device and through an interface system (112), wherein the optical sensor pixel values include first optical sensor pixel values corresponding to a first plurality of optical sensor pixels and second optical sensor pixel values corresponding to a second plurality of optical sensor pixels; A step of transmitting the optical sensor pixel values to the device through the interface system (112); A step of receiving optical sensor pixel values from an array (105) of the optical sensor pixels; A step of analyzing the optical sensor pixel values to detect at least a first object; and The method includes a step of determining first object color information, and the step of determining first object color information is A step of obtaining at least one first optical sensor value from at least one first optical sensor pixel corresponding to the first object, wherein the at least one first optical sensor pixel is at least one instance of the first plurality of optical sensor pixels that received light suppressed in a first light wavelength range; A step of obtaining at least one second optical sensor value from at least one second optical sensor pixel corresponding to the first object, wherein the at least one second optical sensor pixel is not at least one instance of the first plurality of optical sensor pixels; and A method for object detection and object color determination, comprising the step of comparing at least one first optical sensor value and at least one second optical sensor value.
  13. In Article 12, A method for object detection and object color determination, wherein the at least one second optical sensor pixel is at least one instance of a second plurality of optical sensor pixels that receive light suppressed in a second optical wavelength range.
  14. In Article 13, A method for object detection and object color determination, wherein the step of determining the first object color information further includes the step of obtaining at least one third optical sensor value from at least one third optical sensor pixel corresponding to the first object, and the at least one third optical sensor pixel is at least one instance of a third plurality of optical sensor pixels that received light suppressed in a third light wavelength range.
  15. As one or more non-transient storage media for object detection and object color determination, The above one or more non-transient storage media store software, and The above software includes commands for controlling one or more devices to perform a method, and the method is, A step of receiving a request for optical sensor pixel values from an array (105) of optical sensor pixels from a device and through an interface system (112), wherein the optical sensor pixel values include first optical sensor pixel values corresponding to a first plurality of optical sensor pixels and second optical sensor pixel values corresponding to a second plurality of optical sensor pixels; A step of transmitting the optical sensor pixel values to the device through the interface system (112); A step of receiving optical sensor pixel values from an array (105) of the optical sensor pixels; A step of analyzing the optical sensor pixel values to detect at least a first object; and The method includes a step of determining first object color information, and the step of determining first object color information is A step of obtaining at least one first optical sensor value from at least one first optical sensor pixel corresponding to the first object, wherein the at least one first optical sensor pixel is at least one instance of a first plurality of optical sensor pixels that received light suppressed in a first light wavelength range; A step of obtaining at least one second optical sensor value from at least one second optical sensor pixel corresponding to the first object, wherein the at least one second optical sensor pixel is not at least one instance of the first plurality of optical sensor pixels; and One or more non-transient storage media for object detection and object color determination, comprising the step of comparing at least one first optical sensor value and at least one second optical sensor value.
  16. delete
  17. delete
  18. delete
  19. delete
  20. delete

Description

Methods and devices for object detection and object color determination 35 Priority claim under U.S.C. §119 This patent application claims priority to Regular Application No. 16/824,558, filed on March 19, 2020, under the title " METHODS AND DEVICES FOR OBJECT DETECTION AND OBJECT COLOR DETERMINATION ", which is assigned to the assignee of this application and is expressly incorporated by reference into this specification. Technology field The present disclosure generally relates to optical sensors and related methods. Low-power optical sensors, such as those provided by the Assignee, present both opportunities and challenges. Some low-power optical sensors provided by the Assignee consume several milliwatts of power, including power used by the optical sensor and power consumed by associated processing. Some such optical sensor implementations are suitable for "always on" use cases, as well as battery power, low-cost, low-power, ultra-low-power, and TinyML (collaboration between embedded ultra-low-power systems and machine learning communities) use cases. For comparison, camera modules in smartphones typically consume orders of magnitude more power, for example, hundreds of milliwatts or, in some cases, watts. Some security cameras may consume even more power. In some instances, optical sensor pixel data from such low-power optical sensors may be used to detect image changes and/or identify objects. The previously deployed low-power optical sensors of the Assignee were sensitive to all light wavelengths in the visible range. Such "monochrome" or grayscale optical sensors are advantageous because they can be very sensitive and therefore have excellent performance in low-light conditions. Details of one or more embodiments of the subject matter described herein are set forth in the accompanying drawings and the following description. Other features, aspects, and advantages will become apparent from the description, drawings, and claims. Note that the relative dimensions in the following drawings may not be drawn to scale. Identical reference numerals and designations in the various drawings denote identical elements. FIG. 1 is a block diagram illustrating exemplary components of a device according to some implementations. FIG. 2 is a flow diagram providing examples of operations according to some disclosed methods. Figures 3a, 3b, and 3c are graphs illustrating examples of light transmission by anti-color filters as a function of wavelength. FIGS. 4A, FIGS. 4B, and FIGS. 4C illustrate examples of various arrangements of anti-color filter regions. FIG. 5 illustrates an example of an exploded view of a device according to some implementations. The following description relates to specific embodiments for the purpose of describing innovative aspects of the present disclosure. However, those skilled in the art will readily recognize that the teachings in this specification may be applied in a number of different ways. The described embodiments may be implemented in any device, apparatus, or system comprising a device or system as disclosed in this specification. Additionally, the described implementations include mobile phones, multimedia internet-enabled cellular phones, mobile television receivers, wireless devices, smartphones, smart cards, wearable devices, such as bracelets, armbands, wristbands, rings, headbands, patches, etc., Bluetooth® devices, personal data assistants (PDAs), wireless email receivers, handheld or portable computers, netbooks, laptops, smartbooks, tablets, printers, copiers, scanners, fax devices, Global Positioning System (GPS) receivers/navigators, cameras, digital media players (such as MP3 players), camcorders, game consoles, wristwatches, watches, calculators, television monitors, flat-panel displays, electronic reading devices (e.g., e-readers), mobile health devices, computer monitors, auto displays (including odometer and speedometer displays, etc.), cockpit controls and/or displays, camera view displays. It is considered that it may be included in or associated with various electronic devices, such as but not limited to various EMS devices, packaging (e.g., displays of rearview cameras in vehicles), electronic photographs, electronic billboards or signs, projectors, architectural structures, microwaves, refrigerators, stereo systems, cassette recorders or players, DVD players, CD players, VCRs, wireless devices, portable memory chips, washing machines, dryers, washer/dryer units, parking meters, packaging (e.g., in EMS (electromechanical systems) applications including MEMS (microelectromechanical systems) applications, as well as in non-EMS applications), aesthetic structures (e.g., displays of images of clothing or jewelry pieces), and various electronic devices. The teachings in this specification may also be used in applications such as, but not limited to, electronic switching devices, radio frequency filters, sensors, accelerometers, gyroscopes, motion sensing devices, ma