CA-3235882-C - SYSTEMS AND METHODS OF IDENTIFYING PRODUCTS THROUGH PORTABLE SCANNING

CA3235882CCA 3235882 CCA3235882 CCA 3235882CCA-3235882-C

Abstract

Some embodiments product identifying systems comprising: a scanner control circuit; an imaging system; a display; and a memory storing a product identifier module executed by the control circuit to: detect, through a series of images, a machine-readable identifier pattern; control the display to render the series of images on the display; activate a scan timer having a scan duration; render, on the display, a scan timer graphic overlaid on a subset of the series of images and corresponding to a changing remaining time of the scan duration as the remaining time expires; confirm that the identifier pattern was maintained within a threshold distance of the center of the field of view over at least a threshold read duration of the scan duration; extract identifying information; and obtain a product identifier corresponding to the identifying information and add the product identifier to a virtual shopping cart.

Inventors

David W. Sica
Sheetal Patel
Matheus K. Iser
Thiago Pereira Rocha
Jeffrey Lui
Lars C. Rehder
John C. Liedtke
Adil Ansari
Pin Jui Huang
Suk Wai Theda Chong
Khasan Shirmatov

Assignees

WALMART APOLLO, LLC

Dates

Publication Date: 20260505
Application Date: 20240419
Priority Date: 20230530

Claims (19)

CLAIMS What is claimed is: 1. A mobile product identifying system, comprising: a scanner control circuit; an imaging system communicatively coupled with the scanner control circuit; a display communicatively coupled with the scanner control circuit; and a memory communicatively coupled with the scanner control circuit and storing local code comprising a product identifier module configured to be executed by the scanner control circuit to: detect, through a first series of images captured by the imaging system,_multiple identifier patterns within each of the first series of images, the multiple identifier patterns being machine-readable, the multiple identifier patterns including a first identifier pattern and a second identifier pattern; control the display to render the first series of images on the display as the respective images of the first series of images are captured; determine that the first identifier pattern and the second identifier pattern are both of a first identifier pattern type; determine that the first identifier pattern detected has a distance relationship to a center of a field of view of the imaging system; determine that within the first series of images the first identifier pattern is closer to a reference point than the second identifier pattern; activate a scan timer having a scan duration; prioritize the first identifier pattern as an identifier pattern of interest based on the determination that the first identifier pattern is closer to the reference point than the second identifier pattern; confirm that the first identifier pattern was maintained within a threshold distance of the center of the field of view over at least a threshold read duration of the scan duration; extract identifying information based on the first identifier pattern in response to confirming that the first identifier pattern was maintained within the threshold distance of the center of the field of view over at least the threshold read duration of the scan duration; and Date Re9ue/Date Received 2024-04-19 obtain a product identifier corresponding to the identifying information and add the product identifier to a virtual shopping cart.
2. The system of claim 1, wherein the product identifier module is configured to: determine, in response to prioritizing the first identifier pattern, an orientation of the first identifier pattern relative to an orientation of the display.
3. The system of claim 2, wherein the product identifier module is further configured to: render, on the display, the first series of images while rendering a virtual targeting graphic overlaid proximate the first identifier pattern indicating the first identifier pattern as the identifier pattern of interest based on the determined orientation of the first identifier pattern and distinguishing the first identifier pattern from the other of the multiple identifier patterns.
4. The system of claim 1, wherein the product identifier module is further configured to: detect multiple identifier patterns within a previous second series of multiple images captured by the imaging system prior to capturing the first series of multiple images; prioritize, based on the second series of images, the second identifier pattern of the multiple identifier patterns as an initial identifier pattern of interest; control the display to render the second series of multiple images on the display as the respective images of the second series of images are captured and further rendering a virtual targeting graphic overlaid proximate the second identifier pattern indicating the second identifier pattern as the initial identifier pattern of interest; detect, during the capture of the first series of images, a change of the first identifier pattern being positioned closer to another reference point than the second identifier pattern; implement the prioritizing of the first identifier pattern over the second identifier pattern in response to the detected change of the first identifier pattern being positioned closer to the other reference point; and transition the rendering of the virtual targeting graphic to being overlaid proximate the first identifier pattern indicating a change that the first identifier pattern is the identifier pattern of interest while preventing second identifying information from being extracted from the second identifier pattern. Date Re9ue/Date Received 2024-04-19
5. The system of claim 1, wherein the product identifier module is further configured to: detect, through a second series of multiple images captured by the imaging system, a third identifier pattern; determine that the third identifier pattern is beyond a threshold distance from the imaging system; and prevent extracting third identifying information from the third identifier pattern while the third identifier pattern is beyond the threshold distance from the imaging system.
6. The system of claim 5, wherein the product identifier module is further configured to: render, on the display, the second series of multiple images while rendering a virtual distance error feedback graphic overlaid proximate the third identifier pattern while the third identifier pattern is beyond the threshold distance from the imaging system.
7. The system of claim 1, wherein the product identifier module is further configured to: detect a third identifier pattern through a second series of multiple images captured by the imaging system; detect movement, during the capture of the second series of multiple images, in excess of a threshold movement range between the imaging system and the third identifier pattern; and preventing third identifying information from being extracted from the third identifier pattern while the detected movement is in excess of the threshold movement range.
8. The system of claim 7, wherein the product identifier module is further configured to: detect a level of light while capturing a third series of multiple images captured by the imaging system; determine that the detected level of light while capturing the third series of multiple images is in excess of a threshold light level; and prevent fourth identifying information from being extracted from a fourth identifier pattern while the detected level of light is in excess of the threshold light level.
9. The system of claim 1, wherein the product identifier module is further configured to: Date Re9ue/Date Received 2024-04-19 identify, from at least the first series of images, multiple different identifier patterns simultaneously captured within each of the first series of images; control the display while rendering the first series of images to render, in each image of the first series of images, multiple virtual selection graphics each overlaid proximate to a respective one of the multiple different identifier patterns; detect a selection of the first identifier pattern by a user of a first virtual selection graphic, of the multiple virtual selection graphics, positioned most proximate to the first identifier pattern; wherein product identifier module in the prioritizing the first identifier pattern prioritizes the first identifier pattern over the other of the multiple different identifier patterns as a function of detected selection; and modify a visual appearance of the first virtual selection graphic in response to the detected selection indicating the first identifier pattern as the identifier pattern of interest.
10. A method of identifying products, comprising: detecting, through a first series of images captured by an imaging system of a scanner system, a first identifier pattern and a second identifier pattern, the first identifier pattern determined to have a distance relationship to a center of a field of view of the imaging system; controlling a display of the scanner system to render the first series of images on the display as the respective images of the first series of images are captured; determining that the first identifier pattern and the second identifier pattern are both of a first identifier pattern type; determining that the first identifier pattern detected has a distance relationship to a center of a field of view of the imaging system; determining that within the first series of images the first identifier pattern is closer to a reference point than the second identifier pattern; activating a scan timer having a scan duration; prioritizing the first identifier pattern as an identifier pattern of interest based on the determination that the first identifier pattern is closer to the reference point than the second identifier pattern; confirming that the first identifier pattern was maintained within a threshold distance of the center of the field of view over at least a threshold read duration of the scan duration; Date Re9ue/Date Received 2024-04-19 extracting identifying information from based on the first identifier pattern in response to confirming that the first identifier pattern was maintained within the threshold distance of the center of the field of view over at least the threshold read duration of the scan duration; and obtaining a product identifier corresponding to the identifying information and adding the product identifier to a virtual shopping cart.
11. The method of claim 10, further comprising: determining, in response to prioritizing the first identifier pattern, an orientation of the first identifier pattern relative to an orientation of the display.
12. The method of claim 11, further comprising: rendering, on the display, the first series of images while rendering a virtual targeting graphic overlaid proximate the first identifier pattern indicating the first identifier pattern as the identifier pattern of interest based on the determined orientation of the first identifier pattern and distinguishing the first identifier pattern from the other of the multiple identifier patterns.
13. The method of claim 10, further comprising: detecting multiple identifier patterns within a previous second series of multiple images captured by the imaging system prior to capturing the first series of multiple images; prioritizing, based on the second series of images, a second identifier pattern of the multiple identifier patterns as an initial identifier pattern of interest; controlling the display to render the second series of multiple images on the display as the respective images of the second series of images are captured and further rendering a virtual targeting graphic overlaid proximate the second identifier pattern indicating the second identifier pattern as the initial identifier pattern of interest; detecting, during the capture of the first series of images, a change of the first identifier pattern being positioned closer to a reference point than the second identifier pattern; prioritizing the first identifier pattern over the second identifier pattern in response to the detected change of the first identifier pattern being positioned closer to the reference point; and transitioning the rendering of the virtual targeting graphic to being overlaid proximate the first identifier pattern indicating a change that the first identifier pattern is the identifier pattern of Date Re9ue/Date Received 2024-04-19 interest while preventing second identifying information from being extracted from the second identifier pattern.
14. The method of claim 10, further comprising: detecting, through a second series of multiple images captured by the imaging system, second identifier pattern; determining that the second identifier pattern is beyond a threshold distance from the imaging system; render, on the display, the second series of multiple images while rendering a virtual distance error feedback graphic overlaid proximate the second identifier pattern while the second identifier pattern is beyond the threshold distance from the imaging system; and preventing extracting second identifying information from the second identifier pattern in response while the second identifier pattern is beyond the threshold distance from the imaging system.
15. The method of claim 10, further comprising: identifying, from at least the first series of images, multiple different identifier patterns simultaneously captured within each of the first series of images; controlling the display while rendering the first series of images to render, in each image of the first series of images, multiple virtual selection graphics each overlaid proximate to a respective one of the multiple different identifier patterns; detecting a selection of the first identifier pattern by a user of a first virtual selection graphic, of the multiple virtual selection graphics. positioned most proximate to the first identifier pattern; wherein the prioritizing the first identifier pattern comprises prioritizing the first identifier pattern over the other of the multiple different identifier patterns as a function of detected selection; and modifying a visual appearance of the first virtual selection graphic in response to the detected selection indicating the first identifier pattern as the identifier pattern of interest. Date Re9ue/Date Received 2024-04-19
16. A computer-readable media having computer-executable instructions that, upon execution by a computer, cause the computer to perform operations comprising: detecting, through a first series of images captured by an imaging system of a scanner system, a first identifier pattern and a second identifier pattern, the first identifier pattern determined to have a distance relationship to a center of a field of view of the imaging system; controlling a display of the scanner system to render the first series of images on the display as the respective images of the first series of images are captured; determining that the first identifier pattern and the second identifier pattern are both of a first identifier pattern type; determining that the first identifier pattern detected has a distance relationship to a center of a field of view of the imaging system; determining that within the first series of images the first identifier pattern is closer to a reference point than the second identifier pattern; activating a scan timer having a scan duration; prioritizing the first identifier pattern as an identifier pattern of interest based on the determination that the first identifier pattern is closer to the reference point than the second identifier pattern; confirming that the first identifier pattern was maintained within a threshold distance of the center of the field of view over at least a threshold read duration of the scan duration; extracting identifying information from based on the first identifier pattern in response to confirming that the first identifier pattern was maintained within the threshold distance of the center of the field of view over at least the threshold read duration of the scan duration; and obtaining a product identifier corresponding to the identifying information and adding the product identifier to a virtual shopping cart.
17. The computer-readable media of claim 16 having computer-executable instructions that, upon execution by a computer, cause the computer to perform further operations comprising: determining, in response to prioritizing the first identifier pattern, an orientation of the first identifier pattern relative to an orientation of the display. Date Re9ue/Date Received 2024-04-19
18. The computer-readable media of claim 17 having computer-executable instructions that, upon execution by a computer, cause the computer to perform further operations comprising: rendering, on the display, the first series of images while rendering a virtual targeting graphic overlaid proximate the first identifier pattern indicating the first identifier pattern as the identifier pattern of interest based on the determined orientation of the first identifier pattern and distinguishing the first identifier pattern from the other of the multiple identifier patterns.
19. The computer-readable media of claim 16 having computer-executable instructions that, upon execution by a computer, cause the computer to perform further operations comprising: detecting multiple identifier patterns within a previous second series of multiple images captured by the imaging system prior to capturing the first series of multiple images; prioritizing, based on the second series of images, a second identifier pattern of the multiple identifier patterns as an initial identifier pattern of interest; controlling the display to render the second series of multiple images on the display as the respective images of the second series of images are captured and further rendering a virtual targeting graphic overlaid proximate the second identifier pattern indicating the second identifier pattern as the initial identifier pattern of interest; detecting, during the capture of the first series of images, a change of the first identifier pattern being positioned closer to a reference point than the second identifier pattern; prioritizing the first identifier pattern over the second identifier pattern in response to the detected change of the first identifier pattern being positioned closer to the reference point; and transitioning the rendering of the virtual targeting graphic to being overlaid proximate the first identifier pattern indicating a change that the first identifier pattern is the identifier pattern of interest while preventing second identifying information from being extracted from the second identifier pattern. Date Re9ue/Date Received 2024-04-19

Description

SYSTEMS AND METHODS OF IDENTIFYING PRODUCTS THROUGH PORTABLE SCANNING TECHNICAL FIELD [0001] This invention relates generally to retail product recognition. BACKGROUND [0002] The accurate identification of products can often be critical in the retail industry. The misidentification of a product can cause significant problems and lost revenue. Costly customized scanners are typically required to scan products. Many of these customized scanners have limited use and/or are restricted to a particular location. BRIEF DESCRIPTION OF DRAWINGS [0003] Disclosed herein are embodiments of systems, apparatuses and methods pertaining to retail product identification. This description includes drawings, wherein: [0004] FIG. 1 illustrates a simplified block diagram of an exemplary retail product identifying system, in accordance with some embodiments. [0005] FIG. 2 illustrates a simplified block diagram of an exemplary scanner system, in accordance with some embodiments. [0006] FIG. 3 illustrates an exemplary representation of a portable scanner system scanning a product, in accordance with some embodiments. [0007] FIG. 4A illustrates a simplified block diagram representation of an exemplary scanner system that is displaying an image on the display of a portion of a product that includes an identifier pattern, in accordance with some embodiments. [0008] FIG. 4B illustrates a simplified block diagram representation of the exemplary scanner system of FIG. 4A displaying the image on the display of a portion of a product that includes the identifier pattern with the targeting graphic adjusted, in accordance with some embodiments. Date Re9ue/Date Received 2024-04-19 [0009] FIG. SA shows a representation of an exemplary scanning system displaying exemplary targeting graphics at a first position and orientation, for example indicating a first area of the displayed image, in accordance with some embodiments. [0010] FIG. SB shows the exemplary scanner system of FIG. SA with the exemplary targeting graphics adjusted relative to an identifier pattern, in accordance with some embodiments. [0011] FIGS. 6A-6D illustrate simplified block diagram representations of an exemplary scanner system that is displaying images on the display of a portion of a product that includes an identifier pattern, in accordance with some embodiments. [0012] FIG. 7 illustrates a representation of an exemplary scanner system rendering an exemplary added-to-cart indicator following an identification of a product based on the identifying information obtained based on the scanned pattern, in accordance with some embodiments. [0013] FIGS. 8A-8B illustrate simplified block diagram representations of an exemplary scanner system that is displaying exemplary images on the display of a portion of a product that includes multiple identifier patterns, in accordance with some embodiments. [0014] FIG. 9 illustrates a simplified block diagram representation of an exemplary scanner system displaying exemplary images on the display that includes multiple identifier patterns, in accordance with some embodiments. [0015] FIGS. 1 0A-l0B illustrate simplified block diagram representations of an exemplary scanner system that is displaying exemplary images on the display, in accordance with some embodiments. [0016] FIG. 11 illustrates a simplified representation of an exemplary scanner system overlaying on captured images a virtual distance error feedback graphic, in accordance with some embodiments. [0017] FIG. 12 illustrates a simplified flow diagram of an exemplary process of identifying products through images captured by a scanner system, in accordance with some embodiments. [0018] FIG. 13 illustrates a simplified flow diagram of a process of prioritizing identifier patterns, in accordance with some embodiments. Date Re9ue/Date Received 2024-04-19 [0019] FIG. 14 illustrates a simplified flow diagram of an exemplary process of reprioritizing identifier patterns, in accordance with some embodiments. [0020] FIG. 15 illustrates a simplified flow diagram of an exemplary process of obtaining product identifying information based on a scan, in accordance with some embodiments. [0021] FIG. 16 illustrates a simplified flow diagram of an exemplary process of obtaining product identifying information through scanning, in accordance with some embodiments. [0022] FIG. 17 illustrates an exemplary system for use in implementing methods, techniques, devices, apparatuses, systems, servers, and sources enabling product identification, in accordance with some embodiments. [0023] Elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions and/or relative positioning of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of various embodiments of the present invention. Also, common but well-understood elements that are useful or necessary in a commercially