US-12626502-B2 - Automatically measuring an item based on a ratio between item dimensions and reference tag dimensions

US12626502B2US 12626502 B2US12626502 B2US 12626502B2US-12626502-B2

Abstract

An item measuring system and its relate processes may perform operations that include receiving an image of an item and a reference tag; identifying a perimeter of the item; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining dimensions of the item in standardized units based on the known dimensions of the reference tag; and outputting information identifying the dimensions of the item.

Inventors

Todd M. Schimmel
Ryan J. Simpson

Assignees

UNITED STATES POSTAL SERVICE

Dates

Publication Date: 20260512
Application Date: 20210303

Claims (20)

1 . A computer-implemented method performed by an item measuring system included in an automated mail sorting system, the computer-implemented method comprising: receiving an image of an item including a reference tag attached to the item, the image of the item having been captured at an isometric angle showing three dimensions of the item; attempting to automatically detect a perimeter of the item within the image using a contrast-analysis image processing technique; in response to failing to detect the perimeter of the item within the image using the contrast-analysis image processing technique, outputting a message directing a user to place the item in front of a high contrast background to produce a retaken image of the item, wherein the retaken image has the high contrast background; receiving the retaken image of the item having the high contrast background, including the reference tag attached to the item; automatically detecting, using the contrast-analysis image processing technique, the perimeter of the item within the retaken image having the high contrast background; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining a number of pixels for each dimension associated with the perimeter of the item in the retaken image; determining dimensions of the item based on corresponding numbers of pixels associated with the known dimensions of the reference tag and the number of pixels for each dimension associated with the perimeter of the item in the retaken image; and causing an adjustment to at least one of the mail sorting operations of the automated mail sorting system based on the dimensions of the item.
2 . The method of claim 1 , wherein the determining the dimensions of the item further comprises: determining a length represented by each pixel in the retaken image based on the known dimensions of the reference tag and the numbers of pixels associated with each of the dimensions of the reference tag; determining the dimensions of the item in a form of pixels in the retaken image; and converting the dimensions of the item in the form of pixels to standardized units based on the length represented by each pixel.
3 . The method of claim 1 , wherein the identifying the type of the reference tag comprises extracting features of the reference tag from the retaken image.
4 . The method of claim 1 , wherein the retaken image is received from a computing device hosting an application for measuring the item based on capturing the retaken image of the item.
5 . The method of claim 1 , wherein the identifying the known dimensions of the reference tag based on the type comprises: accessing, based on the identified type, a length dimension of the reference tag from a data structure.
6 . The computer-implemented method of claim 1 , wherein: the receiving of the image includes receiving the image from a computing device that captured the image.
7 . The computer-implemented method of claim 6 , wherein the computing device is operably connected to a camera.
8 . A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device of an automated mail sorting system to cause the computing device to perform operations comprising: receiving an image of an item including a reference tag attached to the item, the image of the item having been captured at an isometric angle showing three dimensions of the item; attempting to automatically detect a perimeter of the item within the image using a contrast-analysis image processing technique; in response to failing to detect the perimeter of the item within the image using the contrast-analysis image processing technique, outputting a message directing a user to place the item in front of a high contrast background to produce a retaken image of the item, wherein the retaken image has the high contrast background; receiving the retaken image of the item having the high contrast background, including the reference tag attached to the item; automatically detecting, using the contrast-analysis image processing technique, the perimeter of the item within the retaken image having the high contrast background; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining a number of pixels for each dimension associated with the perimeter of the item in the retaken image; determining dimensions of the item based on corresponding numbers of pixels associated with the known dimensions of the reference tag and the number of pixels for each dimension associated with the perimeter of the item in the retaken image; and causing an adjustment to at least one of the mail sorting operations of the automated mail sorting system based on the dimensions of the item.
9 . The computer program product of claim 8 , wherein the determining the dimensions of the item further comprises: determining a length represented by each pixel in the retaken image based on the known dimensions of the reference tag and the numbers of pixels associated with each of the dimensions of the reference tag; determining the dimensions of the item in a form of pixels in the retaken image; and converting the dimensions of the item in the form of pixels to standardized units based on the length represented by each pixel.
10 . The computer program product of claim 8 , wherein the identifying the type of the reference tag comprises extracting features of the reference tag from the retaken image.
11 . The computer program product of claim 8 , wherein the retaken image is received from a computing device hosting an application for measuring the item based on capturing the retaken image of the item.
12 . The computer program product of claim 8 , wherein the identifying the known dimensions of the reference tag based on the type comprises: accessing, based on the identified type, a length dimension of the reference tag from a data structure.
13 . The computer program product of claim 8 , wherein: the receiving of the image includes receiving the image from a computerized device that captured the image.
14 . A system comprising: a processor, a computer readable memory, a non-transitory computer readable storage medium associated with a computing device of an automated mail sorting system, and program instructions executable by the computing device to cause the computing device to perform operations comprising: receiving an image of an item including a reference tag attached to the item, the image of the item having been captured at an isometric angle showing three dimensions of the item; attempting to automatically detect a perimeter of the item within the image using a contrast-analysis image processing technique; in response to failing to detect the perimeter of the item within the image using the contrast-analysis image processing technique, outputting a message directing a user to place the item in front of a high contrast background to produce a retaken image of the item, wherein the retaken image has the high contrast background; receiving the retaken image of the item having the high contrast background, including the reference tag attached to the item; automatically detecting, using the contrast-analysis image processing technique, the perimeter of the item within the retaken image having the high contrast background; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining a number of pixels for each dimension associated with the perimeter of the item in the retaken image; determining dimensions of the item based on corresponding numbers of pixels associated with the known dimensions of the reference tag and the number of pixels for each dimension associated with the perimeter of the item in the retaken image; and causing an adjustment to at least one of the mail sorting operations of the automated mail sorting system based on the dimensions of the item.
15 . The system of claim 14 , wherein the determining the dimensions of the item further comprises: determining a length represented by each pixel in the retaken image based on the known dimensions of the reference tag and the associated corresponding numbers of pixels; determining the dimensions of the item in a form of pixels in the retaken image; and converting the dimensions of the item in the form of pixels to standardized units based on the length represented by each pixel.
16 . The system of claim 14 , wherein the identifying the type of the reference tag comprises extracting features of the reference tag from the retaken image.
17 . The system of claim 14 , wherein the retaken image is received from a computing device hosting an application for measuring the item based on capturing the retaken image of the item.
18 . The system of claim 14 , wherein the identifying the known dimensions of the reference tag based on the type comprises: accessing, based on the identified type, a length dimension of the reference tag from a data structure.
19 . The system of claim 14 , wherein the receiving of the image includes receiving the image from a computerized device that captured the image.
20 . The system of claim 6 , wherein the computerized device is operably connected to a camera.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of and priority to U.S. Provisional Patent Application No. 62/985,011 filed on Mar. 4, 2020, which is hereby incorporated by reference in its entirety. BACKGROUND Service providers, such as mail or package delivery service providers, may charge for services based on the size and/or dimensions of an item. Other service providers (e.g., airlines) may charge various rates based on the size/dimensions of an item (e.g., luggage). As such, a customer may need to accurately measure the item to avoid being overcharged for service, or undercharged, resulting in the customer not receiving the service. SUMMARY In one example aspect, a computer-implemented method performed by an item measuring system may include receiving an image of an item and a reference tag; identifying a perimeter of the item; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining dimensions of the item in standardized units based on the known dimensions of the reference tag; and outputting information identifying the dimensions of the item. In another example aspect, a computer program product includes a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a computing device to cause the computing device to perform operations including receiving an image of an item and a reference tag; identifying a perimeter of the item; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining dimensions of the item in standardized units based on the known dimensions of the reference tag; and outputting information identifying the dimensions of the item. In another example aspect, a system includes a processor, a computer readable memory, a non-transitory computer readable storage medium associated with a computing device, and program instructions executable by the computing device. The program instructions cause the computing device to perform operations including: receiving an image of an item and a reference tag; identifying a perimeter of the item; identifying a type of the reference tag; identifying known dimensions of the reference tag based on the type; determining dimensions of the item in standardized units based on the known dimensions of the reference tag; and outputting information identifying the dimensions of the item. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates an overview of an example implementation and environment in accordance with aspects of the present disclosure. FIG. 2 illustrates an example flowchart of a process for measuring an item using an image of the item and a reference tag affixed to the item. FIG. 3 illustrates an example implementation of automating the measuring of an item based on an image of the item and a reference tag. FIG. 4 illustrates example components of a device that may be used within environment 100 of FIG. 1. DETAILED DESCRIPTION Certain embodiments of the disclosure will hereafter be described with reference to the accompanying drawings, wherein like reference numerals denote like elements. It should be understood, however, that the accompanying drawings illustrate only the various implementations described herein and are not meant to limit the scope of various technologies described herein. The drawings show and describe various embodiments of the current disclosure. Accurately measuring an item, such as a mail piece, a package, etc., may be cumbersome and inaccurate, thus leading to overcharging or undercharging a customer for service relating to the item (e.g., mail package delivery, luggage delivery, etc.). Accordingly, aspects of the present disclosure may facilitate and/or automate the measuring of an item such that item measurement is accurate, simple, and efficient. In one example embodiment, aspects of the present disclosure may include a system and/or method whereby an image of the item (e.g., a mail package) may be captured at any angle (e.g., an isometric angle showing all three dimensions of the item). As described herein, the system and/or method may automatically determine the dimensions of the item based on a ratio between the item's perimeter dimensions, and the known dimensions of a reference tag that is attached to the item. As one illustrative example, if the length and width of the object is three times the length and width of the reference tag, the length and width dimensions of the item may be determined to be three times that of the reference tag. The depth or third dimension may be determined based on the angle of the item in the captured image, and based on the ratio with the reference tag. In some embodiments, the dimensions of the reference tag may be translated into a number of pixels in the captured image, and the length per pixel may be determined. The number of pixels for each dimension on the perime