US-12626458-B2 - User interface for adjusting bounding box dimensions in contactless measurement device

Abstract

An object dimensioning device includes: a depth reconstruction system; a display device; and a processor and memory storing instructions that, when executed by the processor, cause the processor to: control the depth reconstruction system to capture a three-dimensional representation of a scene; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; display a proposed bounding box on the display device and a plurality of user interface controls configured to adjust locations of corresponding faces of the proposed bounding box; receive an input through the plurality of user interface controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box on the display device.

Inventors

• Francesco Peruch
• Davide ZANELLA

Assignees

• QBOID, INC.

Dates

Publication Date

20260512

Application Date

20240313

Claims (18)

1. 1 . An object dimensioning device comprising: a depth reconstruction system; a display device; and a processor and memory storing instructions that, when executed by the processor, cause the processor to: control the depth reconstruction system to capture a three-dimensional representation of a scene; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; compute a proposed bounding box around the plurality of points; display the proposed bounding box on the display device and a plurality of user interface controls configured to adjust locations of corresponding faces of the proposed bounding box, the user interface controls being displayed separately from the proposed bounding box; receive an input through a control of the plurality of user interface controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box on the display device, wherein the memory further stores instructions that, when executed by the processor, cause the processor to: compute a plurality of proposed locations for a face of the proposed bounding box in accordance with confidence scores of locations of the face computed based on discontinuities detected in the scene; and present the plurality of proposed locations for the face of the proposed bounding box.
2. 2 . The object dimensioning device of claim 1 , wherein the user interface controls comprise: a first line segment corresponding to a length dimension of the proposed bounding box; a second line segment corresponding to a width dimension of the proposed bounding box; and a third line segment corresponding to a height dimension of the proposed bounding box; and wherein the input comprises adjusting a position of a handle at an end of the first line segment and wherein the corresponding face is a face at an end of the proposed bounding box along the length dimension.
3. 3 . The object dimensioning device of claim 2 , wherein relative lengths of the first line segment, the second line segment, and the third line segment respectively correspond to relative lengths of a length, a width, and a height of the proposed bounding box.
4. 4 . The object dimensioning device of claim 1 , wherein the user interface controls comprise: a first pair of sliders configured to control a first pair of faces at opposite ends of a length dimension of the proposed bounding box; a second pair of sliders configured to control a second pair of faces at opposite ends of a width dimension of the proposed bounding box; and a third pair of sliders configured to control a third pair of faces at opposite ends of a height dimension of the proposed bounding box, wherein a handle of a slider of the first pair of sliders is constrained to move along one dimension of the display device, wherein dragging the handle of the slider of the first pair of sliders in a first direction along the one dimension of the display device causes the corresponding face of the first pair of faces to move in a first direction along the length dimension of the proposed bounding box, and wherein dragging the handle of the slider of the first pair of sliders in a second direction along the one dimension causes the corresponding face of the first pair of faces to move in a second direction opposite the first direction along the length dimension of the proposed bounding box.
5. 5 . The object dimensioning device of claim 4 , wherein a speed at which the corresponding face moves is controlled by a distance that the handle of the slider is dragged along the first direction.
6. 6 . The object dimensioning device of claim 1 , wherein the user interface controls comprise: a first pair of scrolling controls configured to control a first pair of faces at opposite ends of a length dimension of the proposed bounding box; a second pair of scrolling controls configured to control a second pair of faces at opposite ends of a width dimension of the proposed bounding box; and a third pair of scrolling controls configured to control a third pair of faces at opposite ends of a height dimension of the proposed bounding box, wherein scrolling a first scrolling control of the first pair of scrolling controls causes a corresponding face of the first pair of faces to move in a direction corresponding to a direction of the scrolling.
7. 7 . The object dimensioning device of claim 1 , wherein the memory further stores instructions that, when executed by the processor, cause the processor to present the plurality of proposed locations for the face of the proposed bounding box by providing user feedback in response to user input received via the plurality of user interface controls.
8. 8 . The object dimensioning device of claim 1 , wherein the memory further stores instructions that, when executed by the processor, cause the processor to display a rectilinear projection of the proposed bounding box and the three-dimensional representation of the scene.
9. 9 . The object dimensioning device of claim 1 , further comprising a network adapter, wherein the memory further stores instructions that, when executed by the processor, cause the processor to transmit the dimensions of the proposed bounding box through a computer network using the network adapter.
10. 10 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to: receive a three-dimensional representation of a scene captured by a depth reconstruction system; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; compute a proposed bounding box around the plurality of points; display the proposed bounding box in a user interface and a plurality of controls configured to adjust locations of corresponding faces of the proposed bounding box, the user interface controls being displayed separately from the proposed bounding box; receive an input through a control of the plurality of controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box in the user interface, wherein the controls comprise: a first line segment corresponding to a first dimension of the proposed bounding box; a second line segment corresponding to a second dimension of the proposed bounding box; and a third line segment corresponding to a third dimension of the proposed bounding box; and wherein the input comprises adjusting a position of a handle at an end of the first line segment and wherein the corresponding face is a face at an end of the proposed bounding box along the first dimension.
11. 11 . The non-transitory computer-readable medium of claim 10 , wherein relative lengths of the first line segment, the second line segment, and the third line segment respectively correspond to relative lengths of a length, a width, and a height of the proposed bounding box.
12. 12 . The non-transitory computer-readable medium of claim 10 , further storing instructions that, when executed by the processor, cause the processor to: compute a plurality of proposed locations for a face of the proposed bounding box in accordance with confidence scores of locations of the face computed based on discontinuities detected in the scene; and present the plurality of proposed locations for the face of the proposed bounding box.
13. 13 . The non-transitory computer-readable medium of claim 12 , further storing instructions that, when executed by the processor, cause the processor to present the plurality of proposed locations for the face of the proposed bounding box by providing user feedback in response to user input received via the plurality of controls.
14. 14 . The non-transitory computer-readable medium of claim 10 , further storing instructions that, when executed by the processor, cause the processor to display a rectilinear projection of the proposed bounding box and the three-dimensional representation of the scene.
15. 15 . The non-transitory computer-readable medium of claim 10 , further storing instructions that, when executed by the processor, cause the processor to transmit the dimensions of the proposed bounding box over a computer network.
16. 16 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to: receive a three-dimensional representation of a scene captured by a depth reconstruction system; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; compute a proposed bounding box around the plurality of points; display the proposed bounding box in a user interface and a plurality of controls configured to adjust locations of corresponding faces of the proposed bounding box, the user interface controls being displayed separately from the proposed bounding box; receive an input through a control of the plurality of controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box in the user interface, wherein the controls comprise: a first pair of sliders configured to control a first pair of faces at opposite ends of a first dimension of the proposed bounding box; a second pair of sliders configured to control a second pair of faces at opposite ends of a second dimension of the proposed bounding box; and a third pair of sliders configured to control a third pair of faces at opposite ends of a third dimension of the proposed bounding box, wherein a handle of a slider of the first pair of sliders is constrained to move along one dimension of the user interface, wherein dragging the handle of the slider of the first pair of sliders in a first direction along the one dimension of the user interface causes the corresponding face of the first pair of faces to move in a first direction along the first dimension of the proposed bounding box, and wherein dragging the handle of the slider of the first pair of sliders in a second direction along the one dimension causes the corresponding face of the first pair of faces to move in a second direction opposite the first direction along the first dimension of the proposed bounding box.
17. 17 . The non-transitory computer-readable medium of claim 16 , wherein a speed at which the corresponding face moves is controlled by a distance that the handle of the slider is dragged along the first direction.
18. 18 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to: receive a three-dimensional representation of a scene captured by a depth reconstruction system; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; compute a proposed bounding box around the plurality of points; display the proposed bounding box in a user interface and a plurality of controls configured to adjust locations of corresponding faces of the proposed bounding box, the user interface controls being displayed separately from the proposed bounding box; receive an input through a control of the plurality of controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box in the user interface, wherein the controls comprise: a first pair of scrolling controls configured to control a first pair of faces at opposite ends of a first dimension of the proposed bounding box; a second pair of scrolling controls configured to control a second pair of faces at opposite ends of a second dimension of the proposed bounding box; and a third pair of scrolling controls configured to control a third pair of faces at opposite ends of a third dimension of the proposed bounding box, wherein scrolling a first scrolling control of the first pair of scrolling controls causes a corresponding face of the first pair of faces to move in a direction corresponding to a direction of the scrolling.

Description

CROSS-REFERENCE TO RELATED APPLICATION(S) This application claims the benefit of U.S. Provisional Patent Application No. 63/453,039, filed in the U.S. Patent and Trademark Office on Mar. 17, 2023, the entire disclosure of which is incorporated by reference herein. FIELD Aspects of embodiments of the present disclosure relate to user interfaces and methods associated therewith for a contactless measurement device. In more detail, some aspects relate to user interfaces for measuring the dimensions of an object and adjusting the dimensions of a proposed bounding box representing the measured dimensions of the object. SUMMARY According to one embodiment of the present disclosure, an object dimensioning device includes: a depth reconstruction system; a display device; and a processor and memory storing instructions that, when executed by the processor, cause the processor to: control the depth reconstruction system to capture a three-dimensional representation of a scene; segment a plurality of points from the three-dimensional representation of the scene, the plurality of points corresponding to an object in the scene; compute a proposed bounding box around the plurality of points; display the proposed bounding box on the display device and a plurality of user interface controls configured to adjust locations of corresponding faces of the proposed bounding box, the user interface controls being displayed separately from the proposed bounding box; receive an input through a control of the plurality of user interface controls to adjust a position of a corresponding face of the proposed bounding box; display the proposed bounding box with the position of the corresponding face of the proposed bounding box adjusted in accordance with the input; and display dimensions of the proposed bounding box on the display device. The user interface controls may include: a first line segment corresponding to a length dimension of the proposed bounding box; a second line segment corresponding to a width dimension of the proposed bounding box, and a third line segment corresponding to a height dimension of the proposed bounding box, and the input may include adjusting a position of a handle at an end of the first line segment and wherein the corresponding face is a face at an end of the proposed bounding box along the length dimension. Relative lengths of the first line segment, the second line segment, and the third line segment respectively correspond to relative lengths of a length, a width, and a height of the proposed bounding box. The user interface controls may include: a first pair of sliders configured to control a first pair of faces at opposite ends of a length dimension of the proposed bounding box; a second pair of sliders configured to control a second pair of faces at opposite ends of a width dimension of the proposed bounding box; and a third pair of sliders configured to control a third pair of faces at opposite ends of a height dimension of the proposed bounding box, and a handle of a slider of the first pair of sliders may be constrained to move along one dimension of the display device, dragging the handle of the slider of the first pair of sliders in a first direction along the one dimension of the display device may cause the corresponding face of the first pair of faces to move in a first direction along the length dimension of the proposed bounding box, and dragging the handle of the slider of the first pair of sliders in a second direction along the one dimension may cause the corresponding face of the first pair of faces to move in a second direction opposite the first direction along the length dimension of the proposed bounding box. A speed at which the corresponding face moves is controlled by a distance that the handle of the slider is dragged along the first direction. The user interface controls may include: a first pair of scrolling controls configured to control a first pair of faces at opposite ends of a length dimension of the proposed bounding box; a second pair of scrolling controls configured to control a second pair of faces at opposite ends of a width dimension of the proposed bounding box; and a third pair of scrolling controls configured to control a third pair of faces at opposite ends of a height dimension of the proposed bounding box, scrolling a first scrolling control of the first pair of scrolling controls may cause a corresponding face of the first pair of faces to move in a direction corresponding to a direction of the scrolling. The memory may further store instructions that, when executed by the processor, cause the processor to: compute a plurality of proposed locations for a face of the proposed bounding box in accordance with confidence scores of locations of the face computed based on discontinuities detected in the scene; and present the plurality of proposed locations for the face of the proposed bounding box. The memory may further store instructions that, when executed