US-12620148-B2 - Rollout photography systems and methods for mobile devices

Abstract

Systems and techniques are described herein for rollout photography for mobile devices. For example, a computing device (e.g., a mobile device) can obtain, from a camera, a plurality of image frames of an object while at least one of the apparatus or the object is moving relative to each other. The computing device can determine a plurality of image segments from the plurality of image frames of the object. The plurality of image segments include a respective image segment from each image frame of the plurality of image frames. The computing device can combine the plurality of image segments to generate a single two-dimensional (2D) image of a surface of the object.

Inventors

• Edward Jacob MEISAROSH
• Seyfullah Halit Oguz

Assignees

• QUALCOMM INCORPORATED

Dates

Publication Date

20260505

Application Date

20230802

Claims (20)

1. 1 . An apparatus for performing rollout photography, the apparatus comprising: at least one memory; and at least one processor coupled to the at least one memory and configured to: obtain, from a camera, a plurality of image frames of an object while at least one of the apparatus or the object is moving relative to each other; determine a capture rate for capturing the plurality of image frames based on a curvature of the object; capture the plurality of image frames based on the capture rate; determine a plurality of image segments from the plurality of image frames of the object based on the capture rate, the plurality of image segments including a respective image segment from each image frame of the plurality of image frames; and combine the plurality of image segments to generate a single two-dimensional (2D) image of a surface of the object.
2. 2 . The apparatus of claim 1 , wherein, to combine the plurality of image frames, the at least one processor is configured to stitch the plurality of image frames together to generate the single 2D image.
3. 3 . The apparatus of claim 2 , wherein the at least one processor is configured to apply one or more post-processing corrections to the plurality of image segments prior to stitching the plurality of image frames together.
4. 4 . The apparatus of claim 1 , wherein the at least one processor is configured to apply one or more post-processing corrections to the single 2D image.
5. 5 . The apparatus of claim 4 , wherein the one or more post-processing corrections comprise at least one of geometric corrections, illumination corrections, or chromaticity corrections.
6. 6 . The apparatus of claim 1 , wherein the at least one processor is configured to obtain the plurality of image frames of the object from the camera while the apparatus is static and the object is rotated in place.
7. 7 . The apparatus of claim 1 , wherein the at least one processor is configured to obtain the plurality of image frames of the object from the camera while the object is rolled and the apparatus is moved in at least one direction.
8. 8 . The apparatus of claim 1 , wherein the at least one processor is configured to obtain the plurality of image frames of the object from the camera while the object is rolled and the apparatus is static.
9. 9 . The apparatus of claim 1 , wherein the at least one processor is configured to obtain the plurality of image frames of the object from the camera while the object is rolled and the apparatus is rotated.
10. 10 . The apparatus of claim 1 , wherein the at least one processor is configured to obtain the plurality of image frames of the object from the camera while the apparatus is revolved around the object.
11. 11 . The apparatus of claim 1 , wherein the at least one processor is configured to: determine a curvature of the object; and determine, based on the curvature of the object, a capture rate for capturing the plurality of image frames.
12. 12 . The apparatus of claim 1 , wherein the at least one processor is configured to provide a user interface for a user to perform the rollout photography.
13. 13 . The apparatus of claim 12 , wherein the at least one processor is configured to output, for display via the user interface, user guidance for capturing the plurality of image frames of the object.
14. 14 . The apparatus of claim 12 , wherein the at least one processor is configured to output, for display via the user interface, an option for a selection of at least one of one or more dimensions or a location of an image subsection of the object for the plurality of image segments.
15. 15 . The apparatus of claim 12 , wherein the at least one processor is configured to output, for display via the user interface, a subsection guide to guide capture of an image from the plurality of image frames such that a subsection of the object for an image segment is included in the image.
16. 16 . The apparatus of claim 15 , wherein the at least one processor is configured to: receive, via the user interface, user input associated with at least one adjustment of the subsection guide; and adjust the subsection guide based on the user input.
17. 17 . The apparatus of claim 1 , wherein the at least one processor is configured to: determine a segment for an image of the plurality of image frames based on a depth of a subsection of the image corresponding to the segment.
18. 18 . The apparatus of claim 1 , wherein whether the apparatus is moving relative to the object or the object is moving relative to the apparatus is based on a capture mode.
19. 19 . The apparatus of claim 1 , further comprising the camera.
20. 20 . The apparatus of claim 1 , wherein the apparatus is a mobile device.

Description

FIELD This application is related to image processing. In some examples, aspects of this application relate to systems and techniques for providing rollout photography for mobile devices. BACKGROUND The increasing versatility of digital camera products has allowed digital cameras to be integrated into a wide array of devices (e.g., mobile devices) and has expanded their use to different applications. For example, mobile devices, such as mobile phones, smart phones, tablet computers, wearable devices, drones, vehicles, and many other devices today are often equipped with camera devices. The camera devices allow users to capture images and/or video (e.g., including frames of images) from any system equipped with a camera device. The images and/or videos can be captured for recreational use, professional photography, surveillance, and automation, among other applications. Moreover, camera devices are increasingly equipped with specific functionalities for modifying images or creating artistic effects on the images. For example, many camera devices are equipped with image processing capabilities for generating different effects on captured images. Electronic devices, such as mobile electronic devices, are increasingly equipped with camera hardware to capture image frames, such as still images and/or video frames, of a scene. A camera is a device that receives light and captures image frames (e.g., still images or video frames) using an image sensor. In some examples, a camera may include one or more processors, such as image signal processors (ISPs), that can process one or more image frames captured by an image sensor. For example, a raw image frame captured by an image sensor can be processed by an image signal processor (ISP) of a camera to generate a preview of the image prior to the final display of the image. SUMMARY The following presents a simplified summary relating to one or more aspects disclosed herein. Thus, the following summary should not be considered an extensive overview relating to all contemplated aspects, nor should the following summary be considered to identify key or critical elements relating to all contemplated aspects or to delineate the scope associated with any particular aspect. Accordingly, the following summary has the sole purpose to present certain concepts relating to one or more aspects relating to the mechanisms disclosed herein in a simplified form to precede the detailed description presented below. Systems and techniques are described for providing rollout photography for mobile devices. According to at least one illustrative example, an apparatus for performing rollout photography is provided. The apparatus includes at least one memory and at least one processor coupled to the at least one memory and configured to: obtain, from a camera, a plurality of image frames of an object while at least one of the apparatus or the object is moving relative to each other; determine a plurality of image segments from the plurality of image frames of the object, the plurality of image segments including a respective image segment from each image frame of the plurality of image frames; and combine the plurality of image segments to generate a single two-dimensional (2D) image of a surface of the object. In another illustrative example, a method for rollout photography is provided. The method includes: obtaining, by a camera of a mobile device, a plurality of image frames of an object while at least one of the mobile device or the object is moving relative to each other; determining, by one or more processors of the mobile device, a plurality of image segments from the plurality of image frames of the object, the plurality of image segments including a respective image segment from each image frame of the plurality of image frames; and combining, by the one or more processors of the mobile device, the plurality of image segments to generate a single two-dimensional (2D) image of a surface of the object. In another illustrative example, a non-transitory computer-readable storage medium is provided that includes instructions stored thereon which, when executed by at least one processor, causes the at least one processor to: obtain, from a camera, a plurality of image frames of an object while at least one of the apparatus or the object is moving relative to each other; determine a plurality of image segments from the plurality of image frames of the object, the plurality of image segments including a respective image segment from each image frame of the plurality of image frames; and combine the plurality of image segments to generate a single two-dimensional (2D) image of a surface of the object. In another illustrative example, an apparatus for performing rollout photography is provided. The apparatus includes means for obtaining, from a camera, a plurality of image frames of an object while at least one of the apparatus or the object is moving relative to each other; means for determin