Search

EP-4258203-B1 - SYSTEMS AND METHODS FOR PERFORMING VIRTUAL APPLICATION OF A RING WITH IMAGE WARPING

EP4258203B1EP 4258203 B1EP4258203 B1EP 4258203B1EP-4258203-B1

Inventors

  • KUO, CHIA-CHEN

Dates

Publication Date
20260506
Application Date
20230328

Claims (17)

  1. A method implemented in a computing device (102), comprising: obtaining an image depicting a hand; determining attributes of a finger (604) on the hand in the image; generating a displacement table comprising locations of pixels for the finger (604) based on the attributes; applying the displacement table to generate a modified finger (704, 804), wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and performing virtual application of a ring on the modified finger (704, 804).
  2. The method of claim 1, wherein determining attributes of the finger (604) comprises: identifying a target region (502) between two knuckles (506, 508) on the finger (604); and determining at least one of: coordinates of the target region (502), a boundary of the target region (502), and an orientation of the target region (502).
  3. The method of claim 2, wherein determining the orientation of the target region (502) comprises determining at least one of: a roll angle of the target region (502), a yaw angle of the target region (502), and a pitch angle of the target region (502).
  4. The method of claim 1, wherein generating the displacement table comprising the locations of the pixels for the finger (604) based on the attributes comprises generating a mapping function comprising a non-linear warp function in an image domain based on the attributes.
  5. A method implemented in a computing device (102), comprising: obtaining an image depicting a hand; determining attributes of a finger (604) on the hand in the image; applying a non-linear warping function to generate a modified finger (704, 804) in the image based on the attributes, wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and performing virtual application of a ring on the modified finger (704, 804) in the image.
  6. The method of claim 5, wherein determining attributes of the finger (604) comprises: identifying a target region (502) between two knuckles (506, 508) on the finger (604); and determining at least one of: coordinates of the target region (502), a boundary of the target region (502), and an orientation of the target region (502).
  7. The method of claim 6, wherein determining the orientation of the target region (502) comprises determining at least one of: a roll angle of the target region (502), a yaw angle of the target region (502), and a pitch angle of the target region (502).
  8. A system, comprising: a memory (214) storing instructions; a processor coupled to the memory (214) and configured by the instructions to at least: obtain an image depicting a hand; determine attributes of a finger (604) on the hand in the image; generate a displacement table comprising locations of pixels for the finger (604) based on the attributes; apply the displacement table to generate a modified finger (704, 804), wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and perform virtual application of a ring on the modified finger (704, 804).
  9. The system of claim 8, wherein the processor is configured to determine attributes of the finger (604) by: identifying a target region (502) between two knuckles (506, 508) on the finger (604); and determining at least one of: coordinates of the target region (502), a boundary of the target region (502), and an orientation of the target region (502).
  10. The system of claim 9, wherein the processor is configured to determine the orientation of the target region (502) by determining at least one of: a roll angle of the target region (502), a yaw angle of the target region (502), and a pitch angle of the target region (502).
  11. The system of claim 8, wherein the processor is configured to generate the displacement table comprising the locations of the pixels for the finger (604) based on the attributes by generating a mapping function comprising a non-linear warp function in an image domain based on the attributes.
  12. A non-transitory computer-readable storage medium storing instructions to be implemented by a computing device (102)having a processor, wherein the instructions, when executed by the processor, cause the computing device (102) to at least: obtain an image depicting a hand; determine attributes of a finger (604) on the hand in the image; generate a displacement table comprising locations of pixels for the finger (604) based on the attributes; apply the displacement table to generate a modified finger (704, 804), wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and perform virtual application of a ring on the modified finger (704, 804).
  13. The non-transitory computer-readable storage medium of claim 12, wherein the processor is configured by the instructions to determine attributes of the finger (604) by: identifying a target region (502) between two knuckles (506, 508) on the finger (604); and determining at least one of: coordinates of the target region (502), a boundary of the target region (502), and an orientation of the target region (502).
  14. The non-transitory computer-readable storage medium of claim 13, wherein the processor is configured by the instructions to determine the orientation of the target region (502) by determining at least one of: a roll angle of the target region (502), a yaw angle of the target region (502), and a pitch angle of the target region (502).
  15. The non-transitory computer-readable storage medium of claim 12, wherein the processor is configured by the instructions to generate the displacement table comprising the locations of the pixels for the finger (604) based on the attributes by generating a mapping function comprising a non-linear warp function in an image domain based on the attributes.
  16. A system, comprising: a memory (214) storing instructions; a processor coupled to the memory (214) and configured by the instructions to at least: obtain an image depicting a hand; determine attributes of a finger (604) on the hand in the image; apply a non-linear warping function to generate a modified finger (704, 804) in the image based on the attributes, wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and perform virtual application of a ring on the modified finger (704, 804) in the image.
  17. A non-transitory computer-readable storage medium storing instructions to be implemented by a computing device (102) having a processor, wherein the instructions, when executed by the processor, cause the computing device (102) to at least: obtain an image depicting a hand; determine attributes of a finger (604) on the hand in the image; apply a non-linear warping function to generate a modified finger (704, 804) in the image based on the attributes, wherein the modified finger (704, 804) depicts the finger (604) being squeezed by a ring; and perform virtual application of a ring on the modified finger (704, 804) in the image.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application claims priority to, and the benefit of, U.S. Provisional Patent Application entitled, "Method and System for Ring Virtual Try-on Based on Image Warping," having Serial No. 63/324,681, filed on March 29, 2022. TECHNICAL FIELD The present disclosure generally relates to systems and methods for performing virtual application of a ring with image warping. Document US 10976829 B1 is directed to systems and methods for displaying augmented-reality objects using a camera of an augmented-reality system to capture visual data for a structure of interest, such as a user's hand.Document US 10789778 B1 describes systems and methods for displaying augmented-reality objects by utilizing weighted features to match a user's hand with a silhouette model for improved tracking of the user's hand.Document US 9165318 B1 describes methods and systems of providing an augmented experience on a user device to facilitate user interaction with one or more virtual items.Document CN 105447735 A relates to a finger ring on-line try-in system and a try-in method thereof.Document CN 106373086 A relates to an augmented reality-based ring 2D online real-time trying method and system.Document US 2020013182 A1 relates to a system and a method for determining ring sizes of users using an image. SUMMARY The invention is set out in the appended set of claims. In accordance with one embodiment, a method implemented in a computing device is disclosed according to claim 1, or according to claim 5. In accordance with another embodiment, a system that comprises a memory storing instructions and a processor coupled to the memory is disclosed according to claim 8, or according to claim 16. In accordance with another embodiment, a non-transitory computer-readable storage medium storing instructions to be implemented by a computing device is disclosed according to claim 12, or according to claim 17. Other systems, methods, features, and advantages of the present disclosure will be apparent to one skilled in the art upon examining the following drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS Various aspects of the disclosure are better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, with emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views. FIG. 1 is a block diagram of a computing device configured to perform virtual application of a ring with image warping according to various embodiments of the present disclosure.FIG. 2 is a schematic diagram of the computing device of FIG. 1 in accordance with various embodiments of the present disclosure.FIG. 3 is a top-level flowchart illustrating examples of functionality implemented as portions of the computing device of FIG. 1 for performing virtual application of a ring with image warping according to various embodiments of the present disclosure.FIG. 4 illustrates an example user interface provided on a display of the computing device according to various embodiments of the present disclosure.FIG. 5 illustrates the computing device in FIG. 1 identifying a target region for performing image warping according to various embodiments of the present disclosure.FIG. 6 illustrates the computing device in FIG. 1 generating a displacement table for performing image warping on the target region based on attributes of the finger according to various embodiments of the present disclosure.FIG. 7 illustrates application of the displacement table to the target region to generate a modified finger according to various embodiments of the present disclosure.FIG. 8 illustrates virtual application of a ring on the modified finger after application of the displacement table according to various embodiments of the present disclosure.FIG. 9 is a top-level flowchart illustrating examples of functionality implemented as portions of the computing device of FIG. 1 for performing virtual application of a ring with image warping according to an alternative embodiment of the present disclosure. DETAILED DESCRIPTION The subject disclosure is now described with reference to the drawings, where like reference numerals are used to refer to like elements throughout the following description. Other aspects, advantages, and novel features of the disclosed subject matter will become apparent from the following detailed description and corresponding drawings. There is a need for an improved way for allowing consumers to evaluate the appearance of rings when considering different rings of interest. The present disclosure is directed to systems and methods for achieving a more realistic appearance of rings on a user by performing virtual application of a rings using image warping based on attributes associated with the user's finger. A description of a system