Search

KR-20260067595-A - Virtual fitting method through uniform area masking processing

KR20260067595AKR 20260067595 AKR20260067595 AKR 20260067595AKR-20260067595-A

Abstract

The present invention relates to a virtual fitting service method through uniform area masking processing, comprising the steps of: receiving a selected clothing image and user body shape information from a user terminal; extracting a body shape image corresponding to the selected clothing image and the user body shape information; performing masking processing and preprocessing by setting a uniform mask area larger than the wearing area on a clothing area corresponding to the selected clothing image on the body shape image; and generating a clothing synthesis result in which a clothing synthesis model synthesizes the selected clothing image onto the body shape image based on the preprocessing result. According to the present invention as described above, by applying uniform area masking to the area of the clothing to be worn, the fine shape of the sleeve or pattern of the clothing can be preserved, thereby maximizing the effect of virtual fitting.

Inventors

  • 김민선

Assignees

  • (주)하마랩

Dates

Publication Date
20260513
Application Date
20241106

Claims (4)

  1. A step in which a preprocessing module preprocesses a clothing image received from the user terminal and a body shape image corresponding to the user body shape information; A step in which a masking module performs a masking process of setting a uniform mask area larger than the wearing area in a clothing area corresponding to the selected clothing image on the body shape image; and A virtual fitting service method through uniform area masking processing, characterized by including a step in which a clothing synthesis model generates a clothing synthesis result by synthesizing the selected clothing image onto the body shape image based on the results of the preprocessing and masking processing.
  2. In paragraph 1 The above masking process is A step of parsing the body and clothing regions of the above body shape image using a human parsing model, and extracting pose data of the body shape image through a pose extraction model to enable pose estimation; A step of generating masking data for body and clothing areas to be synthesized based on the above-mentioned parsing data of body and clothing wearing areas and the above-mentioned pose data; A step of expanding the bounding box of the entire masking area of the generated masking data into a rectangular shape; and A virtual fitting service method through uniform area masking processing, characterized by including the step of generating rectangular uniform area masking data by expanding the width of the masking box based on the outermost X, Y coordinates of the bounding boxes.
  3. In paragraph 1, The above clothing synthesis model uses a Stable Diffusion model, and A virtual fitting service method using uniform region masking, characterized by preparing a pre-trained basic synthetic model and an untrained additional synthetic model, measuring the difference in output between the two models for the same input through loss, updating the weights of the additional synthetic model through backpropagation, and using the additional synthetic model with updated weights as the clothing synthetic model.
  4. In paragraph 3, A virtual fitting service method through uniform region masking processing, characterized in that the clothing synthesis model calculates the difference between the outputs of two models for the same input as KL diversity loss, and calculates the difference between the output of the additional synthesis model and the label value as cross-entropy loss.

Description

Virtual fitting method through uniform area masking processing The present invention relates to a virtual fitting method using generative artificial intelligence, and more specifically, to a technology that enables the preservation of fine details of the sleeves or patterns of clothing by applying uniform area masking to the area of clothing to be worn. The reason consumers prefer offline shopping over online shopping when buying clothes is the strong perception that clothing is a product that must be tried on in person to ensure a good fit. Due to this consumer preference for trying on clothes before purchasing, online clothing sales have not grown as actively, and this purchasing trend is even more pronounced, especially for expensive items. Meanwhile, consumers often search for and refer to reviews, such as purchase reviews and blog reviews, to try and alleviate the inconvenience of offline shopping. However, since these reviews are merely accounts of others' experiences, they are often not of much help to the consumer themselves. Consequently, there are many cases where consumers end up making a final purchase only after visiting an offline store in person and trying on the clothes they wanted. As a result, there is a growing demand for virtual fitting services that allow users to check whether clothing fits their body type when purchasing online. As a technology for such virtual fitting services, Korean Registered Patent No. 2580427 presents a technology that provides an environment where users can have an experience similar to trying on clothes in person offline by providing a virtual fitting image through the synthesis of the clothing image onto the model image when users upload only clothing images and model images. Current virtual fitting technologies parse each part of the body and the part of the clothing, then mask the part corresponding to the clothing to be worn, and then synthesize the image of the clothing to be worn onto the masked part. When generating composite images of clothing, generative AI faces a problem where the effectiveness of virtual fitting is halved because it converts characters or patterns that it has not learned into similar characters or patterns, or recognizes unique sleeve patterns or sleeves that do not follow the human body contours as background and cuts out those parts. In addition, conventional virtual fitting services have the problem that they are not suitable for providing real-time services online because the clothing synthesis process requires a significant amount of time. This patent is the result of a project filed with the support of Gyeonggi Province and the Gyeonggi Economic & Science Promotion Agency's 2024 Global Startup Commercialization Support Program. FIG. 1 shows the configuration of a virtual fitting system through uniform area masking processing according to the present invention. Figure 2 is a block diagram illustrating the internal configuration of a virtual fitting service device. Figure 3 is a flowchart illustrating the process of performing a virtual fitting service through uniform area masking processing. Figure 4 is a flowchart illustrating the process of performing the masking algorithm in Figure 2. Figure 5 is an image illustrating the process of performing a virtual fitting service. The embodiments described in the present invention and the configurations illustrated in the drawings are merely preferred embodiments of the present invention and do not represent all of the technical concept of the present invention; therefore, the scope of the rights of the present invention should not be interpreted as being limited by the embodiments and drawings described in the text. That is, since the embodiments are subject to various modifications and may take various forms, the scope of the rights of the present invention should be understood to include equivalents capable of realizing the technical concept. Furthermore, the objectives or effects presented in the present invention do not imply that a specific embodiment must include all of them or only such effects; therefore, the scope of the rights of the present invention should not be understood as being limited by them. Unless otherwise defined, all terms used herein have the same meaning as generally understood by those skilled in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having meanings consistent with the context of the relevant technology and should not be interpreted as having an ideal or overly formal meaning not explicitly defined in this invention. Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the attached drawings. FIG. 1 shows the configuration of a virtual fitting system through uniform area masking processing according to the present invention, and FIG. 2 is a block diagram showing the detailed configuration of a virtual fitting service device (200). As