Search

CN-121992611-A - Clothes processing device, clothes fading detection method and equipment thereof, and storage medium

CN121992611ACN 121992611 ACN121992611 ACN 121992611ACN-121992611-A

Abstract

The invention relates to a clothes treatment device, a clothes fading detection method, equipment and a storage medium. The clothes fading detection method specifically comprises the steps of obtaining operation state parameters of a clothes treatment device, respectively determining first acquisition time aiming at the surface of clothes and second acquisition time aiming at washing water based on the operation state parameters, controlling an image acquisition assembly to acquire a first image at the first acquisition time and acquire a second image at the second acquisition time, respectively extracting clothes color characteristics of the first image and washing water color characteristics of the second image, and determining clothes fading conditions based on association relations between the washing water color characteristics and the clothes color characteristics. Compared with the prior art, the method and the device have the advantages that the acquisition time of clothes and washing water is respectively determined by acquiring the operation parameters, so that the space-time decoupling of the detection process is realized, the interference of water film reflection and foam in a mixed scene is avoided, and the original image data with high signal-to-noise ratio is acquired.

Inventors

  • MOU PING
  • LI ZHIQIANG
  • CHEN TIANYI

Assignees

  • 南京一目智能科技有限公司

Dates

Publication Date
20260508
Application Date
20260122

Claims (16)

  1. 1. A laundry discoloration detecting method, which is applied to a laundry treating apparatus equipped with an image acquisition assembly, the method comprising: acquiring operation state parameters of the clothes treatment device; determining a first collection timing for the surface of the laundry and a second collection timing for the wash water, respectively, based on the operating state parameters; Controlling the image acquisition component to acquire a first image at the first acquisition time and acquire a second image at the second acquisition time; Respectively extracting the color characteristics of clothes of the first image and the color characteristics of washing water of the second image; and determining the clothes fading condition based on the association relation between the washing water color characteristics and the clothes color characteristics.
  2. 2. The method according to claim 1, wherein the step of acquiring the operation state parameter of the laundry treating apparatus includes: The image acquisition assembly comprises a first camera module arranged on an inner cylinder lifting rib of the clothes processing device, a second camera module arranged on a circulating pipeline or a water drain pipeline, a third camera module arranged at a door body or a door seal of the clothes processing device, or any combination of the camera modules.
  3. 3. The method according to claim 2, wherein when the image capturing assembly includes the third camera module, the step of determining a first capturing opportunity for a laundry surface and a second capturing opportunity for wash water, respectively, based on the operation state parameter, wherein the step of determining the first capturing opportunity specifically includes: Responding to the washing program stage parameters to represent that the clothes treatment device enters a clothes amount sensing stage or a main washing tumbling stage, and monitoring real-time rotating speed data of the inner cylinder in real time; judging whether the real-time rotating speed data is in a preset low-speed visual interval or not so as to ensure that the clothes to be washed pass through a visual area of the third camera module under the action of gravity and the motion ambiguity is lower than a preset limit value; and when the real-time rotating speed data is in the low-speed visual interval, locking the current moment as the first acquisition time.
  4. 4. The method according to claim 2, wherein when the image capturing assembly includes the first camera module, the step of determining a first capturing opportunity for a laundry surface and a second capturing opportunity for wash water, respectively, based on the operation state parameter, wherein the step of determining the first capturing opportunity includes: establishing a mapping relation between the rotation phase of the inner cylinder and the spatial position of the first camera module; When the rotation phase of the inner cylinder falls into a first preset phase interval, the first camera module is judged to be above the liquid level of the inner cylinder, and the first acquisition time is determined.
  5. 5. The method according to claim 2, wherein when the image capturing assembly includes the first camera module, the step of determining a first capturing opportunity for a laundry surface and a second capturing opportunity for wash water, respectively, based on the operation state parameter, wherein the step of determining the second capturing opportunity includes: establishing a mapping relation between the rotation phase of the inner cylinder and the spatial position of the first camera module; when the rotation phase of the inner cylinder falls into a second preset phase interval, the first camera module is judged to be in a state of being immersed in washing water, and the second acquisition time is determined.
  6. 6. The method according to claim 2, wherein when the image capturing assembly comprises the second camera module, the step of determining a first capturing opportunity for a laundry surface and a second capturing opportunity for wash water, respectively, based on the operating state parameter, wherein the step of determining the second capturing opportunity specifically comprises: when the washing program stage parameter characterization enters a drainage stage or a circulation stage, continuously monitoring fluid movement characteristics in the field of view of the second camera module; comparing the bubble coverage data in the fluid motion characteristics with a preset threshold value; And when continuous liquid flow is formed in the field of view of the second camera module and the bubble coverage rate data is lower than the threshold value, locking the current moment as the second acquisition time.
  7. 7. The method of claim 6, wherein the step of controlling the image acquisition assembly to acquire a first image at the first acquisition occasion and to acquire a second image at the second acquisition occasion, wherein the step of acquiring the second image at the second acquisition occasion specifically comprises: Controlling the second camera module to execute multi-frame continuous shooting operation at the second acquisition time; And eliminating dynamic bubble noise points in the continuous liquid flow by using an inter-frame difference algorithm or a background modeling algorithm to acquire the second image.
  8. 8. The method according to claim 1, wherein the step of extracting the laundry color features of the first image and the washing water color features of the second image, respectively, comprises: performing foreground segmentation on the first image, identifying and removing an inner barrel metal wall background and a highlight reflection area, and calculating main tone characteristics of the remaining area as the clothes color characteristics; and performing region extraction on the second image to obtain a pixel set of a liquid phase transmission region or a liquid phase scattering region, and calculating global statistical characteristics of the pixel set as the washing water color characteristics.
  9. 9. The method according to claim 1, wherein the step of determining a laundry fade condition based on the association relationship of the wash water color feature and the laundry color feature includes: mapping the laundry color features and the wash water color features to the same color space; Constructing a chromaticity shift vector representing a change in the wash water color characteristic relative to the laundry color characteristic; Judging whether the chromaticity offset vector meets a preset fading consistency condition, wherein the fading consistency condition is that the module length of the chromaticity offset vector is smaller than a preset similarity threshold value, and the deviation between the direction of the chromaticity offset vector and the hue angle of the clothing color characteristic is smaller than a preset angle tolerance; And generating a judging result for confirming that the clothes fade condition exists in response to the fade consistency condition.
  10. 10. The method according to claim 9, wherein after the step of generating a determination result confirming that there is a laundry fade, the method further comprises: controlling the image acquisition assembly to repeatedly acquire the second image in a preset number of subsequent detection periods; counting time domain variation trend of the color characteristics of the washing water extracted in the preset number of subsequent detection periods; And if the time domain change trend represents that the chroma saturation is in a monotonically increasing state, outputting a final effective fading confirmation signal.
  11. 11. A laundry treatment apparatus, characterized by comprising a casing, an inner cylinder rotatably provided in the casing for accommodating laundry, a pipe assembly provided in the casing for guiding a flow of washing water, an image acquisition assembly provided on the casing, the inner cylinder or the pipe assembly for acquiring image data inside the inner cylinder or inside the pipe assembly, a main control assembly in communication with the image acquisition assembly, the main control assembly being configured to perform the laundry color-loss detection method according to any one of claims 1 to 10.
  12. 12. The laundry treatment apparatus of claim 11, wherein the pipe assembly comprises a circulation pipe or a drain pipe, the image acquisition assembly comprises a third camera module disposed at a door or a door closure of the cabinet, and a second camera module disposed on the circulation pipe or the drain pipe; The master control assembly is configured to activate the third camera module to acquire the first image when the first acquisition opportunity is determined, and activate the second camera module to acquire the second image when the second acquisition opportunity is determined.
  13. 13. The garment treatment device of claim 11, wherein the image acquisition assembly comprises a first camera module sealingly disposed within the inner barrel lifting rib; The main control assembly is configured to monitor the rotation phase of the inner barrel in real time, lock the first acquisition time and control the first camera module to acquire the first image when the rotation phase represents the top phase interval of the first camera module moving to the position above the liquid level of the inner barrel, and lock the second acquisition time and control the first camera module to acquire the second image when the rotation phase represents the first camera module moving to the bottom phase interval immersed in the washing water.
  14. 14. The laundry treatment apparatus of claim 11, wherein the pipe assembly comprises a circulation pipe or a drain pipe; The image acquisition assembly comprises a first camera module and a second camera module, the first camera module is arranged in the inner barrel lifting rib in a sealing mode, and the second camera module is arranged on the circulating pipeline or the water draining pipeline; the main control assembly is configured to determine the first acquisition time and schedule the first camera module to acquire the first image when the first camera module is monitored to rotate along with the inner barrel to a preset high-level interval above the liquid level, and determine the second acquisition time and schedule the second camera module to acquire the second image when the clothes treatment device is monitored to enter a drainage or circulation stage and form continuous liquid flow in the pipeline assembly.
  15. 15. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 10 when the program is executed by the processor.
  16. 16. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any one of claims 1 to 10.

Description

Clothes processing device, clothes fading detection method and equipment thereof, and storage medium Technical Field The invention relates to the field of clothes care, in particular to a clothes treatment device, a clothes fading detection method, equipment and a storage medium thereof. Background With the development of washing treatment technology, the level of intellectualization of washing apparatuses (e.g., washing machines, washing and drying integrated machines) is continuously increasing. The user expects that the washing apparatus can automatically recognize the laundry attribute and adjust the washing course accordingly, so as to prevent the cross color phenomenon of the laundry, which is a result of the laundry losing color. In order to realize the monitoring of the color fading condition of the clothes, the prior related art generally adopts a color recognition scheme. For example, chinese patent application CN115961446a discloses a control method for a washing apparatus, which includes acquiring colors of all laundry to be washed during operation of the washing apparatus, acquiring colors of washing water, judging whether there is laundry to fade based on the colors of the washing water, and determining actual faded laundry according to the colors of the washing water and the colors of the laundry in case that it is judged that there is laundry to fade. The technical scheme aims to solve the problem that the washing effect of the dark color clothes is not ideal because the dark color clothes are simply judged to be the fading clothes in the prior art. However, in the actual washing process, the inner tub environment of the washing apparatus is complicated. On the one hand, the clothes roll along with the water flow in the inner cylinder, the surface state of the clothes is unstable and is easily covered by the washing water or blocked by other clothes, and on the other hand, foam generated by the washing agent is usually mixed in the washing water, and the water flow is in a turbulent state. In the above prior art, specific acquisition conditions are not set for two different physical forms of the laundry and the washing water. If image acquisition is directly carried out under the mixed environment of the inner barrel, the acquired clothes image is easily interfered by water film reflection or uneven illumination, and the acquired washing water image is easily interfered by surface foam, bubbles and background clothes color. The noise introduced by the acquisition environment can reduce the signal-to-noise ratio of the color feature extraction, thereby affecting the accuracy of the final fading judgment. Disclosure of Invention To achieve the above objects and other advantages and in accordance with a first aspect of embodiments of the present invention, there is provided a laundry fade detection method, applied to a laundry treating apparatus provided with an image capturing assembly, the method comprising: Acquiring operation state parameters of the clothes treatment device; Determining a first acquisition time for the surface of the clothes and a second acquisition time for the washing water respectively based on the running state parameters; Controlling an image acquisition assembly to acquire a first image at a first acquisition time and acquire a second image at a second acquisition time; Respectively extracting the color characteristics of clothes of the first image and the color characteristics of washing water of the second image; and determining the fading condition of the clothes based on the association relation between the washing water color characteristics and the clothes color characteristics. Optionally, the step of "acquiring the operation state parameter of the laundry treating apparatus" includes: The image acquisition assembly comprises a first camera module arranged on an inner barrel lifting rib of the clothes processing device, a second camera module arranged on a circulating pipeline or a water drain pipeline, a third camera module arranged at a door body or a door seal of the clothes processing device, or any combination of the camera modules. Optionally, when the image capturing assembly includes the third camera module, the step of determining the first capturing opportunity for the surface of the laundry and the second capturing opportunity for the wash water based on the operation state parameters, respectively, specifically includes: responding to the washing program stage parameter to represent that the clothes treating device enters a clothes amount sensing stage or a main washing tumbling stage, and monitoring real-time rotating speed data of the inner barrel in real time; Judging whether the real-time rotating speed data is in a preset low-speed visual interval or not so as to ensure that the clothes to be washed pass through a visual area of the third camera module under the action of gravity and the motion ambiguity is lower than a preset limit value; And