CN-121992610-A - Clothes processing device, clothes fading detection method and equipment thereof, and storage medium

CN121992610ACN 121992610 ACN121992610 ACN 121992610ACN-121992610-A

Abstract

The application relates to a clothes treatment device, a clothes fading detection method, equipment and a storage medium. The clothes fading detection method specifically comprises the steps of obtaining running state information of a clothes treatment device, determining a target observation period meeting preset immersion observation conditions according to the running state information, obtaining a monitoring image which is derived from an image acquisition device and corresponds to the target observation period, carrying out image feature analysis on the monitoring image to extract color feature information representing the color of washing liquid, and determining clothes fading conditions according to the color feature information. Compared with the prior art, the method has the advantages that the image acquisition device is arranged on the inner barrel lifting rib, the operation state information is used for locking the immersion observation period, the accurate in-situ acquisition of the washing liquid is realized, the dynamic clothes interference is eliminated by combining the time domain image characteristic analysis, and the color characteristic of the washing liquid is accurately extracted. The application effectively overcomes the interference of foam shielding and environment, and improves the accuracy of fading detection.

Inventors

MOU PING
HOU LEI

Assignees

南京一目智能科技有限公司

Dates

Publication Date: 20260508
Application Date: 20260121

Claims (15)

1. The method is characterized by being applied to a clothes processing device provided with an image acquisition device on an inner barrel lifting rib, and comprises the following steps of: acquiring operation state information of the clothes treatment device, and determining a target observation period meeting preset immersion observation conditions according to the operation state information; acquiring a monitoring image which originates from the image acquisition device and corresponds to the target observation period; Performing image feature analysis on the monitoring image to extract color feature information representing the color of the washing liquid; And determining the fading condition of the clothes according to the color characteristic information.
2. The method according to claim 1, wherein the step of determining the laundry fade status based on the color feature information includes: acquiring the color characteristics of a reference washing liquid of the clothes treatment device in a water inlet stage or a washing initial stage; Calculating a color difference value between the color characteristic information and the color characteristic of the reference washing liquid; if the color difference value exceeds a preset color fading threshold value, judging that the clothes color fading condition exists.
3. The method according to claim 2, wherein the step of calculating a color difference value between the color feature information and the reference wash liquid color feature comprises: mapping the color characteristics of the reference washing liquid into a reference zero point under a pixel coordinate system; and acquiring a vector offset modular length of the color characteristic information relative to the reference zero point in the pixel coordinate system, and determining the vector offset modular length as the color difference value.
4. The method according to claim 1, wherein the step of acquiring the operation state information of the laundry treating apparatus and determining a target observation period satisfying a preset immersion observation condition according to the operation state information includes: acquiring real-time water level data and real-time rotation phase of the inner cylinder as the running state information; Calculating a corresponding effective phase interval in which the lifting rib is completely immersed below the liquid level based on the real-time water level data and the geometric construction parameters of the inner cylinder; And determining the duration time period of the real-time rotation phase falling into the effective phase interval as the target observation period.
5. The method according to claim 1, wherein the step of acquiring the operation state information of the laundry treating apparatus and determining a target observation period satisfying a preset immersion observation condition according to the operation state information includes: acquiring an image statistical index of a preview video stream output by the image acquisition device as the running state information, wherein the image statistical index comprises a brightness average value or texture complexity of a current frame; and when the brightness average value is monitored to be changed in a step mode or the texture complexity is lower than a preset complexity threshold value, marking the current moment as the starting moment of the target observation period.
6. The method of claim 1, wherein the monitoring image comprises a multi-frame time series image corresponding to the target observation period; The step of performing image feature analysis on the monitoring image to extract color feature information characterizing the color of the washing liquid includes: mapping the monitoring image to a unified pixel coordinate system; Counting the numerical value dispersion characteristics of the pixel points in the pixel coordinate system in the time dimension; Based on the numerical value dispersion characteristics, a dynamic interference area and a steady background area are segmented from the pixel coordinate system; and calculating the color characteristic information based on the pixel value of the steady-state background area.
7. The method of claim 6, wherein the step of separating a dynamic interference region from a steady state background region from the pixel coordinate system based on the numerical dispersion feature comprises: Calculating the pixel value variance of the pixel point in the multi-frame time sequence image; if the pixel value variance is larger than a preset stability threshold, the pixel point is classified into the dynamic interference area; and if the pixel value variance is smaller than or equal to the stability threshold, classifying the pixel point into the steady-state background area.
8. The method of claim 7, wherein the step of calculating the color characterization information based on the pixel values of the steady state background region comprises: performing median filtering processing on pixel value sequences of all pixel points belonging to the steady background area in the time dimension to obtain a synthesized background image; And extracting the color characteristic information from the synthesized background image.
9. The method of claim 1, wherein the operating state information further comprises a real-time rotational speed of the inner barrel; The step of "acquiring a monitoring image which originates from the image acquisition apparatus and corresponds to the target observation period" includes: Judging whether the real-time rotating speed of the inner cylinder is larger than a preset imaging critical rotating speed, and if so, generating a rotating speed adjusting instruction to control the inner cylinder to decelerate; and acquiring the monitoring image when the inner cylinder is in a low-speed state in response to the rotating speed adjusting instruction and is in the target observation period in time.
10. The method according to claim 1, wherein the step of performing image feature analysis on the monitoring image to extract color feature information characterizing the color of the washing liquid comprises: calculating a definition evaluation index of each communication area in the monitoring image; based on the depth of field characteristic of the image acquisition device, identifying the region with the definition evaluation index lower than a preset focusing threshold as a near field shielding region and eliminating the near field shielding region; and reserving an area of which the definition evaluation index is in a preset permeability range, and extracting the color characteristic information from the area.
11. The method according to claim 2, further comprising, after determining that there is a laundry fade, sequentially performing the steps of: Controlling the clothes treatment device to execute a water draining action until the water level is reduced to a preset empty water level; Controlling the inner cylinder to execute centrifugal dehydration action at a low-speed centrifugal rotation speed, wherein the low-speed centrifugal rotation speed is lower than a preset standard dehydration rotation speed; and controlling the laundry treating apparatus to perform a water inlet action, and controlling a heating assembly of the laundry treating apparatus to maintain a closed state during the water inlet action and a subsequent rinsing action.
12. The method according to claim 2, further comprising, after determining that there is a laundry fade, sequentially performing the steps of: Controlling the laundry treating apparatus to perform a draining action; controlling a delivery component of the clothes treatment device to execute delivery action, and delivering a preset color protection additive into the inner barrel; Controlling the laundry treatment apparatus to run a color-protecting washing program; And during the operation of the color protection washing program, controlling the washing water temperature not to be higher than a preset color protection temperature threshold value, and controlling the inner cylinder to rotate according to a preset soft protection beat.
13. A laundry treatment apparatus configured to perform the method according to any one of claims 1 to 12, comprising: the inner wall of the inner cylinder is provided with raised lifting ribs; the image acquisition device is arranged in a containing cavity formed in the lifting rib, and the lens faces the inner cylinder; And the controller is electrically connected with the image acquisition device and is used for acquiring the monitoring image and executing the image characteristic analysis.
14. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 12 when the program is executed by the processor.
15. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any one of claims 1 to 12.

Description

Clothes processing device, clothes fading detection method and equipment thereof, and storage medium Technical Field The invention relates to the field of clothes care, in particular to a clothes treatment device, a clothes fading detection method, equipment and a storage medium thereof. Background With the improvement of living standard, the washing machine has become a necessary cleaning appliance for families. In the daily washing process, the clothes with dark color or poor color fastness are easy to be separated out of dye, and if the clothes are not found in time, the color cross of other light-color clothes is easy to occur. Therefore, the color fading and cross color detection function of clothes becomes an important research direction of the washing machine technology. There are some solutions in the prior art regarding the identification of cross-color of clothing. For example, chinese patent application publication No. CN114277542a discloses an intelligent clothing cross-color recognition method and a washing machine using the same. According to the method, images of the to-be-washed clothes are obtained, the soaked clothes and the washing water are shot and sampled every one sampling time in the washing process, and color difference change reference values among the images are compared to obtain the color cross risk level. This solution attempts to provide an early warning by monitoring the color changes of the laundry and water during the washing process. However, in practical applications, image acquisition is severely obstructed by the field of view and environmental disturbances. The image capturing devices of the prior art are typically mounted adjacent to the inner sidewall or viewing window of the outer barrel. In the washing process, a large amount of foam generated in the inner barrel is easy to float on the liquid level or adhere to the front of the lens, and tumbling clothes are easy to be accumulated near the observation window or the side wall, so that the view of the camera is blocked, and a washing liquid image capable of representing the fading condition is difficult to directly and clearly capture. Disclosure of Invention To achieve the above objects and other advantages and in accordance with a first aspect of the present invention, there is provided a laundry detecting method applied to a laundry treating apparatus having an image pickup device provided on an inner drum lifting rib, the method comprising: Acquiring operation state information of the clothes treatment device, and determining a target observation period meeting preset immersed observation conditions according to the operation state information; acquiring a monitoring image which is derived from the image acquisition device and corresponds to a target observation period; Performing image feature analysis on the monitoring image to extract color feature information representing the color of the washing liquid; and determining the fading condition of the clothes according to the color characteristic information. Optionally, the step of "acquiring operation state information of the laundry treating apparatus and determining a target observation period satisfying a preset immersion observation condition according to the operation state information" includes: acquiring real-time water level data and real-time rotation phase of the inner cylinder as running state information; Based on real-time water level data and geometric construction parameters of the inner cylinder, calculating an effective phase interval in which the lifting rib is completely immersed below the liquid level; And determining the duration time period of the real-time rotation phase falling into the effective phase interval as a target observation period. Optionally, the step of "acquiring operation state information of the laundry treating apparatus and determining a target observation period satisfying a preset immersion observation condition according to the operation state information" includes: Acquiring an image statistical index of a preview video stream output by an image acquisition device as running state information, wherein the image statistical index comprises a brightness average value or texture complexity of a current frame; when the brightness average value is monitored to be subjected to step change or the texture complexity is lower than a preset complexity threshold value, the current moment is marked as the starting moment of the target observation period. Optionally, the monitoring image comprises a plurality of frames of time series images corresponding to a target observation period; The step of performing image feature analysis on the monitoring image to extract color feature information characterizing the color of the washing liquid, comprises the following steps: Mapping the monitoring image to a unified pixel coordinate system; counting the numerical value dispersion characteristics of the pixel points in the pixel coordi