EP-4738241-A1 - COOKING APPLIANCE CONTROL METHOD AND DEVICE, COOKING APPLIANCE AND STORAGE MEDIUM

Abstract

The present application provides a cooking appliance control method and device, a cooking appliance and a storage medium. The control method comprises: in the process of cooking a food ingredient with a cooking appliance, generating at least one food ingredient image of the food ingredient; detecting the at least one food ingredient image, and determining at least one target image with pollutants in the image content; and restoring the at least one target image to a pollutant-free state.

Inventors

• WANG, Yaxuan

Assignees

• Guangdong Midea Kitchen Appliances Manufacturing Co., Ltd.

Dates

Publication Date

20260506

Application Date

20231106

Claims (16)

1. A control method for a cooking appliance, comprising: during a process of cooking a food ingredient with the cooking appliance, generating at least one food ingredient image of the food ingredient; detecting the at least one food ingredient image, and determining at least one target image with contaminant in its image content; and restoring the at least one target image to a contaminant-free state.
2. The control method according to claim 1, wherein, the food ingredient image comprises a plurality of sub-regions, and the detecting the at least one food ingredient image and determining the at least one target image with contaminant in its image content comprises: traversing each food ingredient image to acquire image features of each sub-region; and determining the at least one target image based on the image features.
3. The control method according to claim 2, wherein, the image features comprise an optical flow direction, brightness, and color, and the determining the at least one target image based on the image features comprises: determining the food ingredient image as the target image in a case that the optical flow direction of any of the sub-regions is toward the direction of gravity and the brightness is greater than a preset brightness; or determining the food ingredient image as the target image in a case that the optical flow direction of any of the sub-regions is toward the direction of gravity and the color is white.
4. The control method according to claim 2, wherein, the image features comprise a refractive index, and the determining the at least one target image based on the image features comprises: determining the food ingredient image as the target image in a case that the refractive index of any of the sub-regions is less than a preset refractive index.
5. The control method according to claim 2, wherein, the image features comprise brightness, saturation, and contrast, and the determining the at least one target image based on the image features comprises: determining the food ingredient image as the target image in a case that the brightness, saturation, or contrast of any of the sub-regions is greater than a preset value.
6. The control method according to claim 2, wherein, the determining the at least one target image based on the image features comprises: determining the food ingredient image as the target image in a case that a difference between the image features of any two adjacent sub-regions is greater than a first preset difference.
7. The control method according to claim 2, wherein, the determining the at least one target image based on the image features comprises: in a case that a difference between the image features of a same sub-region in two food ingredient images generated at adjacent time points is greater than a second preset difference, determining the later generated food ingredient image as the target image.
8. The control method according to any one of claims 2 to 7, wherein, the restoring the at least one target image to the contaminant-free state comprises: determining a change trend of the food ingredient in the sub-region with contaminant in the target image based on at least one food ingredient image generated before the target image; and restoring the sub-region with contaminant in the target image based on the change trend of the food ingredient in the sub-region with contaminant.
9. The control method according to any one of claims 2 to 7, wherein, the restoring the at least one target image to the contaminant-free state comprises: acquiring a first sub-region with contaminant in the target image; acquiring a second sub-region, which corresponds to the first sub-region, in a food ingredient image immediately preceding the target image; replacing the first sub-region with the second sub-region; and performing smoothing processing on the replaced target image based on a preset algorithm to restore the at least one target image to the contaminant-free state.
10. The control method according to any one of claims 2 to 7, wherein, the restoring the at least one target image to the contaminant-free state comprises: acquiring a third sub-region with contaminant in the target image; acquiring a fourth sub-region, which corresponds to the third sub-region, in a food ingredient image immediately preceding the target image; and adjusting the image features of the third sub-region based on the image features of the fourth sub-region to restore the at least one target image to the contaminant-free state.
11. The control method according to any one of claims 2 to 7, wherein, the restoring the at least one target image to the contaminant-free state comprises: inputting the at least one target image into a preset neural network to restore the at least one target image to the contaminant-free state.
12. The control method according to any one of claims 1 to 7, wherein, the contaminant comprise a water droplet or water mist.
13. A cooking appliance control device, comprising: a generating unit configured to generate at least one food ingredient image of a food ingredient during a process of cooking the food ingredient with a cooking appliance; a detecting unit configured to detect the at least one food ingredient image and determine at least one target image with contaminant in its image content; and a restoring unit configured to restore the at least one target image to a contaminant-free state.
14. A cooking appliance control device, comprising: a processor and a memory, wherein, the memory stores a program or an instruction that runs in the processor; the program or instruction, when executed by the processor, causes the processor to perform steps of a control method for a cooking appliance according to any one of claims 1 to 12.
15. A cooking appliance, comprising: a cooking appliance control device according to claim 13 or claim 14.
16. A computer-readable storage medium, wherein, a program or an instruction are stored in the computer-readable storage medium; the program or instruction, when executed by a processor, causes the processor to perform steps of a control method for a cooking appliance according to any one of claims 1 to 12.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to Chinese Patent Application No. 202310906385.7 filed with the China National Intellectual Property Administration on July 24, 2023 and entitled "COOKING APPLIANCE CONTROL METHOD AND DEVICE, COOKING APPLIANCE AND STORAGE MEDIUM", the entire contents of which are herein incorporated by reference. FIELD The present application relates to the technical field of household electrical appliances, and specifically relates to a control method for a cooking appliance and device, a cooking appliance and a storage medium. BACKGROUND In related technologies, during a process where a user acquires images of the food ingredients being cooked through a cooking appliance, water droplets or mist may condense on the camera of the cooking appliance. This results in appearance of water droplets or mist on the food ingredient images, to lead to poor quality of the food ingredient images and affecting user experience. SUMMARY The present application aims to solve at least one of the technical problems existing in the prior art. Thus, a first aspect of the present application provides a control method for a cooking appliance. A second aspect of the present application provides a cooking appliance control device. A third aspect of the present application provides a cooking appliance control device. A fourth aspect of the present application provides a cooking appliance. A fifth aspect of the present application provides a computer-readable storage medium. The first aspect of the present application provides a control method for a cooking appliance, comprising: during a process of cooking a food ingredient with a cooking appliance, generating at least one food ingredient image of the food ingredient; detecting the at least one food ingredient image, and determining at least one target image with contaminant in its image content; and restoring the at least one target image to a contaminant-free state. The control method for a cooking appliance provided in the present application can be configured to acquire images of the cooking process of the food ingredient while the cooking appliance is cooking the food ingredients, and then the images are made available for the user to view, to meet the user's needs on the cooking process and improving user experience. Furthermore, the cooking appliance can be provided with an image acquisition device, such as a camera or other device. The image acquisition device is disposed in the cooking cavity of the cooking appliance, and images of the food ingredients can be acquired during the cooking process of the food ingredients by the cooking appliance. In some embodiments, during the process of cooking the food ingredients by the cooking appliance, the image acquisition device of the cooking appliance can be controlled to capture images of the food ingredients in the cooking cavity, to generate at least one food ingredient image of the food ingredients in the cooking cavity. It is understandable that the user can, according to their own needs, obtain the final image of the cooked food ingredients through the image acquisition device after the food ingredients are cooked. Additionally, food ingredient images at each cooking stage can further be acquired during the cooking process. Furthermore, after the generation of at least one food ingredient image is completed, at least one food ingredient image can be detected to determine whether there are contaminant in the image content of the food ingredient image. The contaminant can be water droplets or mist; the contaminant can comprise water droplets or mist, i.e., whether water droplets or mist exist in the image content, to determine the target images containing contaminant in its image content. It is understandable that during the cooking process of food ingredients, the temperature in the cooking cavity rises, causing the moisture contained in the food ingredients to evaporate and then condense into water droplets or mist on the camera of the image acquisition device. Furthermore, the contaminant can further comprise oil droplets, oil stains, or other impurities displayed in the image. When contaminant condense on the camera, the acquired food ingredient images will show such contaminant, to degrade the quality of the food ingredient images and failing to meet the user's requirements for the quality of the food ingredient images. Furthermore, in the case of detecting the presence of contaminant in the image content of at least one food ingredient image, i.e., in the case of determining that the at least one food ingredient image comprises the target image, restoration processing can be performed on the target image. That is, the parts of the image content of the food ingredient image that contain contaminant are restored to remove the contaminant from the image content while retain the original effect of the food ingredients in the food ingredient image, to meet the user's requ