Search

CN-122015414-A - Control method and device of refrigeration equipment and refrigeration equipment

CN122015414ACN 122015414 ACN122015414 ACN 122015414ACN-122015414-A

Abstract

The invention relates to the technical field of intelligent household appliance control and provides a control method and device of refrigeration equipment and the refrigeration equipment, wherein the control method comprises the following steps of responding to a trigger signal, collecting space scene data and multi-mode data of the refrigeration equipment, wherein the multi-mode data at least comprises image video data and voice data; the method comprises the steps of extracting visual information and voice information in multi-mode data, carrying out multi-mode fusion on the visual information and the voice information, combining space scene data to confirm user requirements, and controlling corresponding functional modules to work according to the user requirements. According to the method, through fusing two interactive modes of image video data and voice data and combining space scene data, richer and more-dimensional user intention information can be obtained, so that the refrigeration equipment can more accurately understand the composite user requirements comprising a target object, a space position and an operation instruction, and the accuracy of control instruction generation and the reliability of interaction are greatly improved.

Inventors

  • LI HUI

Assignees

  • 合肥美的生物医疗有限公司

Dates

Publication Date
20260512
Application Date
20260414

Claims (11)

  1. 1. A control method of a refrigeration device, characterized in that the refrigeration device comprises a plurality of functional modules, the control method of the refrigeration device comprising the steps of: responding to a trigger signal, and collecting space scene data and multi-mode data of the refrigeration equipment, wherein the multi-mode data at least comprises image video data and voice data; extracting visual information and voice information in the multi-mode data; Performing multi-mode fusion on the visual information and the voice information, and combining the space scene data to confirm the user requirements; And controlling the corresponding functional modules to work according to the user demands.
  2. 2. The method of controlling a refrigeration unit according to claim 1, wherein the step of extracting visual information and voice information from the multi-modal data comprises: extracting the visual information from the image video data, wherein the visual information comprises gesture characteristics and article category characteristics; the voice information is extracted from the voice data, and the voice information comprises operation intention based on voice text.
  3. 3. The method for controlling a refrigeration device according to claim 2, wherein the refrigeration device is a refrigerator, the multi-modal fusion of the visual information and the voice information, and the combination of the spatial scene data to confirm the user's demand, comprise: determining a space region to be controlled by the refrigerator according to the gesture features and the space scene data; determining functional requirements associated with the spatial region and/or the item class feature according to the operational intent and the item class feature; And combining the space region, the object class features and the functional requirements to generate the structured user requirements.
  4. 4. A control method of a refrigeration apparatus according to claim 3, wherein said function module includes a quick-freezing process module, and said step of controlling operation of said corresponding function module when said user demand includes said function demand related to quick-freezing or quick-cooling includes: Starting the quick-freezing processing module corresponding to the physical position according to the space region; According to the object category characteristics, a preset knowledge graph is called to determine corresponding target quick cooling time; And after the target quick cooling time passes, generating notification information of the quick cooling end and feeding back the notification information.
  5. 5. A control method of a refrigeration apparatus according to claim 3, wherein said function module includes a food management module, and when said user demand includes said function demand related to food management, said step of controlling operation of said corresponding function module includes: Identifying the access state of the article corresponding to the article category characteristic according to the visual information; and updating the stock information of the corresponding articles in the database of the refrigerator according to the access state.
  6. 6. A control method of a refrigeration unit according to claim 3, wherein said function module includes a freshness evaluation module, and said step of controlling operation of said corresponding function module when said user demand includes said function demand related to freshness or shelf life query includes: acquiring quality guarantee period information of the article corresponding to the article category characteristics; and evaluating the freshness level of the corresponding article and outputting the freshness level by combining the corresponding article, the quality guarantee period information and the corresponding deposit time.
  7. 7. A control method of a refrigeration unit according to claim 3, wherein said function module includes a recipe recommendation module, and said step of controlling operation of said corresponding function module when said user request includes said function request related to a recipe includes: obtaining the type and the quantity of food materials currently recorded in a database of the refrigerator; Generating a plurality of candidate menus matched with the food types and the quantity according to the corresponding relation in the preset knowledge graph and the user preference information; and prioritizing and outputting the plurality of candidate menus according to the user preference information.
  8. 8. A control device of a refrigeration apparatus, comprising: The data acquisition module is used for responding to the trigger signal and acquiring the space scene data and the multi-mode data of the refrigeration equipment, wherein the multi-mode data at least comprises image video data and voice data; the feature extraction module is used for extracting visual information and voice information in the multi-mode data; The fusion confirming module is used for carrying out multi-mode fusion on the visual information and the voice information and combining the space scene data to confirm the user requirements; And the control execution module is used for controlling the corresponding functional modules in the refrigeration equipment to work according to the user requirements.
  9. 9. A refrigeration apparatus comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements a method of controlling the refrigeration apparatus according to any one of claims 1 to 7 when executing the computer program.
  10. 10. A non-transitory computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed by a processor, implements a method of controlling a refrigeration appliance according to any one of claims 1 to 7.
  11. 11. A computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, are capable of performing the method of controlling a refrigeration appliance according to any of claims 1 to 7.

Description

Control method and device of refrigeration equipment and refrigeration equipment Technical Field The invention relates to the technical field of intelligent household appliance control, in particular to a control method and device of refrigeration equipment and the refrigeration equipment. Background With the development of intelligent household appliance technology, intelligent refrigeration equipment, such as intelligent refrigerators, with man-machine interaction function has become popular. Currently, the interaction mode of users and intelligent refrigerators mainly depends on physical keys, touch screens and graphical menu interfaces. The user needs to search for and trigger a desired function, such as adjusting the temperature of a specific storage room, setting a quick cooling mode, or performing food management, by browsing a hierarchical menu or memorizing a specific operation path. For some functions which are not frequently used or are hidden deeply in design, a user often needs to spend more time to learn or search, so that the interaction process is complicated, the efficiency is low, and the user experience is poor. In order to improve the intuitiveness and convenience of interaction, a scheme of performing interaction control by adopting a single mode has appeared in the related technology. For example, some intelligent refrigerators support direct control of some functions, such as tuning to a refrigeration mode, by voice commands, while others are equipped with visual sensors that enable automatic entry of food materials by identifying specific food materials or bar codes. However, these single modality (voice only or vision only) based interaction schemes have inherent drawbacks. Under complex household environment noise, voice recognition may be misidentified or missed due to user accent, speech speed or background interference, while pure vision schemes may fail in recognition due to light condition change, food material shielding or viewing angle problems. More importantly, the information provided by a single mode is limited in dimension, and complex instructions of spatial orientation, target objects and specific operation intentions are difficult to accurately understand, so that the refrigeration equipment is in a condition of wrong response or incapacity of responding, the refrigeration equipment still needs to be corrected for multiple times or is retracted to a manual menu operation, and the intelligent degree and the user experience are improved. Disclosure of Invention The present invention is directed to solving at least one of the technical problems existing in the related art. Therefore, the invention provides a control method of refrigeration equipment, which is used for solving the problems that in the existing control process, the information dimension provided by a single mode is limited, the complex instruction of the specific operation intention of a user is difficult to understand accurately, and the intelligent degree and the user experience are low. The invention provides a control method of refrigeration equipment, which comprises a plurality of functional modules, and comprises the following steps: responding to a trigger signal, and collecting space scene data and multi-mode data of the refrigeration equipment, wherein the multi-mode data at least comprises image video data and voice data; extracting visual information and voice information in the multi-mode data; Performing multi-mode fusion on the visual information and the voice information, and combining the space scene data to confirm the user requirements; And controlling the corresponding functional modules to work according to the user demands. According to the control method of the refrigeration equipment provided by the invention, the step of extracting the visual information and the voice information in the multi-mode data comprises the following steps: extracting the visual information from the image video data, wherein the visual information comprises gesture characteristics and article category characteristics; the voice information is extracted from the voice data, and the voice information comprises operation intention based on voice text. According to the control method of the refrigeration equipment provided by the invention, the refrigeration equipment is a refrigerator, the visual information and the voice information are subjected to multi-mode fusion, and the spatial scene data are combined to confirm the user requirements, and the control method comprises the following steps: determining a space region to be controlled by the refrigerator according to the gesture features and the space scene data; determining functional requirements associated with the spatial region and/or the item class feature according to the operational intent and the item class feature; And combining the space region, the object class features and the functional requirements to generate the structured user requiremen