CN-121998583-A - Intelligent judging method and device for meal end and meal equipment

CN121998583ACN 121998583 ACN121998583 ACN 121998583ACN-121998583-A

Abstract

The invention relates to the technical field of self-service catering service equipment, and discloses an intelligent judging method and device for finishing dining and dining equipment, wherein the method and device are used for primarily judging whether a user is likely to finish dining by monitoring whether a face image of a dining person on a display of the dining equipment disappears or not; and then, the distance sensor is used for collecting distance data of the user and the equipment, if the distance exceeds the preset meal-making distance, the end of the meal making is finally confirmed, the accuracy and the instantaneity of the judgment of the end of the meal making are improved, the accurate triggering of the noninductive payment settlement is ensured, the meal making monitoring and the judgment of the end of the meal making are convenient for the next meal-making person, and the service efficiency and the user experience of the self-service meal making terminal are optimized.

Inventors

LIANG XIANHAI
LIN WEIBIAO

Assignees

中山市德玛仕智能厨房设备有限公司

Dates

Publication Date: 20260508
Application Date: 20260107

Claims (10)

1. The intelligent distinguishing method for the end of meal is characterized by comprising the following steps: In the dining process of the dining personnel, monitoring the face on a display of the dining equipment according to the face image of the dining personnel to obtain a face monitoring result of the dining personnel, wherein the face of the dining personnel is displayed on the display in real time in the dining process, and dishes are placed on the dining equipment and are used for being eaten by the dining personnel; When the face monitoring result of the dining personnel is used for representing that the face image of the dining personnel disappears from the display, acquiring distance data between the dining personnel and the position of the dining equipment based on a distance sensor of the dining equipment; and when the distance data of the dining personnel are used for indicating that the current distance of the dining personnel exceeds the preset dining distance, determining that the dining of the dining personnel is finished.
2. The method of claim 1, wherein when the face monitoring result of the diner is used to represent the disappearance of the face image of the diner from the display, the method further comprises: monitoring a first duration of time when the facial image of the diner disappears from the display, wherein the starting time of the first duration of time is determined based on the time when the facial image of the diner is monitored to disappear from the display; When the first duration is longer than or equal to a first preset duration, monitoring the weight change of dishes on the meal making equipment to obtain a monitoring result of the weight change of the dishes; And when the monitored result of the change of the weight of the dishes is used for indicating that the second duration time length of the weight of the dishes on the dining equipment is not changed is longer than or equal to a second preset duration time length, executing the operation of collecting the distance data between the dining personnel and the position of the dining equipment based on the distance sensor of the dining equipment, wherein the starting moment of the second duration time length is determined based on the moment of monitoring the disappearance of the face image of the dining personnel from the display or the moment of monitoring the moment of the first duration time length reaching the first preset duration time length.
3. The method according to claim 1 or 2, wherein when the distance data of the diner is used to indicate that the current distance of the diner exceeds a preset meal distance, the method further comprises: acquiring the variable weight of the dining personnel for the dishes on the dining equipment to meal the dishes at the time; Acquiring the historical meal weight of the meal taker for the dishes on the meal taker according to the face image of the meal taker and the acquired dish identification of the dishes on the meal taker; Calculating the absolute value of the weight difference between the variable weight of dishes on the meal making equipment and the historical meal making weight; And judging whether the absolute value of the weight difference is in a preset weight difference range, and executing the operation of determining the end of meal making of the meal-taking person when the absolute value of the weight difference is in the preset weight difference range.
4. A method according to any one of claims 1-3, wherein the method further comprises: When the face image of the dining personnel does not disappear from the display of the dining equipment, a target area of the face image of the dining personnel on the display of the dining equipment is obtained; Judging whether the preset meal distance needs to be adjusted according to a target area corresponding to the face image and the whole display area of the display; And when judging that the preset meal-making distance does not need to be adjusted, executing the operation of acquiring distance data between the dining personnel and the position of the meal-making equipment based on the distance sensor of the meal-making equipment.
5. The method according to claim 4, wherein the method further comprises: when the preset meal distance is judged to be required to be adjusted, determining a distance correction parameter for the meal person according to a target area corresponding to the face image and the whole display area of the display; And based on the distance correction parameters of the dining personnel, performing correction operation on the preset dining distance, and performing the operation of acquiring distance data between the dining personnel and the position of the dining equipment based on the distance sensor of the dining equipment.
6. The method of claim 5, wherein the entire display area of the display is comprised of an upper display area, a middle display area, and a lower display area, the distances between the upper display area, the middle display area, and the lower display area and the bottom location of the dining apparatus decreasing; The step of judging whether the preset meal distance needs to be adjusted according to the target area corresponding to the face image and the whole display area of the display comprises the following steps: Analyzing the respective area proportion of a target area corresponding to the face image in the upper display area and the middle display area, or the respective area proportion in the upper display area and the lower display area; When the duty ratio of the upper display area is larger than that of the middle display area, or when the duty ratio of the lower display area is larger than that of the middle display area, determining that the preset meal distance needs to be adjusted; When the duty ratio of the upper display area is larger than that of the middle display area, the preset meal distance after adjustment is larger than that before adjustment; when the duty ratio of the lower display area is larger than that of the middle display area, the preset meal distance after adjustment is smaller than the preset meal distance before adjustment.
7. The method of any one of claims 1-3, 5, 6, further comprising: When the object sensor of the dining equipment senses that the dining personnel approaches to the preset distance range of the dining equipment, the image collector and the display of the dining equipment are awakened, wherein the object sensor of the dining equipment comprises a distance sensor and/or an infrared thermal image sensor; And in the meal making process of the meal making person, acquiring the face image of the meal making person in real time based on the image acquisition device, and displaying the acquired face image of the meal making person on the display in real time.
8. An apparatus for intelligently discriminating the end of a meal, the apparatus comprising: The monitoring module is used for monitoring the face on the display of the dining equipment according to the face image of the dining personnel in the dining process of the dining personnel to obtain the face monitoring result of the dining personnel, the face of the dining personnel is displayed on the display in real time in the dining process of the dining personnel, and dishes are placed on the dining equipment and used for being eaten by the dining personnel; The acquisition module is used for acquiring distance data between the dining personnel and the position of the dining equipment based on a distance sensor of the dining equipment when the face monitoring result of the dining personnel is used for indicating that the face image of the dining personnel disappears from the display; and the determining module is used for determining that the dining personnel finishes the dining when the distance data of the dining personnel is used for indicating that the current distance of the dining personnel exceeds the preset dining distance.
9. A dining apparatus, characterized in that it comprises: A memory storing executable program code; A processor coupled to the memory; the processor invokes the executable program code stored in the memory to perform the method of intelligently discriminating the end of a meal as claimed in any one of claims 1 to 7.
10. A computer storage medium storing computer instructions which, when invoked, are operable to perform a method of intelligently discriminating the end of a meal as claimed in any one of claims 1 to 7.

Description

Intelligent judging method and device for meal end and meal equipment Technical Field The invention relates to the technical field of self-service catering service equipment, in particular to an intelligent distinguishing method and device for meal end and meal equipment. Background With the rapid development of the smart catering industry, the self-service meal-making equipment is widely applied to various dining halls and dining places, so that automatic meal-making is realized, and meanwhile, automatic meal-making fee settlement is realized. Therefore, in order to realize accurate settlement of the meal cost, a key link is to accurately judge that the meal of the user is finished. In the prior art, the judging mode of the end of the meal is mainly that when the user finishes the meal, a worker confirms the end of the meal manually or determines that the user finishes the meal when judging that a dinner plate held by the user moves away from an identification area of the meal terminal. However, it is found that, by manually judging the end of the meal, the labor cost is increased, and the judgment delay is easily caused by human negligence, if the equipment is not released in time for the subsequent users to use, or misjudgment is easily caused, if the user who does not end the meal is marked as finished by mistake, the meal is easily judged as the end of the meal by mistake because the meal staff temporarily moves out of the dinner plate in a way of recognizing the end of the meal by the dinner plate, such as adjusting the dish component, so that the settlement is advanced. Therefore, no matter what way, the accuracy of judging the end of the meal of the diner is low. Therefore, a new determining mode for the end of meal delivery is provided, so that the accuracy of determining the end of meal delivery of the meal delivery person is improved, and the technical scheme for improving the settlement accuracy of the meal delivery cost is particularly important. Disclosure of Invention The invention provides an intelligent judging method and device for meal completion and meal completion equipment, which can be combined with a distance sensor and an image collector to accurately determine the meal completion so as to improve the accuracy of meal completion and charging, and simultaneously facilitate meal completion monitoring and meal completion judgment for the next meal person. The first aspect of the invention discloses a method for intelligently judging the end of meal, which comprises the following steps: In the dining process of the dining personnel, monitoring the face on a display of the dining equipment according to the face image of the dining personnel to obtain a face monitoring result of the dining personnel, wherein the face of the dining personnel is displayed on the display in real time in the dining process, and dishes are placed on the dining equipment and are used for being eaten by the dining personnel; When the face monitoring result of the dining personnel is used for representing that the face image of the dining personnel disappears from the display, acquiring distance data between the dining personnel and the position of the dining equipment based on a distance sensor of the dining equipment; and when the distance data of the dining personnel are used for indicating that the current distance of the dining personnel exceeds the preset dining distance, determining that the dining of the dining personnel is finished. As an optional implementation manner, in the first aspect of the present invention, when the face monitoring result of the diner is used to represent that the face image of the diner disappears from the display, the method further includes: monitoring a first duration of disappearance of the facial image of the dining person from the display; When the first duration time is longer than or equal to a first preset time, monitoring the weight change of dishes on the dining equipment to obtain a monitoring result of the weight change of the dishes, wherein the starting time of the first duration time is determined based on the time when the face image of the diner is monitored to disappear from the display; And when the monitored result of the change of the weight of the dishes is used for indicating that the second duration time length of the weight of the dishes on the dining equipment is not changed is longer than or equal to a second preset duration time length, executing the operation of collecting the distance data between the dining personnel and the position of the dining equipment based on the distance sensor of the dining equipment, wherein the starting moment of the second duration time length is determined based on the moment of monitoring the disappearance of the face image of the dining personnel from the display or the moment of monitoring the moment of the first duration time length reaching the first preset duration time length. As an optional implementation mann