EP-4172849-B1 - A SYSTEM AND METHOD FOR PROVIDING ASSISTANCE DURING BOTTLE-FEEDING
Inventors
- JASCHKE, Lena Maria
- SINGHVI, Priyanka
- KOCKX, Franciscus Nicolaas
Dates
- Publication Date
- 20260506
- Application Date
- 20210621
Claims (15)
- An image processor (34) for use in a system for providing assistance during bottle-feeding, comprising: an input for receiving video images of a subject bottle-feeding an infant; an output for providing video images for display, wherein the image processor is adapted to: identify the infant within the video images; determine the orientation of the infant; identify the bottle within the video images; determine the orientation of the bottle; determine a required reorientation of the bottle and/or infant in order to reach a desired bottle orientation; and control one or more devices chosen from the group consisting of: a display device to output reorientation instructions and an audio output device to output reorientation instructions, to assist the subject in reorienting the bottle and/or the infant to achieve the desired bottle and/or infant orientation.
- The image processor (34) of claim 1, further adapted to control the display device to output the reorientation instructions overlaid over the video images.
- The image processor (34) of claim 2, wherein from the group consisting of a display and an audio output device the display device is chosen.
- The image processor (34) of claim 1, further adapted to identify the orientation of the hand of the subject in the images, and determine the orientation of the long axis of the bottle to be perpendicular to the orientation of the palm of the hand.
- The image processor (34) of any one of claims 3 to 4, wherein the desired bottle orientation corresponds to a tilt angle relative to a body axis of the infant within a predefined range.
- The image processor (34) of any one of claims 3 to 5, further adapted to identify the position of the head of the infant and the position of the feeding hand of the subject in the images.
- The image processor (34) of any one of claims 3 to 6, further adapted to identify the pose of the subject in the images.
- A system for providing assistance during bottle-feeding, comprising: a camera (30) for capturing video images of a subject bottle-feeding an infant; the image processor of any one of claims 1 to 7; and one or more devices chosen from the group consisting of: a display (32) for displaying the video images and an audio output device to output reorientation instructions.
- A computer-implemented method for providing assistance during bottle-feeding, comprising: (42) identifying an infant within video images captured of a subject bottle-feeding an infant; (44) determining the orientation of the infant; (46) identifying the bottle within the video images; (48) determining the orientation of the bottle; (50) determining a required reorientation of the bottle and/or infant in order to reach a desired bottle orientation; and (52) outputting reorientation instructions by performing one or more activities chosen from the group consisting of: displaying output reorientation instructions and outputting reorientation instructions using audio signals to assist the subject in reorienting the bottle and/or infant to the desired bottle and/or infant orientation.
- The method of claim 9, wherein the video images are displayed in combination with the reorientation instructions.
- The method of claim 10, wherein from the group consisting of displaying and outputting displaying is chosen.
- The method of claim 11, comprising identifying the orientation of the hand of the subject in the images, and determining the orientation of the long axis of the bottle to be perpendicular to the orientation of the palm of the hand.
- The method of any one of claims 11 to 12, comprising identifying the pose of the subject in the images.
- A computer program product comprising instructions for implementing the method of any one of claims 9 to 13 when said program is run on a processor.
- A computer readable medium comprising the computer program product of claim 14.
Description
FIELD OF THE INVENTION This invention relates to bottle-feeding of an infant (e.g. a baby), and in particular it relates to a system and method for assisting in correctly holding the bottle and/or the infant. BACKGROUND OF THE INVENTION Bottle-feeding an infant is a more complicated process than many may suspect. The angle at which an infant is fed during bottle-feeding is crucial to a feed which is comfortable for the infant and which allows the infant to receive the correct amount of milk. For example, an incorrect feeding technique, such as an incorrect bottle angle, can cause too much air to enter the stomach and in extreme cases can possibly cause choking or loss of breath. The correct feeding technique means that all the milk is administered correctly, with reduced gas and colic, and helps to avoid over feeding and under feeding of the infant. Colic for example is caused by air in the digestive system. Air can enter into a teat region of a feeding bottle if the liquid level within the feeding bottle drops below a certain level and/or the feeding bottle is provided to the infant in a horizontal position. However, a horizontal or near-horizontal feeding position may be preferred (depending on the orientation of the infant) since it may more closely mimic the natural feeding position. Thus, there is a relatively narrow optimum range of angles for the baby bottle (relative to the infant), and this can create difficulties for the mother or other caregiver in achieving a successful feed. WO 2019/167087 A1 and CN 110 339 067 A are examples of systems for providing assistance during bottle feeding. SUMMARY OF THE INVENTION The invention is defined by the claims. According to examples in accordance with an aspect of the invention, there is provided an image processor for use in a system for providing assistance during bottle-feeding, comprising: an input for receiving video images of a subject bottle-feeding an infant;an output for providing video images for display, wherein the image processor is adapted to: identify the infant within the video images;determine the orientation of the infant;identify the bottle within the video images;determine the orientation of the bottle;determine a required reorientation of the bottle and/or infant in order to reach a desired bottle orientation; andcontrol one or more devices chosen from the group consisting of: the display device to output reorientation instructions and an audio output device to output reorientation instructions, to assist the subject in reorienting the bottle and/or the infant to achieve the desired bottle and/or infant orientation. In an embodiment, the image processor is further adapted to control the display device to output the reorientation instructions overlaid over the video images. In an embodiment, the display device is chosen from the group consisting of a display and an audio output device and the image processor is further adapted to control the display device to output the reorientation instructions overlaid over the video images. This image processor performs image analysis to provide real time assistance to a subject (e.g. mother of an infant or other caregiver) during bottle-feeding of an infant. In particular, the processor determines a desired bottle orientation and/or infant orientation, and provides feedback to assist the subject in maintaining the most appropriate bottle angle and/or infant orientation for correctly holding the infant and bottle to achieve a successful feed. The desired bottle angle depends on the orientation of the infant as well as on the angle relative to the horizontal. Thus, the bottle angle and/or the infant or subject orientation may need to be adjusted to achieve a desired relationship. The processor may for example provide instructions only for reorienting the bottle if the infant is in a suitable position for feeding. If the infant position is not suitable, the system may then provide instructions for reorienting the infant, before providing instructions for reorienting the bottle. The reorientation instructions enable the user to be guided throughout the feeding process. The system also keeps the subject engaged by providing positive reinforcement and constant audio and/or visual feedback In the case of hospitals, the system can be used to provide the video images to a remote monitoring station to address the issue of hospital under-staffing, by allowing a remote monitoring of multiple feeding processes by one medical person who reviews the video images. Additionally the medical person can tune the angles to provide optimal feedback in specific cases. The image processor may be adapted to identify the orientation of the hand of the subject in the images, and determine the orientation of the long axis of the bottle as being perpendicular to the orientation of the palm of the hand. Thus, the bottle orientation may be derived from the hand of the subject (since the hand of the subject may obscure the bottle i