EP-4736747-A1 - METHODS AND SYSTEMS FOR DETECTING OXYGEN SATURATION FROM A CAMERA

Abstract

A system for predicting a characteristic of a neonate, the system including a ballistographic monitoring device configured to measure movement of the neonate and create a ballistographic signal from the measured movement, a vital measurement device configured to measure a vitals measurement of the neonate and create a vital signal from the vitals measurement, a camera configured to capture an image of the neonate and create a camera signal from the image, a memory including instructions, and at least one processor to execute the instructions to extract a first feature from the ballistographic signal, extract a second feature from the vital signal, extract a third feature from the camera signal, process the first feature, the second feature, and the third feature using a learning model trained to generate a prediction for a characteristic of the neonate, and display the prediction from the learning model on a user interface.

Inventors

• KHAIR, MOHAMMAD
• MANICKAM, Kalaivani
• FALK, STEVEN M.
• KAVOORI SETHUMADHAVAN, NAGAPRIYA
• NAIK, RAJENDRA

Assignees

• GE Precision Healthcare LLC

Dates

Publication Date

20260506

Application Date

20251007

Claims (9)

1. A system for predicting a characteristic of a neonate comprising: a ballistographic monitoring device configured to measure movement of the neonate and create a ballistographic signal from the measured movement; a vital measurement device configured to measure a vitals measurement of the neonate and create a vital signal from the vitals measurement; a camera configured to capture an image of the neonate and create a camera signal from the image; a memory including instructions; and at least one processor to execute the instructions to: extract a first feature from the ballistographic signal; extract a second feature from the vital signal; extract a third feature from the camera signal; process the first feature, the second feature, and the third feature using a learning model trained to generate a prediction for a characteristic of the neonate; and display the prediction from the learning model on a user interface.
2. The system of claim 1, wherein the first extracted features, the second extracted features, and the third extracted features include the heart rate of the neonate, the breathing rate of the neonate, or the movement pattern of the neonate, the oxygenation level of the neonate, or the oxygen absorption value of the neonate.
3. The system of claim 1, wherein the prediction includes sepsis, meningitis, hypoxemia, radiologically proven pneumonia, or early infantile cerebral palsy.
4. The system of claim 1, wherein the processor is further configured to: process the first feature, the second feature, and the third feature using the learning model trained to generate a score indicating a severity of the prediction; display the score from the learning model on the user interface.
5. The system of claim 1, wherein the image defines an infrared (IR) image and a red image.
6. The system of claim 5, wherein the extracting the third feature comprises: creating a first red plethysmograph waveform from a red image; creating a second infrared (IR) plethysmograph waveform from an infrared (IR) image; calculating the third feature using the first red plethysmograph waveform and the second IR plethysmograph waveform.
7. The system of claim 5, wherein the red image and the IR image comprise imaging data obtained from one or more regions of skin of the patient.
8. The system of claim 1, wherein the vital measurement device defines a heart rate monitor, a blood pressure monitor, a pulse oximeter, a temperature probe, or a respiratory ventilator.
9. The system of claim 1, wherein the learning model is a machine learning model trained on historical and patient data.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation-in-part of and claims priority to U.S. Patent Application No. 17/957,668, U.S. Patent Application No. 17/957,535, and U.S. Patent Application No. 17/957,370, the entire contents of which is hereby incorporated by reference. BACKGROUND The present disclosure generally relates to infant care stations, and more specifically to detecting oxygen saturation from a camera. Some neonates are not physiologically well enough developed to be able to survive without special medical attention. A frequently used medical aid for such infants is the incubator. The primary objective of the incubator is to provide an environment which will maintain the neonate at a minimum metabolic state thereby permitting as rapid physiological development as possible. Neonatal incubators create a microenvironment that is thermally neutral where a neonate can develop. These incubators typically include a humidifier and a heater and associated control system that controls the humidity and temperature in the neonatal microenvironment. The humidifier comprises a device that evaporates an evaporant, such as distilled water, to increase relative humidity of air within the neonatal microenvironment. The humidifier is typically controllable such that the amount of water, or water vapor, added to the microenvironment is adjustable in order to control the humidity to a desired value. The heater may be, for example, an air heater controllable to maintain the microenvironment area to a certain temperature. Radiant warmers may be used instead of incubators for some neonates where less environmental control is required. In still other embodiments, hybrid incubator/radiant warming systems may be utilized. Since the microenvironment is accurately controlled in a neonatal care system, the care system includes an enclosure that is sealed as best possible to help maintain the controlled microenvironment. Such an enclosure will typically include four sidewalls or side panels and a top hood that surround an infant support platform. Typically, one or more of the side panels can include access points, such as porthole doors, and a removable top, among others, that enable clinicians to access neonates in the microenvironment. In some examples, detecting a patient's oxygen saturation level, heart rate, respiratory rate, and the like, may involve accessing the patient through an access point. SUMMARY This summary is provided to introduce a selection of concepts that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in limiting the scope of the claimed subject matter. An infant care station can include a camera and a processor to obtain the video data from the camera for a patient, generate a point cloud based on the video data, train, using the point cloud as input, a first set of artificial intelligence instructions to detect one or more neonatal patient characteristics, and generate an output representing the one or more patient characteristics based on the first set of artificial intelligence instructions. In some examples, the invention includes a system for predicting a characteristic of a neonate, the system including a ballistographic monitoring device configured to measure movement of the neonate and create a ballistographic signal from the measured movement, a vital measurement device configured to measure a vitals measurement of the neonate and create a vital signal from the vitals measurement, a camera configured to capture an image of the neonate and create a camera signal from the image, a memory including instructions, and at least one processor to execute the instructions to extract a first feature from the ballistographic signal, extract a second feature from the vital signal, extract a third feature from the camera signal, process the first feature, the second feature, and the third feature using a learning model trained to generate a prediction for a characteristic of the neonate, and display the prediction from the learning model on a user interface. A system for predicting a characteristic of a neonate including a ballistographic monitoring device configured to measure movement of the neonate and create a ballistographic signal from the measured movement, a vital measurement device configured to measure a vitals measurement of the neonate and create a vital signal from the vitals measurement, a camera configured to capture an image of the neonate and create a camera signal from the image, a memory including instructions, and at least one processor to execute the instructions to obtain the ballistographic signal from the ballistographic monitoring device, obtain the vital signal from the vital measurement device, obtain the camera signal from the camera, process the ballistographic signal, the vital signal, and the camera signal