BR-102024004334-B1 - Integrated system for preventive, predictive, and reactive monitoring of workplace safety deviations and incidents based on artificial intelligence, mixed reality, sensor fusion, vital and environmental monitoring, including the activation, deactivation, and deceleration of hazardous devices and machines.

BR102024004334B1BR 102024004334 B1BR102024004334 B1BR 102024004334B1BR-102024004334-B1

Abstract

Integrated system for preventive, predictive, and reactive monitoring of workplace safety deviations and incidents based on artificial intelligence, mixed reality, sensor fusion, vital and environmental monitoring, including the activation, deactivation, and deceleration of hazardous devices and machines. Integrated system for preventive, predictive and reactive monitoring of workplace safety deviations and incidents based on artificial intelligence, mixed reality, sensor fusion, vital and environmental monitoring, including the activation, deactivation and deceleration of hazardous devices and machines comprising at least one first workplace environment monitoring device, at least one second workplace environment monitoring device, at least one human-machine interface device, wherein the at least first device comprises at least one component housing, at least one camera, at least one sensor, at least one battery, at least one wireless data transmission unit, at least one data processing unit, wherein the at least second device comprises at least one component housing, at least one connection module for a camera device, at least one sensor, at least one battery, at least one wireless data transmission unit, (...).

Inventors

ANDRÉ SARMENTO BARBOSA
LETÍCIA TAVARES DOS SANTOS
NEWTON SILVA DUARTE
CID RODRIGO BARCELLOS FILHO
GABRIEL ROCHA MARIANO DA SILVA
DIEGO BUSSON DE MORAES

Assignees

ALGR INTELIGÊNCIA DAS COISAS LTDA

Dates

Publication Date: 20260317
Application Date: 20240305

Claims (10)

1. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES characterized by comprising At least one first workplace environment monitoring device (1) At least one second workplace environment monitoring device (2) At least one human-machine interface device wherein the at least first device (1) comprises at least one housing (3) for components at least one camera (4) at least one sensor at least one battery unit at least one wireless data transmission unit at least one data processing unit at least one hole wherein the at least second device (2) comprises at least one housing (6) for components at least one module of connection for camera device (7) at least one sensor at least battery unit at least wireless data transmission unit at least data processing unit at least one hole, wherein the at least one sensor of the at least first device (1) comprises at least one gas sensor positioned inside the housing (3) for components a temperature and humidity sensor positioned inside the housing (3) for components a fall sensor positioned inside the housing (3) for components an oximetry and heart rate sensor positioned on at least one between the temple and the ear of a user, and wherein the at least one sensor of the at least second device (2) comprises four gas sensors a CO2 sensor a humidity and temperature sensor a volatile organic compound sensor a particulate matter sensor a Lida sensor a Radar sensor, and wherein the at least one data processing unit comprises at least one artificial intelligence-based data processing model comprising means for receiving a dataset from at least one of the at least one sensor, the at least one camera (4) and the at least one device with camera (7), means for processing a dataset and detecting working conditions, and means for classifying working conditions; wherein at least one data processing unit additionally comprises means for transmitting the captured data and the processed data to at least one human-machine interface device.
2. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized in that at least one first device (1) additionally comprises means for being coupled to at least one piece of personal protective equipment, in which at least one first device (1) additionally comprises means for being coupled to a helmet, and in which at least one second device (2) additionally comprises means for being coupled to a support device, and in which at least one connection module for a camera device (7) comprises means for connecting at least one mobile phone and a camera device with 360-degree rotation capability. in the horizontal direction and 360 degrees in the vertical direction.
3. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized by further comprising at least one complementary element integrated into at least one of at least one first workplace environment monitoring device (1) and at least one second workplace environment monitoring device (2), wherein the at least one complementary element is selected from flashlight (11), laser pointer (12), panic button, microphone, augmented reality device (13), emergency button (14), emergency siren (15), stereoscopic camera, infrared camera, thermal camera, hyperspectral camera, camera of X-ray, gas sensor, temperature and humidity sensor, accelerometer, gyroscope, oximetry and heart rate sensor, flashlight activation button, laser pointer activation button.
4. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORK SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 3, characterized in that at least one augmented reality device (13) comprises at least one translucent screen and at least one projector, wherein the projection displayed on the screen comprises a set of data relating to the monitored environment, and wherein at least one augmented reality device (13) comprises at least one translucent screen with a size selected between a size corresponding to the frontal field of vision of one human eye and a size corresponding to the frontal field of vision of two human eyes, and wherein at least one augmented reality device (13) comprises additionally at least one gesture detection radar, and wherein at least one augmented reality device (13) is coupled to at least one housing (3) for components of at least one first device (1).
5. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized in that at least one sensor is selected from among gyroscope, accelerometer, oximeter, gas sensor, temperature, humidity, pressure, noise, particle size, biological, chemical, electric field, high voltage, particulate matter, location, radar, Lidar and seismometer, CO2 and volatile organic compounds, Radio Frequency Identification (RFID), barcode, QR Code, Bluetooth, GPS or ultra-wideband (UWB).
6. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized by at least one data processing unit transmitting the captured and processed data to at least one human-machine interface device in real time.
7. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORK SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized in that the first workplace monitoring device (1) further comprises a flashlight (11) positioned on the front face of the housing (3) for components, a laser pointer (12) positioned on one of the side faces of the housing (3) for components, a flashlight activation button positioned on the side face of the housing (3) for components opposite the laser pointer (12), a laser pointer activation button positioned on the side face of the housing (3) for components opposite the laser pointer (12), a button for emergency (14) positioned on the upper face of the housing (3) for components; two stereoscopic cameras positioned, each, on a side face of the housing (3) for components, above or below the drive buttons and laser pointer (12).
8. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORK SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF DANGEROUS DEVICES AND MACHINES, according to claim 1, characterized in that at least one second device (2) additionally comprises an air outlet (16), an emergency button (14), an emergency signal, and two stereoscopic cameras.
9. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORK SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to claim 1, characterized in that at least one second device (2) additionally comprises an air outlet (16) positioned on the side of the housing (6) for components, an emergency button (14) positioned on the top of the housing (6) for components, an emergency signal positioned on the top of the housing (6) for components, two stereoscopic cameras positioned on the top of the housing (6) for components, four gas sensors positioned inside the housing (6) for components, and a CO2 sensor positioned inside the housing. (6) for components a humidity and temperature sensor positioned inside the housing (6) for components a volatile organic compounds sensor positioned inside the housing (6) for components a particulate matter sensor positioned inside the housing (6) for components a Lidar sensor positioned inside the housing (6) for components a Radar sensor positioned inside the housing (6) for components.
10. INTEGRATED SYSTEM FOR PREVENTIVE, PREDICTIVE AND REACTIVE MONITORING OF WORKPLACE SAFETY DEVIATIONS AND INCIDENTS BASED ON ARTIFICIAL INTELLIGENCE, MIXED REALITY, SENSOR FUSION, VITAL AND ENVIRONMENTAL MONITORING, INCLUDING THE ACTIVATION, DEACTIVATION AND DECELERATION OF HAZARDOUS DEVICES AND MACHINES, according to any one of claims 8 or 9, characterized in that at least one particulate matter sensor comprises a sensor capable of detecting particles smaller than 10 micrometers, or smaller than 2.5 micrometers, or smaller than 1.0 micrometers.

Description

Field of Invention [001]. The present invention belongs to the field of systems for monitoring working conditions. More specifically, it refers to an integrated system for preventive, predictive and reactive monitoring of deviations and incidents of workplace safety based on artificial intelligence, mixed reality, sensor fusion, vital and environmental monitoring, including the activation, deactivation and deceleration of hazardous devices and machines. Background of the Invention [002]. Monitoring industrial processes using cameras has become a crucial tool in optimizing the efficiency and safety of operations. In the current state of the art, the cameras used for this purpose have advanced features, including high resolution, real-time image capture capability, and intelligent video analysis functionalities. These cameras are designed to withstand adverse conditions, such as extreme temperatures, corrosive environments, and vibrations, ensuring reliable operation in challenging industrial environments. [003]. One of the most important features of high-end industrial monitoring cameras is their ability to integrate with automation and control systems, allowing for complete and integrated process supervision. In addition, many models offer advanced connectivity, such as Ethernet and Wi-Fi, enabling remote access to real-time process images and data, even from mobile devices. [004]. The recent evolution of cameras for monitoring industrial processes includes significant advances in technologies such as computer vision, machine learning, and image analysis. This allows for automatic fault detection, pattern identification, maintenance prediction, and even automated corrective actions based on advanced algorithms. [005]. Patent document WO2023009551A1 describes an industrial process monitoring system that uses advanced cameras with computer vision and image analysis capabilities. The system integrates with automation and control systems, enabling real-time remote supervision and automatic fault detection, pattern identification, and maintenance forecasting. [006]. Patent document US10643080B2 describes an industrial process monitoring system that uses a combination of sensors and cameras to collect real-time data on operations. [007]. However, prior art documents fail to disclose an optimized and low-cost system in which various sensors are brought together to provide real-time information on working conditions, and to integrate mobile and fixed devices, image data and others, to formulate a complete overview of the monitored environment. Brief Description of the Invention [008]. The present invention solves these and other problems of the art by means of the object defined in the claims. It is a system for preventive, predictive and reactive monitoring of deviations and incidents of safety at work based on artificial intelligence, mixed reality, sensor fusion, vital and environmental monitoring, including the activation, deactivation and deceleration of dangerous devices and machines. [009] One objective of the present invention is to provide computer vision and remote assistance capabilities for workers in industrial sectors where the use of personal protective equipment is necessary. A device of the present invention can be attached to a safety helmet, allowing the transmission of the worker's visual image, sensor data, and real-time conversation. The device may also include a flashlight and laser pointer that can be activated locally and remotely, a panic button, a fall detector via an embedded accelerometer, an oximeter for measuring vital data, and sensors for gas, temperature, humidity, and pressure. Like the camera image and microphone, all sensor data is sent to a smartphone application and then transmitted to the cloud, where AI-powered telemetry applications can analyze, correlate, and present the received data. [0010]. The device of the present invention may include an augmented reality component, including a screen to provide useful information about the work environment, superimposed on the camera image. [0011] Another objective of the present invention is to enable the monitoring of a work environment in industry or similar settings, through robust, mobile hardware fixed to a support. In a device of the present invention, a camera monitors the work environment and the operator in real time, transmitting the video to the cloud and to remote employees. The device also has an emergency button, emergency siren, and up to four different gas sensors, as well as temperature, humidity, and pressure sensors. Like the camera image, all sensor data is transmitted to the cloud, where AI-powered telemetry applications can analyze, correlate, and present the received data. [0012]. Other sensors may be included such as sensors to detect tremors (or micro-tremors) that would not be felt by workers but could indicate possible earthquakes, landslides and collapses, as well as sensors to detect electric fields, to