RU-2022126486-A - SYSTEM OF SOCIAL AND PSYCHOLOGICAL MONITORING OF A HUMAN

Inventors

• Заречная Ольга Юрьевна
• Молянов Павел Валерьевич
• Сичинава Зураби Иродиевич
• Бражкин Сергей Александрович

Assignees

• ОБЩЕСТВО С ОГРАНИЧЕННОЙ ОТВЕТСТВЕННОСТЬЮ "НЬЮВИЖИН-ЭМОЦИИ"

Dates

Publication Date

20260508

Application Date

20200313

Claims (19)

1. 1. A system of psychological monitoring of a person, including:
2. an image capture unit capable of capturing video images;
3. a face recognition unit capable of identifying and recognizing faces in a video stream;
4. an emotion detection unit capable of detecting a person's emotions and their intensity based on a captured video stream;
5. an analysis unit capable of analyzing the said specific emotions of a person and their intensity over a predetermined period of time to determine his psycho-emotional state.
6. 2. A system for psychological monitoring of a person according to paragraph 1, in which the face recognition unit is configured to recognize faces by comparing faces selected in the video stream with reference photographs loaded into the database.
7. 3. A system for psychological monitoring of a person according to paragraph 2, in which the said database is a face descriptor database (FDB), and the face recognition unit is configured to convert images of a person’s face to represent them in the form of numerical face descriptors and to compare the said numerical face descriptors with the descriptors stored in the FDB.
8. 4. The human psychological monitoring system according to paragraph 1, additionally containing a reporting unit configured to receive data from the analysis unit and generate reports on the dynamics and reasons for changes in human emotions, their intensity, and the general psycho-emotional state of the human over certain time intervals.
9. 5. The human psychological monitoring system according to paragraph 1, additionally containing a notification unit configured to receive data from the analysis unit and notify the operator of the psychological monitoring system about the psycho-emotional state of the person being monitored.
10. 6. A human psychological monitoring system according to any one of paragraphs 1-5, in which at least one of the face recognition unit, the emotion detection unit and the analysis unit is implemented on the basis of a self-learning artificial neural network (ANN) or a convolutional neural network (CNN).
11. 7. A human psychological monitoring system according to paragraph 6, in which all three of the face recognition unit, emotion detection unit and analysis unit are implemented on the basis of neural networks.
12. 8. A human psychological monitoring system according to paragraph 1, in which the analysis unit is designed with the ability to analyze human emotional reactions associated with an event localized on an object and in time, and to determine said event as the cause of these reactions.
13. 9. A human psychological monitoring system according to paragraph 1, in which the face recognition unit and the emotion detection unit are implemented as a local video stream pre-processing server.
14. 10. A method for psychological monitoring of a person, carried out by means of a system for psychological monitoring of a person according to any of paragraphs 1-9, comprising the steps of:
15. capture video images;
16. identify and recognize faces in a video stream;
17. determine a person’s emotions and their intensity;
18. analyze the aforementioned specific emotions of a person and their intensity over a predetermined period of time to determine his psycho-emotional state.
19. 11. A computer-readable data carrier containing a program stored thereon which, when executed by a computer, implements the method for psychological monitoring of a person according to paragraph 10.