US-12616401-B2 - Psychological state display system

Abstract

A psychological state display system includes a near-infrared light source that outputs outside light toward a plurality of persons, the output light including a first near-infrared radiation having a wavelength of greater than or equal to 780 nm and less than 2,500 nm; an imaging device that receives the first near-infrared radiation included in the output light outputted and captures an infrared image of the plurality of persons; a generation device that, using a trained machine learning model that receives an input of the infrared image captured and outputs a psychological state of at least one person among the plurality of persons indicated by the infrared image, generates psychological data indicating the psychological state; and a display device that displays a change over time in the psychological data generated.

Inventors

• Shozo Oshio
• Mitsuru Nitta
• Ryosuke Shigitani
• AKIKO TAKIMOTO
• Hiroshi Maruyama

Assignees

• PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.

Dates

Publication Date

20260505

Application Date

20230324

Priority Date

20220418

Claims (20)

1. 1 . A psychological state display system comprising: a near-infrared light source that outputs output light toward a plurality of persons, the output light including a first near-infrared radiation having a wavelength of greater than or equal to 780 nm and less than 2,500 nm and an output of greater than or equal to 10 W and smaller than or equal to 3 KW; an imaging device that receives the first near-infrared radiation included in the output light outputted and captures an infrared image of the plurality of persons; a generation device that, using a trained machine learning model that receives an input of the infrared image captured and outputs a psychological state of at least one person among the plurality of persons indicated by the infrared image, generates psychological data indicating the psychological state; and a display device that displays a change over time in the psychological data generated.
2. 2 . The psychological state display system according to claim 1 , wherein the first near-infrared radiation has a peak wavelength in a range of wavelengths greater than or equal to 780 nm and less than 2,500 nm.
3. 3 . The psychological state display system according to claim 1 , wherein the near-infrared light source includes a first solid-state light emitting element that outputs the first near-infrared radiation.
4. 4 . The psychological state display system according to claim 1 , wherein the near-infrared light source includes: a second solid-state light emitting element that outputs excitation light; and a phosphor member that, based on the excitation light outputted, outputs wavelength-converted light as the first near-infrared radiation.
5. 5 . The psychological state display system according to claim 1 , wherein the output light includes visible light.
6. 6 . The psychological state display system according to claim 5 , wherein the near-infrared light source: controls the first near-infrared radiation and the visible light independently of each other; and controls at least one of on/off or dimming of each of the first near-infrared radiation and the visible light.
7. 7 . The psychological state display system according to claim 1 , wherein a received light signal intensity obtained as the imaging device receives the first near-infrared radiation reflected by the plurality of persons while the output light including the first near-infrared radiation is being outputted is a first received light signal intensity, a second near-infrared radiation different from the first near-infrared radiation is emitted toward the plurality of persons while the output light including the first near-infrared radiation is not being outputted, the second near-infrared radiation is a near-infrared radiation outputted from a light source different from the near-infrared light source, a received light signal intensity obtained as the imaging device receives the second near-infrared radiation reflected by the plurality of persons is a second received light signal intensity, and a minimum value of the first received light signal intensity is greater than a maximum value of the second received light signal intensity.
8. 8 . The psychological state display system according to claim 1 , wherein the near-infrared light source outputs the output light toward at least one person among the plurality of persons from a direction other than a forward direction that a head of the at least one person faces.
9. 9 . The psychological state display system according to claim 8 , wherein an area of an irradiation target region to be irradiated with the first near-infrared radiation is greater than or equal to 10 m 2 and less than 10,000 m 2 .
10. 10 . The psychological state display system according to claim 8 , wherein a distance between the near-infrared light source and a person, among the plurality of persons, who is located closest to the near-infrared light source is greater than or equal to 50 cm and less than 30 m.
11. 11 . The psychological state display system according to claim 8 , wherein when the near-infrared light source is viewed in a vertical direction, a divergence angle of the near-infrared radiation in a horizontal direction is greater than or equal to 30° and smaller than or equal to 180°.
12. 12 . The psychological state display system according to claim 1 , wherein the generation device determines a stimulus to be provided to the plurality of persons, based on the psychological data generated.
13. 13 . The psychological state display system according to claim 12 , further comprising: a control device that controls a stimulus device that provides the stimulus to the plurality of persons, wherein the control device controls the stimulus device to provide the stimulus determined to the plurality of persons.
14. 14 . The psychological state display system according to claim 13 , further comprising: the stimulus device, wherein the control device controls the stimulus device to provide the stimulus determined to at least one or more of the plurality of persons.
15. 15 . The psychological state display system according to claim 13 , wherein the stimulus determined is a stimulus that acts on at least one of vision, hearing, smell, and touch of the plurality of persons.
16. 16 . The psychological state display system according to claim 13 , wherein the control device controls the stimulus device to shut off or reduce the stimulus provided to the plurality of persons.
17. 17 . The psychological state display system according to claim 12 , wherein when the psychological data generated indicates that the psychological state of one or more persons among the plurality of persons is a predetermined psychological state, the generation device determines a stimulus to be provided to the one or more persons, based on the predetermined psychological state.
18. 18 . The psychological state display system according to claim 14 , wherein the stimulus device is the near-infrared light source that outputs the output light including visible light.
19. 19 . The psychological state display system according to claim 1 , wherein the imaging device captures the infrared image that includes blood vessel information regarding vasoconstriction of each of the plurality of persons, based on the blood vessel information included in the infrared image captured, the generation device generates vitals information indicating a vital sign of at least one person among the plurality of persons, and the display device displays the vitals information generated.
20. 20 . The psychological state display system according to claim 1 , wherein the near-infrared light source and the imaging device are installed in an entertainment space, a public space, or a learning space.

Description

TECHNICAL FIELD The present invention relates to a psychological state display system. BACKGROUND ART In recent years, there have been known technologies for estimating a psychological state (an emotion) or the like of a person from an image capturing that person. For example, Patent Literature (PTL) 1 discloses a system (a facial expression estimating device) that, based on the facial expressions and the movements of a person indicated by an image of that person, estimates a facial expression suitable for that person's psychological state and emotion. CITATION LIST Patent Literature PTL 1 Japanese Unexamined Patent Application Publication No. 2014-206903 SUMMARY OF INVENTION Technical Problem Incidentally, the system disclosed in PTL 1 reveals only the temporary psychological state of the person included in the image. It is often the case that the psychological state of a human (a person) changes as the time elapses, and there is a desire to visualize this change. Accordingly, the present invention is directed to providing a psychological state display system that can visualize a change in the psychological state of a person under the condition where the influence of illumination light is minimized. Solution to Problem A psychological state display system according to one aspect of the present invention includes: a near-infrared light source that outputs output light toward a plurality of persons, the output light including a first near-infrared radiation having a wavelength of greater than or equal to 780 nm and less than 2,500 nm; an imaging device that receives the first near-infrared radiation included in the output light outputted and captures an infrared image of the plurality of persons; a generation device that, using a trained machine learning model that receives an input of the infrared image captured and outputs a psychological state of at least one person among the plurality of persons indicated by the infrared image, generates psychological data indicating the psychological state; and a display device that displays a change over time in the psychological data generated. Advantageous Effects of Invention The psychological state display system according to the present invention can visualize a change in the psychological state of a person under the condition where the influence of illumination light is minimized. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a diagram showing a configuration of a psychological state display system according to an embodiment. FIG. 2 is a block diagram showing a characteristic functional configuration of a psychological state display system according to an embodiment. FIG. 3 is a schematic diagram of a near-infrared light source and a person according to an embodiment, as they are viewed in the vertical direction. FIG. 4 is a schematic diagram of the near-infrared light source and the person shown in FIG. 3, as they are viewed from the side. FIG. 5 is a flowchart showing a processing procedure through which a psychological state display system according to an embodiment trains a machine learning model. FIG. 6 is a flowchart showing a processing procedure through which a psychological state display system according to an embodiment visualizes a psychological state of a person. FIG. 7 is a diagram showing an infrared image captured by an imaging device according to an embodiment. FIG. 8 shows one example of psychological data that is based on the infrared image shown in FIG. 7. FIG. 9 shows another example of psychological data that is based on the infrared image shown in FIG. 7. FIG. 10 shows yet another example of psychological data according to an embodiment. FIG. 11 is a block diagram showing a characteristic functional configuration of a psychological state display system according to a variation of an embodiment. DESCRIPTION OF EMBODIMENTS Hereinafter, some embodiments will be described in specific terms with reference to the drawings. The embodiments described below merely illustrate general or specific examples. The numerical values, the shapes, the materials, the constituent elements, the arrangement positions and the connection modes of the constituent elements, the steps, the orders of the steps, and so on illustrated in the following embodiment are examples and are not intended to limit the present invention. Among the constituent elements described in the following embodiments, any constituent elements that are not cited in the independent claims are to be construed as optional constituent elements. The drawings are schematic diagrams and do not necessarily provide the exact depiction. In the drawings, substantially identical configurations are given identical reference characters, and duplicate description thereof may be omitted or simplified. Embodiment Configuration of Psychological State Display System A configuration of psychological state display system 1 according to the present embodiment will be described. FIG. 1 is a diagram showing a configuration