EP-3883236-B1 - INFORMATION PROCESSING APPARATUS, IMAGING APPARATUS, METHOD, AND STORAGE MEDIUM
Inventors
- DOBASHI, TOSHIYUKI
- YAMAMOTO, KEIICHI
- OHTA, SEIYA
- CHINO, SHUNSUKE
Dates
- Publication Date
- 20260506
- Application Date
- 20210305
Claims (13)
- An information processing apparatus, comprising: an acquisition means (403) configured to acquire a captured moving image with a current camera exposure from a monitoring camera (101); a face detection means (406) configured to perform a first face detection processing (S501) on the moving image; a human body detection means (406) configured to perform human body detection processing (S503) on the moving image in a case where a face area is not detected by the first face detection processing (S501); a first exposure determination means (407) configured to determine exposure (S507) based on luminance of a human body area detected by the human body detection processing (S503) in a case where the human body area is detected as a first exposure target value, or determine exposure based on luminance of a face area detected by the first face detection processing (S501) in a case where the face area is detected as a second exposure target value and set the determined exposure value to the monitoring camera (S510), wherein the face detection means (406) performs a second face detection processing (S511) on an image captured at the exposure determined by the first exposure determination means (407); a second exposure determination means (407) controls the monitoring camera (101) to maintain the exposure until a predetermined condition is satisfied in a case where a face area is detected by the second face detection processing (S511) and, in a case where a face area is not detected by the second face detection processing (S511), perform exposure control of the monitoring camera with the camera exposure with which the captured moving image was acquired before performing the first face image detection (S514); and the predetermined condition includes that, after the exposure is determined by the first exposure determination means (407), a human body area is detected again by the human body detection means (406) or a face area is detected again by the face detection means (406) and an exposure target value is newly set.
- The information processing apparatus according to claim 1, wherein the second exposure determination means (407) is configured to, when a predetermined time passes in a state where neither a face area nor a human body area is detected after maintenance of the exposure is started, cancel the maintenance of the exposure and newly determine exposure based on luminance of a predetermined area of the captured image.
- The information processing apparatus according to claim 2, further comprising: a storage means configured to store average luminance of the predetermined area of the image as a reference value in a case where neither a face area nor a human body area is detected by the face detection means (406) or the human body detection means (406) after the second exposure determination means (407) starts maintenance of the exposure; and a calculation means configured to calculate a difference value between current average luminance of the predetermined area and the reference value in a case where, after the storage means stores the reference value, neither a face area nor a human body area is detected by the face detection means or the human body detection means again, wherein the second exposure determination means is configured to, in a case where the difference value calculated by the calculation means is greater than or equal to a threshold, cancel the maintenance of the exposure and newly determine exposure based on luminance of the predetermined area of the captured image.
- The information processing apparatus according to claim 2 or 3, wherein the predetermined area is an entire area of the captured image.
- The information processing apparatus according to claim 2 or 3, wherein the predetermined area is an area near a center of the captured image.
- The information processing apparatus according to any one of the preceding claims, wherein the first exposure determination means (407) is configured to determine the exposure so that a difference between the luminance of the human body area detected by the human body detection means (406) and target luminance falls within a predetermined range.
- The information processing apparatus according to any one of the preceding claims, wherein the second exposure determination means (407) is configured to determine the exposure so that a difference between the luminance of the face area detected by the face detection means (406) and target luminance falls within a predetermined range.
- The information processing apparatus according to any one of the preceding claims, wherein the human body area is any of a whole body, an upper body, a bust, and a head area including a face.
- The information processing apparatus according to any one of the preceding claims, further comprising the monitoring camera (101).
- The information processing apparatus according to any one of the preceding claims, wherein the second exposure determination means (407) is further configured to determine whether face confirmation processing is valid, wherein, in a case where the face confirmation processing is valid, the second face detection processing (S511) is performed, wherein, in a case where the face confirmation processing is not valid, the second face detection processing (S511) is not performed and the exposure is maintained irrespective of presence/absence of a face detection.
- A method comprising: acquiring a captured moving image with a current camera exposure from a monitoring camera (101); performing a first face detection processing (S501) on the moving image; performing a human body detection processing (S503) on the moving image in a case where a face area is not detected by the first face detection processing (S501); determining exposure based on luminance of a detected human body area detected by the human body detection processing (S503) in a case where the human body area is detected as a first exposure target value, or determining exposure based on luminance of a face area detected by the first face detection processing (S501) in a case where the face area is detected as a second exposure target value; setting the determined exposure value to the monitoring camera (S510); performing a second face detection processing (S511) on an image captured at the determined exposure; and controlling the monitoring camera (101) to maintain (S513) the exposure until a predetermined condition is satisfied in a case where a face area is detected by the second face detection processing (S511) and, in a case where a face area is not detected by the second face detection processing (S511), performing exposure control of the monitoring camera with the camera exposure with which the captured moving image was acquired before performing the first face image detection (S514), wherein the predetermined condition includes that, after the exposure is determined, a human body area is detected again or a face area is detected again and an exposure target value is newly set.
- The method according to claim 11, wherein, when a predetermined time passes in a state where neither a face area nor a human body area is detected after maintenance of the exposure is started, the maintenance of the exposure is canceled, and exposure is newly determined based on luminance of a predetermined area of the captured image.
- A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method according to claim 11 or 12.
Description
BACKGROUND Field of the Disclosure The present invention relates to an information processing apparatus, an imaging apparatus, a method, and a storage medium. Description of the Related Art A technology that detects a face area of an object from a captured image and adjusts image quality of the captured image based on information about the face area has been known (see Japanese Patent Application Laid-Open No. 2017-092544). JP2015130615 discloses a method of exposure compensation, in which a first image is taken at an exposure based on the body of a subject, and then an exposure is determined based on the face and a second image is taken. SUMMARY OF THE DISCLOSURE The present invention in its one aspect provides an information processing apparatus as specified in claims 1 to 10. The present invention in its one aspect provides a method as specified in claims 11 and 12. The present invention in its one aspect provides a storage medium as specified in claim 13. Further features of the present invention will become apparent from the following description of embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram illustrating a configuration of an imaging control system according to a first embodiment of the present invention.Fig. 2 is a block diagram illustrating an internal configuration of a monitoring camera according to the first embodiment.Fig. 3 is a block diagram illustrating an internal configuration of a client apparatus according to the first embodiment.Fig. 4 is a diagram illustrating functions and configurations performed by the client apparatus.Fig. 5 is a flowchart illustrating exposure control processing according to the first embodiment.Fig. 6 is a flowchart illustrating exposure control processing according to a second embodiment.Figs. 7A and 7B are diagrams respectively illustrating a face detection area and a human body detection area.Figs. 8A and 8B are a flowchart illustrating exposure control processing according to a third embodiment.Fig. 9 is a flowchart illustrating exposure control processing according to a fourth embodiment. DESCRIPTION OF THE EMBODIMENTS Embodiments of the present invention are described in detail below with reference to the drawings. The following embodiments do not limit the present invention, and all of combinations of features described in the embodiments are not necessarily essential for solving means of the present invention. Configurations of the embodiments can be appropriately corrected or modified depending on a specification of an apparatus to which the present invention is applied and various kinds of conditions (use condition, use environment, etc.). The technical scope of the present invention is defined by claims and is not limited by the following individual embodiments. Further, parts of the embodiments described below may be appropriately combined with one another. One or more of functional blocks illustrated in the drawings described below may be implemented by hardware such as an application specific integrated circuit (ASIC) and a programmable logic array (PLA), or may be implemented through execution of software by a programmable processor such as a central processing unit (CPU) and a micro processing unit (MPU). Further, one or more of the functional blocks may be implemented by a combination of software and hardware. Thus, in the following description, even in a case where different functional blocks are described as main executors of operation, the functional blocks can be implemented by the same hardware as the main executor. First Embodiment (Basic Configuration) Fig. 1 is a diagram illustrating a configuration of an imaging control system 100 according to a first embodiment of the present invention. The imaging control system 100 includes a monitoring camera 101, a network 102, a client apparatus 103, an input device 104, and a display device 105. The monitoring camera 101 is an imaging apparatus that acquires a moving image and can perform imaging of an object and image processing. The monitoring camera 101 and the client apparatus 103 are communicably connected to each other via the network 102. The client apparatus 103 is communicably connected with the input device 104 and the display device 105. The client apparatus 103 is an apparatus that processes various information (information processing apparatus). The client apparatus 103 also functions as an imaging control apparatus that controls imaging by the monitoring camera 101. The input device 104 includes a mouse and/or a keyboard, and is operated by a user of the client apparatus 103. The display device 105 is a device including a monitor that displays an image received from the client apparatus 103. The display device 105 can also function as a user interface (UI) such as a touch panel. In this case, the display device 105 also functions as an input device for inputting an instruction, information, data, etc. to the client a