Search

CN-121999471-A - Occupant monitoring method, apparatus, device, storage medium, and program product

CN121999471ACN 121999471 ACN121999471 ACN 121999471ACN-121999471-A

Abstract

The present disclosure relates to an occupant monitoring method, apparatus, device, storage medium, and program product. The occupant monitoring method comprises the steps of obtaining a monitoring image from a camera and a sensing signal from a sensor different from the camera, comparing a first number of occupants in the monitoring image with a second number of occupants determined according to the sensing signal, controlling a shooting range of the camera until the first number of the occupants in the monitoring image is greater than or equal to the second number under the condition that the first number is smaller than the second number, and controlling the shooting range of the camera according to the position of the first number of the occupants in the monitoring image under the condition that the first number is greater than or equal to the second number so that the first number of the occupants in the monitoring image is in a preset range of the monitoring image.

Inventors

  • WANG HONG
  • LI CHUANG
  • LU CHENGLONG
  • HU WENTAO

Assignees

  • 延锋国际汽车技术有限公司

Dates

Publication Date
20260508
Application Date
20260410

Claims (16)

  1. 1. An occupant monitoring method, characterized by comprising: acquiring a monitoring image from a camera and a sensing signal from a sensor different from the camera; comparing a first number of occupants within the monitoring image with a second number of occupants determined from the sensing signal; Controlling the shooting range of the camera until the first number of passengers in the monitoring image is larger than or equal to the second number under the condition that the first number is smaller than the second number, and And under the condition that the first number is greater than or equal to the second number, controlling the shooting range of the camera according to the positions of the first number of passengers in the monitoring image so as to enable the first number of passengers in the monitoring image to be in the preset range of the monitoring image.
  2. 2. The occupant monitoring method according to claim 1, wherein acquiring a monitoring image from a camera and a sensing signal from a sensor different from the camera includes: and acquiring the monitoring image and the sensing signal in response to the camera operating in a follow-up mode.
  3. 3. The occupant monitoring method according to claim 2, characterized in that the occupant monitoring method further comprises: responsive to determining that the position of the occupant is subject to a change in accordance with the sensing signal, initiating a follow-up mode of the camera; responsive to detecting a change in seat orientation and/or back angle, a follow-up mode of the camera is activated, or Responsive to receiving a command signal to change the seat layout, orientation, and/or back angle, a follower mode of the camera is initiated.
  4. 4. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera until the first number of occupants within the monitored image is greater than or equal to the second number, if the first number is smaller than the second number, comprises: Determining a first side in a first direction and a second side facing away from the first side from the sensing signal, wherein more occupants are distributed in the cabin on the first side than on the second side; Controlling the shooting range of the camera to move towards the first side in the first direction until the first number of passengers in the monitoring image is greater than or equal to the second number or the shooting range of the camera reaches the end position of the first side; And controlling the shooting range of the camera to move towards the second side in the first direction until the first number of passengers in the monitoring image is greater than or equal to the second number under the condition that the shooting range of the camera reaches the end position of the first side.
  5. 5. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera so that the first number of occupants in the monitor image is within the preset range of the monitor image in accordance with the positions of the first number of occupants in the monitor image in the case where the first number is greater than or equal to the second number includes: Determining a center of a smallest rectangular area within the monitoring image containing heads of a first number of occupants and a center of the monitoring image; Calculating an angle by which the camera rotates, wherein the angle is such that a distance between a center of the minimum rectangular area and a center of the monitoring image is less than or equal to a preset threshold value, and And controlling the camera to rotate according to the angle.
  6. 6. The occupant monitoring method according to claim 5, wherein an angle at which a camera rotates in a second direction is determined based on a field angle of the camera in the second direction, a distance between a center of the minimum rectangular area in the second direction and a center of the monitoring image, and a length of the monitoring image in the second direction.
  7. 7. The occupant monitoring method according to claim 6, wherein, in the case where the first number is one, an angle θ x by which the camera rotates in the second direction satisfies θ x =-θ L ×x/L or satisfies tan (θ x )=-tan(θ L /2) × (2 x)/L, where θ L is a field angle of the camera in the second direction, x is a value obtained by subtracting a coordinate of a center of the head of the occupant in the second direction from a coordinate of a center of the monitoring image in the second direction, and L is a length of the monitoring image in the second direction; In the case where the first number is two, an angle θ x by which the camera rotates in the second direction satisfies θ x =-θ L /2×(x 1 +x 2 )/L or satisfies tan (θ x )=-tan(θ L /2)×(x 1 +x 2 )/L, where θ L is a field angle of the camera in the second direction, x 1 and x 2 are values obtained by subtracting coordinates of centers of heads of two occupants in the second direction from coordinates of centers of the monitor image in the second direction, L is a length of the monitor image in the second direction, or In the case where the first number is three or more, an angle θ x by which the camera rotates in the second direction satisfies θ x =-θ L /2×(x min +x max )/L or satisfies tan (θ x )=-tan(θ L /2)×(x min +x max )/L, where θ L is a field angle of the camera in the second direction, x min is a minimum value of a value obtained by subtracting a coordinate of a center of a head of each occupant in the second direction from a coordinate of a center of the monitoring image in the second direction, x max is a maximum value of a value obtained by subtracting a coordinate of a center of the head of each occupant in the second direction from a coordinate of a center of the monitoring image in the second direction, and L is a length of the monitoring image in the second direction.
  8. 8. The occupant monitoring method of claim 6 wherein the second direction includes a third direction and a fourth direction perpendicular to each other; Calculating the rotation angle of the camera comprises calculating a first rotation angle of the camera along a third direction, wherein the first rotation angle enables the distance between the center of the minimum rectangular area and the projection of the center of the monitoring image in the third direction to be smaller than or equal to a first threshold value; Controlling the camera to rotate according to the angle comprises controlling the camera to rotate along the third direction by the first angle; calculating the angle of rotation of the camera further comprises calculating a second angle of rotation of the camera in a fourth direction, wherein the second angle is such that a distance between a center of the minimum rectangular area and a projection of a center of the monitoring image in the fourth direction is less than or equal to a second threshold; Controlling the camera to rotate according to the angle further comprises controlling the camera to rotate along the fourth direction by the second angle so that the distance between the center of the minimum rectangular area and the center of the monitoring image is smaller than or equal to a preset threshold value.
  9. 9. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera so that the first number of occupants in the monitor image is within the preset range of the monitor image in accordance with the positions of the first number of occupants in the monitor image in the case where the first number is greater than or equal to the second number includes: calculating the rotation angle of the camera according to the distance between the center of the minimum rectangular area containing the heads of the first number of passengers in the current monitoring image and the center of the current monitoring image; Controlling the camera to rotate according to the angle; ending the rotation when the distance between the center of the minimum rectangular area in the current monitoring image and the center of the current monitoring image is smaller than or equal to a preset threshold value; And returning to an operation of calculating the rotation angle of the camera according to the distance between the center of the smallest rectangular area containing the heads of the first number of passengers in the current monitoring image and the center of the current monitoring image under the condition that the distance between the center of the smallest rectangular area in the current monitoring image and the center of the current monitoring image is larger than a preset threshold value.
  10. 10. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera so that the first number of occupants in the monitor image is within the preset range of the monitor image in accordance with the positions of the first number of occupants in the monitor image in the case where the first number is greater than or equal to the second number includes: rotating the camera to a plurality of angles and shooting corresponding monitoring images at each angle respectively; obtaining a first score from the head features of each occupant in each of the monitored images in one or more feature dimensions, wherein the one or more feature dimensions include at least one of an area of the head in the monitored image, a head angle, a position of the head in the monitored image, and a face feature quantity; Determining a second score from the first score, occupant weight, and feature weight; and rotating the camera according to the second fraction corresponding to each angle.
  11. 11. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera so that the first number of occupants in the monitor image is within the preset range of the monitor image in accordance with the positions of the first number of occupants in the monitor image in the case where the first number is greater than or equal to the second number includes: Determining a cabin mode corresponding to a seat orientation within a current cabin; determining an angle according to a cabin mode, wherein the angle is such that a first number of occupants within the monitoring image are within a preset range of the monitoring image, and And controlling the camera to rotate according to the angle.
  12. 12. The occupant monitoring method according to claim 1, wherein controlling the photographing range of the camera so that the first number of occupants in the monitor image is within the preset range of the monitor image in accordance with the positions of the first number of occupants in the monitor image in the case where the first number is greater than or equal to the second number includes: Determining a position of a center of a head of each occupant based on a cabin parameter of a seat of each occupant including one or more of a seat position, a seat height, and a headrest height and a preset mannequin parameter including one or more of a torso length, a neck length, and a head position, and And controlling the shooting range of the camera according to the position of the center of each passenger head so that the centers of the first number of passenger heads in the monitoring image are all in the preset range of the monitoring image.
  13. 13. An occupant monitoring device comprising a camera module, a sensing module, a control module communicatively coupled to the camera module and the sensing module, and a drive module communicatively coupled to the control module and mechanically coupled to the camera module, wherein: The camera module is configured to acquire a monitoring image; The sensing module is configured to acquire a sensing signal, and The control module is configured to: comparing a first number of occupants within the monitoring image with a second number of occupants determined from the sensing signal, Controlling a photographing range of the photographing module by controlling the driving module in a case where the first number is smaller than the second number until the first number of occupants in the monitoring image is greater than or equal to the second number, and And under the condition that the first number is greater than or equal to the second number, controlling the shooting range of the shooting module by controlling the driving module according to the positions of the first number of passengers in the monitoring image so as to enable the first number of passengers in the monitoring image to be in the preset range of the monitoring image.
  14. 14. An occupant monitoring apparatus, characterized by comprising: a memory configured to store instructions, and A processor coupled to the memory, which when executed by the processor, performs the operations of the occupant monitoring method according to any one of claims 1-12.
  15. 15. A computer readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement the operations of the occupant monitoring method of any of claims 1-12.
  16. 16. A computer program product, characterized in that it comprises instructions which, when executed by a processor, implement the operations of the occupant monitoring method according to any one of claims 1 to 12.

Description

Occupant monitoring method, apparatus, device, storage medium, and program product Technical Field The present disclosure relates to the field of automotive intelligence, and in particular, to an occupant monitoring method, an occupant monitoring apparatus, an occupant monitoring device, a computer-readable storage medium, and a computer program product. Background With the improvement of safety and intelligence of automobiles, the functions of occupant monitoring systems (Occupant Monitoring System, OMS) in the passenger compartment are expanding. The implementation of the various functions of the OMS depends on the acquired occupant images. In the prior art, because of the difference between the independent adjustment of the seat by the passengers and the body types of the passengers, the problems of head image distortion, incomplete, perspective compression and the like are easily caused, so that the monitoring effect of the OMS is poor, and the use of partial functions is affected. Disclosure of Invention According to a first aspect of the present disclosure, there is provided an occupant monitoring method including acquiring a monitoring image from a camera and a sensing signal from a sensor different from the camera, comparing a first number of occupants in the monitoring image with a second number of occupants determined from the sensing signal, controlling a photographing range of the camera until the first number of occupants in the monitoring image is greater than or equal to the second number if the first number is less than the second number, and controlling the photographing range of the camera according to a position of the first number of occupants in the monitoring image if the first number is greater than or equal to the second number so that the first number of occupants in the monitoring image is within a preset range of the monitoring image. In some embodiments, acquiring the monitoring image from the camera and the sensing signal from a sensor other than the camera includes acquiring the monitoring image and the sensing signal in response to the camera operating in a follower mode. In some embodiments, the occupant monitoring method further includes initiating a follower mode of the camera in response to determining a change in the position of the occupant from the sensing signal, initiating a follower mode of the camera in response to detecting a change in the seat position and/or the back angle, or initiating a follower mode of the camera in response to receiving a command signal to change the seat layout, the position, and/or the back angle. In some embodiments, controlling the camera's range of capture until the first number of occupants within the monitored image is greater than or equal to the second number includes determining a first side in a first direction and a second side facing away from the first side based on the sense signal, wherein more occupants are distributed within the cabin on the first side than on the second side, controlling the camera's range of capture to move toward the first side in the first direction until the first number of occupants within the monitored image is greater than or equal to the second number or the camera's range of capture reaches a final position of the first side, and controlling the camera's range of capture to move toward the second side facing away from the first side in the first direction until the first number of occupants within the monitored image is greater than or equal to the second number if the camera's range of capture reaches a final position of the first side. In some embodiments, controlling the range of capture of the camera based on the location of the first number of occupants within the monitoring image with the first number greater than or equal to the second number such that the first number of occupants within the monitoring image are within a preset range of the monitoring image includes determining a center of a smallest rectangular area within the monitoring image that contains a head of the first number of occupants and a center of the monitoring image, calculating an angle at which the camera rotates, wherein the angle is such that a distance between the center of the smallest rectangular area and the center of the monitoring image is less than or equal to a preset threshold, and controlling the camera to rotate according to the angle. In some embodiments, the angle at which the camera rotates in the second direction is determined according to the angle of view of the camera in the second direction, the distance between the center of the smallest rectangular area in the second direction and the center of the monitoring image, and the length of the monitoring image in the second direction. In some embodiments, the angle of rotation of the camera in the second direction, θ x, satisfies θ x=-θL x/L or satisfies tan (θ x)=-tan(θL/2) x (2 x)/L, where θ L is the angle of view of the camera in the second direction