Search

EP-4304897-B1 - VEHICLE CAMERA MIRROR SYSTEM WITH ADJUSTABLE VIDEO FEED

EP4304897B1EP 4304897 B1EP4304897 B1EP 4304897B1EP-4304897-B1

Inventors

  • CORRODI, BRAD
  • COOPRIDER, TROY OTIS

Dates

Publication Date
20260506
Application Date
20220311

Claims (14)

  1. A vehicle display system, comprising: a camera (20) configured to provide a video feed of an area outside a vehicle (10); a display (18) configured to display the video feed to an occupant (70) of the vehicle (10); at least one sensor (31) configured to obtain data about at least one bodily characteristic of a vehicle occupant (70); and a processor (50) operatively connected to the camera (20), display (18), and at least one sensor (31), and configured to: determine, based on the data from the at least one sensor (31), whether the vehicle occupant (70) is providing a video adjustment command for the video feed on the display (18); adjust the video feed on the display (18) based on the video adjustment command being provided during a first vehicle operational state; and disregard the data about the at least one bodily characteristic of the vehicle occupant (70) obtained during a second vehicle operational state that is different from the first vehicle operational state; wherein the first vehicle operational state corresponds to a magnitude of one of a deceleration and an acceleration of the vehicle (10) being less than a predefined threshold, and wherein the second vehicle operational state corresponds to the magnitude of said one of the deceleration and the acceleration of the vehicle being greater than the predefined threshold.
  2. The vehicle display system of claim 1, wherein the at least one bodily characteristic includes: a gaze direction; a gaze direction and a head rotation direction; a head tilt direction; a head tilt direction and a torso lean direction; or a hand movement, a finger movement, or both.
  3. The vehicle display system of claim 1, wherein: the video adjustment command corresponds to the vehicle occupant (70) looking at the display (18) and attempting to look outside a current field of view of the video feed on the display (18); and to adjust the video feed on the display (18), the processor (50) is configured to adjust a field of view of the video feed on the display (18).
  4. The vehicle display system of claim 3, wherein to adjust the video feed on the display (18), the processor (50) is configured to: determine, based on the data from the at least one sensor (31), an area of interest outside the video feed that the vehicle occupant (70) is trying to view; and adjust a field of view of the video feed so that the video feed on the display (18) includes the area of interest.
  5. The vehicle display system of claim 3, wherein: the display (18) is configured to display (18) a cropped version of the video feed; and to adjust the video feed on the display (18), the processor (50) is configured to adjust a cropping of the video feed.
  6. The vehicle display system of claim 1, wherein: the video adjustment command corresponds to at least one of the occupant (70) leaning their torso forward or backward from an initial torso position, and the occupant (70) tilting their head forwards or backwards from an initial head position; and to adjust the video feed on the display (18), the processor (50) is configured to adjust a magnification of the video feed on the display (18).
  7. The vehicle display system of claim 1, wherein the processor (50) is also configured to receive video adjustment commands as voice commands or gesture commands.
  8. A method comprising: recording images of an area outside a vehicle cabin (22) with a camera (20); displaying a video feed of the recorded images to an occupant (70) of the vehicle (10) in the vehicle cabin (22); determining, based on data about at least one bodily characteristic of a vehicle occupant (70) from at least one sensor (31), whether the vehicle occupant (70) is providing a video adjustment command for the video feed on the display (18); adjusting the video feed on the display (18) based on the video adjustment command being provided during a first vehicle operational state; and disregarding the data about the at least one bodily characteristic of the vehicle occupant (70) obtained during a second vehicle operational state that is different from the first vehicle operational state; wherein the first vehicle operational state corresponds to a magnitude of one of a deceleration and an acceleration of the vehicle (10) being less than a predefined threshold, and the second vehicle operational state corresponds to the magnitude of said one of the deceleration and the acceleration of the vehicle being greater than the predefined threshold.
  9. The method of claim 8, wherein the at least one bodily characteristic includes a gaze direction; a gaze direction and a head rotation direction; a head tilt direction; a head tilt direction and a torso lean direction; or at least one of a hand and finger movement.
  10. The method of claim 8, wherein said adjusting the video feed on the display (18) includes at least one of: adjusting a cropping of the video feed on the display (18); adjusting a magnification of the video feed on the display (18); adjusting a field of view of the video feed on the display (18);
  11. The method of claim 8, wherein: the video adjustment command corresponds to the vehicle occupant looking at the display and attempting to look outside a current field of view of the video feed on the display; and adjusting the video feed on the display includes adjusting a field of view of the video feed on the display (18);
  12. The method of claim 8, wherein: wherein adjusting the video feed on the display (18) includes: determining, based on the data from the at least one sensor (31), an area of interest outside the video feed that the vehicle occupant (70) is trying to view; and adjusting a field of view of the video feed so that the video feed on the display (18) includes the area of interest;
  13. The method of claim 8, wherein said adjusting a field of view of the video feed comprises adjusting how the video feed is cropped for display (18) on the display (18).
  14. The method of claim 8, wherein: the video adjustment command corresponds to at least one of the driver leaning their torso forward or backward from an initial torso position, and the driver tilting their head forwards or backwards from an initial head position; and adjusting the video feed on the display (18) includes adjusting a magnification of the video feed on the display (18).

Description

BACKGROUND This application relates to camera mirror systems for vehicles, such as commercial vehicles. Camera mirror systems (CMS) supplement or replace traditional mirrors of vehicles with video feeds from cameras disposed outside of the vehicles. CMS utilize one or more cameras to provide an enhanced field of view to a vehicle operator. In some examples, CMS cover a larger field of view than a conventional mirror, or include views that are not fully obtainable via a conventional mirror. However, CMS generally provide static video feeds that do not behave like traditional mirrors, that provide different fields of view when looked at from different angles. US 10 810 966 B1 describes an apparatus including an interface and a processor. The interface may be configured to communicate video data to a display. The processor may be configured to receive video frames from a capture device, generate video data for the display in response to the video frames, perform operations to detect an object in the video frames and determine eye position information. US 10 239 456 B1 describes an apparatus comprising an interface to a sensor and a processor. The sensor may be configured to generate a video signal having a first field of view based on a targeted view from a vehicle. DE 10 2010 033786 A1 describes a method for detecting and displaying areas located laterally next to and behind a vehicle, in which images of the areas captured by means of several image capture units. US 2017336797 A1 describes a vehicle control system including an imaging section, a surroundings monitoring section, and a display controller. The display controller is configured to display an image of surroundings of the vehicle superimposed over part of an image based on an operation by the occupant. SUMMARY OF THE INVENTION The present invention is defined herein in accordance with the appended independent claims. Optional features of the invention are set out in the appended dependent claims. A vehicle display system according to an example embodiment of the present disclosure includes a camera configured to provide a video feed of an area outside a vehicle; a display configured to display the video feed to an occupant of the vehicle (e.g., on a display disposed within a vehicle cabin of the vehicle); at least one sensor configured to obtain data about at least one bodily characteristic of a vehicle occupant; and a processor operatively connected to the camera, display, and at least one sensor. The processor is configured to determine, based on the data from the at least one sensor, whether the vehicle occupant is providing a video adjustment command for the video feed on the display; adjust the video feed on the display based on the video adjustment command being provided during a first vehicle operational state; and disregard the data about the at least one bodily characteristic of the vehicle occupant obtained during a second vehicle operational state that is different from the first vehicle operational state. The first vehicle operational state corresponds to a magnitude of one of a deceleration and an acceleration of the vehicle being less than a predefined threshold. The second vehicle operational state corresponds to the magnitude of the one of the deceleration and the acceleration of the vehicle being greater than the predefined threshold. In a further example of the foregoing embodiment, the at least one bodily characteristic includes a gaze direction. In a further example of any of the foregoing embodiments, the at least one bodily characteristic includes a gaze direction and a head rotation direction. In a further example of any of the foregoing embodiments, the at least one bodily characteristic includes a head tilt direction. In a further example of any of the foregoing embodiments, the at least one bodily characteristic includes a head tilt direction and a torso lean direction. In a further example of any of the foregoing embodiments, the at least one bodily characteristic includes a hand movement, a finger movement, or both. In a further example of any of the foregoing embodiments, the video adjustment command corresponds to the vehicle occupant looking at the display and attempting to look outside a current field of view of the video feed on the display. To adjust the video feed on the display, the processor is configured to adjust a field of view of the video feed on the display. In a further example of any of the foregoing embodiments, to adjust the field of view of the video feed on the display, the processor is configured to determine, based on the data from the at least one sensor, an area of interest outside the video feed that the vehicle occupant is trying to view; and adjust the field of view of the video feed so that the video feed on the display includes the area of interest. In a further example of any of the foregoing embodiments, the display is configured to display a cropped version of the video feed. To adjust the