US-12620275-B2 - Apparatus for recording and/or displaying state of moving object

Abstract

An apparatus for recording and/or displaying a state of a moving object includes: an information acquisition unit that acquires information regarding a surrounding environment of the moving object; a behavior acquisition unit that acquires a behavior during movement of the moving object; and a processing circuit, in which the processing circuit determines an environment where the moving object is positioned based on the information acquired by the information acquisition unit, and record and/or display the state of the moving object when the determined environment is a predetermined environment and the behavior acquired by the behavior acquisition unit satisfies a predetermined condition.

Inventors

• Yuki Hara
• Steven Andrew Stemmer

Assignees

• HONDA MOTOR CO., LTD.

Dates

Publication Date

20260505

Application Date

20240130

Claims (18)

1. 1 . An apparatus for recording a state of a moving object, the apparatus comprising: a camera configured to acquire information regarding a surrounding environment of the moving object, the information including an image of surroundings of the moving object; at least one sensor configured to acquire a behavior during movement of the moving object; and a processing circuit, wherein the processing circuit is configured to determine an environment where the moving object is positioned based on the information acquired by the camera, control a memory to record the state of the moving object in response to the determined environment is a predetermined environment and the behavior acquired by the at least one sensor satisfies a predetermined condition, the processing circuit is further configured to identify whether a road where the moving object is traveling is an unpaved road based on the image acquired by the camera, the processing circuit determines the environment as the predetermined environment when identifying the road is the unpaved road, the processing circuit controls the memory to record the image acquired by the camera as the record of the state of the moving object in response to the determined environment being the predetermined environment and the behavior acquired by the at least one sensor satisfying the predetermined condition, and the processing circuit is further configured to evaluate a degree of interest of a user in the environment and the behavior with image analysis using machine learning of an image in a passenger compartment of the moving object acquired by an interior camera, or with sound analysis using machine learning of a sound in the passenger compartment of the moving object acquired by an interior microphone, and automatically set the predetermined environment and the predetermined condition for the behavior based on the evaluated degree of interest.
2. 2 . The apparatus according to claim 1 , wherein the information further includes position information of the moving object.
3. 3 . The apparatus according to claim 2 , further comprising a plurality of the cameras, wherein the plurality of cameras acquire a multi-view image as the image on the surrounding of the moving object.
4. 4 . The apparatus according to claim 1 , wherein the processing circuit further records at least one of the determined environment and the behavior acquired by the at least one sensor as the record of the state of the moving object.
5. 5 . The apparatus according to claim 1 , wherein the processing circuit records the state of the moving object over a predetermined period around a timing at which the behavior acquired by the at least one sensor is determined to satisfy the predetermined condition.
6. 6 . The apparatus according to claim 1 , wherein the processing circuit includes a memory that stores a customized environment customized by a user of the moving object regarding the environment where the moving object is positioned and a customized behavior customized by the user regarding the behavior during the movement of the moving object, the predetermined environment is the customized environment stored in the memory, and the predetermined condition is the customized behavior stored in the memory.
7. 7 . The apparatus according to claim 6 , wherein when at least one of the customized environment and the customized behavior is not stored in the memory, the processing circuit is configured not to record the state of the moving object.
8. 8 . The apparatus according to claim 1 , wherein the at least one sensor is an existing sensor of the moving object.
9. 9 . The apparatus according to claim 1 , wherein the predetermined condition is that a difference between rotating speeds of left and right wheels of the moving object exceeds a threshold.
10. 10 . The apparatus according to claim 1 , wherein the predetermined condition is that pitching or movement in a front-rear direction of the moving object is repeated a predetermined number of times or more within a predetermined period.
11. 11 . The apparatus according to claim 1 , wherein the predetermined condition is that yawing of the moving object is repeated a predetermined number of times or more within a predetermined period.
12. 12 . The apparatus according to claim 1 , wherein the predetermined condition is that an acceleration operation and a braking operation of the moving object are repeated a predetermined number of times or more within a predetermined period.
13. 13 . The apparatus according to claim 1 , wherein the predetermined condition is that an operation amount of an acceleration operation and/or an operation amount of a braking operation of the moving object exceeds a threshold.
14. 14 . The apparatus according to claim 1 , wherein the predetermined condition is that an extension amount of a suspension of the moving object exceeds a threshold continuously for a predetermined period.
15. 15 . The apparatus according to claim 1 , wherein the predetermined condition is that one of left and right suspensions of the moving object is more compressed than another of the left and right suspensions continuously for a predetermined time.
16. 16 . The apparatus according to claim 1 , wherein the predetermined condition is that an inclination in a front-rear direction of the moving object exceeds a threshold.
17. 17 . The apparatus according to claim 1 , wherein the predetermined condition is that an inclination in a left-right direction of the moving object exceeds a threshold.
18. 18 . The apparatus according to claim 1 , wherein the processing circuit changes the predetermined condition depending on the determined environment.

Description

TECHNICAL FIELD The present disclosure relates to an apparatus for recording and/or displaying a state of a moving object. BACKGROUND ART Recently, efforts have been actively made to provide access to a sustainable transportation system considering vulnerable traffic participants. As one of such efforts, research and development relating to a driving assistance technology and an automated driving technology for moving objects (for example, vehicles such as automobiles) has been made to further improve safety and convenience of traffic. For example, a vehicle video recording apparatus described in JP2011-28651A includes a camera and a control unit configured to record a video acquired by the camera in a memory. The control unit executes the recording process under a preset condition such as places that attract attention. Examples of the places that attract attention include tourist sites, sights, historic spots, and beautiful places. A video/audio automatic editing apparatus described in JP3514236B records brain waves in synchronization with a video and a sound. Using the recorded brain waves, only videos of interest to a user are automatically extracted from past-experience videos of the user. In the vehicle video recording apparatus described in JP2011-28651A, under the predetermined condition, for example, videos can be automatically recorded in the places such as tourist sites, sights, historic spots, and beautiful places. However, only videos of interest to the user cannot be automatically extracted from the videos recorded in the above-described environments. In the video/audio automatic editing apparatus described in JP3514236B, only videos of interest to the user can be automatically extracted. However, to record the brain waves of the user, the user needs to wear an electroencephalogram, and there is room for improvement from the viewpoints of convenience or cost. One aspect of the present disclosure provides an apparatus capable of recording and/or displaying a state of a moving object of interest to a user. The safety of traffic is further improved, which contributes to the development of a sustainable transportation system. SUMMARY OF INVENTION According to an aspect of the present disclosure, there is provided an apparatus for recording and/or displaying a state of a moving object includes: an information acquisition unit that acquires information regarding a surrounding environment of the moving object; a behavior acquisition unit that acquires a behavior during movement of the moving object; and a processing circuit, in which the processing circuit determines an environment where the moving object is positioned based on the information acquired by the information acquisition unit, and record and/or display the state of the moving object when the determined environment is a predetermined environment and the behavior acquired by the behavior acquisition unit satisfies a predetermined condition. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a side view illustrating an example of a moving object; FIG. 2 is a plan view illustrating the moving object of FIG. 1; FIG. 3 is a block diagram illustrating the moving object of FIG. 1; FIG. 4 is a flowchart illustrating an example of a process that is executed by a processing circuit of FIG. 3; FIG. 5 is a block diagram illustrating another example of the moving object; FIG. 6 is a plan view illustrating another example of an apparatus for recording and/or displaying a state of a moving object; FIG. 7 is a block diagram illustrating the apparatus of FIG. 6; and FIG. 8 is a flowchart illustrating an example of a process that is executed by a processing circuit of the apparatus of FIG. 7. DESCRIPTION OF EMBODIMENTS Hereinafter, an embodiment of the present disclosure will be described based on the accompanying drawings. Note that the drawings are seen such that reference numerals look properly oriented. In the present disclosure, to simplify and clarify the description, each of front and rear, left and right, and upward and downward directions will be described based on a direction seen from a user (for example, a driver) of a vehicle 10 illustrated in FIG. 1, and a front side, a rear side, a left side, a right side, an upward side, and a downward side of the vehicle 10 will be represented by Fr, Rr, L, R, U, and D, respectively in the drawings. FIGS. 1 and 2 illustrate a vehicle that is an example of a moving object. The vehicle 10 is an automobile including a driving source (not illustrated), and wheels including drive wheels that are driven by power of the driving source and steered wheels that can be steered. In the present embodiment, the vehicle 10 is a four-wheel automobile including a pair of left and right front wheels and a pair of left and right rear wheels. The driving source of the vehicle 10 is, for example, an electric motor. The driving source of the vehicle 10 may be an internal combustion engine such as a gasoline engine or a diesel engine, or may