US-12626730-B2 - Information processing apparatus controlling image capturing and recording in mobile image capturing apparatus, control method therefor, and storage medium storing control program therefor

US12626730B2US 12626730 B2US12626730 B2US 12626730B2US-12626730-B2

Abstract

An information processing apparatus that can accurately record information about a steering instruction of a mobile object in real time in association with captured data captured by a mobile image capturing apparatus. The information processing apparatus including a memory device that stores a set of instructions and at least one processor that executes the set of instructions to obtain steering instruction information about a mobile object with steering, generate steering-instruction related information corresponding to the steering instruction information, obtain captured data generated by an image capturing apparatus, which is mounted on a mobile image capturing apparatus, capturing an image of the mobile object; and record the captured data and the steering-instruction related information generated in association with each other whenever the captured data is obtained from the image capturing apparatus.

Inventors

Akane Kanzaki

Assignees

CANON KABUSHIKI KAISHA

Dates

Publication Date: 20260512
Application Date: 20241112
Priority Date: 20231128

Claims (19)

1 . An information processing apparatus comprising: a memory device that stores a set of instructions; and at least one processor that executes the set of instructions to: obtain steering instruction information about a mobile object with steering; generate steering-instruction related information corresponding to the steering instruction information; obtain captured data generated by an image capturing apparatus, which is mounted on a mobile image capturing apparatus, capturing an image of the mobile object; and record the captured data and the steering-instruction related information generated in association with each other whenever the captured data is obtained from the image capturing apparatus, wherein the steering-instruction related information includes an edit point flag indicating either one of an edit point for an image and an edit point for sound.
2 . The information processing apparatus according to claim 1 , wherein the steering-instruction related information includes the steering instruction information.
3 . The information processing apparatus according to claim 1 , wherein the steering-instruction related information includes a transition edit point flag indicating either one of an edit point for image transition and an edit point for sound transition.
4 . The information processing apparatus according to claim 1 , wherein the steering-instruction related information includes a recommended transition flag indicating either one of recommended transition for image transition and recommended transition for sound transition.
5 . The information processing apparatus according to claim 1 , wherein the steering instruction information is a flag expressed by a multi-value.
6 . The information processing apparatus according to claim 1 , wherein the steering-instruction related information includes a flag corresponding to a combination of the steering instruction information and information about a camera work in the mobile image capturing apparatus.
7 . The information processing apparatus according to claim 1 , wherein the steering-instruction related includes a flag corresponding to a combination of the steering instruction information and surrounding space information about a surrounding space of the mobile object.
8 . The information processing apparatus according to claim 7 , wherein the surrounding space information about the surrounding space of the mobile object is the steering instruction information of another object different from the mobile object.
9 . The information processing apparatus according to claim 7 , wherein the surrounding space information about the surrounding space of the mobile object is information indicating surrounding environment of the mobile object.
10 . The information processing apparatus according to claim 7 , wherein the surrounding space information about the surrounding space of the mobile object is information indicating weather surrounding the mobile object.
11 . The information processing apparatus according to claim 1 , wherein the image capturing apparatus includes an image capturing device and a sound obtaining device, and wherein the captured data is at least one of image data captured by the image capturing device or sound data obtained by the sound obtaining device.
12 . The information processing apparatus according to claim 1 , wherein the at least one processor executes the set of instructions to change a plurality of same steering instruction information pieces obtained as the steering instruction information to combination of different steering instruction information pieces.
13 . The information processing apparatus according to claim 12 , wherein the at least one processor executes the set of instructions to: change one of two same steering instruction information pieces to a steering instruction information piece associated with the steering-instruction related information indicating an in-point of an edit point; and change another of the two pieces of the same steering instruction information obtained to steering instruction information associated with the steering-instruction related information indicating an out-point of the edit point.
14 . The information processing apparatus according to claim 12 , wherein the at least one processor that executes the set of instructions to: change an earliest obtained steering instruction information piece among three same steering instruction information pieces obtained as the steering instruction information to first steering instruction information piece associated with the steering-instruction related information indicating an in-point of an edit point; and change remaining two same steering instruction information pieces to second steering instruction information piece and third steering instruction information associated with the steering-instruction related information piece indicating out-points of the edit point in an order of obtained.
15 . The information processing apparatus according to claim 1 that is inside the mobile image capturing apparatus.
16 . The information processing apparatus according to claim 1 that is inside the mobile object.
17 . The information processing apparatus according to claim 1 that is inside a server that is communicably connected to the mobile image capturing apparatus and the mobile object.
18 . A control method for an information processing apparatus, the control method comprising: obtaining steering instruction information about a mobile object with steering; generating steering-instruction related information corresponding to the steering instruction information; obtaining captured data generated by an image capturing apparatus, which is mounted on a mobile image capturing apparatus, capturing an image of the mobile object; and recording the captured data and the steering-instruction related information generated in association with each other whenever the captured data is obtained from the image capturing apparatus, wherein the steering-instruction related information includes an edit point flag indicating either one of an edit point for an image and an edit point for sound.
19 . A non-transitory computer-readable storage medium storing a control program causing a computer to execute a control method for an information processing apparatus, the control method comprising: obtaining steering instruction information about a mobile object with steering; generating steering-instruction related information corresponding to the steering instruction information; obtaining captured data generated by an image capturing apparatus, which is mounted on a mobile image capturing apparatus, capturing an image of the mobile object; and recording the captured data and the steering-instruction related information generated in association with each other whenever the captured data is obtained from the image capturing apparatus, wherein the steering-instruction related information includes an edit point flag indicating either one of an edit point for an image and an edit point for sound.

Description

BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to an information processing apparatus, a control method therefor, and a storage medium storing a control program therefor that control image capturing and recording in a mobile image capturing apparatus. Description of the Related Art In recent years, attention has been given to a style of capturing an image during a drive and making it an image work as a drive VLOG. Since various image cuts are required in a VLOG, a user who makes a drive VLOG using a mobile image capturing apparatus such as a drone has started to appear. In order to obtain a drive VLOG with higher quality, a user may want an edition to add sound to an image in accordance with an operation of a car and an edition to insert a transition between scenes of a captured image. For example, there are an edition to add an engine sound to a scene in which an accelerator is stepped on, an edition to rotate a steering wheel at an end of a scene and then to add a rotation transition between the scene and the next scene, etc. Meanwhile, a technique to record image data captured by a drone and information related to the image data is disclosed. For example, Japanese Patent Laid-Open Publication No. 2022-104716 (JP 2022-104716A) discloses a technique to record image data captured by a camera of a drone and to generate identification information for identifying the recorded image data. Japanese Patent Laid-Open Publication No. 2012-216102 (JP 2012-216102A) discloses the following technique. That is, an onboard image capturing apparatus captures an image by a built-in camera, obtains additional information characterizing the image captured, and transmits the additional information to an image management apparatus. The image management apparatus determines whether the image characterized by the additional information is necessary based on the additional information. When determining that the image is necessary, the image management apparatus requests and receives the image data from the image capturing apparatus and stores the image data in association with the additional information. However, the identification information of JP 2022-104716A and the additional information of JP 2012-216102A are information about the image captured by the camera such as the image captured time and are not information about an object captured by the camera. For example, when a mobile object is a car, information about a treading degree of an accelerator by a user who drives the car can be theoretically obtained by analyzing an acceleration of the car from the image data recorded in the camera, but is difficult to obtain the treading degree of the accelerator with high accuracy. In addition, when such analysis is performed, there is a problem that information about a steering instruction to the mobile object cannot be recorded in association with the captured image in real time. In the VLOG production, a work is produced while combining various captured data including image data and sound data obtained with a drone through image capturing. Therefore, when only the image data that are determined to be necessary are recorded together with the additional information as in JP 2012-216102A, there is a problem that the captured data required by the user in editing may not be recorded. SUMMARY OF THE INVENTION The present invention provides an information processing apparatus, a control method therefor, and a storage medium storing a control program therefor, which can accurately record information about a steering instruction of a mobile object in real time in association with captured data captured by a mobile image capturing apparatus. Accordingly, an aspect of the present invention provides an information processing apparatus including a memory device that stores a set of instructions and at least one processor that executes the set of instructions to obtain steering instruction information about a mobile object with steering, generate steering-instruction related information corresponding to the steering instruction information, obtain captured data generated by an image capturing apparatus, which is mounted on a mobile image capturing apparatus, capturing an image of the mobile object; and record the captured data and the steering-instruction related information generated in association with each other whenever the captured data is obtained from the image capturing apparatus. According to the present invention, the information about the steering instruction of the object involving movement can be recorded in association with the captured data captured by the mobile image capturing apparatus with high accuracy in real time. Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing hardware configuration examples of a mobile image