CN-122002144-A - Image pickup apparatus, control method, storage medium, and program product

Abstract

The invention provides an image pickup apparatus and a control method, a storage medium, and a program product. The image capturing apparatus includes a first generation unit configured to generate image data at a predetermined period, a second generation unit configured to generate metadata related to processing until generation of the image data, a first output unit configured to add the metadata to the image data to output the image data to the outside, and a second output unit configured to output predetermined information generated until the image data in the metadata to the outside a plurality of times before the image data is output by the first output unit.

Inventors

• Hengguan Cheng

Assignees

• 佳能株式会社

Dates

Publication Date

20260508

Application Date

20251031

Priority Date

20241101

Claims (20)

1. 1. An image pickup apparatus comprising: a first generation unit configured to generate image data at a predetermined period; a second generation unit configured to generate metadata related to processing until generation of the image data; A first output unit for adding the metadata to the image data to output the image data to the outside, and And a second output unit configured to output predetermined information generated in the metadata until the image data is output, to the outside, a plurality of times before the image data is output by the first output unit.
2. 2. The image pickup apparatus according to claim 1, further comprising: An extracting unit configured to extract the predetermined information to be output to the outside by the second output unit from the metadata generated by the second generating unit before the image data is output by the first output unit.
3. 3. The image pickup apparatus according to claim 1, Wherein, after the image data to which the metadata is added is externally output by the first output unit, the second output unit does not externally output predetermined information about image data to be output after the image data.
4. 4. The image pickup apparatus according to claim 1, Wherein the metadata added to the image data and output by the first output unit includes the same information as predetermined information related to the image data.
5. 5. The image pickup apparatus according to claim 1, Wherein the predetermined information includes information for synchronizing image data to be output by the first output unit with the predetermined information to be output by the second output unit.
6. 6. The image pickup apparatus according to claim 1, Wherein the second generation unit generates first metadata synchronized with first image data to be output by the first output unit, and second metadata scheduled to be synchronized with second image data to be output after the first image data, The first output unit adds the first metadata to the first image data to output the first image data to the outside, and The second output unit outputs the second metadata when the first metadata is added to the first image data to output the first image data to the outside.
7. 7. The image pickup apparatus according to claim 6, Wherein the second metadata includes predetermined information related to the second image data.
8. 8. The image pickup apparatus according to claim 1, Wherein the second output unit outputs the predetermined information to the outside at a timing when the predetermined information generated by the second generation unit is obtained.
9. 9. The image pickup apparatus according to claim 8, Wherein the second output unit outputs, as a set, first predetermined information related to the first image data generated by the second generation unit before the first output unit outputs the first image data, and second predetermined information related to the second image data of the same type as the first predetermined information generated by the second generation unit before the first output unit outputs the second image data, which is output before the first image data, to the outside.
10. 10. The image pickup apparatus according to claim 1, Wherein the second output unit uses the predetermined information to change the frequency of outputting the predetermined information according to the importance level of the process to be performed externally.
11. 11. The image pickup apparatus according to claim 10, Wherein the second output unit increases the frequency of outputting the predetermined information as the importance level of the process to be externally performed is higher.
12. 12. The image pickup apparatus according to claim 11, Wherein the predetermined information includes posture information of the image capturing apparatus, information related to brightness of an image, and information related to image capturing processing, and The frequency decreases in the order of the posture information of the image capturing apparatus, the information on the brightness of the image, and the information on the image capturing process.
13. 13. The image pickup apparatus according to claim 1, further comprising an image pickup unit for picking up an image at a predetermined frame rate, Wherein the image data is moving image data, The metadata is information associated with the moving image data to be generated for each frame of the moving image data, and The metadata includes metadata before exposure of the imaging unit, metadata during readout of an image signal from the imaging unit, metadata during development of the image signal, and metadata related to post-processing of the developed image data.
14. 14. The image pickup apparatus according to claim 1, Wherein the predetermined information is information to be used for a process to be performed externally, and The process to be externally performed is a process of synthesizing the image data with CG data in real time.
15. 15. The image pickup apparatus according to claim 13, Wherein the predetermined information includes a time code or a frame number of a frame scheduled to be the image data output by the first output unit.
16. 16. The image pickup apparatus according to claim 13, Wherein the predetermined information includes information corresponding to a time of a difference with a time code synchronized with image data to be output from the first output unit or a frame number of a difference with a frame number.
17. 17. The image pickup apparatus according to any one of claims 1 to 16, Wherein the first output unit conforms to a serial digital interface standard, SDI standard, and The second output unit meets the user datagram protocol standard, UDP standard.
18. 18. A control method of an image pickup apparatus, the control method comprising: Generating image data at a predetermined period; Generating metadata related to a process up to generation of the image data; Adding the metadata to the image data to output the image data from the first output unit to the outside, and The predetermined information on the image data generated from among the metadata until the image data is output from the second output unit a plurality of times before the image data is output from the first output unit.
19. 19. A computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 18.
20. 20. A computer program product comprising a program for causing a computer to execute the control method according to claim 18.

Description

Image pickup apparatus, control method, storage medium, and program product Technical Field The present disclosure relates to an image capturing apparatus, a control method, a storage medium, and a program product, and particularly relates to control for outputting information related to image data to the outside. Background A technique called visual effect (hereinafter VFX) is known. VFX is a technique for synthesizing a computer graphic (hereinafter CG) with an image actually photographed. The case of combining a photographed image with CG in VFX includes a method of combining CG generated in advance after photographing the photographed image and a method of combining CG with photographed images photographed in sequence in real time. In the latter method, CG is synthesized with a captured image by using metadata associated with image data for each frame of the captured image, and a communication protocol called User Datagram Protocol (UDP) is generally used because real-time characteristics are emphasized. Japanese patent No. 7190594 describes a method in which a time code of metadata is output from an output unit different from an output unit outputting image data to which the time code is added, whereby the time code of metadata can be used even when the time code added to the image data cannot be used correctly. UDP has a possibility that metadata of a certain frame is lost due to packet loss. In the case where packet loss occurs, since metadata of the lost frame cannot be used, there is a possibility that an unnatural image is generated. Disclosure of Invention The present disclosure has been made in view of the above-described problems, and provides a technical advantage in that generation of unnatural images due to packet loss can be reduced. In order to solve the above-described problems, the present disclosure relates to an image capturing apparatus including a first generation unit configured to generate image data at a predetermined period, a second generation unit configured to generate metadata related to processing until generation of the image data, a first output unit configured to add the metadata to the image data to output the image data to the outside, and a second output unit configured to output predetermined information generated in the metadata until the image data is output to the outside a plurality of times before the image data is output by the first output unit. In order to solve the above-described problems, the present disclosure relates to a control method of an image capturing apparatus, the control method including generating image data at a predetermined period, generating metadata related to processing until generation of the image data, adding the metadata to the image data to output the image data from a first output unit to the outside, and outputting predetermined information related to the image data, generated from among the metadata until the image data is output, from a second output unit to the outside a plurality of times before the image data is output from the first output unit. In order to solve the above-described problems, the present disclosure relates to a computer-readable storage medium storing a program for causing a computer to function as an image pickup apparatus as described above. In order to solve the above-described problems, the present disclosure relates to a computer program product including a program for causing a computer to function as the image pickup apparatus as described above. Features of the present disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of the embodiments is described by way of example. Drawings The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description, serve to explain the principles of the embodiments. Fig. 1 is a block diagram showing the configuration of an image capturing apparatus according to the present embodiment. Fig. 2 is a block diagram showing the configuration of the image processing apparatus according to the present embodiment. Fig. 3 is a flowchart illustrating a control process of the image capturing apparatus of the present embodiment. Fig. 4 is a diagram showing metadata output from the image capturing apparatus of the present embodiment. Fig. 5 is a diagram showing a description example of metadata output from the image capturing apparatus of the present embodiment. Fig. 6 is a flowchart illustrating a control process of the image processing apparatus of the present embodiment. Fig. 7A to 7D are diagrams showing operations from image capturing processing to image data output processing of the image capturing apparatus according to the first embodiment. Fig. 8A to 8D are diagrams showing operations from image capturing processing to image data output processing of the image capturing appara