Search

JP-7854744-B2 - Image generation device and program

JP7854744B2JP 7854744 B2JP7854744 B2JP 7854744B2JP-7854744-B2

Inventors

  • 木村 宏樹
  • アウン コ ナイ

Assignees

  • 株式会社STUDIO55

Dates

Publication Date
20260507
Application Date
20250204

Claims (4)

  1. An image generation device that generates a superimposed image by superimposing a 2D image, which is a 3D model of a virtual object onto an image of a target area, An image acquisition unit that acquires the captured image, which is a 360-degree spherical image, and the 3D model, A unit for acquiring imaging position that acquires the imaging position including the height at which the aforementioned image was captured, A superposition position determination unit determines the superposition position of the captured image and the two-dimensional image obtained by converting the three-dimensional model, based on the acquired imaging position. An image conversion unit converts the three-dimensional model into a 360-degree spherical image based on the determined superposition position to obtain the two-dimensional image, An image generation unit generates a superimposed image by superimposing the captured image and the converted two-dimensional image at a determined superposition position, A reference point acquisition unit that acquires a predetermined reference point in the captured image, A feature point acquisition unit acquires feature points that indicate the position in the three-dimensional model corresponding to the acquired reference points, An estimation unit that estimates the imaging position based on the acquired reference points and feature points, Equipped with, The aforementioned imaging position acquisition unit is an image generation device that acquires the estimated imaging position.
  2. An image generation device that generates a superimposed image by superimposing a 2D image, which is a 3D model of a virtual object onto an image of a target area, An image acquisition unit that acquires the captured image, which is a 360-degree image, and the 3D model, A unit for acquiring imaging position that acquires the imaging position including the height at which the aforementioned image was captured, A superposition position determination unit determines the superposition position of the captured image and the two-dimensional image obtained by converting the three-dimensional model, based on the acquired imaging position. An image conversion unit converts the three-dimensional model into a 360-degree spherical image based on the determined superposition position to obtain the two-dimensional image, An image generation unit generates a superimposed image by superimposing the captured image and the converted two-dimensional image at a determined superposition position, A reference point acquisition unit that acquires a predetermined reference point in the captured image, A location information acquisition unit acquires the location of the acquired reference point on a map as location information, An estimation unit that estimates the imaging position based on the acquired reference point and location information, Equipped with, The aforementioned imaging position acquisition unit is an image generation device that acquires the estimated imaging position.
  3. This program causes a computer to function as an image generation device that generates a superimposed image by superimposing a 2D image, which is a 3D model of a virtual object onto an image of a target area, The aforementioned computer, An image acquisition unit that acquires the captured image, which is a 360-degree spherical image, and the 3D model. A unit that acquires the imaging position including the height at which the aforementioned image was captured, A superposition position determination unit determines the superposition position of the captured image and the two-dimensional image obtained by converting the three-dimensional model, based on the acquired imaging position. An image conversion unit converts the three-dimensional model into a 360-degree spherical image based on the determined superposition position to obtain the two-dimensional image. An image generation unit generates a superimposed image by superimposing the captured image and the converted two-dimensional image at a determined superposition position. A reference point acquisition unit that acquires a predetermined reference point in the captured image, A feature point acquisition unit acquires feature points that indicate the position in the three-dimensional model corresponding to the acquired reference points. An estimation unit estimates the imaging position based on the acquired reference points and feature points. To make it function as, The aforementioned imaging position acquisition unit is a program that acquires the estimated imaging position.
  4. This program causes a computer to function as an image generation device that generates a superimposed image by superimposing a 2D image, which is a 3D model of a virtual object onto an image of a target area, The aforementioned computer, An image acquisition unit that acquires the captured image, which is a 360-degree spherical image, and the 3D model. A unit that acquires the imaging position including the height at which the aforementioned image was captured, A superposition position determination unit determines the superposition position of the captured image and the two-dimensional image obtained by converting the three-dimensional model, based on the acquired imaging position. An image conversion unit converts the three-dimensional model into a 360-degree spherical image based on the determined superposition position to obtain the two-dimensional image. An image generation unit generates a superimposed image by superimposing the captured image and the converted two-dimensional image at a determined superposition position. A reference point acquisition unit that acquires a predetermined reference point in the captured image, A location information acquisition unit acquires the location of the acquired reference point on a map as location information. An estimation unit estimates the imaging position based on the acquired reference point and location information. To make it function as, The aforementioned imaging position acquisition unit is a program that acquires the estimated imaging position.

Description

This invention relates to an image generation apparatus and program. Traditionally, creating exterior drawings of planned buildings has been used to show the completed image. Presenting such exterior drawings is useful in sales and marketing of residential properties. Recently, it has become common practice to use 3D rendering images (hereinafter simply referred to as rendering images) as exterior views to show the completed image. Using rendering images allows for viewing the exterior from various viewpoints. Furthermore, by superimposing rendering images onto actual images of the planned construction site, it is possible to check the harmony with the surrounding landscape. For example, a method of displaying architectural images has been proposed in which a 3D image of the building (exterior image 9) is superimposed onto an image taken of the planned location of the building (see, for example, Patent Document 1). Japanese Patent Publication No. 2014-89697 This is a schematic diagram showing the relationship between the imaging position of the captured image synthesized by the image generation device according to the first embodiment of the present invention and the planned construction site included in the image target.This is a schematic diagram showing a superimposed image generated by the image generation device of the first embodiment.This is a schematic diagram showing an image captured and synthesized by the image generation device of the first embodiment.This is a schematic diagram showing a rendering image synthesized by the image generation apparatus according to the first embodiment.This is a block diagram showing the configuration of the image generation device according to the first embodiment.This is a block diagram showing the configuration of an image generation apparatus according to a second embodiment of the present invention.This is a block diagram showing the configuration of an image generation device according to a third embodiment of the present invention. The image generation apparatus 1 and program according to each embodiment of the present invention will be described below with reference to Figures 1 to 7. First, in describing the image generation apparatus 1 and program according to each embodiment, the generated images (hereinafter also referred to as superimposed images) will be explained with reference to Figures 1 to 4. The superimposed image is, for example, an image obtained by superimposing a rendering image of a building onto an image taken from the imaging position P of the planned construction site A, as shown in Figures 1 and 2. Specifically, the superimposed image is an image obtained by superimposing a rendering image of the planned building onto a real-world image of the planned construction site A. By superimposing the rendering image onto the real-world image, it is possible to confirm the harmony between the planned building and adjacent buildings, etc. In the following implementations, a 360-degree spherical image is used as the captured image, as shown in Figure 3. This allows for a complete view of the surrounding area from a predetermined viewpoint. Therefore, it is possible to check not only the harmony with adjacent buildings, but also with the surrounding environment. On the other hand, the rendered image is, for example, a 3D model as shown in Figure 4. The rendered image is created using, for example, a mesh and texture. Therefore, the rendered image needs to be converted so that it can be superimposed on a 360-degree spherical image from a predetermined viewpoint. The image generation device 1 according to each of the following embodiments performs the conversion of the rendered image based on the imaging position P, including height. This allows for easy correction of the rendered image to match the 360-degree spherical image. [First Embodiment] Next, an image generation apparatus 1 and program according to the first embodiment of the present invention will be described with reference to Figures 1 to 5. Image generation device 1 is, for example, a device that acquires and superimposes an captured image and a rendered image. As shown in Figure 5, image generation device 1 comprises an image acquisition unit 11, an image acquisition position acquisition unit 12, a superimposition position determination unit 13, an image conversion unit 14, an image generation unit 15, and an output unit 16. The image acquisition unit 11 is implemented, for example, by the operation of the CPU. The image acquisition unit 11 acquires both an captured image (a 360-degree spherical image) and a rendered image. The captured image, for example, is a 360-degree spherical image taken by the user, specifically a 360-degree spherical image taken from a position P where the planned construction site A is visible. The image acquisition unit 11 also acquires a rendered image, for example, an image previously created as a 3D model of the building. The image acquisition unit 12 is im