KR-102963820-B1 - System and method for creating of pre-distorted image for 360-degree panorama

KR102963820B1KR 102963820 B1KR102963820 B1KR 102963820B1KR-102963820-B1

Abstract

A method for generating a distorted image using a pre-distorted image generation system operated by at least one processor, wherein spatial information of a real space to project an original panoramic image using one projector, one mirror, and multiple screens is received. Based on the spatial information, the original panoramic image is mapped to a virtual screen, and a virtual space is created to include the virtual screen, one virtual projector, and one virtual mirror. When a light ray output through the virtual projector is reflected onto the virtual screen, color information obtained by reflection from the original panoramic image mapped onto the virtual screen and coordinate information from which the color information was obtained are extracted, and the color information on the coordinates of the original panoramic image corresponding to the obtained coordinate information is updated with the obtained color information to generate the original panoramic image as a distorted image.

Inventors

정문열
박연용
이정직

Assignees

서강대학교산학협력단

Dates

Publication Date: 20260511
Application Date: 20201028

Claims (9)

A method for generating a distorted image using a pre-distorted image generation system operated by at least one processor, wherein A step of receiving spatial information of the actual space to project the original panoramic image using one projector, one reflector, and multiple screens, A step of mapping the original panoramic image onto a virtual screen based on the above spatial information, and creating a virtual space that includes the virtual screen, one virtual projector, and one virtual reflector. A step of extracting color information obtained by reflecting off the original panoramic image mapped to the virtual screen and coordinate information where the color information was obtained, when a ray output through the virtual projector is reflected on the virtual screen using a ray tracing technique; and A step of updating the color information on the coordinates of the original panoramic image corresponding to the acquired coordinate information with the acquired color information to generate the original panoramic image into a distorted image. A method for generating a pre-distorted image including
In paragraph 1, A method for generating a pre-distorted image, wherein the spatial information includes shape information of the actual space, height information of the actual space and size information of the space floor, height information of the plurality of screens, distance information from the projection origin of the projector to the space floor, and distance information from the projection origin of the projector to the reflector.
In paragraph 2, The step of extracting coordinate information from which the above color information is obtained is: A step of generating a control signal to output the light beam composed of a plurality of pixels through a virtual camera included in the virtual projector, A step of collecting color information and coordinate information from the original panoramic image mapped to the virtual screen by any one of the rays composed of the plurality of pixels, and When the light ray collecting the above color information and coordinate information is inserted into the virtual reflector, the step of extracting the inserted color information and coordinates A method for generating a pre-distorted image including
In paragraph 3, The step of generating a distorted image from the above original panoramic image is, A step of verifying the starting point coordinates of the virtual mirror from which the above ray originated and the coordinates reflected from the virtual screen, and Step of inversely transforming the above starting point coordinates and reflected coordinates from the centroid coordinate system to the 3D coordinate system A method for generating a pre-distorted image including
As a system for generating pre-distorted images, An interface for receiving spatial information of a real space including one projector, one reflector, and multiple screens, Storage for storing original panoramic image information of a 360-degree panoramic image to be projected in the above actual space, and processor Includes, The above processor is, A pre-distorted image generation system that generates a virtual space including a virtual projector, a virtual mirror, and a 360-degree virtual screen mapped with an original panoramic image based on spatial information of the actual space, and when a ray output through the virtual projector is reflected by the original panoramic image mapped on the virtual screen and the reflected light is input, extracts color information and coordinate information from the reflected light, reflects the color information and coordinate information into the original panoramic image, and generates a distorted image using a ray tracing technique.
In paragraph 5, The above processor is, A pre-distorted image generation system that generates a control signal to output the light beam composed of multiple pixels through the virtual projector.
In paragraph 6, The above processor is, A pre-distortion image generation system that checks the starting point coordinates of the virtual mirror from which the above ray originates and the coordinates reflected from the virtual screen, and inversely transforms the starting point coordinates and the reflected coordinates from a centroid coordinate system to a 3D coordinate system.
In paragraph 6, The above processor is, A pre-distortion image generation system that generates a pre-distortion image based on input spatial information using the above-mentioned ray tracing technique.
In paragraph 5, The projector is located on the ceiling of the actual space, and the reflector is installed at a certain distance from the projector toward the floor of the actual space. A pre-distorted image generation system in which the virtual projector and the virtual reflector are generated at the same positions as the projector and the reflector in the virtual space.

Description

System and method for creating of pre-distorted image for 360-degree panorama The present invention relates to a system and method for generating a pre-distorted image for a 360-degree panorama using a single projector and a hemispherical mirror to generate a 360-degree panorama. Conventional 360-degree panoramic technology provides projection using multiple projectors in a large space with a distance greater than the minimum focal distance of the projector. In addition, in science museums, 360-degree panoramic video can also be provided by projecting an image onto the ceiling of a dome-shaped space using a reflector. Using these techniques, it is possible to create a 360-degree panorama. However, in large spaces, especially in rectangular areas, projectors must be installed on every wall, leading to the problem of excessive space occupation by multiple projectors. Additionally, projection is difficult in narrow spaces, and maintenance issues arise due to the need to use multiple projectors. To address these issues, various panorama systems are being researched to generate 360-degree panoramas with a small number of projectors. However, these studies also have the disadvantage that the user must manually set the relationship between the input image and the projection space during the process of generating a pre-distorted image. In addition, since the projector or reflector is positioned in the center of the floor of the space, it restricts the movement of users within the space, and problems arise where the image reflected by the reflector is blocked by the viewer, causing large shadows to form. Furthermore, when projecting in a square or other multi-faceted space rather than a dome, there is no solution to address image distortion, resulting in the disadvantage of providing a distorted image. FIG. 1 is an example of an environment to which a pre-distorted image generation system according to an embodiment of the present invention is applied. FIG. 2 is a structural diagram of a pre-distorted image generation system according to an embodiment of the present invention. FIG. 3 is a flowchart of a method for generating a distorted image in advance according to an embodiment of the present invention. FIG. 4 is a flowchart of a method for generating a distorted image according to an embodiment of the present invention. FIG. 5 is an exemplary diagram illustrating a ray tracing process for generating a pre-distorted image according to an embodiment of the present invention. FIG. 6 is an example of a distorted image according to an embodiment of the present invention. FIG. 7 is an example of a pre-distorted image projected onto a mirror according to an embodiment of the present invention. Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals. Throughout the specification, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. A system and method for generating a pre-distorted image for a 360-degree panorama according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is an example of an environment in which a pre-distorted image generation system according to an embodiment of the present invention is applied. In FIG. 1, a pre-distortion image generation system (100) for projecting a 360-degree panoramic image within a space (10) composed of various shapes (e.g., square, polyhedral, etc.) is coupled to a projector (200) installed on the ceiling. The projector (200) is also coupled to a reflector (300) installed on the ceiling at a certain distance to the left and right or up and down from the projector (200). The reflector (300) is described as being implemented in a hemispherical shape. In an embodiment of the present invention, one projector (200) is positioned in the middle of the ceiling of the space (10), and one reflector (300) is positioned in the space of the space (10) at a certain distance from the projector (200) in the direction of the ground. The projector (200) and the reflector (300) installed in this manner do not restrict the movement paths of multiple users located in the space (10), and can also solve the problem of shadow formation by users. The pre-distortion image generation system (100) generates a virtual space based on spatial information input from the outside. At this time, the pre-distortion image generation system (100) generates a virtual projector and