US-20260127815-A1 - INFORMATION PROCESSING DEVICE AND METHOD, AND INFORMATION PROCESSING SYSTEM

US20260127815A1US 20260127815 A1US20260127815 A1US 20260127815A1US-20260127815-A1

Abstract

The present disclosure relates to an information processing device, a method, and an information processing system capable of performing 3D modeling more easily. On the basis of a first captured image generated by first imaging of a 3D object, first three-dimensional shape information is generated. Using the first three-dimensional shape information, an accuracy of second three-dimensional shape information that can be generated using second captured images generated from second imaging performed thus far is evaluated, and a scoring result is generated. On the basis of the scoring result, the second imaging is controlled, or guidance information for the second imaging is generated and controlled to be output. The present disclosure can be applied in, for example, an information processing device, an imaging device, an imaging communication device, an electronic device, an information processing method, a program, an information processing system, or the like.

Inventors

Keisuke UYAMA

Assignees

Sony Group Corporation

Dates

Publication Date: 20260507
Application Date: 20230925
Priority Date: 20221014

Claims (20)

1 . An information processing system comprising: circuitry configured to obtain three-dimensional shape information of a real object, obtain a first image of the real object captured within a first imaging range, obtain a second imaging range, determine an overlap rate between the first imaging range and the second imaging range based on the three-dimensional shape information, and control capturing related to a second image based on the second imaging range, in accordance with the overlap rate and the three-dimensional shape information.
2 . The information processing system according to claim 1 , wherein the circuitry controls to capture the second image of the real object with the second imaging range, in accordance with the overlap rate satisfying at least one threshold.
3 . The information processing system according to claim 1 , wherein the overlap rate refers to a degree of a region where the first imaging range and the second imaging range overlap.
4 . The information processing system according to claim 1 , wherein a position and attitude of capturing the second image are determined according to the overlap rate between the first imaging range and the second imaging range.
5 . The information processing system according to claim 1 , wherein the overlap rate is ratio of a range that intersects the first imaging range and the second imaging range over a frustum in the second imaging range.
6 . The information processing system according to claim 1 , wherein second three-dimensional shape data is generated based on the second image.
7 . The information processing system according to claim 6 , wherein the overlap between the first imaging range and the second imaging range is determined for a polygon of the reconstructed object in the virtual space.
8 . The information processing system according to claim 1 , wherein the circuitry is further configured to control to display information indicating the overlap rate.
9 . The information processing system according to claim 2 , wherein the second image is captured automatically.
10 . The information processing system according to claim 1 , wherein the circuitry is further configured to determine the position and attitude based on the three-dimensional shape information of the real object.
11 . The information processing system according to claim 2 , wherein the circuitry is further configured to obtain the first image and the second image from an imaging device communicatively connected with the information processing system.
12 . The information processing system according to claim 1 , wherein the second imaging range is adjusted based on the overlap rate with the first imaging range to acquire additional information of the real object.
13 . The information processing system according to claim 2 , wherein the at least one threshold defines a minimum required overlap rate for capturing the second image.
14 . An information processing method comprising: obtaining three-dimensional shape information of a real object; obtaining a first image of the real object captured within a first imaging range; obtaining a second imaging range; determining an overlap rate between the first imaging range and the second imaging range based on the three-dimensional shape information; and controlling to display information indicating the overlap rate in relation to capture of a second image associated with the second imaging range.
15 . The information processing method according to claim 14 , wherein the second image of the real object with the second imaging range is captured in accordance with the overlap rate satisfying at least one threshold.
16 . An information processing system comprising: circuitry configured to obtain three-dimensional shape information of a real object, obtain a first image of the real object captured within a first imaging range, obtain a second imaging range, determine an overlap rate between the first imaging range and the second imaging range based on the three-dimensional shape information, and control to display information indicating the overlap rate.
17 . The information processing system according to claim 16 , wherein the second image of the real object with the second imaging range is captured in accordance with the overlap rate satisfying at least one threshold.
18 . The information processing system according to claim 16 , wherein the displayed information indicates guidance for adjusting an imaging device from which the first image is obtained based on the overlap rate between the first imaging range and the second imaging range.
19 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a power and data supplying method, the method comprising: obtaining three-dimensional shape information of a real object; obtaining a first image of the real object captured within a first imaging range; obtaining a second imaging range; determining an overlap rate between the first imaging range and the second imaging range based on the three-dimensional shape information; and controlling to display information indicating the overlap rate.
20 . The non-transitory computer-readable storage medium according to claim 19 , wherein the second image of the real object with the second imaging range is captured in accordance with the overlap rate satisfying at least one threshold.

Description

TECHNICAL FIELD The present disclosure relates to an information processing device and a method, and an information processing system, and particularly relates to an information processing device and a method, and an information processing system, that enable 3D modeling to be performed more easily. BACKGROUND ART Conventionally as a method of 3D modeling a 3D object having a three-dimensional shape, there is a method called photogrammetry, in which images of a 3D object are captured from a plurality of directions and 3D data is generated on the basis of the obtained plurality of captured images (see PTL 1, for example). There is also a method called real-time 3D modeling, in which 3D data is generated instantaneously (in real time) on the basis of information such as captured images, attitude information, depth, and the like. Furthermore, in recent years, a method generally referred to as neural rendering has been proposed in which neural fields are configured on the basis of a shot image and the attitude of the shot image, and an image seen from a desired viewpoint, a three-dimensional model, or the like is generated (e.g., Neural Radiance Fields (NeRF)). CITATION LIST Patent Literature PTL 1: JP 2018-63693A SUMMARY Technical Problem When, as in the stated methods, 3D modeling is performed on the basis of captured images of a 3D object, it is desirable to generate the 3D data as accurately as possible with the lowest number of captured images as possible, to reduce the workload, the amount of processing, and the like. To that end, it is desirable to image the 3D object at a more appropriate position and attitude. However, it has been difficult for photographers to ascertain the position and attitude at which it is appropriate to perform imaging. Having been conceived in light of such circumstances, the present disclosure enables 3D modeling to be performed more easily. Solution to Problem An information processing device according to one aspect of the present technique is an information processing device including: a first 3D modeling processing unit that, on the basis of a first captured image generated by first imaging of a 3D object, generates first three-dimensional shape information expressing a three-dimensional shape of the 3D object; a scoring processing unit that, using the first three-dimensional shape information, evaluates an accuracy of second three-dimensional shape information that can be generated using second captured images generated from second imaging performed thus far, and generates a scoring result; and an imaging control unit that, on the basis of the scoring result, controls the second imaging of the 3D object. An information processing method according to one aspect of the present technique is an information processing method including: generating, on the basis of a first captured image generated by first imaging of a 3D object, first three-dimensional shape information expressing a three-dimensional shape of the 3D object; evaluating, using the first three-dimensional shape information, an accuracy of second three-dimensional shape information that can be generated using second captured images generated from second imaging performed thus far, and generating a scoring result; and controlling, on the basis of the scoring result, the second imaging of the 3D object. An information processing device according to another aspect of the present technique is an information processing device including an imaging unit that images a 3D object and a communication unit that communicates with another information processing device. The communication unit supplies camera information pertaining to the imaging unit to the other information processing device, and obtains imaging control information generated by the other information processing device on the basis of the camera information. The imaging unit images the 3D object on the basis of the imaging control information, and generates a captured image for generating three-dimensional shape information expressing a three-dimensional shape of the 3D object. An information processing method according to another aspect of the present technique is an information processing method including: supplying camera information pertaining to an imaging unit that images a 3D object to another information processing device, and obtaining imaging control information generated by the other information processing device on the basis of the camera information; and imaging the 3D object on the basis of the imaging control information, and generating a captured image for generating three-dimensional shape information expressing a three-dimensional shape of the 3D object. An information processing system according to yet another aspect of the present technique is an information processing system including an information processing device and an imaging device. The information processing device includes: a first 3D modeling processing unit that, on the basis of a fir