US-12620220-B2 - Image display system, terminal, method, and program for determining a difference between a first image and a second image

US12620220B2US 12620220 B2US12620220 B2US 12620220B2US-12620220-B2

Abstract

The present invention provides an image display system, a terminal, a method, and a program that can quickly and accurately display an image corresponding to a particular location. An image display system according to one example embodiment of the present invention includes: a current image acquisition unit configured to acquire a first image captured by a mobile terminal; an information acquisition unit configured to acquire information including a position and an orientation of the mobile terminal that has captured the first image; a past image acquisition unit configured to acquire a second image based on the position and the orientation of the mobile terminal and a position and an orientation associated with the second image stored in the past in a storage device; and a difference detection unit configured to detect a difference between the first image and the second image.

Inventors

Shizuo Sakamoto

Assignees

NEC CORPORATION

Dates

Publication Date: 20260505
Application Date: 20230824
Priority Date: 20160324

Claims (20)

1 . An image display device comprising: at least one memory configured to store computer program code; and at least one processor configured to execute the computer program code to: acquire a first image captured by a mobile terminal; acquire information including a first position and a first orientation of the mobile terminal that has captured the first image; acquire a second image based on the first position and the first orientation; acquire a second position and a second orientation associated with the second image stored in a storage device, the second image being a panoramic image including an image captured with an angle range wider than a captured range of the first image and being captured within a predetermined distance from a current position of the mobile terminal; select a part cut out from the second image in a direction corresponding to the first orientation when the panoramic image close to the first position of the mobile terminal is present; and display the part cut out from the second image.
2 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to acquire the panoramic image which is created by combining a plurality of images captured in different orientations at a same position.
3 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to: detect a difference between the first image and the second image; and output a notification based on the difference between the first image and the second image.
4 . The image display device according to claim 3 , wherein the at least one processor is further configured to execute the computer program code to display the notification in addition to at least one of the first image and the second image.
5 . The image display device according to claim 4 , wherein the at least one processor is further configured to execute the computer program code to display a frame surrounding a region including the difference on the first image and the second image.
6 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to display a first marker on a map indicating the second position associated with the second image.
7 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to acquire the second position and the second orientation associated with the second image which are a position and an orientation of a captured range of the second image.
8 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to: calculate a similarity degree indicating resemblance of the first position and the first orientation of the mobile terminal to the second position and the second orientation associated with the second image; and acquire the second image based on the similarity degree.
9 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to perform notification when the second position associated with the second image is within a predetermined distance from the position of the mobile terminal.
10 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to recognize an object included in the first image and the second image and output information on the object.
11 . The image display device according to claim 1 , wherein the at least one processor is further configured to execute the computer program code to: acquire a condition designated by a user of the mobile terminal; and acquire the second image based on the designated condition in addition to the first position and the first orientation of the mobile terminal and the second position and the second orientation associated with the second image.
12 . An image display method comprising: acquiring a first image captured by a mobile terminal; acquiring information including a first position and a first orientation of the mobile terminal that has captured the first image; acquiring a second image based on the first position and the first orientation; acquiring a second position and a second orientation associated with the second image stored in a storage device, the second image being a panoramic image including an image captured with an angle range wider than a captured range of the first image and being captured within a predetermined distance from a current position of the mobile terminal; selecting a part cut out from the second image in a direction corresponding to the first orientation when the panoramic image close to the first position of the mobile terminal is present; and displaying the part cut out from the second image.
13 . The image display method according to claim 12 , further comprising acquiring the panoramic image which is created by combining a plurality of images captured in different orientations at a same position.
14 . The image display method according to claim 12 , further comprising: detecting a difference between the first image and the second image; and outputting a notification based on the difference between the first image and the second image.
15 . The image display method according to claim 14 , further comprising displaying the notification in addition to at least one of the first image and the second image.
16 . The image display method according to claim 15 , further comprising to displaying a frame surrounding a region including the difference on the first image and the second image.
17 . The image display method according to claim 12 , further comprising displaying a first marker on a map indicating the second position associated with the second image.
18 . The image display method according to claim 12 , further comprising acquiring the second position and the second orientation associated with the second image which are a position and an orientation of a captured range of the second image.
19 . The image display method according to claim 12 , further comprising: calculating a similarity degree indicating resemblance of the first position and the first orientation of the mobile terminal to the second position and the second orientation associated with the second image; and acquiring the second image based on the similarity degree.
20 . A non-transitory computer-readable storage medium storing a program that causes a computer to perform: acquiring a first image captured by a mobile terminal; acquiring information including a first position and a first orientation of the mobile terminal that has captured the first image; acquiring a second image based on the first position and the first orientation; acquiring a second position and a second orientation associated with the second image stored in a storage device, the second image being a panoramic image including an image captured with an angle range wider than a captured range of the first image and being captured within a predetermined distance from a current position of the mobile terminal; selecting a part cut out from the second image in a direction corresponding to the first orientation when the panoramic image close to the first position of the mobile terminal is present; and displaying the part cut out from the second image.

Description

CROSS REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. application Ser. No. 18/140,463 filed Apr. 27, 2023, which is a continuation of U.S. application Ser. No. 17/329,787 filed May 25, 2021, which is a continuation of U.S. application Ser. No. 16/086,942 filed Sep. 20, 2018, which is a National Stage of International Application No. PCT/JP2017/011654 filed Mar. 23, 2017, claiming priority based on Japanese Patent Application No. 2016-059612, filed Mar. 24, 2016, the disclosure of which is incorporated herein in its entirety by reference. TECHNICAL FIELD The present invention relates to an image display system, a terminal, a method, and a program that display an image captured in the past at a particular location. BACKGROUND ART In security of an area, detection of a suspicious object is performed. A suspicious object may be an explosive or a toxic substance, for example, which is basically an object which is not usually placed at the place. Thus, detection of a suspicious object requires determination as to whether or not the object is usually placed. In particular, in security of an important event, surveys are performed over multiple times, and the personnel may be different for each survey. For example, in security of an important person, personnel who perform a survey in advance on a planned route and personnel who perform safety check immediately before the important person passes by are often different in actual practice. It is difficult to report all, to the personnel who perform check immediately before an important person passes by, whether or not it is an object that has been confirmed to be usually placed. Thus, when a suspicious object has been placed after the previous survey, the personnel who check immediately before the important person passes by may not notice the suspicious object or may overreact to the object and take time for check even though it is not a suspicious object. For example, it may be possible to capture and accumulate various places as images in advance in a prior survey, compare the images with the current landscape in the prior survey, and thereby examine whether or not an object which was not present in the prior survey increases in the current landscape. In this case, such a technology is required that stores and provides many images captured in the prior survey in association with capturing places. In the art disclosed in Patent Literature 1, images associated with position information indicating capturing places are accumulated on a server, and the server selects an image close to the current position or a position designated by a user out of the accumulated images to display the image on a display of a mobile terminal. CITATION LIST Patent Literature PTL 1: Japanese Patent Application Laid-Open No. 2009-187233 Non Patent Literature NPL 1: “Quasi-Zenith Satellites System User Interface Specification,” [online], Nov. 28, 2014, Japan Aerospace Exploration Agency, [searched on Feb. 25, 2016], Internet <URL:http://qz-vision.jaxa.jp/USE/is-qzss/DOCS/IS-QZSS_16_J.pdf>, p.A1-A12NPL 2: “Image Recognition Service “GAZIRU” [online], NEC Corporation, [searched on Feb. 29, 2016], Internet <URL: http://jpn.nec.com/solution/cloud/gazou/pdf/GAZIRU.pdf> SUMMARY OF INVENTION Since the art disclosed in Patent Literature 1 only displays an image captured at a position close to the current position or a designated position, however, it is not to display an image in which a particular place (landscape) is captured. That is, an image acquired based only on a position may include a plurality of images in which all the directions are captured from the position. It takes much time to search many images acquired based only on a position for an image in which a particular place is captured. In security performed in a wide range, since it is demanded to reduce time taken at one place, it is difficult to use the art disclosed in Patent Literature 1 for security including detection of a suspicious object. The present invention has been made in view of the above problem and intends to provide an image display system, a terminal, a method, and a program that can quickly and accurately display an image corresponding to a particular place. The first example aspect of the present invention is an image display system including: a first image acquisition unit configured to acquire a first image captured by a mobile terminal; an information acquisition unit configured to acquire information including a position and an orientation of the mobile terminal that has captured the first image; a second image acquisition unit configured to, based on the position and the orientation of the mobile terminal and a position and an orientation associated with a second image stored in the past in a storage device, acquire the second image; and a difference detection unit configured to detect a difference between the first image and the second image. The second example aspect of the present i