US-12620105-B2 - Display terminal, communication system, and non-transitory recording medium

US12620105B2US 12620105 B2US12620105 B2US 12620105B2US-12620105-B2

Abstract

A display terminal includes circuitry that: displays a predetermined-area moving image; receives designation of a first object visible in a first predetermined-area moving image being a predetermined-area moving image in a first display area and representing a first predetermined area of the wide-view moving image; receives designation of a second object visible in a second predetermined-area moving image being a predetermined-area moving image in a second display area and representing a second predetermined area of the wide-view moving image; displays the first predetermined-area moving image such that movement of the first object is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; and displays the second predetermined-area moving image such that movement of the second object is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area.

Inventors

Junpei MIKAMI
Daisuke Saitoh
Hiroshi HINOHARA
Takeshi Homma

Assignees

RICOH COMPANY, LTD.

Dates

Publication Date: 20260505
Application Date: 20250108
Priority Date: 20220516

Claims (20)

1 . A display terminal, comprising: circuitry configured to: display a predetermined-area moving image representing a predetermined area of a wide-view moving image, the wide-view moving image having a viewing angle in a wide range; receive designation of a first object visible in a first predetermined-area moving image, the first predetermined-area moving image being a predetermined-area moving image in a first display area representing a first predetermined area of the wide-view moving image; receive designation of a second object visible in a second predetermined-area moving image, the second predetermined-area moving image being a predetermined-area moving image in a second display area and representing a second predetermined area of the wide-view moving image; display the first predetermined-area moving image such that movement of the first object that is designated is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; display the second predetermined-area moving image such that movement of the second object that is designated is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area; receive a request for hiding at least one of the first display area or the second display area; and adjust display so that the at least one of the first display area or the second display area, for which the request is received, is invisible.
2 . The display terminal according to claim 1 , wherein the circuitry is further configured to: receive a request for adding a display area to the first display area; and display the second display area for displaying the second predetermined-area moving image.
3 . The display terminal according to claim 2 , wherein in displaying the second display area, the circuitry is configured to display, in the second display area, the second predetermined-area moving image that is the same as the first predetermined-area moving image.
4 . The display terminal according to claim 3 , wherein the circuitry is further configured to: transmit one of position information indicating a position of the first object in the wide-view moving image and point-of-view information indicating the first predetermined area, to an information processing system that distributes the wide-view moving image to display the first predetermined-area moving image, such that movement of the first object is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; receive the one of the position information and the point-of-view information from the information processing system to additionally display the second display area; and display, based on the received one of the position information and the point-of-view information, the second predetermined-area moving image that is same as the first predetermined-area moving image, in the second display area.
5 . The display terminal according to claim 1 , wherein the circuitry is further configured to display the first predetermined-area moving image such that the first object that is designated is visible in a center of the first predetermined-area moving image.
6 . The display terminal according to claim 1 , wherein the circuitry is further configured to display the second predetermined-area moving image such that the second object that is designated is visible in a center of the second predetermined-area moving image.
7 . The display terminal according to claim 1 , wherein the circuitry is further configured to display video of one or more sites of one or more users who are in a virtual room, simultaneously with the first predetermined-area moving image and the second predetermined-area moving image.
8 . The display terminal according to claim 1 , wherein the wide-view moving image includes a moving image having a viewing angle in a wider range than a display range of the display terminal at a time.
9 . The display terminal according to claim 8 , wherein the wide-view moving image includes a spherical image in equirectangular projection format, an omnidirectional image, a hemispherical image, a three-dimensional (3D) panoramic image, a two-dimensional (2D) panoramic image, or a virtual reality (VR) image.
10 . The display terminal according to claim 1 , wherein the circuitry is further configured to: convert a single frame of the wide-view moving image including the first predetermined-area moving image being displayed in the first display area into a feature value; detect a position of the first object in the single frame by using the feature value; and display the first predetermined-area moving image such that movement of the first object for which the position is detected is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area.
11 . The display terminal according to claim 1 , wherein the circuitry is further configured to: convert a single frame of the wide-view moving image including the second predetermined-area moving image being displayed in the second display area into a feature value; detect a position of the second object in the single frame by using the feature value; and display the second predetermined-area moving image such that movement of the second object for which the position is detected is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area.
12 . The display terminal according to claim 7 , further comprising: a display, wherein the circuitry is configured to control the display to display the predetermined-area moving image; control the display to display the first predetermined-area moving image; control the display to display the second predetermined-area moving image; and control the display to display the video.
13 . The display terminal according to claim 7 , wherein the circuitry is further configured to control a projector to display the predetermined-area moving image; control the projector to display the first predetermined-area moving image; control the projector to display the second predetermined-area moving image; and control the projector to display the video.
14 . The display terminal according to claim 7 , wherein the virtual room is a communication session in which the wide-view moving image is shared.
15 . A communication system comprising: a display terminal comprising circuitry; and an image capturing apparatus configured to capture an image to generate a wide-view moving image having a viewing angle in a wide range and transmit the wide-view moving image to the display terminal, the circuitry of the display terminal being configured to: display a predetermined-area moving image representing a predetermined area of the wide-view moving image; receive designation of a first object visible in a first predetermined-area moving image, the first predetermined-area moving image being a predetermined-area moving image in a first display area and representing a first predetermined area of the wide-view moving image; receive designation of a second object visible in a second predetermined-area moving image, the second predetermined-area moving image being a predetermined-area moving image in a second display area and representing a second predetermined area of the wide-view moving image; display the first predetermined-area moving image such that movement of the first object that is designated is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; display the second predetermined-area moving image such that movement of the second object that is designated is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area; receive a request for hiding at least one of the first display area or the second display area; and adjust display so that the at least one of the first display area or the second display area, for which the request is received, is invisible.
16 . The communication system according to claim 15 , wherein the circuitry is further configured to: receive a request for adding a display area to the first display area; and display the second display area for displaying the second predetermined-area moving image.
17 . The communication system according to claim 16 , wherein in displaying the second display area, the circuitry is configured to display, in the second display area, the second predetermined-area moving image that is the same as the first predetermined-area moving image.
18 . The communication system according to claim 17 , wherein the circuitry is further configured to: transmit one of position information indicating a position of the first object in the wide-view moving image and point-of-view information indicating the first predetermined area, to an information processing system that distributes the wide-view moving image to display the first predetermined-area moving image, such that movement of the first object is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; receive the one of the position information and the point-of-view information from the information processing system to additionally display the second display area; and display, based on the received one of the position information and the point-of-view information, the second predetermined-area moving image that is same as the first predetermined-area moving image, in the second display area.
19 . The communication system according to claim 15 , wherein the circuitry is further configured to display the first predetermined-area moving image such that the first object that is designated is visible in a center of the first predetermined-area moving image.
20 . A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, causes the processors to perform a display method comprising: displaying a predetermined-area moving image on a display, the predetermined-area moving image representing a predetermined area of a wide-view moving image, the wide-view moving image having a viewing angle in a wide range; receiving designation of a first object visible in a first predetermined-area moving image, the first predetermined-area moving image being a predetermined-area moving image in a first display area and representing a first predetermined area of the wide-view moving image; receiving designation of a second object visible in a second predetermined-area moving image, the second predetermined-area moving image being a predetermined-area moving image in a second display area and representing a second predetermined area of the wide-view moving image; displaying, on the display, the first predetermined-area moving image such that movement of the first object that is designated is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; displaying, on the display, the second predetermined-area moving image such that movement of the second object that is designated is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area receiving a request for hiding at least one of the first display area or the second display area; and adjusting display so that the at least one of the first display area or the second display area, for which the request is received, is invisible.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This patent application is a continuation application of U.S. application Ser. No. 18/142,030, filed May 2, 2023, which is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2022-080275, filed on May 16, 2022, in the Japan Patent Office, the entire disclosures of each are hereby incorporated by reference herein. BACKGROUND Technical Field The present disclosure relates to a display terminal, a communication system, and a non-transitory recording medium. Related Art A wide-field-of-view image having a wide viewing angle and captured in a wide imaging range as an imaging range including even an area that is difficult for a normal angle of view to cover is known. The wide-field-of-view image is hereinafter referred to as a “wide-view image”. Examples of the wide-view image include a 360-degree image that is a captured image of an entire 360-degree view. The 360-degree image is also referred to as a spherical image, an omnidirectional image, or an “all-around” image. The wide-view image is generated by capturing an image of an object or surroundings such as scenery with a spherical imaging camera. The wide-view image looks entirely distorted to a user who views the wide-view image. A predetermined area, which is a portion of the wide-view image, may be displayed on a display unit such as a display for viewing. SUMMARY According to an embodiment of the present disclosure, a display terminal includes circuitry. The circuitry causes a display to display a predetermined-area moving image representing a predetermined area of a wide-view moving image having a viewing angle in a wide range; receives designation of a first object visible in a first predetermined-area moving image, the first predetermined-area moving image being a predetermined-area moving image in a first display area displayed on the display and representing a first predetermined area in the wide-view moving image; receives designation of a second object visible in a second predetermined-area moving image, the second predetermined-area moving image being a predetermined-area moving image in a second display area displayed on the display and representing a second predetermined area in the wide-view moving image; causes the display to display the first predetermined-area moving image such that movement of the first object that is designated is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; and causes the display to display the second predetermined-area moving image such that movement of the second object that is designated is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area. According to an embodiment of the present disclosure, a communication system includes the display terminal and an image capturing apparatus. The image capturing apparatus captures an image to generate a wide-view moving image having a viewing angle in a wide range and transmits the wide-view moving image to the display terminal. According to an embodiment of the present disclosure, a non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, causes the processors to perform a display method. The display method includes displaying a predetermined-area moving image on a display, the predetermined-area moving image representing a predetermined area of a wide-view moving image having a viewing angle in a wide range; receiving designation of a first object visible in a first predetermined-area moving image, the first predetermined-area moving image being a predetermined-area moving image in a first display area displayed on the display and representing a first predetermined area in the wide-view moving image; receiving designation of a second object visible in a second predetermined-area moving image, the second predetermined-area moving image being a predetermined-area moving image in a second display area displayed on the display and representing a second predetermined area in the wide-view moving image; displaying, on the display, the first predetermined-area moving image such that movement of the first object that is designed is tracked to make the first object continuously visible in the first predetermined-area moving image within the first display area; and displaying, on the display, the second predetermined-area moving image such that movement of the second object that is designed is tracked to make the second object continuously visible in the second predetermined-area moving image within the second display area. BRIEF DESCRIPTION OF THE DRAWINGS A more complete appreciation of embodiments of the present disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accom