Search

JP-7855885-B2 - Communication terminal, remote control method, and program

JP7855885B2JP 7855885 B2JP7855885 B2JP 7855885B2JP-7855885-B2

Inventors

  • 荒海 雄一
  • 冨井 靖浩

Assignees

  • 株式会社リコー

Dates

Publication Date
20260511
Application Date
20220322

Claims (6)

  1. A communication terminal that can be remotely controlled for a remotely controlled mobile device, A receiving unit that receives remote control requests for multiple targets of the remotely operated mobile device, A transmitting unit that enables remote control of the multiple target objects by transmitting operation information indicating the remote control of the multiple target objects to which different operating rights apply, A display control unit that displays a screen associated with the communication terminal or the user of the communication terminal to which the current operating rights are set, for each of the multiple operating targets of the remotely operated mobile device, immediately after the start of video distribution or in response to a predetermined operation during video distribution, A communication terminal characterized by having the following features.
  2. The communication terminal according to claim 1 , characterized in that the display control unit causes the display control unit to display information regarding the operating rights set for another communication terminal or another user having said other communication terminal.
  3. The communication terminal according to claim 2 , characterized in that the information relating to the operating right displays the elapsed time since the operating right was applied to the target of the operating right.
  4. The communication terminal according to any one of claims 1 to 3 , characterized in that the remotely operated mobile device is a telepresence robot.
  5. A remote control method performed by a remotely controllable communication terminal on a remotely controlled mobile device, The aforementioned communication terminal is The remotely controlled mobile device receives remote control commands for multiple targets to be operated, By transmitting operation information indicating the remote operation of the plurality of operating targets to which the exclusive operating rights apply, the plurality of operating targets are made remotely controllable. For each of the multiple targets of the remotely controlled mobile device, a screen displaying the communication terminal or the user of the communication terminal to which the current operating rights are set will be displayed immediately after video distribution begins or in response to a predetermined operation during video distribution. A remote control method characterized by the following.
  6. For a remotely controlled mobile device, and for a remotely controllable communication terminal , The remotely controlled mobile device receives remote control requests for multiple targets, By transmitting operation information indicating the remote operation of the multiple targets to which the exclusive operating rights apply, the multiple targets are made remotely controllable. For each of the multiple targets of the remotely controlled mobile device, a screen displaying the communication terminal or the user of the communication terminal to which the current operating rights are set will be displayed immediately after video distribution begins or in response to a predetermined operation during video distribution. A program characterized by the following features.

Description

This disclosure pertains to communication terminals, communication management systems, remotely operated mobile devices, communication systems, remote operation methods, communication management methods, control methods, communication methods, and programs. Communication systems that allow communication terminals to communicate between multiple locations via communication networks such as the internet or LAN (Local Area Network) to send and receive video and/or audio are becoming widespread. This communication system enables users at remote locations to communicate with each other, for example, to hold remote meetings. Furthermore, telepresence robots (hereinafter referred to as "robots") that combine remote conferencing, robotics, and remote control technologies are known (see Patent Document 1). This technology combines remote control from a remote location with robotics technology, allowing a user to operate a robot from a remote location and make it behave as if the user were physically present (present) at a given location. The robot typically features a display, enabling remote conferencing and remotely controlled movement. The user can conduct remote meetings using a PC (Personal Computer), smartphone, or tablet, controlling the robot located at the other end of the line from a remote location. This allows the user to control who they communicate with and where they go. Unlike conventional remote conferencing technologies, the robot acts as a surrogate for the user, moving to different locations and engaging in conversations, providing an unprecedented sense of presence to the remote party. Furthermore, there are facilities such as museums and art galleries that exhibit valuable objects, academic materials, and works of art to visitors in the form of displays. Due to the recent decrease in visitors caused by the COVID-19 lockdown, services such as online experiential tours have begun to be offered. There is also a movement towards introducing such services in corporate showrooms. In these types of services, pilot projects are underway to introduce remote tours utilizing robots, allowing users in remote locations to freely tour facilities online. These remote tours provide multiple users in remote locations with a simulated experience of visiting the facility by viewing video footage captured by robots. Furthermore, users can also remotely control the robots to freely explore the facility. This is an example of a diagram illustrating the general outline of a communication system.This diagram illustrates an example of displaying a 360-degree image captured by a wide-angle camera.This figure shows an example configuration of a communication system according to one embodiment.This figure shows an example of the hardware configuration of a communication terminal according to one embodiment.This figure shows an example of the hardware configuration of a communication management system.This figure shows an example of the hardware configuration of a mobile device.This is a hardware configuration diagram of an example of a wide-angle imaging device.This is an example of a diagram illustrating the use of a wide-angle photographic device.This diagram illustrates the general process for creating equirectangular projection images and 360-degree images from images captured by a wide-angle imaging device.This diagram illustrates the general process for creating equirectangular projection images and 360-degree images from images captured by a wide-angle imaging device.This diagram shows the positions of a virtual camera and a predetermined region when a 360-degree image is treated as a three-dimensional sphere.This figure shows an example of a stereoscopic perspective view, etc., as shown in Figure 11.This is an example of a diagram illustrating the relationship between information in a given region and an image of that region.This is a functional block diagram of each device or system that makes up a communication system.This is a functional block diagram of each device or system that makes up a communication system.This is a sequence diagram illustrating an example of the processing during the preparation phase of a communication system.This figure shows an example of a destination selection screen displayed on a communication terminal.This is a sequence diagram illustrating an example of communication processing in a communication system.This figure shows the display screen for operation rights information.This is a sequence diagram showing the process (part 1) for remotely controlling a telepresence robot.This is a sequence diagram showing the process (part 2) for remotely controlling a telepresence robot.This is an illustrative diagram showing how this embodiment is applied to an online tour of a museum.This is an example of a screen displayed on communication terminal 10A during an online tour of the museum.This is an illustrative diagram showing the application of this embodiment to remote shopping.This is an