Search

JP-7856242-B2 - Video distribution system, video distribution device, terminal, method, and program

JP7856242B2JP 7856242 B2JP7856242 B2JP 7856242B2JP-7856242-B2

Inventors

  • 川崎 洋平
  • 藤田 邦彦
  • 的場 直人

Assignees

  • ＮＴＴテクノクロス株式会社
  • 株式会社ＮＴＴドコモ

Dates

Publication Date
20260511
Application Date
20211209

Claims (14)

  1. A first creation unit creates a first overall image by converting a first frame image constituting a first video to a first width and a first height that are smaller than the width and height of the first frame image, respectively . A second creation unit creates a thumbnail image by converting a second frame image that constitutes a second video which will be a thumbnail video for the first video to a second width and second height that are smaller than the width and height of the second frame image and smaller than the width and height of the first video, respectively . A compositing unit creates a second overall image by combining the aforementioned thumbnail image with the first overall image, The distribution unit distributes the second overall image to the user terminal, A video distribution system that has the following features.
  2. A plurality of sub-region images representing each of a plurality of pre-set sub-regions for the first frame image, and having a third creation unit that creates a plurality of sub-region images with a first width and a first height , The aforementioned distribution unit, The video distribution system according to claim 1, wherein when the first video is played on the user terminal, a partial region image from among the plurality of partial region images corresponding to the display range of the user terminal when the first video is played is further distributed to the user terminal.
  3. The second video mentioned above includes a 2D video. It has a fourth creation unit that creates a 2D image in which the second frame image constituting the 2D video has a predetermined third width and third height , The aforementioned distribution unit, The video distribution system according to claim 1 or 2, wherein when the 2D video is played on the user terminal, the 2D image is further distributed to the user terminal.
  4. The second creation unit described above is: One or more thumbnail images are created by converting one or more second frame images constituting each of the one or more second videos to the second width and the second height, respectively. The aforementioned synthesis section is A video distribution system according to any one of claims 1 to 3, comprising creating a second overall image by combining one or more thumbnail images with the first overall image.
  5. The first or second video includes at least one panoramic video and zero or more 2D videos. The second creation unit described above is: The video distribution system according to claim 4, wherein one or more thumbnail images are created by converting one or more second frame images constituting each of the videos other than the video played on the user terminal from the one or more second videos to the second width and second height , respectively.
  6. The second width and the second height are both smaller than the first width and the first height , The aforementioned synthesis section is A video distribution system according to any one of claims 1 to 5, wherein the thumbnail image is embedded in the lower, upper, left, or right edge of the first overall image to composite the thumbnail image with the first overall image.
  7. The video distribution system according to any one of claims 1 to 6, wherein the first video includes a panoramic video.
  8. A first creation unit creates a first overall image by converting a first frame image constituting a first video to a first width and a first height that are smaller than the width and height of the first frame image, respectively . A second creation unit creates a thumbnail image by converting a second frame image that constitutes a second video which will be a thumbnail video for the first video to a second width and second height that are smaller than the width and height of the second frame image and smaller than the width and height of the first video, respectively . A compositing unit creates a second overall image by combining the aforementioned thumbnail image with the first overall image, The distribution unit distributes the second overall image to the user terminal, A video distribution device having the following features.
  9. A first video playback device, When a display unit receives a second overall image obtained by combining a first overall image obtained by converting a first frame image constituting the first video to a predetermined first width and first height , and a thumbnail image obtained by converting a second frame image constituting a second video that will be a thumbnail video for the first video to a second width and second height smaller than the width and height of the second frame image, and smaller than the first width and first height , the display unit displays the video composed of the first video and the thumbnail image. A terminal.
  10. The aforementioned display unit is If the first video is a panoramic video, the video composed of the thumbnail images is displayed in an area corresponding to one or more parts of the top, bottom, left, and right sides of the first video. The terminal according to claim 9, wherein, if the first video is a 2D video, the terminal displays the first video on a portion of the background with the panoramic video as the background, and displays the video composed of the thumbnail images in areas corresponding to one or more portions of the top, bottom, left, and right sides of the panoramic video.
  11. A first creation procedure for creating a first overall image by converting a first frame image constituting a first video to a first width and a first height that are smaller than the width and height of the first frame image, respectively , A second creation procedure for creating a thumbnail image by converting a second frame image that constitutes a second video which will be a thumbnail video for the first video to a second width and second height that are smaller than the width and height of the second frame image and smaller than the width and height of the first video, respectively , A synthesis procedure for creating a second overall image by combining the aforementioned thumbnail image with the first overall image, The distribution procedure for delivering the second overall image to the user terminal, How a computer executes it.
  12. The first device capable of playing the video is A display procedure that, upon receiving a second overall image obtained by combining a first overall image obtained by converting a first frame image constituting the first video to a predetermined first width and first height , and a thumbnail image obtained by converting a second frame image constituting a second video that will be a thumbnail video for the first video to a second width and second height smaller than the width and height of the second frame image, and smaller than the first width and first height, respectively, displays the video composed of the first video and the thumbnail image. How to do it.
  13. A first creation procedure for creating a first overall image by converting a first frame image constituting a first video to a first width and a first height that are smaller than the width and height of the first frame image, respectively , A second creation procedure for creating a thumbnail image by converting a second frame image that constitutes a second video which will be a thumbnail video for the first video to a second width and second height that are smaller than the width and height of the second frame image and smaller than the width and height of the first video, respectively , A synthesis procedure for creating a second overall image by combining the aforementioned thumbnail image with the first overall image, The distribution procedure for delivering the second overall image to the user terminal, A program that causes a computer to execute something.
  14. On a device capable of playing the first video, A display procedure that, upon receiving a second overall image obtained by combining a first overall image obtained by converting a first frame image constituting the first video to a predetermined first width and first height , and a thumbnail image obtained by converting a second frame image constituting a second video that will be a thumbnail video for the first video to a second width and second height smaller than the width and height of the second frame image, and smaller than the first width and first height, respectively, displays the video composed of the first video and the thumbnail image. A program that executes the command.

Description

Applicable under Article 30, Paragraph 2 of the Patent Law. Published on January 21, 2021 at https://www.nttdocomo.co.jp/info/news_release/2021/01/21_01.html. Published on February 4, 2021 at https://docomo-openhouse-2021.jp/pre/. Published on December 14, 2020 at https://www.nttdocomo.co.jp/info/news_release/2020/12/14_00.html. This invention relates to a video distribution system, a video distribution device, a terminal, a method , and a program. In recent years, videos that allow viewing in all directions—360 degrees—have become known. Such videos are called panoramic videos (also known as "panoramic videos," "360-degree panoramic videos," "VR (Virtual Reality) videos," "VR videos," or "3D videos"). Conversely, regular videos that are not panoramic are sometimes called "2D videos" in contrast to panoramic videos. Furthermore, for example, a video distribution server may stream panoramic videos to a client terminal, allowing the client terminal to view the video. However, panoramic videos generally have large data sizes, which can make distribution time-consuming and delay the display of the video on the client terminal. In contrast, a technology is known that delivers the area displayed on the client terminal (hereinafter also referred to as the "viewing area") in normal quality, while delivering the area not displayed on the client terminal in low quality (for example, Non-Patent Document 1). By using this technology, it becomes possible to reduce the time required to deliver panoramic videos while suppressing a decrease in the user's viewing quality when viewing panoramic videos via streaming, etc. Daisuke Ochi, Shinnosuke Iwaki, "Real-time 360-degree video distribution system (Special Feature: Dwango x NTT R&D Collaboration)", NTT Technical Journal 27(4), 51-54, 2015-04 This diagram illustrates examples of partial area tiles and overall reduction tiles.This figure shows an example of the overall configuration of a video distribution system according to the first embodiment.This diagram illustrates an example of VR viewing mode and 2D viewing mode.This figure shows an example of the functional configuration of a video distribution system according to the first embodiment.This is a sequence diagram showing an example of video distribution processing according to the first embodiment.This is a diagram (part 1) illustrating an example of combining a full-size reduced tile and thumbnail tiles for panoramic video.This is a diagram (part 2) illustrating an example of combining a full-size reduced tile and thumbnail tiles for panoramic video.This is a sequence diagram showing an example of the mode switching process according to the first embodiment.This is a diagram (part 1) illustrating an example of switching from VR viewing mode to 2D viewing mode.This is a diagram (part 2) illustrating an example of switching from VR viewing mode to 2D viewing mode.This diagram illustrates an example of switching from 2D viewing mode to VR viewing mode.This is a diagram illustrating an example of a ROI panoramic video.This is a sequence diagram showing an example of video distribution processing according to the second embodiment. The following describes a first and second embodiment as an embodiment of the present invention. [First Embodiment] First, the first embodiment will be described. In this embodiment, a video distribution system 1 that allows viewing while switching between panoramic video and 2D video will be described. <How to distribute panoramic videos> As a prerequisite for this embodiment, a panoramic video distribution method described in Non-Patent Document 1 will be explained. In the technology described in Non-Patent Document 1, the field of view displayed on the client terminal is distributed in normal quality, while the rest of the field of view is distributed in low quality. For example, as shown in Figure 1, in a panoramic video represented by a full-dome projection sphere, the observation position is the center of the full-dome projection sphere, and the field of view is the range captured by a pseudo-camera device at this observation position with a predetermined angle of view. Furthermore, a panoramic video represented by a full-dome projection sphere can be represented using an equirectangular projection with a vertical angle θ of 0 to π and a horizontal angle φ of 0 to 2π. In this case, the technology described in Non-Patent Document 1 delivers a portion of the panoramic video (more precisely, the frame images of that panoramic video) represented using an equirectangular projection, including the field of view, as a "partial region tile," and a compressed image of the entire panoramic video as a "whole reduced tile," to the client terminal. By using this technology, the time required for delivering the panoramic video can be reduced, high-quality video can be viewed within the field of view, and the video can be viewed without interruption even when the field of view is moved. Here, compressio