US-12627789-B2 - Information processing device, information processing method, and program

Abstract

An information processing device includes a line-of-sight information acquisition unit that acquires line-of-sight information about viewers on a shared screen displayed on a display unit, and a line-of-sight guidance display determination unit that determines whether to display line-of-sight guidance for guiding the lines of sight of the viewers, on the basis of the line-of-sight information about the viewers.

Inventors

• Ryouhei YASUDA
• Yuhei Taki
• Kunihito Sawai
• SHIMENG PENG

Assignees

• Sony Group Corporation

Dates

Publication Date

20260512

Application Date

20230526

Priority Date

20220607

Claims (20)

1. 1 . An information processing method comprising: receiving line-of-sight information about a plurality of viewers on a shared screen displayed on a display device; calculating a degree of correlation of the line-of-sight information between the plurality of viewers based on a degree of dispersion of the line-of-sight information about the plurality of viewers; and determining whether to display line-of-sight guidance for guiding lines of sight of the plurality of viewers, based on the line-of-sight information about the plurality of viewers, wherein the line-of-sight information includes multiple information items about the lines of sight of the plurality of viewers, and wherein it is determined whether to display the line-of-sight guidance based on the degree of correlation of the multiple information items about the lines of sight of the plurality of viewers calculated based on the degree of dispersion.
2. 2 . The information processing method according to claim 1 , wherein the method further comprises receiving operation information about a pointing operation performed on the shared screen by a presenter, and wherein it is determined to display the line-of-sight guidance when the pointing operation is not performed.
3. 3 . The information processing method according to claim 1 , wherein the method further comprises calculating a correlation value of the line-of-sight information between the plurality of viewers, and wherein it is determined whether to display the line-of-sight guidance further based on the correlation value.
4. 4 . The information processing method according to claim 1 , wherein the line-of-sight information includes coordinates of focus points of the plurality of viewers on the shared screen.
5. 5 . The information processing method according to claim 4 , wherein the degree of correlation is calculated further based on information corresponding to orientation of characters displayed on the shared screen.
6. 6 . The information processing method according to claim 4 , wherein the degree of correlation is calculated further based on information corresponding to an aspect ratio of the display device.
7. 7 . The information processing method according to claim 1 , wherein the line-of-sight information includes rotation information about pupils of the plurality of viewers.
8. 8 . The information processing method according to claim 1 , wherein the degree of correlation is calculated by assigning weights to the multiple information items included in the line-of-sight information.
9. 9 . The information processing method according to claim 1 , wherein the method further comprises controlling display of the line-of-sight guidance when it is determined that the line-of-sight guidance is to be displayed.
10. 10 . The information processing method according to claim 9 , wherein the display device is controlled to display, as the line-of-sight guidance display, a blurred region outside of a predetermined range with respect to a focus point of a presenter on the shared screen.
11. 11 . The information processing method according to claim 9 , wherein the display device is controlled to display, as the line-of-sight guidance display, a marker with respect to a focus point of a presenter on the shared screen.
12. 12 . The information processing method according to claim 9 , wherein the display device is controlled to display, as the line-of-sight guidance display, a moving icon with respect to a focus point of a presenter on the shared screen.
13. 13 . The information processing method according to claim 9 , wherein the display device is controlled to display, as the line-of-sight guidance display, line-of-sight guidance animation from a focus point of at least one viewer of the plurality of viewers viewer to a focus point of a presenter on the shared screen.
14. 14 . The information processing method according to claim 1 , wherein the method further comprises switching whether or not to display the line-of-sight guidance in response to an instruction of a presenter.
15. 15 . The information processing method according to claim 1 , wherein the method further comprises determining that the line-of-sight guidance is not to be displayed for a predetermined period after the shared screen is switched.
16. 16 . The information processing method according to claim 1 , wherein when the display device displays the shared screen on which focus points of the plurality of viewers concentrate at a certain point, it is determined that the line-of-sight guidance is not to be displayed.
17. 17 . An information processing device comprising: circuitry configured to receive line-of-sight information about viewers on a shared screen displayed on a display device, calculate a degree of correlation of the line-of-sight information between the plurality of viewers based on a degree of dispersion of the line-of-sight information about the plurality of viewers, and determine whether to display line-of-sight guidance for guiding lines of sight of the plurality of viewers, based on the line-of-sight information about the plurality of viewers, wherein the line-of-sight information includes multiple information items about the lines of sight of the plurality of viewers, and wherein the circuitry determines whether to display the line-of-sight guidance based on the degree of correlation of the multiple information items about the lines of sight of the plurality of viewers calculated based on the degree of dispersion.
18. 18 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by that causes an information processing device of a computer causes the computer to execute a method, the method comprising: receiving line-of-sight information about viewers on a shared screen displayed on a display device; calculating a degree of correlation of the line-of-sight information between the plurality of viewers based on a degree of dispersion of the line-of-sight information about the plurality of viewers; and determining whether to display line-of-sight guidance for guiding lines of sight of the plurality of viewers, based on the line-of-sight information about the plurality of viewers, wherein the line-of-sight information includes multiple information items about the lines of sight of the plurality of viewers, and wherein it is determined whether to display the line-of-sight guidance based on the degree of correlation of the multiple information items about the lines of sight of the plurality of viewers calculated based on the degree of dispersion.
19. 19 . An information processing method comprising: receiving line-of-sight information about a plurality of viewers on a shared screen displayed on a display device; calculating a degree of correlation of the line-of-sight information between the plurality of viewers; and determining whether to display line-of-sight guidance for guiding lines of sight of the plurality of viewers, based on the line-of-sight information about the plurality of viewers; wherein the line-of-sight information includes coordinates of focus points of the plurality of viewers on the shared screen and includes multiple information items about the lines of sight of the plurality of viewers, wherein the degree of correlation is calculated based on information corresponding to an aspect ratio of the display device, and wherein it is determined whether to display the line-of-sight guidance based on the degree of correlation of the multiple information items about the lines of sight of the plurality of viewers calculated based on the aspect ratio of the display device.
20. 20 . An information processing method comprising: receiving line-of-sight information about a plurality of viewers on a shared screen displayed on a display device; calculating a degree of correlation of the line-of-sight information between the plurality of viewers; and determining whether to display line-of-sight guidance for guiding lines of sight of the plurality of viewers, based on the line-of-sight information about the plurality of viewers; wherein the line-of-sight information includes multiple information items about the lines of sight of the plurality of viewers, wherein the degree of correlation is calculated by assigning weights to the multiple information items included in the line-of-sight information, and wherein it is determined whether to display the line-of-sight guidance based on the degree of correlation of the multiple information items about the lines of sight of the plurality of viewers calculated by assigning the weights to the multiple information items included in the line-of-sight information.

Description

CROSS REFERENCE TO PRIOR APPLICATION This application is a National Stage Patent Application of PCT International Patent Application No. PCT/JP2023/019671 (filed on May 26, 2023) under 35 U.S.C. § 371, which claims priority to Japanese Patent Application No. 2022-092460 (filed on Jun. 7, 2022), which are all hereby incorporated by reference in their entirety. TECHNICAL FIELD The present technique relates to an information processing device, an information processing method, and a program and particularly relates to a technique for online communications. BACKGROUND ART For example, PTL1 describes a device that displays a guidance image for guiding the lines of sight of participants (viewers) to the position of attention of a presenter when it is determined that the participants do not focus attention on an image portion corresponding to the position of attention of the presenter who makes a presentation through a network. CITATION LIST Patent Literature PTL 1: JP 2018-77417A SUMMARY Technical Problem In the foregoing device, if the presenter does not constantly focus attention on an image portion being explained, the position of attention of the presenter may be frequently displaced from those of viewers, so that a guidance image may be frequently displayed. In this case, the foregoing device may confuse viewers and disable effective guidance of viewer's lines of sight. Accordingly, an object of the present technique is to effectively guide a viewer's line of sight. Solution to Problem An information processing device according to the present technique includes a line-of-sight information acquisition unit that acquires line-of-sight information about viewers on a shared screen displayed on a display unit, and a line-of-sight guidance display determination unit that determines whether to display line-of-sight guidance for guiding lines of sight of the viewers, on the basis of the line-of-sight information about the viewers. Thus, the information processing devices can display line-of-sight guidance regardless of the focus point of a presenter when the focus points of the viewers are dispersed. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is an explanatory drawing of the configuration of an online communication system. FIG. 2 is an explanatory drawing of the configuration of an information processing device. FIG. 3 is an explanatory drawing of the functional configuration of a CPU. FIG. 4 is an explanatory drawing of a shared screen displayed in online communications. FIG. 5 is an explanatory drawing of the focus points of viewers when a moving pointer is displayed. FIG. 6 is an explanatory drawing of the focus points of the viewers when the moving pointer is not displayed. FIG. 7 is an explanatory drawing of graphs when a correlation value is high. FIG. 8 is an explanatory drawing of graphs when a correlation value is low. FIG. 9 is an explanatory drawing of line-of-sight information used for calculating a correlation value when a display unit is horizontally oriented. FIG. 10 is an explanatory drawing of line-of-sight information used for calculating a correlation value when the display unit is vertically oriented. FIG. 11 is an explanatory drawing of a method for calculating a correlation value when multiple devices are provided as line-of-sight detectors. FIG. 12 shows heat maps based on line-of-sight information. FIG. 13 shows the heat map of line-of-sight information about a presenter. FIG. 14 is an explanatory drawing showing an example of line of sight guidance display according to specific example 1. FIG. 15 is an explanatory drawing showing an example of line-of-sight guidance display according to specific example 2. FIG. 16 is an explanatory drawing showing an example of line-of-sight guidance display according to specific example 3. FIG. 17 is an explanatory drawing showing an example of line-of-sight guidance display according to specific example 4. FIG. 18 is a flowchart showing a flow of line of sight guidance display control. DESCRIPTION OF EMBODIMENT Hereinafter, an embodiment will be described in the following order. <1. Configuration of online communication system 1><2. Configuration of information processing device 2><3. Outline of online communications><4. Determination processing><5. Line-of-sight guidance display processing><6. Flow of line-of-sight guidance display control><7. Other configuration examples of online communication system 1><8. Summary of embodiment><9. Present technique> 1. Configuration of Online Communication System 1 The configuration of an online communication system 1 as an embodiment of the present technique will be described first. FIG. 1 is an explanatory drawing of the configuration of the online communication system 1. As illustrated in FIG. 1, the online communication system 1 includes a plurality of information processing devices 2. The information processing devices 2 are connected via a network 3, e.g., the Internet and can communicate with one another via the netwo