Search

US-12619073-B2 - Control device, control method for head-mounted display device, and program

US12619073B2US 12619073 B2US12619073 B2US 12619073B2US-12619073-B2

Abstract

A control device includes a determination unit that determines an image visually recognized by a user among a plurality of images displayed by an image display unit based on at least one of the line of sight of the user and the orientation of the head of the user, a setting unit that sets, as a first image, an image having the highest number of determination times that an image has been determined as an image visually recognized by the user among the plurality of images displayed by the image display unit, and sets, as a second image, an image having the second highest number of determination times after the first image, and a display control unit that changes a display position of the second image so that a display distance between the first image and the second image being displayed becomes shorter than a preset distance.

Inventors

  • Shinichi Kobayashi

Assignees

  • SEIKO EPSON CORPORATION

Dates

Publication Date
20260505
Application Date
20230719
Priority Date
20220720

Claims (11)

  1. 1 . A control device configured to control a head-mounted display device mounted on the head of a user and including a display unit configured to display a plurality of images to be seen as superimposed on an outside view, the control device comprising: a first detection unit configured to detect a direction of a line of sight of the user; a second detection unit configured to detect an orientation of the head of the user; a determination unit configured to determine, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among the plurality of images currently displayed on the display unit to be seen as superimposed on the outside view; a setting unit configured to set, as a first image, an image that is visually recognized by the user for the highest number of times among the plurality of images currently displayed on the display unit, and set, as a second image, an image that is visually recognized by the user for the second highest number of times; and a display control unit configured to change a display position of the second image to be closer to a display position of the first image so that a display distance between the first image and the second image is smaller than a preset distance.
  2. 2 . The control device according to claim 1 , wherein the setting unit counts, for each of the plurality of images, a number of determination times per unit time that the determination unit determined to be the image visually recognized by the user, sets, as the first image, an image that is visually recognized by the user for the highest number of times with the number of determination times per unit time equal to or greater than a preset number of times, and sets, as the second image, an image that is visually recognized by the user for the second highest number of times with the number of determination times per unit time equal to or greater than the preset number of times.
  3. 3 . The control device according to claim 1 , wherein the display control unit changes the display position of the second image so that the display distance between the first image and the second image is smaller than the preset distance when the display distance before the change is greater than the preset distance.
  4. 4 . The control device according to claim 1 , comprising a storage unit configured to store setting information configured to set a priority of the display position of the second image with respect to the display position of the first image, wherein the display control unit changes the display position of the second image based on the display position of the first image and the setting information.
  5. 5 . The control device according to claim 1 , comprising: an imaging unit configured to capture an image of an outside view; and a third detection unit configured to detect an object visually recognized by the user from a captured image generated by the imaging unit, wherein the display control unit changes the display position of the second image so that the second image is displayed on a same side as the first image when the first image and the second image are displayed on both sides of the object, that is both above and below the object or both left and right of the object.
  6. 6 . The control device according to claim 5 , wherein the display unit displays an image associated with the object detected by the third detection unit.
  7. 7 . The control device according to claim 5 , comprising a fourth detection unit configured to detect a distance to the object, wherein the display unit displays the plurality of images at positions corresponding to the distance detected by the fourth detection unit.
  8. 8 . The control device according to claim 1 , wherein the determination unit is configured to determine whether or not the user visually recognized an image by changing a direction of a line of sight while rotating the head, the setting unit is configured to generate a counting table in which a count value is registered, the count value being obtained by counting the number of times that the user visually recognized an image of the plurality of images, and a value to be added to the count value, in the counting table, corresponding to the image visually recognized by the user when the user visually recognized the image by changing the direction of the line of sight while rotating the head is set to be greater than a value to be added to the count value, in the counting table, corresponding to the image visually recognized by the user when the user visually recognized the image by changing the direction of the line of sight without rotating the head.
  9. 9 . The control device according to claim 1 , wherein when the line of sight of the user is directed to a respective image currently displayed on the display unit for a preset time or longer, increase a counter counting the number of times the respective image is visually recognized, by 1, and each of the plurality of images currently displayed on the display unit has the respective counter.
  10. 10 . A control method for a head-mounted display device mounted on the head of a user and including a display unit configured to display a plurality of images to be seen as superimposed on an outside view, the control method comprising: a first step of detecting a direction of a line of sight of the user; a second step of detecting an orientation of the head of the user; a third step of determining, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among the plurality of images currently displayed on the display unit to be seen as superimposed on the outside view; a fourth step of setting, as a first image, an image that is visually recognized by the user for the highest number of times among the plurality of images currently displayed on the display unit, and setting, as a second image, an image that is visually recognized by the user for the second highest number of times; and a fifth step of changing a display position of the second image to be closer to a display position of the first image so that a display distance between the first image and the second image is smaller than a preset distance.
  11. 11 . A non-transitory computer-readable storage medium storing a program executed by a computer mounted in a control device, the control device being configured to control a head-mounted display device mounted on the head of a user and including a display unit configured to display a plurality of images to be seen as superimposed on an outside view, the program causing the computer to perform: a first procedure of detecting a direction of a line of sight of the user; a second procedure of detecting an orientation of the head of the user; a third procedure of determining, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among the plurality of images currently displayed on the display unit to be seen as superimposed on the outside view; a fourth procedure of setting, as a first image, an image that is visually recognized by the user for the highest number of times among a plurality of the images currently displayed on the display unit, and setting, as a second image, an image that is visually recognized by the user for the second highest number of times; and a fifth procedure of changing a display position of the second image to be closer to a display position of the first image so that a display distance between the first image and the second image is smaller than a preset distance.

Description

The present application is based on, and claims priority from JP Application Serial Number 2022-115363, filed Jul. 20, 2022, the disclosure of which is hereby incorporated by reference herein in its entirety. BACKGROUND 1. Technical Field The present disclosure relates to a control device, a control method for a head-mounted display device, and a program. 2. Related Art In the related art, a technology for a head-mounted display device which is designed to be mounted on the head of a user U and includes a display unit that displays images of outside views to be visually recognized is known. The technology allows images displayed by the display unit to change according to movement of the head of the user U. JP-A-2021-119364 is about a head-mounted display device that allows outside views to be visually recognized and includes a display control unit that controls display of an image display unit. The display control unit controls the display of the image display unit in a first mode when the movement of the head of the user U is a movement in a first direction by a value exceeding a first predetermined threshold and in a second mode when the movement of the head of the user U is a movement in a second direction by a value exceeding a second predetermined threshold. However, the head of the user needs to be moved to switch the mode of display, and thus a technique capable of changing an image displayed by the display unit to be displayed in accordance with the state of the display unit being used has been demanded. SUMMARY The present disclosure is about a control device configured to control a head-mounted display device mounted on the head of a user and including a display unit configured to display an image of an outside view so as to be visually recognized, the control device including a first detection unit configured to detect a direction of a line of sight of the user, a second detection unit configured to detect an orientation of the head of the user, a determination unit configured to determine, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among a plurality of images displayed by the display unit, a setting unit configured to set, as a first image, an image with the highest number of times determined by the determination unit to be the image visually recognized by the user among a plurality of the images displayed by the display unit, and set, as a second image, an image with the second highest number of times determined by the determination unit to be the image visually recognized by the user after the first image, and a display control unit configured to change a display position of the second image so that a display distance that is a distance on the display between the first image and the second image is smaller than a preset distance. The present disclosure is about a control method for a head-mounted display device that is mounted on the head of a user and includes a display unit configured to display an image of an outside view so as to be visually recognized, the control method including a first step of detecting a direction of a line of sight of the user, a second step of detecting an orientation of the head of the user, a third step of determining, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among a plurality of images displayed by the display unit, a fourth step of setting, as a first image, an image with the highest number of times determined in the third step to be the image visually recognized by the user among a plurality of the images displayed by the display unit, and setting, as a second image, an image with the second highest number of times determined in the third step to be the image visually recognized by the user after the first image, and a fifth step of changing a display position of the second image so that a display distance that is a distance on the display between the first image and the second image is smaller than a preset distance. The present disclosure is about a non-transitory computer-readable storage medium storing a program executed by a computer mounted in a control device, the control device being configured to control a head-mounted display device mounted on the head of a user and including a display unit configured to display an image of an outside view to be visually recognized, the program causing the computer to perform a first procedure of detecting a direction of a line of sight of the user, a second procedure of detecting an orientation of the head of the user, a third procedure of determining, based on at least one of the line of sight of the user or the orientation of the head of the user, an image visually recognized by the user from among a plurality of images displayed by the display unit, a fourth procedure of setting, as a first image, an image with