US-12626341-B2 - Processor, display control method, and display control program

US12626341B2US 12626341 B2US12626341 B2US 12626341B2US-12626341-B2

Abstract

A processor, which is included in a glasses-type display device that allows at least one eye of a user to visually recognize a real space and that displays a captured image obtained by imaging the real space with a camera, performs display processing of displaying a partial image, which is a partial region of the captured image captured by the camera, in a manner visually recognizable by the user based on a parallax between the eye of the user and the camera.

Inventors

Shinichiro Fujiki

Assignees

FUJIFILM CORPORATION

Dates

Publication Date: 20260512
Application Date: 20240216
Priority Date: 20230228

Claims (12)

1 . A processor included in a glasses-type display device that allows at least one eye of a user to visually recognize a real space and that displays a captured image obtained by imaging the real space with a camera, wherein the processor performs display processing of displaying a partial image, which is a partial region of the captured image captured by the camera, in a manner visually recognizable by the user based on a parallax between the eye of the user and the camera, wherein the processor performs display processing, including cancelling a misregistration amount β corresponding to a distance between a position of a subject image in a real image and a position of a subject image in the captured image, wherein the processor performs display processing, including cutting out a partial region from the captured image as a partial image so as to cancel the misregistration amount β, and wherein the misregistration amount B is derived according to the following equation: β=α×(F÷D), where F is a focal length of the camera, D is a distance between the camera and a subject, and a is the parallax between the eye of the user and the camera.
2 . The processor according to claim 1 , wherein the processor determines a range in which the partial image is cut out based on a subject distance to a main subject included in the captured image and the parallax.
3 . The processor according to claim 2 , wherein the processor determines a display size of the partial image based on the subject distance.
4 . The processor according to claim 1 , wherein the parallax is a parallax between the eye of the user that visually recognizes the real space and the camera.
5 . The processor according to claim 1 , wherein the processor determines, according to the parallax between the one eye of the user and the camera, a region corresponding to the real space visually recognized with the one eye of the user as a range in which the partial image is cut out, and the processor displays the cut partial image in a manner visually recognizable by an eye other than the one eye of the user in the display processing.
6 . The processor according to claim 5 , wherein the processor displays the partial image in an entire visual field of the eye other than the one eye of the user in the display processing.
7 . The processor according to claim 1 , wherein the processor determines, according to the parallax between the one eye of the user and the camera, a region corresponding to the real space visually recognized with the one eye of the user as a range in which the partial image is cut out, and the processor displays the cut partial image in a manner visually recognizable by the one eye of the user in the display processing.
8 . The processor according to claim 7 , wherein the processor displays the partial image in a part in a visual field of the one eye of the user in the display processing.
9 . The processor according to claim 7 , wherein the processor performs cutting-out of the partial image and the display processing corresponding to each of a plurality of eyes of the user.
10 . The processor according to claim 1 , wherein the partial image is a live view image.
11 . A display control method comprising: via a processor included in a glasses-type display device that allows at least one eye of a user to visually recognize a real space and that displays a captured image obtained by imaging the real space with a camera, performing display processing of displaying a partial image, which is a partial region of the captured image captured by the camera, in a manner visually recognizable by the user based on a parallax between the eye of the user and the camera, performing display processing, including cancelling a misregistration amount β corresponding to a distance between a position of a subject image in a real image and a position of a subject image in the captured image, wherein the processor performs display processing, including cutting out a partial region from the captured image as a partial image so as to cancel the misregistration amount β, and wherein the misregistration amount β is derived according to the following equation; β=α×(F÷D), where F is a focal length of the camera, D is a distance between the camera and a subject, and α is the parallax between the eye of the user and the camera.
12 . A non-transitory storage medium storing a display control program causing a processor, which is included in a glasses-type display device that allows at least one eye of a user to visually recognize a real space and that displays a captured image obtained by imaging the real space with a camera, to execute a process comprising: performing display processing of displaying a partial image, which is a partial region of the captured image captured by the camera, in a manner visually recognizable by the user based on a parallax between the eye of the user and the camera, performing display processing, including cancelling a misregistration amount β corresponding to a distance between a position of a subject image in a real image and a position of a subject image in the captured image, wherein the processor performs display processing, including cutting out a partial region from the captured image as a partial image so as to cancel the misregistration amount β, and wherein the misregistration amount β is derived according to the following equation: β=α×(F÷D), where F is a focal length of the camera, D is a distance between the camera and a subject, and α is the parallax between the eye of the user and the camera.

Description

CROSS REFERENCE TO RELATED APPLICATIONS This application claims priority from Japanese Application No. 2023-030564, filed on Feb. 28, 2023, the entire disclosure of which is incorporated herein by reference. BACKGROUND 1. Technical Field The present disclosure relates to a processor, a display control method, and a non-transitory storage medium storing a display control program. 2. Description of the Related Art A glasses-type display device such as an augmented reality (AR) device that allows a user to visually recognize a display image together with a real space is known in the related art. A technology in which a captured image is visually recognized by AR glasses by imaging a real space visually recognized by a user with a camera and by displaying the obtained captured image as a projection image is known. For example, JP2020-204856A discloses a technology for projecting a captured image obtained by imaging a visual line direction of a wearer of a head-mounted display onto a retinal display. SUMMARY However, in the technology according to the related art, in a case in which a position of an eye of a user who visually recognizes the real space is deviated from a position of a camera, parallax occurs. Therefore, a real image visually recognized by the user and the captured image captured by the camera may look different. In such a case, for example, the user feels a sense of incongruity. The present disclosure has been made in view of the above circumstances, and an object of the present disclosure is to provide a processor, a display control method, and a non-transitory storage medium storing a display control program that can suppress the deviation between the real image visually recognized by the user and the captured image in a case in which the user visually recognizes the captured image captured by the camera together with the real space. In order to achieve the above object, a processor according to a first aspect of the present disclosure, which is included in a glasses-type display device that allows at least one eye of a user to visually recognize a real space and that displays a captured image obtained by imaging the real space with a camera, performs display processing of displaying a partial image, which is a partial region of the captured image captured by the camera, in a manner visually recognizable by the user based on a parallax between the eye of the user and the camera. According to a processor of a second aspect of the present disclosure, in the processor of the first aspect, the processor determines a range in which the partial image is cut out based on a subject distance to a main subject included in the captured image and the parallax. According to a processor of a third aspect of the present disclosure, in the processor of the second aspect, the processor determines a display size of the partial image based on the subject distance. According to a processor of a fourth aspect of the present disclosure, in the processor of the first aspect, the parallax is a parallax between the eye of the user that visually recognizes the real space and the camera. According to a processor of a fifth aspect of the present disclosure, in the processor of the first aspect, the processor determines, according to the parallax between the one eye of the user and the camera, a region corresponding to the real space visually recognized with the one eye of the user as a range in which the partial image is cut out, and the processor displays the cut partial image in a manner visually recognizable by an eye other than the one eye of the user in the display processing. According to a processor of a sixth aspect of the present disclosure, in the processor of the fifth aspect, the processor displays the partial image in an entire visual field of the eye other than the one eye of the user in the display processing. According to a processor of a seventh aspect of the present disclosure, in the processor of the first aspect, the processor determines, according to the parallax between the one eye of the user and the camera, a region corresponding to the real space visually recognized with the one eye of the user as a range in which the partial image is cut out, and the processor displays the cut partial image in a manner visually recognizable by the one eye of the user in the display processing. According to a processor of an eighth aspect of the present disclosure, in the processor of the seventh aspect, the processor displays the partial image in a part in a visual field of the one eye of the user in the display processing. According to a processor of a ninth aspect of the present disclosure, in the processor of the eighth aspect, the processor performs cutting-out of the partial image and the display processing corresponding to each of a plurality of eyes of the user. According to a processor of a tenth aspect of the present disclosure, in the processor of the ninth aspect, the partial image is a live view image