Search

JP-7855391-B2 - Electronic devices, methods for controlling electronic devices, programs, and storage media

JP7855391B2JP 7855391 B2JP7855391 B2JP 7855391B2JP-7855391-B2

Inventors

  • 菊池 宏太郎

Assignees

  • キヤノン株式会社

Dates

Publication Date
20260508
Application Date
20220415

Claims (15)

  1. A first acquisition means for acquiring a first image captured through a first optical system of the imaging device and a second image having parallax with respect to the first image, captured through a second optical system of the imaging device, A second acquisition means for acquiring distance information indicating the distance from the imaging device to the subject, An electronic device characterized by having control means to control the parallax between a first image and a second image by mechanical adjustment, which adjusts the angle between the optical axis of the first optical system and the optical axis of the second optical system, when the rate of change of the distance indicated by the distance information is less than a threshold, and by soft adjustment, which performs image processing on the first image and the second image, when the rate of change of the distance is greater than the threshold.
  2. The electronic device according to claim 1, characterized in that the control means adjusts the rotation angle in the parallax direction of the first optical system and the second optical system in the mechanical adjustment.
  3. The electronic device according to claim 1, characterized in that the control means changes the display position in which the first image and the second image are displayed on the display device from the position in which the software adjustment is not performed.
  4. The electronic device according to claim 3, characterized in that the control means shifts the first image and the second image in the parallax direction during the soft adjustment.
  5. The electronic device according to claim 1, further characterized in that the control means adjusts the distance between the optical axes of the first optical system and the second optical system.
  6. The electronic device according to claim 1, wherein the control means further controls the focus of the imaging device.
  7. The electronic device according to claim 1, characterized in that the threshold is based on the operating speed of the mechanism that performs the mechanical adjustment.
  8. The electronic device according to claim 1, characterized in that the threshold value is a value that can be arbitrarily set by the user.
  9. The electronic device according to claim 1, characterized in that the threshold value varies depending on the distance from the imaging device to the subject.
  10. The electronic device according to claim 1, characterized in that the second acquisition means acquires distance information indicating the distance from the imaging device to a subject that is captured in the center of the first image and the second image.
  11. It further includes a detection means for detecting the user's gaze position, The electronic device according to claim 1, characterized in that the second acquisition means acquires distance information indicating the distance from the imaging device to the subject determined based on the line of sight.
  12. Acquisition means for acquiring a first image captured through a first optical system of an imaging device and a second image having parallax with respect to the first image, captured through a second optical system of the imaging device, An electronic device characterized by having control means that controls the parallax between a first image and a second image by adjusting the angle between the optical axis of the first optical system and the optical axis of the second optical system when the distance from the imaging device to the subject changes at a first speed, and by performing image processing on the first image and the second image when the distance changes at a second speed faster than the first speed.
  13. A first acquisition step involves acquiring a first image captured through a first optical system of the imaging device and a second image captured through a second optical system of the imaging device, which has parallax with respect to the first image. A second acquisition step involves acquiring distance information indicating the distance from the imaging device to the subject, A control step for electronic equipment, comprising: a control step of controlling the parallax between a first image and a second image by mechanical adjustment, which adjusts the angle between the optical axis of the first optical system and the optical axis of the second optical system, when the rate of change of the distance indicated by the distance information is less than a threshold; and a control step of controlling the parallax between a first image and a second image by soft adjustment, which performs image processing on the first image and the second image, when the rate of change of the distance is greater than the threshold.
  14. A program for causing a computer to function as one of the means of the electronic device described in any one of claims 1 to 12.
  15. A computer-readable storage medium storing a program for causing the computer to function as one of the means of the electronic device described in any one of claims 1 to 12.

Description

This invention relates to electronic equipment, a control method for electronic equipment, a program, and a storage medium. In recent years, devices that can capture and display images in real time, thereby augmenting human visual information, have become widespread. Using head-mounted displays (HMDs) for experiencing augmented reality (AR), users can experience virtual objects, complete with realistic size and distance perception, as if they were actually present in real space. Humans perceive depth by viewing objects from different perspectives with their right and left eyes, and perceiving depth from the difference between how the object appears to the right eye and how it appears to the left eye (binocular parallax). Therefore, when imaging a subject and displaying it on an HMD (Head-Mounted Display), displaying it in 3D using a parallax equivalent to the user's binocular parallax allows the user to comfortably perceive the displayed subject in 3D. The parallax of 3D display varies depending on the subject distance (the distance from the HMD to the subject), becoming larger as the subject distance decreases. Therefore, it is necessary to adjust the parallax of 3D display according to the subject distance. In the technology disclosed in Patent Document 1, the parallax of 3D display is adjusted by adjusting the angle of the optical axis of the imaging unit or by processing the image data. Japanese Patent Publication No. 2012-204904 This is a block diagram of a head-mounted display according to the first embodiment.This is a diagram showing an example of how to wear a head-mounted display according to the first embodiment.This figure illustrates the difference in convergence angles according to the first embodiment.This is a diagram illustrating the mechanical adjustment according to the first embodiment.This is a diagram illustrating the soft adjustment according to the first embodiment.This is a flowchart showing the parallax adjustment process according to the first embodiment.This figure shows the mechanical adjustment amount according to the first embodiment.This figure shows the image shift amount according to the first embodiment.This is a flowchart showing the determination process of the adjustment method according to the first embodiment.This is a flowchart showing the focus adjustment process according to the second embodiment. (First embodiment) The following describes a first embodiment of the present invention. In the first embodiment, an example is described in which the electronic device to which the present invention is applied is a wearable device such as a head-mounted display (HMD). <Structure> Figure 1 is a block diagram showing an example configuration of the HMD 100. The HMD 100 includes an imaging display unit 250R for the right eye and an imaging display unit 250L for the left eye. First, the imaging display units 250R and 250L will be described. The imaging display unit 250R includes an image imaging unit 200R for the right eye, an A/D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D/A converter 216, an EVF 217, an eyepiece 116, etc. Similarly, the imaging display unit 250L includes an image imaging unit 200L for the left eye, an A/D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D/A converter 216, an EVF 217, an eyepiece 116, etc. Each of the image capturing units 200R and 200L includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a shutter 210, and an imaging unit 211. Lens 202 is composed of multiple lenses, but in Figure 1, it is simplified and shown as a single lens. The system control unit 218 communicates with the lens system control circuit 205 and controls the aperture 1 via the aperture drive circuit 203. Furthermore, the system control unit 218 focuses on the target by displacing the focus lens included in lens 202 via the AF drive circuit 204. The shutter 210 is a focal-plane shutter that allows for free control of the exposure time of the imaging unit 211 under the control of the system control unit 218. The imaging unit 211 is an image sensor (imaging sensor, image sensor) composed of a CCD or CMOS element, which converts an optical image into an electrical signal. The imaging unit 211 may also have an imaging plane phase difference sensor that outputs defocus amount information to the system control unit 218. The A/D converter 212 converts the analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (such as resizing, including pixel interpolation and reduction, and color conversion) on the data from the A/D converter 212 or the data from the memory control unit 213 (described later). The image processing unit 214 also performs predetermined calculations using the captured image data, and the system control unit 218 performs