Search

CN-122027781-A - Automatic parallax adjustment method and system

CN122027781ACN 122027781 ACN122027781 ACN 122027781ACN-122027781-A

Abstract

The invention provides an automatic parallax adjustment system and an automatic parallax adjustment method. The pair of cameras are used for shooting an object to obtain a first image and a second image. The pair of cameras includes two lenses, a distance between the two lenses. The controller is communicatively connected to the pair of cameras and is configured to perform correcting the first image with the first correction matrix and correcting the second image with the second correction matrix, cropping the first correction image and the second correction image, defining a comfort range of binocular focusing distances according to a viewing distance of the stereoscopic display to eyes of a user, and calculating corrected binocular parallax according to the comfort range, the first cropped image and the second cropped image.

Inventors

  • Tu Zongwei

Assignees

  • 宏碁股份有限公司

Dates

Publication Date
20260512
Application Date
20241112

Claims (10)

  1. 1. An automatic parallax adjustment method, comprising: Shooting an object by using a pair of cameras to obtain a first image and a second image, wherein a distance exists between two lenses of the pair of cameras; Correcting the first image by using a first correction matrix to obtain a first correction image, and correcting the second image by using a second correction matrix to obtain a second correction image, wherein the first correction image and the second correction image simulate two images obtained by the pair of cameras when two optical axes of the two lenses are parallel; Cropping the first correction image and the second correction image to leave a portion of the first correction image overlapping the second correction image, wherein the first correction image is cropped to leave a first cropped image and the second correction image is cropped to leave a second cropped image; Estimating binocular parallax of the first cropped image and the second cropped image according to the focal lengths of the two lenses, the pixel sizes of the pair of cameras, the first cropped image and the second cropped image; Measuring a viewing distance of the stereoscopic display to eyes of a user; Defining a comfortable range of binocular focusing distances according to the viewing distance; Calculating corrected binocular disparity from the comfort range, the first cropped image and the second cropped image, and And enabling the stereoscopic display to display a stereoscopic image according to the corrected binocular parallax.
  2. 2. The automatic parallax adjustment method according to claim 1, characterized by further comprising: And adjusting the resolutions of the first and second cropped images back to the resolutions of the first and second images, and multiplying the binocular disparities of the first and second cropped images by a first scaling constant adjusted corresponding to the resolutions to obtain an amplified binocular disparities, wherein the step of calculating the corrected binocular disparities from the comfort range, the first and second cropped images comprises adding a correction to the amplified binocular disparities to obtain the corrected binocular disparities.
  3. 3. The automatic parallax adjustment method according to claim 1, characterized by further comprising: adjusting the resolutions of the first and second cropped images back to the resolutions of the first and second images, multiplying the binocular parallax of the first and second cropped images by a first scaling constant corresponding to the resolution adjustment to obtain an amplified binocular parallax, and Multiplying the amplified binocular disparity by a second proportionality constant according to the proportionality relation between the resolution of the stereoscopic display and the resolutions of the first image and the second image to obtain a resolution-adjusted binocular disparity, wherein the step of calculating the corrected binocular disparity according to the comfort range, the first cut image and the second cut image comprises adding a correction amount to the resolution-adjusted binocular disparity to obtain the corrected binocular disparity.
  4. 4. The automatic parallax adjustment method according to claim 1, wherein the method of measuring the viewing distance of the stereoscopic display to the eyes of the user includes measuring the viewing distance with one camera, two cameras, or a distance sensor provided on the stereoscopic display.
  5. 5. The automatic parallax adjustment method according to claim 1, wherein the binocular parallax of the first and second cropped images is binocular parallax in units of pixels.
  6. 6. An automatic parallax adjustment system, comprising: a pair of cameras for capturing an object to obtain a first image and a second image, the pair of cameras comprising two lenses having a distance therebetween, and A controller, telecom connected to the pair of cameras, and configured to perform: Correcting the first image by using a first correction matrix to obtain a first correction image, and correcting the second image by using a second correction matrix to obtain a second correction image, wherein the first correction image and the second correction image simulate two images obtained by the pair of cameras when two optical axes of the two lenses are parallel; Cropping the first correction image and the second correction image to leave a portion of the first correction image overlapping the second correction image, wherein the first correction image is cropped to leave a first cropped image and the second correction image is cropped to leave a second cropped image; Estimating binocular parallax of the first cropped image and the second cropped image according to the focal lengths of the two lenses, the pixel sizes of the pair of cameras, the first cropped image and the second cropped image; Defining a comfortable range of the binocular focusing distance according to the viewing distance from the stereoscopic display to eyes of a user; Calculating corrected binocular disparity from the comfort range, the first cropped image and the second cropped image, and And outputting a stereoscopic image signal with the corrected binocular parallax to the stereoscopic display.
  7. 7. The automatic parallax adjustment system of claim 6, wherein the controller is configured to further perform: And adjusting the resolutions of the first and second cropped images back to the resolutions of the first and second images, and multiplying the binocular disparities of the first and second cropped images by a first scaling constant adjusted corresponding to the resolutions to obtain an amplified binocular disparities, wherein the step of calculating the corrected binocular disparities from the comfort range, the first and second cropped images comprises adding a correction to the amplified binocular disparities to obtain the corrected binocular disparities.
  8. 8. The automatic parallax adjustment system of claim 6, wherein the controller is configured to further perform: adjusting the resolutions of the first and second cropped images back to the resolutions of the first and second images, multiplying the binocular parallax of the first and second cropped images by a first scaling constant corresponding to the resolution adjustment to obtain an amplified binocular parallax, and Multiplying the amplified binocular disparity by a second proportionality constant according to the proportionality relation between the resolution of the stereoscopic display and the resolutions of the first image and the second image to obtain a resolution-adjusted binocular disparity, wherein the step of calculating the corrected binocular disparity according to the comfort range, the first cut image and the second cut image comprises adding a correction amount to the resolution-adjusted binocular disparity to obtain the corrected binocular disparity.
  9. 9. The automatic parallax adjustment system of claim 6, wherein the controller is configured to command one, two, or a distance sensor disposed on the stereoscopic display to measure the viewing distance.
  10. 10. The automatic parallax adjustment system according to claim 6, wherein the binocular parallax of the first and second cropped images is binocular parallax in units of pixels.

Description

Automatic parallax adjustment method and system Technical Field The invention relates to an automatic parallax adjustment method and system (automatic disparity adjustment method AND SYSTEM). Background In recent years, stereoscopic display technology has been vigorously developed, and various optical systems for stereoscopic displays have been used up to now. Current stereoscopic displays often have the problem of vergence adjustment conflicts (vergence-accommodation conflict, VAC). The convergence adjustment conflict is caused by confusion of human brain due to the fact that the single-eye focusing distance (accommodation distance) is different from the double-eye focusing distance (VERGENCE DISTANCE), and a user can easily dizziness. Therefore, how to design an optical solution that can overcome the convergence adjustment conflict is still a major topic of stereoscopic display. On the other hand, in order to obtain stereoscopic image content for display by a stereoscopic display, a stereoscopic camera may be employed to photograph an object. The existing stereo camera adopts two sub-cameras to shoot an object so as to simulate parallax effect generated by watching the object by two eyes. However, when parallax between the left eye image and the right eye image captured by the stereoscopic camera is applied to the stereoscopic display, a problem of a collision of adjustment of the convergence of vision is easily caused. Disclosure of Invention The invention aims at an automatic parallax adjustment method which can effectively inhibit the problem of vision convergence adjustment conflict. The invention aims at an automatic parallax adjustment system which can effectively inhibit the problem of vision convergence adjustment conflict. An embodiment of the invention provides an automatic parallax adjustment method, which comprises the steps of shooting an object by a pair of cameras to obtain a first image and a second image, correcting the first image by a first correction matrix to obtain a first correction image, correcting the second image by a second correction matrix to obtain a second correction image, wherein the first correction image and the second correction image simulate two images obtained by the pair of cameras when two optical axes of the two lenses are parallel, cutting the first correction image and the second correction image to leave a part where the first correction image and the second correction image overlap, wherein the first correction image is cut to leave a first cut image, the second correction image is cut to leave a second cut image, estimating binocular parallax of the first cut image and the second cut image according to the focal length of the two lenses, the first cut image and the second cut image, measuring the binocular parallax of the first cut image and the second cut image, calculating the binocular parallax of a stereoscopic display according to the binocular parallax of a stereoscopic display user, and displaying the corrected parallax of the stereoscopic display according to the binocular parallax of the second corrected image and the binocular parallax of the stereoscopic display according to the corrected parallax of the two-eye. An embodiment of the invention provides an automatic parallax adjustment system, which comprises a pair of cameras and a controller. The pair of cameras are used for shooting an object to obtain a first image and a second image. The pair of cameras includes two lenses, a distance between the two lenses. The controller is communicatively coupled to the pair of cameras and is configured to perform correcting a first image with a first correction matrix to obtain a first corrected image and correcting a second image with a second correction matrix to obtain a second corrected image, wherein the first corrected image and the second corrected image simulate two images obtained by the pair of cameras when two optical axes of the two lenses are parallel, cropping the first corrected image and the second corrected image to leave a portion where the first corrected image and the second corrected image overlap, wherein the first corrected image is cropped to leave a first cropped image and the second corrected image is cropped to leave a second cropped image, estimating binocular parallax of the first cropped image and the second cropped image based on a focal length of the two lenses, a pixel size of the pair of cameras, the first cropped image and the second cropped image, defining a comfortable range of binocular disparity based on a viewing distance of the stereoscopic display to eyes of a user, and calculating a parallax of the stereoscopic display to the stereoscopic display based on the comfortable range, the first cropped image and the second cropped image. In the automatic parallax adjustment method and the automatic parallax adjustment system according to the embodiments of the present invention, since the comfort range of the binocular f