Search

CN-121978836-A - Light emitting direction regulating and controlling method and system based on pixel micro-lens array

CN121978836ACN 121978836 ACN121978836 ACN 121978836ACN-121978836-A

Abstract

The invention relates to the technical field of optical display and discloses a light emitting direction regulating and controlling method and system based on a pixel micro-lens array, wherein the light emitting direction regulating and controlling method based on the pixel micro-lens array comprises the steps of collecting pixel distribution specification and physical size parameters of a vehicle-mounted head-up display panel, constructing a multi-electrode micro-fluidic lens array, conducting optical calibration in a full temperature range, monitoring the eye position of a driver in real time, predicting future movement tracks, conducting ray tracing calculation, conducting direction vector calculation, reversely solving a target direction into control voltage of a micro-lens through a physical constraint neural network, establishing a coupling matrix between pixels, conducting self-adaptive updating, conducting rolling optimization and disturbance compensation, conducting virtual measurement state estimation and voltage application, conducting multi-target optimization and fault self-healing management, and dynamically adjusting a control strategy according to head position change of the driver, display content priority and environmental conditions.

Inventors

  • XIA LIHUI

Assignees

  • 宁波启阳光电有限公司

Dates

Publication Date
20260505
Application Date
20260203

Claims (10)

  1. 1. The light emitting direction regulating and controlling method based on the pixel micro-lens array is characterized by comprising the following steps: Collecting pixel resolution parameters and physical size parameters of a vehicle-mounted head-up display panel, constructing a multi-electrode micro-fluidic lens array, and performing full-temperature range optical calibration to obtain a micro-lens control parameter library; the method comprises the steps of monitoring the eye position of a driver in real time, and predicting the eye movement track to obtain eye position data and a track predicted value of the driver; Performing ray tracing calculation based on the eye position data of the driver to obtain a ray propagation path parameter, and performing direction vector calculation by combining the ray propagation path parameter to obtain a target light emitting direction vector; based on the target light-emitting direction vector, reversely solving the target direction into control voltage of the micro lens through a physical constraint neural network to obtain a control voltage sequence; Establishing a coupling matrix between pixels based on a microlens control parameter library and carrying out self-adaptive updating to obtain a self-adaptive coupling matrix; Based on the optimal control voltage sequence, virtual measurement state estimation and voltage application are carried out, and virtual measurement feedback information and a voltage signal applied in real time are obtained; And performing multi-objective optimization and fault self-healing management based on the voltage signals applied in real time and virtual measurement feedback information to obtain a self-adaptive control strategy and a health state evaluation result.
  2. 2. The method for adjusting and controlling the light emitting direction based on the pixel micro-lens array according to claim 1, wherein the constructing the multi-electrode micro-fluidic lens array comprises: constructing a micro-lens structure above a single pixel unit, depositing a bottom electrode layer on a glass substrate by adopting a transparent conductive oxide material, and patterning the electrode layer into a multi-electrode structure through photoetching and etching processes; depositing a hydrophobic dielectric layer above the electrode layer, constructing a micro-channel cavity structure above the hydrophobic dielectric layer, and sequentially injecting conductive liquid and optically transparent liquid into the micro-channel cavity; Packaging a transparent cover plate at the top of the cavity, and sealing by ultraviolet curing glue to obtain a single micro lens unit; after the construction of a single microlens unit is completed, the microlens units are prepared in batches according to the pixel array arrangement of the display panel, and a pixel microlens array is formed.
  3. 3. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the full-temperature-range optical calibration comprises: Building an automatic optical measurement platform; Placing a pixel microlens array within a temperature control cavity; calibrating temperature points for each micro lens unit, measuring optical responses corresponding to different voltage combinations at each temperature point, and obtaining voltage optical response data sets at different temperatures; and establishing a continuous response curved surface model by adopting a polynomial fitting method to obtain the curvature radius and the optical axis offset of the lens.
  4. 4. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the real-time monitoring of the eye position of the driver comprises: An infrared camera group is arranged at the positions of an instrument desk and an A column in the automobile and is provided with an infrared LED light supplementing lamp, and the camera group forms a triangular layout to cover the front and two side visual angles of the head of a driver; Locating a face area by adopting a face detection algorithm of deep learning, extracting facial feature points by adopting a face key point locating algorithm in the detected face area, extracting key points of two eyes from the facial feature points, and calculating the central positions of the two eyes as two-dimensional image coordinates of eye positions; And calculating three-dimensional space coordinates of eyes by adopting a stereoscopic vision matching algorithm, and obtaining the three-dimensional coordinates of the two eyes of the driver under a vehicle coordinate system through coordinate transformation.
  5. 5. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the predicting the eye movement trace comprises: extracting historical time sequence data of the eye position of a driver from continuous output of a Kalman filter, inputting a standardized historical position sequence into a pre-trained long-period and short-period memory network, and outputting eye position predicted values at a plurality of moments in the future by the network; and establishing three motion models, namely a uniform motion model, a uniform acceleration motion model and a periodic motion model, and adopting an interactive multi-model algorithm to automatically select the most suitable model or fuse the prediction results of a plurality of models according to the current motion characteristics.
  6. 6. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the performing the ray tracing calculation includes: Establishing a three-dimensional geometric model of the windshield, wherein the three-dimensional geometric model comprises the curved surface shape, thickness, refractive index and coating characteristic of the glass; For each pixel point on the head-up display panel, calculating a propagation path of light rays emitted from the pixel point after being reflected by the windshield to the eye position of a driver, and calculating the reflectivity and the transmissivity by adopting a Fresnel formula; and (3) pre-calculating the light ray path of each pixel point under the typical eye position by adopting a lookup table method, and interpolating according to the actual eye position during online operation to obtain the light ray propagation path parameters from the pixel point to the eye position.
  7. 7. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the inverse solving the target direction into the control voltage of the microlens through the physical constraint neural network comprises: Adopting a physical information neural network architecture to establish a mapping network embedded with physical constraints, wherein the physical constraints comprise liquid volume conservation constraints, young-Lippmann equation constraints, geometric relation constraints and voltage continuity constraints; the total loss function is designed as a weighted sum of the prediction error term and the physical constraint violation term.
  8. 8. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the establishing the inter-pixel coupling matrix comprises: Selecting representative pixel points in the pixel micro-lens array, sequentially applying standard control voltage to each selected pixel point to generate light-emitting direction deflection, and simultaneously measuring light-emitting direction change of surrounding pixel points; Fitting a coupling coefficient by adopting a linear regression method, wherein the coupling coefficient is defined as the ratio of the light-emitting direction variation quantity of surrounding pixels to the light-emitting direction deflection quantity of a central pixel; establishing a coupling matrix, and converting the coupling matrix into a sparse matrix; And updating the coupling coefficient by adopting a recursive least square algorithm to obtain the self-adaptive coupling matrix.
  9. 9. The method for adjusting and controlling the light emitting direction based on the pixel microlens array according to claim 1, wherein the virtual measurement state estimation comprises: establishing a state space model of the micro lens unit, wherein state variables comprise the position, the speed and the curvature of a liquid interface; the state estimation is realized by adopting an extended Kalman filtering algorithm, and the method comprises a prediction step and an updating step, wherein the prediction step predicts the state at the next moment according to a state equation and control input, and the updating step corrects the state estimation according to an output equation and virtual observation; virtually observing information from adjacent pixels, and when the state estimation of a certain pixel is inconsistent with the state estimation of the adjacent pixels, using the estimated value of the adjacent pixels as indirect observation; And comparing the estimated value with the target value, calculating tracking error, and adjusting the control voltage according to the error to obtain virtual measurement feedback information.
  10. 10. A light emitting direction regulating system based on a pixel microlens array, which is characterized by being used for executing the light emitting direction regulating method based on the pixel microlens array according to any one of claims 1 to 9, comprising the following steps of The micro-fluidic lens array module is used for collecting pixel resolution parameters and physical size parameters of the vehicle-mounted head-up display panel, constructing a multi-electrode micro-fluidic lens array and performing full-temperature-range optical calibration to obtain a micro-lens control parameter library; the eye position monitoring module is used for monitoring the eye position of the driver in real time and predicting the eye movement track to obtain the eye position data and the track predicted value of the driver; The target direction calculation module is used for carrying out ray tracing calculation based on the eye position data of the driver to obtain ray propagation path parameters; the voltage solving module is used for reversely solving the target direction into the control voltage of the micro lens through the physical constraint neural network based on the target light-emitting direction vector to obtain a control voltage sequence; The optimization control module establishes a coupling matrix between pixels based on a microlens control parameter library and carries out self-adaptive updating to obtain a self-adaptive coupling matrix; The voltage application module is used for carrying out virtual measurement state estimation and voltage application based on the optimal control voltage sequence to obtain virtual measurement feedback information and a voltage signal applied in real time; And the self-healing management module is used for performing multi-objective optimization and fault self-healing management based on the voltage signals applied in real time and the virtual measurement feedback information to obtain a self-adaptive control strategy and a health state evaluation result.

Description

Light emitting direction regulating and controlling method and system based on pixel micro-lens array Technical Field The invention relates to the technical field of optical display, in particular to a light emitting direction regulating and controlling method and system based on a pixel micro-lens array. Background With the rapid development of intelligent driving technology, a vehicle-mounted head-up display system has become an important component for improving driving safety and user experience. Conventional heads-up display systems employ a fixed optical projection scheme to project display content onto a windshield to form a virtual image. However, since the height, sitting posture and seat position of the driver have individual differences, and the head position can be dynamically changed during driving, the display system with a fixed projection angle cannot ensure that all drivers can watch the display content at the optimal viewing angle, and problems such as display content deviation, ghost and distortion easily occur. The self-adaptive display technology mainly adopts a liquid crystal lens, an MEMS micro mirror or a mechanical regulating mechanism to change the light projection direction, the liquid crystal lens technology can realize electric control regulation, but has the advantages of low response speed, limited regulation range, unstable performance in a wide temperature range of a vehicle-mounted environment, high response speed but high driving voltage, reliability problem of mechanical parts, serious light energy loss caused by low filling factor, mainly realizes focal length regulation, cannot realize optical axis transverse offset, and can only regulate and control the focusing depth but cannot regulate and control the light emitting direction, and the problems of difficult compromise between the response speed and the regulation range, lack of pixel-level independent regulation capability, low light energy utilization efficiency, lack of real-time optimal control algorithm and the like exist. Disclosure of Invention The invention provides a light emitting direction regulating and controlling method and system based on a pixel micro-lens array, which solve the technical problem that a fixed projection angle display system in the related art cannot adapt to dynamic change of the head position of a driver. The invention provides a light emitting direction regulating and controlling method based on a pixel micro-lens array, which comprises the following steps: Collecting pixel resolution parameters and physical size parameters of a vehicle-mounted head-up display panel, constructing a multi-electrode micro-fluidic lens array, and performing full-temperature range optical calibration to obtain a micro-lens control parameter library; the method comprises the steps of monitoring the eye position of a driver in real time, and predicting the eye movement track to obtain eye position data and a track predicted value of the driver; Performing ray tracing calculation based on the eye position data of the driver to obtain a ray propagation path parameter, and performing direction vector calculation by combining the ray propagation path parameter to obtain a target light emitting direction vector; based on the target light-emitting direction vector, reversely solving the target direction into control voltage of the micro lens through a physical constraint neural network to obtain a control voltage sequence; Establishing a coupling matrix between pixels based on a microlens control parameter library and carrying out self-adaptive updating to obtain a self-adaptive coupling matrix; Based on the optimal control voltage sequence, virtual measurement state estimation and voltage application are carried out, and virtual measurement feedback information and a voltage signal applied in real time are obtained; And performing multi-objective optimization and fault self-healing management based on the voltage signals applied in real time and virtual measurement feedback information to obtain a self-adaptive control strategy and a health state evaluation result. In a preferred embodiment, the constructing a multi-electrode microfluidic lens array comprises: constructing a micro-lens structure above a single pixel unit, depositing a bottom electrode layer on a glass substrate by adopting a transparent conductive oxide material, and patterning the electrode layer into a multi-electrode structure through photoetching and etching processes; depositing a hydrophobic dielectric layer above the electrode layer, constructing a micro-channel cavity structure above the hydrophobic dielectric layer, and sequentially injecting conductive liquid and optically transparent liquid into the micro-channel cavity; Packaging a transparent cover plate at the top of the cavity, and sealing by ultraviolet curing glue to obtain a single micro lens unit; after the construction of a single microlens unit is completed, the microlens uni