CN-121432733-B - Man-machine interactive digital ancient book display method and system based on aerial imaging

CN121432733BCN 121432733 BCN121432733 BCN 121432733BCN-121432733-B

Abstract

The invention discloses a man-machine interaction type digital ancient book display method and system based on aerial imaging, which relate to the technical field of man-machine interaction and comprise the steps of obtaining a user viewpoint position set and a page edge point position set of an aerial imaging area, calculating space azimuth projection between the page edge point and a user viewpoint, and generating a reflection azimuth change set; the method comprises the steps of identifying a boundary area causing jump of a reflection path based on a reflection azimuth change set, extracting a viewpoint angle corresponding to the boundary area, screening a stable observation direction with minimum reflection response change amplitude as a page main reflection direction, calculating an included angle projection value through the page main reflection direction and the viewpoint angle, and generating a page continuous focal plane group according to the included angle projection value.

Inventors

ZHANG QINGQIANG
Pan Xiaohuang
ZHENG HAOXIN

Assignees

安徽卓超科技有限公司

Dates

Publication Date: 20260512
Application Date: 20251219

Claims (10)

1. A man-machine interactive digital ancient book display method based on aerial imaging, which is characterized by comprising the following steps: S11, acquiring a user viewpoint position set and a page edge point position set of an aerial imaging region, calculating space azimuth projection between the page edge point and a user viewpoint, and generating a reflection azimuth change set; s12, identifying a boundary area causing jump of a reflection path based on the reflection azimuth change set, extracting a viewpoint angle corresponding to the boundary area, and screening a stable observation direction with minimum reflection response change amplitude as a page main reflection direction; s13, calculating an included angle projection value through the page main reflection direction and the viewpoint angle, generating a page continuous focal plane group according to the included angle projection value, and constructing a focal depth estimation structure corresponding to a page area; S14, calculating a focus position change direction value according to the page continuous focal plane group and the focus depth estimation structure, and generating a focus depth dynamic adjustment parameter value through the focus position change direction value; S15, generating a space re-projection path of the ancient book page image according to the focal depth dynamic adjustment parameter value, identifying a projection interruption event, and generating re-projection path correction data based on the projection interruption event so as to update the space re-projection path.
2. The human-computer interaction type digital ancient book showing method based on aerial imaging as claimed in claim 1, wherein the steps of extracting the viewpoint angle corresponding to the boundary region and screening the stable viewing direction with the minimum variation amplitude of the reflection response as the page main reflection direction are as follows: s121, based on the reflection azimuth change set, respectively executing direction difference value calculation processing on the reflection azimuth change data in the set to generate direction difference value data used for representing the intensity of direction change; S122, calculating the direction change amplitude value of each position according to the continuous direction difference value change value, and marking the position with the direction change amplitude value larger than the jump identification threshold value as a jump candidate position; s123, performing continuity screening processing on the position indexes which are not marked as boundary areas, and classifying the position indexes which do not meet jump identification conditions in the direction difference value data into a continuous observation area set; S124, calculating local variation amplitude values of the direction difference data based on the direction difference data corresponding to each position index in the continuous observation area set, identifying a direction vector with the minimum local variation amplitude value, and taking the direction vector as the page main reflection direction.
3. The method for displaying a man-machine interactive digital ancient book based on aerial imaging according to claim 2, wherein the logic for identifying the boundary area causing the reflection path jump according to the jump candidate position is as follows: a1, based on the direction difference data, performing adjacent difference calculation according to the arrangement sequence of the user viewpoints, and generating a continuous direction difference change value; A2, marking the position with the continuous direction difference value variation value larger than a preset jump identification threshold value as a jump candidate position according to the continuous direction difference value variation value; a3, performing index aggregation processing on adjacent hopping candidate positions based on the hopping candidate positions to generate a hopping position group; and a4, mapping the jump position group to a position index of the page space according to the jump position group, and outputting a page area corresponding to the position index as a boundary area.
4. The human-computer interactive digital ancient book display method based on aerial imaging of claim 3, wherein the step of performing index aggregation processing on adjacent jump candidate positions comprises the steps of: a31, calculating a distance change value of adjacent jump candidate positions based on the interval distance between the jump candidate positions, and judging whether the distance between the candidate positions is continuous or not according to the distance change value; a32, merging jump candidate positions with continuous intervals lower than the preset interval difference value into the same jump position subgroup according to the distance change value in sequence; and a33, calculating an internal index distribution difference value for each jump position subgroup, screening candidate positions with abnormal deviation points based on the distribution difference value, renumbering the jump position subgroup with the abnormal deviation points removed, and generating a jump position group.
5. The method for displaying human-computer interactive digital ancient books based on aerial imaging according to claim 4, wherein generating a continuous focal plane group of pages according to the projection value of the included angle and constructing a focal depth estimation structure corresponding to the page area comprises: S131, generating a screened included angle projection set based on the page main reflection direction and the viewpoint angle; s132, performing section grouping processing based on the included angle projection set, dividing the included angle projection set into a plurality of included angle projection sections, and constructing a projection mapping relation based on the plurality of included angle projection sections to generate a page continuous focal plane group; s133, performing geometric light path mapping processing based on the included angle projection values, calculating the vision distance variation of each included angle projection value on a virtual imaging plane, and taking the vision distance variation as a relative focal length parameter value; S134, inputting the relative focal length parameter values into a preset focal depth distribution function, generating corresponding initial focal plane depth estimated values, and integrating the focal depth estimated structures corresponding to the page areas based on all the initial focal plane depth estimated values.
6. The method for displaying human-computer interactive digital ancient books based on aerial imaging according to claim 5, wherein the logic for generating the filtered projection set of included angles is: b1, setting the origin of a space Cartesian coordinate system to be positioned at the center point of the page, and extracting the main reflection direction vector of the page; b2, converting all viewpoint angles contained in the continuous observation area set generated in the step S123 into space direction vectors, and uniformly mapping the space direction vectors into the space Cartesian coordinate system set in the step b 1; and b3, sequentially calculating the projection values of the included angles between the page main reflection direction vector and each viewpoint direction vector, checking whether all the projection values of the included angles are in a preset imaging view field range, removing data points beyond the range, and outputting a projection set of the included angles after screening and projection calculation.
7. The aerial imaging-based digital ancient book presentation method of claim 6, wherein the step of generating the set of page-continuous focal planes comprises: S132.1, extracting adjacent included angle projection values according to the arrangement sequence of each included angle projection value in the set based on the included angle projection set, and calculating the numerical difference between the adjacent included angle projection values to generate an included angle projection difference value set for grouping processing; s132.2, calculating a difference value variation between continuous included angle projection difference values, and identifying difference value sections with the difference value variation continuously lower than a set variation intensity threshold value according to the difference value variation so as to generate an included angle projection section set for section grouping; And S132.3, performing projection curvature fitting processing on each angle-clamped projection section, and generating a page continuous focal plane group according to the projection curvature fitting processing.
8. The method for displaying a digital ancient book based on man-machine interaction of claim 7, wherein the step of generating the dynamic adjustment parameter value of the depth of focus comprises: s141, calculating a direction difference value of the focus position along with the change of the projection value of the included angle based on the focus position data corresponding to each focus plane in the page continuous focus plane group, and recording the direction difference value as a focus position direction difference value set; s142, identifying a continuous ascending segment and a continuous descending segment of the focus position change direction according to the numerical value change trend in the focus position direction difference value set, and taking a segment meeting the continuity condition as a candidate focus change direction segment; S143, calculating a direction change amplitude value of each direction section based on the candidate focus change direction section, and extracting a dominant focus change direction according to the direction change amplitude value to generate a focus position change direction value; s144, inputting the focus position change direction value into a preset adjusting function to generate a focus depth dynamic adjusting parameter value for adjusting the stability of the focus depth of the page.
9. The method for displaying a digital ancient book based on man-machine interaction of claim 8, wherein the step of updating the spatial re-projection path comprises: S151, performing space mapping processing on each angle projection value based on the angle projection set, the page continuous focal plane group and the focal depth dynamic adjustment parameter value, and generating an initial space re-projection path consisting of a plurality of space mapping points; S152, detecting whether each mapping point has space crossing with the boundary area according to the space mapping point sequence of the initial space re-projection path, and marking the space mapping point crossing the boundary area as a projection interruption event point; S153, based on the projection value of the included angle corresponding to each projection interruption event point, executing nearest neighbor search in the page continuous focal plane group to determine an effective mapping interval corresponding to the projection interruption event point, and generating re-projection path correction data according to the effective mapping interval; S154, the re-projection path correction data are respectively matched with the corresponding space mapping points in the initial space re-projection path, so that position adjustment processing is carried out on the space coordinates of the space mapping points, and an updated space re-projection path is generated.
10. A man-machine interactive digital ancient book display system based on aerial imaging for realizing a man-machine interactive digital ancient book display method based on aerial imaging as claimed in any one of claims 1 to 9, characterized in that the system comprises: The method comprises the steps that a viewpoint acquisition module S21 acquires a user viewpoint position set and a page edge point position set of an aerial imaging area, calculates space azimuth projection between the page edge point and a user viewpoint, and generates a reflection azimuth change set; the path identifying module S22 is used for identifying a boundary area causing jump of a reflection path based on the reflection azimuth change set, extracting a viewpoint angle corresponding to the boundary area, and screening a stable observation direction with minimum reflection response change amplitude as a page main reflection direction; The focal plane generation module S23 calculates an included angle projection value through the page main reflection direction and the viewpoint angle, generates a page continuous focal plane group according to the included angle projection value, and constructs a focal depth estimation structure corresponding to the page area; The focal depth deducing module S24 calculates a focal position change direction value according to the page continuous focal plane group and the focal depth estimating structure, and generates a focal depth dynamic adjusting parameter value through the focal position change direction value; The projection updating module S25 generates a spatial re-projection path of the ancient book page image according to the focal depth dynamic adjustment parameter value, identifies a projection interruption event, and generates re-projection path correction data based on the projection interruption event to update the spatial re-projection path.

Description

Man-machine interactive digital ancient book display method and system based on aerial imaging Technical Field The invention relates to the technical field of man-machine interaction, in particular to a man-machine interaction type digital ancient book display method and system based on aerial imaging. Background The aerial imaging technology enables images to form visual images at the spatial positions of solid-free screens through precise design, has the characteristics of non-shielding, non-contact and immersive observation, is gradually applied to three-dimensional presentation of digital ancient books in cultural exhibition and man-machine interaction scenes, and the display mode is usually combined with user viewpoint perception, spatial projection and image reconstruction, so that users can freely observe ancient books pages at different positions, and simultaneously, higher requirements are put forward on page edges, imaging distances and display definition, so that the problem of spatial consistency under the condition of multi-view dynamic observation becomes a basic premise of continuous development of the application. At present, in the man-machine interactive digital ancient book display process based on aerial imaging, the continuous movement of a user viewpoint in the front-back, left-right and height directions can cause the change of the spatial orientation between the page edge and the observation direction, the reflection path presents nonlinear characteristics along with the viewpoint change, the direction response mutation is easy to occur at a specific position, the problems of parallax offset and unstable page position are caused when aerial images are switched at multiple viewing angles, and particularly the situation that imaging dislocation and observation are inconsistent is easier to expose at the page edge area. Secondly, under the condition that multi-view observation and imaging distance synchronously change, the focal position of an aerial imaging page continuously drifts along with the observation direction, imaging light path lengths corresponding to different viewpoints are different, if the integral constraint of a focusing depth change rule is lacking, the phenomenon of abrupt change of focal depth, uneven definition or short-time defocusing easily occurs in a local area of the page, and therefore the identification and reading continuity of the content of the ancient page by a user in the continuous observation process are affected. In addition, in the process of performing space re-projection and optical path inversion on an aerial imaging page, when the imaging path crosses a reflection path change area or a page effective imaging boundary, space interruption or invalid mapping points may occur on the projection path, so that the image is partially lost or jumped, and if dynamic correction and continuity constraint on the re-projection path are lacking, it is difficult to maintain the overall continuity and stable presentation effect of the aerial image under the comprehensive condition of real-time change of multi-view dynamic observation and imaging distance. Disclosure of Invention In order to solve the technical problems, the invention provides a man-machine interaction type digital ancient book display method based on aerial imaging, which comprises the following steps: S11, acquiring a user viewpoint position set and a page edge point position set of an aerial imaging region, calculating space azimuth projection between the page edge point and a user viewpoint, and generating a reflection azimuth change set; s12, identifying a boundary area causing jump of a reflection path based on the reflection azimuth change set, extracting a viewpoint angle corresponding to the boundary area, and screening a stable observation direction with minimum reflection response change amplitude as a page main reflection direction; s13, calculating an included angle projection value through the page main reflection direction and the viewpoint angle, generating a page continuous focal plane group according to the included angle projection value, and constructing a focal depth estimation structure corresponding to a page area; S14, calculating a focus position change direction value according to the page continuous focal plane group and the focus depth estimation structure, and generating a focus depth dynamic adjustment parameter value through the focus position change direction value; S15, generating a space re-projection path of the ancient book page image according to the focal depth dynamic adjustment parameter value, identifying a projection interruption event, and generating re-projection path correction data based on the projection interruption event so as to update the space re-projection path. Further, the step of extracting the viewpoint angle corresponding to the boundary region and screening the stable observation direction with the minimum variation amplitude of the refle