CN-121977528-A - Multi-station relay type intelligent continuous navigation system, method and terminal

CN121977528ACN 121977528 ACN121977528 ACN 121977528ACN-121977528-A

Abstract

The application provides a multi-station relay type intelligent continuous navigation system, a method and a terminal, which are characterized in that multi-mode biology and behavior data of a current user are collected through station interaction terminals arranged at a plurality of key path node positions of an indoor and outdoor compound space, navigation requirements of the current user and de-identification feature codes are obtained, and navigation request information of the current user is generated and sent to a navigation center server; the navigation center server connected with each site interaction terminal analyzes the received navigation request message, performs path planning operation, calculates a target feasible path meeting the navigation requirement, and sends the target feasible path to the corresponding site interaction terminal, and displays the target feasible path on a three-dimensional digital twin map of the indoor and outdoor composite space through each site interaction terminal while guiding the current user through voice, so that cross-terminal relay navigation is realized, user navigation experience is improved, user safety anonymous identification is realized, and privacy leakage is avoided.

Inventors

JIANG YUXI
XU LI
LI SU
WANG YAO

Assignees

上海三思电子工程有限公司
上海三思科技发展有限公司
嘉善三思光电技术有限公司
浦江三思光电技术有限公司
浙江浦照光电技术有限公司

Dates

Publication Date: 20260505
Application Date: 20260202

Claims (10)

1. A multi-station relay type intelligent continuous navigation system is used for continuously navigating indoor and outdoor composite spaces and is characterized by comprising a navigation center server and a plurality of station interaction terminals respectively connected with the navigation center server; the station interaction terminals are fixedly arranged at the positions of a plurality of key path nodes in the indoor and outdoor composite space; the system carries out continuous navigation on the indoor and outdoor composite space in the following modes: acquiring multi-mode biological and behavioral data of a current user through a site interaction terminal, acquiring navigation requirements and de-identification feature codes of the current user, generating a navigation request message of the current user and sending the navigation request message to the navigation center server; analyzing the received navigation request message through the navigation center server, executing path planning operation, calculating a target feasible path meeting the navigation requirement, and sending the target feasible path to the site interaction terminal; and receiving the target feasible path through the site interaction terminal, displaying the target feasible path on the three-dimensional digital twin map of the indoor and outdoor composite space, and guiding the current user through voice.
2. The multi-site relay type intelligent continuous navigation system according to claim 1, wherein the site interaction terminal comprises: the multi-modal sensing module is used for responding to the interactive behaviors of the current user and collecting multi-modal biology and behavior data of the current user in real time through one or more interactive channels, wherein the multi-modal biology and behavior data comprises one or more combinations of text modal data, voice modal data and visual modal data; The navigation demand recognition module is connected with the multi-mode sensing module and is used for recognizing the navigation demand of the current user according to the multi-mode biology and behavior data; The user characteristic extraction module is connected with the multi-mode sensing module and is used for extracting key identity characteristics of the current user according to the multi-mode biological and behavior data and generating de-identification characteristic codes of the current user; The station communication module is connected with the navigation demand identification module and the user characteristic extraction module, is connected with the navigation center server, and is used for generating a navigation request message of a current user according to the navigation demand and the de-identification feature code and sending the navigation request message to the navigation center server; and the path prompt module is connected with the site communication module and is used for displaying the target feasible path on the three-dimensional digital twin map of the indoor and outdoor composite space and guiding the current user through voice.
3. The multi-site relay intelligent continuous navigation system of claim 2, wherein the multi-modal awareness module comprises: the text data acquisition unit is used for acquiring one or more text modal data of the current user in real time through the text interaction channel; the voice data acquisition unit is used for acquiring one or more voice mode data of the current user in real time through the voice interaction channel; and the visual data acquisition unit is used for acquiring one or more visual mode data of the current user in real time.
4. The multi-site relay type intelligent continuous navigation system of claim 3, wherein the navigation demand identification module comprises: The voice recognition unit is connected with the voice data acquisition unit and is used for respectively transcribing each acquired voice mode data into texts and generating one or more text transcription data of the current user; The semantic understanding unit is connected with the text data acquisition unit and the voice recognition unit and is used for respectively carrying out text analysis and semantic understanding on each acquired text modal data and each transcribed text transcription data to acquire the navigation requirement of the current user; the automatic request navigation unit is connected with the visual data acquisition unit and is used for automatically acquiring the navigation requirement of the current user after the current user stays above a preset stay time threshold according to the acquired visual mode data.
5. The multi-site relay type intelligent continuous navigation system of claim 3, wherein the user feature extraction module comprises: The voice feature extraction unit is connected with the voice data acquisition unit and is used for respectively carrying out acoustic feature extraction and aggregation operation on each voice mode data of the current user to generate an aggregate acoustic feature vector of the current user; The visual feature extraction unit is connected with the visual data acquisition unit and is used for respectively carrying out visual feature extraction and aggregation operation on each visual mode data of the current user to generate an aggregated visual feature vector of the current user; And the feature fusion unit is connected with the voice feature extraction unit and the visual feature extraction unit and is used for carrying out feature fusion on the aggregate acoustic feature vector and the aggregate visual feature vector to generate a fusion identity feature vector of the current user, and carrying out binarization and hash operation on the fusion identity feature vector to generate a de-identification feature code of the current user.
6. The multi-site relay intelligent continuous navigation system of claim 1, wherein the navigation hub server comprises: the navigation demand analysis module is used for analyzing the navigation request message and acquiring the starting position and the expected destination of the current user; The path planning module is connected with the navigation demand analysis module and is used for calculating a target feasible path from the starting position to the expected destination based on the pre-constructed real-time navigation topological network of the indoor and outdoor composite space; The central communication module is connected with the navigation demand analysis module and the path planning module, is connected with each site interaction terminal, and is used for receiving the navigation request message sent by the site interaction terminal and forwarding the navigation request message to the navigation demand analysis module; The data storage and cleaning module is connected with the navigation demand analysis module and used for generating a history navigation request record of the current user according to the de-identification feature code of the current user and the expected destination and storing the history navigation request record into a pre-constructed navigation request database, and the data storage and cleaning module is also used for periodically destroying the expired history navigation request record in the navigation request database based on a pre-defined data cleaning mechanism.
7. The multi-site relay type intelligent continuous navigation system of claim 6, wherein the manner of obtaining the desired destination of the current user comprises: Analyzing the navigation request message, obtaining a de-identification feature code of the current user, and judging whether the navigation request message contains an expected destination of the current user or not; if the expected destination is included, the expected destination is sent to the path planning module so as to execute path planning operation and update the history navigation request record of the current user; And if the expected destination is not contained, comparing the de-identified feature code of the current user with the de-identified feature codes in the plurality of historical navigation request records stored in the navigation request database, screening the matched historical navigation request records, and sending the historical expected destination in the historical navigation request records as the expected destination of the current user to the path planning module to execute path planning operation, and updating the historical navigation request records of the current user.
8. The multi-site relay intelligent continuous navigation system of claim 6, wherein the navigation hub server further comprises: the topology network updating module is connected with the path planning module and the operation management system of the indoor and outdoor composite space, and is used for acquiring environment monitoring data of the indoor and outdoor composite space from the operation management system, updating the real-time navigation topology network in real time according to the environment monitoring data and sending the updated real-time navigation topology network to the path planning module.
9. The multi-station relay type intelligent continuous navigation method is characterized by being applied to a multi-station relay type intelligent continuous navigation system, wherein the system comprises a navigation center server and a plurality of station interaction terminals respectively connected with the navigation center server, and each station interaction terminal is fixedly arranged at a plurality of key path node positions of an indoor and outdoor composite space, and the method comprises the following steps: acquiring multi-mode biological and behavioral data of a current user through a site interaction terminal, acquiring navigation requirements and de-identification feature codes of the current user, generating a navigation request message of the current user and sending the navigation request message to the navigation center server; analyzing the received navigation request message through the navigation center server, executing path planning operation, calculating a target feasible path meeting the navigation requirement, and sending the target feasible path to the site interaction terminal; and receiving the target feasible path through the site interaction terminal, displaying the target feasible path on the three-dimensional digital twin map of the indoor and outdoor composite space, and guiding the current user through voice.
10. The multi-station relay type intelligent continuous navigation terminal is characterized by comprising a memory and a processor; The memory is used for storing a computer program; The processor is configured to execute the computer program stored in the memory, so that the terminal implements the functions of the multi-site relay type intelligent continuous navigation system according to any one of claims 1 to 8.

Description

Multi-station relay type intelligent continuous navigation system, method and terminal Technical Field The application relates to the technical field of intelligent navigation, in particular to a multi-station relay type intelligent continuous navigation system, a method and a terminal. Background Conventional complex space navigation systems, such as those used in large industrial parks, underground business complexes, subway transfer hubs, etc., typically rely on static sign identification or mobile-side GPS navigation. However, static signs cannot be updated dynamically in real time, and there is a lack of interactive guidance for individualized routes, and in underground, closed or multi-floor structures, GPS signals are generally weak or frequently fail, and mobile-end GPS navigation cannot be accurately located. Along with the progress of navigation technology, digital twin technology and man-machine interaction technology, an intelligent navigation system integrating high-precision positioning, multi-source data fusion and personalized path planning is becoming the preference of complex space navigation. However, the existing intelligent navigation system mostly adopts a single-site independent operation mode, lacks continuous navigation capability for complex indoor and outdoor mixed environments, breaks continuous navigation experience of users at different positions, needs repeated interaction with the navigation system, and is poor in navigation experience, especially in underground and floor staggered scenes. In addition, the existing intelligent navigation system collects more user characteristic data in the process of interacting with a user, but lacks a user privacy protection and automatic cleaning mechanism, and can cause long-term storage risk and privacy disclosure risk. Disclosure of Invention In view of the above-mentioned drawbacks of the prior art, the present application aims to provide a multi-station relay type intelligent continuous navigation system, a method and a terminal, which are used for solving the technical problems of lack of continuous navigation capability, poor navigation experience and risk of storing and revealing private data in the existing navigation system with complex space. In order to achieve the above and other related objects, a first aspect of the present application provides a multi-site relay type intelligent continuous navigation system for continuously navigating an indoor and outdoor composite space, which comprises a navigation hub server and a plurality of site interaction terminals respectively connected with the navigation hub server, wherein each site interaction terminal is fixedly arranged at a plurality of key path node positions of the indoor and outdoor composite space, the continuous navigation of the indoor and outdoor composite space is performed by the system, the method comprises the steps of collecting multi-mode biological and behavioral data of a current user through the site interaction terminal, obtaining navigation requirements and de-identification feature codes of the current user, generating navigation request information of the current user, sending the navigation request information to the navigation hub server, analyzing the received navigation request information through the navigation hub server, executing path planning operation, calculating a target feasible path meeting the navigation requirements, sending the target feasible path to the site interaction terminal, receiving the target feasible path through the site interaction terminal, simultaneously displaying the target feasible path on the indoor and outdoor composite space, and simultaneously guiding the current voice map on the indoor and outdoor composite space. In some embodiments of the first aspect of the present application, the site interaction terminal includes a multimodal perception module configured to respond to an interaction behavior of a current user, collect multimodal living things and behavior data of the current user in real time through one or more interaction channels, where the multimodal living things and behavior data includes one or more of text modality data, voice modality data, and visual modality data, a navigation requirement recognition module connected to the multimodal perception module and configured to recognize a navigation requirement of the current user according to the multimodal living things and behavior data, a user feature extraction module connected to the multimodal perception module and configured to extract key identity features of the current user according to the multimodal living things and behavior data, generate a de-identification feature code of the current user, and a site communication module connected to the navigation requirement recognition module and the user feature extraction module and connected to the navigation hub server and configured to generate a navigation request message of the current user acco