Search

CN-121998535-A - Whole-course logistics tracing method and system based on head-mounted equipment

CN121998535ACN 121998535 ACN121998535 ACN 121998535ACN-121998535-A

Abstract

The application provides a whole-course logistics tracing method and system based on head-mounted equipment, and belongs to the technical field of man-machine interaction. The method comprises the steps of determining accurate coordinates of a gazing point, realizing real-time perception of the sight line behavior of a person wearing the head-mounted equipment, generating a superposition display instruction sequence and a semitransparent superposition area according to target identification information and geographic position coordinate data, realizing visual navigation guidance on the premise of not dispersing the attention of the person wearing the head-mounted equipment, ensuring accurate approval of operation intention and no need of additional operation by generating gazing intention confirmation signals, determining a gazing record data set according to the operation intention information and the identity, forming a complete logistics tracing chain by combining a historical logistics operation chain, ensuring that the tracing record can accurately reflect the circulation of logistics nodes, and ensuring the continuity, the credibility and the integrity of the logistics tracing chain.

Inventors

  • Liu Linhang
  • ZHAO YAN

Assignees

  • 广州达普绅智能设备有限公司

Dates

Publication Date
20260508
Application Date
20260129

Claims (9)

  1. 1. The whole-course logistics traceability method based on the head-mounted equipment is characterized by comprising the following steps of: acquiring biological feature interaction data and geographic position coordinate data of a person wearing the head-mounted equipment in real time, wherein the biological feature interaction data comprise pupil center pixel coordinates, cornea reflection point pixel coordinates, pupil diameter change range, eye movement track and head posture data; determining the accurate coordinates of the gaze point according to the biological feature interaction data and the geographic position coordinate data; Judging whether the accurate coordinate of the fixation point is positioned in a target recognition area, if so, acquiring a target recognition area image, and determining target identification information according to the target recognition area image; determining a navigation instruction sequence from the person wearing the head-mounted equipment to a target position according to the target identification information and the geographic position coordinate data; determining a superimposed display instruction sequence according to the geographic position coordinate data and the navigation instruction sequence, and generating a semitransparent superimposed region according to the superimposed display instruction sequence; Judging whether the continuous fixation time of the precise fixation point coordinates in the semitransparent layered region exceeds a preset time threshold or not in the preset time, if so, generating a fixation intention confirming signal, and respectively acquiring operation intention information corresponding to the fixation intention confirming signal and an identity mark corresponding to the wearing head-mounted equipment personnel; and determining a gazing record data set according to the operation intention information and the identity, acquiring a historical logistics operation chain, and determining a complete logistics traceability chain according to the gazing record data set and the historical logistics operation chain.
  2. 2. The head-mounted device-based whole-course logistic traceability method according to claim 1, wherein the determining the gaze point accurate coordinates according to the biometric interaction data and the geographic position coordinate data comprises: Performing time synchronization alignment on the biological feature interaction data and the geographic position coordinate data to generate a synchronous interaction sequence; based on the synchronous interaction sequence, determining fixation duration and fixation direction vector by adopting an interaction recognition algorithm; And determining the accurate coordinates of the gazing point according to the gazing duration and the gazing direction vector.
  3. 3. The head-mounted equipment-based whole-course logistics traceability method of claim 1, wherein the determining target identification information according to the target identification area image comprises: Determining a target boundary box by adopting a target detection algorithm based on the target identification area image; Determining a target image according to the target boundary box, and determining a text recognition result of the target image by adopting an optical character recognition algorithm based on the target image; And determining the target identification information according to the text recognition result.
  4. 4. The headset-based whole-course logistics traceability method of claim 1, wherein the determining the navigation instruction sequence from the headset personnel to the target location according to the target identification information and the geographic location coordinate data comprises: determining target position coordinates and target priority attributes according to the target identification information; Determining an optimal path point set from the wearing head-mounted equipment personnel to a target position by adopting an A star algorithm based on the geographic position coordinate data, the target position coordinate and the target priority attribute; And determining the navigation instruction sequence according to the optimal path point set.
  5. 5. The head-mounted equipment-based whole-course logistics traceability method of claim 4, wherein determining a superimposed display instruction sequence from the geographic location coordinate data and the navigation instruction sequence comprises: Performing time stamp synchronous alignment on the geographic position coordinate data and the navigation instruction sequence, and judging whether a deviation value between the aligned geographic position coordinate data and the aligned navigation instruction sequence exceeds a preset deviation threshold value; if the judgment result exceeds the preset deviation threshold, re-adopting an A star algorithm to optimize the optimal path point set; And if the geographic position coordinate data after alignment does not exceed the preset deviation threshold value, fusing the geographic position coordinate data after alignment with the navigation instruction sequence to determine the superimposed display instruction sequence.
  6. 6. The head-mounted equipment-based whole-course logistics traceability method of claim 1, wherein the generating a semitransparent overlay area according to the overlay display instruction sequence comprises: Determining a visual area parameter according to the superimposed display instruction sequence, wherein the visual area parameter comprises a display positioning parameter, a display direction parameter and a display style parameter; and generating a semitransparent overlapped region by adopting an augmented reality algorithm based on the visual region parameters.
  7. 7. The head-mounted based whole-course logistic traceability method according to claim 1, further comprising, after said determining a gaze record dataset according to said operational intent information and said identity: acquiring a preset check code, a fixation record time stamp and fixation record position coordinates of each piece of fixation record data in the fixation record data set; Based on the gazing record time stamp and the gazing record position coordinate, determining a current check code of each gazing record data by adopting a hash algorithm; judging whether the current check code is the same as the preset check code, if so, marking the current gazing record data as abnormal data; if the gaze record data are the same, judging whether time-position consistency exists between the current gaze record data and gaze record data adjacent to the current gaze record data; If the time and position consistency is judged to be met, marking the current gazing record data as verification passing; and if the time and position consistency is judged not to be met, marking the current gazing record data as verification failure.
  8. 8. The head-mounted equipment-based whole-course logistics traceability method of claim 1, wherein the determining a complete logistics traceability chain from the gaze record data set and the historical logistics operation chain comprises: performing multidimensional rule matching on the gazing record data set and the historical logistics operation chain to determine an initial logistics traceability chain; judging whether the data sequence of the initial logistics tracing chain meets the continuity of the whole flow data, and if so, taking the initial logistics tracing chain as a complete logistics tracing chain; and if the full-flow data continuity is judged not to be met, marking the initial logistics tracing chain as an abnormal tracing chain.
  9. 9. Whole commodity circulation traceability system based on head-mounted device, characterized by comprising: The acquisition module is used for acquiring biological characteristic interaction data and geographic position coordinate data of a person wearing the head-mounted equipment in real time, wherein the biological characteristic interaction data comprise pupil center pixel coordinates, cornea reflection point pixel coordinates, pupil diameter change range, eye movement track and head posture data; The first determining module is used for determining the accurate coordinates of the gaze point according to the biological characteristic interaction data and the geographic position coordinate data; The first judging module is used for judging whether the accurate coordinate of the fixation point is positioned in a target identification area, if so, acquiring an image of the target identification area, and determining target identification information according to the image of the target identification area; The second determining module is used for determining a navigation instruction sequence from the person wearing the head-mounted equipment to the target position according to the target identification information and the geographic position coordinate data; The third determining module is used for determining a superposition display instruction sequence according to the geographic position coordinate data and the navigation instruction sequence and generating a semitransparent superposition area according to the superposition display instruction sequence; The second judging module is used for judging whether the continuous fixation time of the precise fixation point coordinates in the semitransparent layered region exceeds a preset time threshold value in preset time, if so, generating a fixation intention confirming signal, and respectively acquiring operation intention information corresponding to the fixation intention confirming signal and an identity mark corresponding to the person wearing the head-mounted equipment; And the fourth determining module is used for determining a gazing record data set according to the operation intention information and the identity, acquiring a historical logistics operation chain, and determining a complete logistics traceability chain according to the gazing record data set and the historical logistics operation chain.

Description

Whole-course logistics tracing method and system based on head-mounted equipment Technical Field The application relates to the technical field of man-machine interaction, in particular to a whole-course logistics tracing method and system based on head-mounted equipment. Background At present, logistics traceability is a key field for guaranteeing the safety of a supply chain and realizing the whole traceability of goods, and the logistics traceability is important in that a problem link can be found in time, the operation efficiency is improved, and strict compliance requirements are met. In modern warehouse and distribution environments, whole-course logistics traceability relies on accurate recordings of the operational intent, time and location of each operational node to form a reliable traceability chain. In the current logistics tracing method based on the head-mounted equipment, manual touch control, voice command or gesture recognition is mostly adopted to complete information input and task confirmation, so that an operator needs to frequently interrupt direct processing of goods when sorting or loading and unloading the goods, and in turn, the operator triggers scanning, confirmation and recording by touching a screen, making voice or making specific gestures. Resulting in repeated switching of the operator's attention between the goods and the equipment, which is prone to delays or omissions in operation, especially in complex warehouses where the goods are dense and the space is narrow, this distraction further amplifies the risk of recording errors. The above information of the background section application is only for enhancement of understanding of the background of the application and therefore it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Disclosure of Invention In view of the above, the application provides a whole-course logistics traceability method and system based on head-mounted equipment, which can finish the processing of logistics information on the premise of not dispersing attention. In a first aspect, an embodiment of the present application provides a whole-course logistic tracing method based on a head-mounted device, the method including acquiring, in real time, biological feature interaction data and geographical position coordinate data of a person wearing the head-mounted device, the biological feature interaction data including pupil center pixel coordinates, cornea reflection point pixel coordinates, pupil diameter variation ranges, eye movement trajectories, and head posture data, determining gaze point precise coordinates according to the biological feature interaction data and the geographical position coordinate data, determining whether the gaze point precise coordinates are located in a target recognition area, acquiring a target recognition area image if the gaze point precise coordinates are located in the target recognition area image, determining target identification information according to the target recognition area image, determining a navigation instruction sequence from the person wearing the head-mounted device to a target position according to the target identification information and the geographical position coordinate data, determining a superimposed display instruction sequence according to the geographical position coordinate data and the superimposed display instruction sequence, determining whether gaze point precise coordinates are located in the translucent superimposed area within preset time for a preset time, determining whether gaze time exceeds a preset time, determining a gaze intention-to-on-intention-to-operate signal corresponding to the head-mounted device is obtained according to a preset time, determining that a gaze-on-intention-to-attach signal is exceeded, and determining a corresponding operation-intention-to-operate-intention-to-position signal is obtained according to the target-of the gaze-operation-intention-request signal, and determining a complete logistics traceability chain according to the gazing record data set and the historical logistics operation chain. In a second aspect, the embodiment of the application provides a whole-course logistics traceability system based on head-mounted equipment, which comprises an acquisition module, a first determination module, a first judgment module, a second determination module, a third determination module, a second judgment module and a fourth determination module. The system comprises an acquisition module, a first determination module, a second determination module, a third determination module, a first judgment module and a second judgment module, wherein the acquisition module is used for acquiring biological characteristic interaction data and geographic position coordinate data of a person wearing the head-mounted equipment in real time, the biological characteristic interaction data compris