Search

CN-119620862-B - Method and device for realizing electronic instruction book of electric vehicle instrument and electronic equipment

CN119620862BCN 119620862 BCN119620862 BCN 119620862BCN-119620862-B

Abstract

The application provides a method and a device for realizing an electronic instruction book of an electric vehicle instrument and electronic equipment, and relates to the field of data processing. The method comprises the steps of obtaining working procedure positions and working contents of workers in production of electric vehicle meters, determining electronic guidance contents from electronic guidance books according to the working procedure positions and the working contents to generate a first image, displaying the first image to the workers through the AR glasses, receiving quality detection information, sent by detection equipment, of the electric vehicle meters, wherein the quality detection information comprises operation step information, operation step completion time and defective product conditions, the quality detection information is used for indicating whether the quality of the electric vehicle meters is qualified or not, marking the quality detection information into the first image to generate a second image, and displaying the second image to the workers through the AR glasses. By implementing the technical scheme, the electronic instruction book and the product tracing are reasonably combined, so that the beneficial implementation of the electronic instruction book is facilitated.

Inventors

  • ZHANG XIN

Assignees

  • 无锡市极光电动科技有限公司

Dates

Publication Date
20260508
Application Date
20241125

Claims (9)

  1. 1. The method for realizing the electronic instruction book of the electric vehicle instrument is characterized by comprising the following steps of: acquiring working procedure positions and working contents of a worker in the production work of the electric vehicle instrument, wherein the worker wears AR glasses; determining electronic instruction content from an electronic instruction book according to the procedure position and the working content, and generating a first image; displaying the first image to the staff member through the AR glasses; Receiving quality detection information which is sent by detection equipment and aims at the electric vehicle instrument, wherein the quality detection information comprises information of operated steps, time for completing the operated steps and defective products, and the quality detection information is used for indicating whether the quality of the electric vehicle instrument is qualified or not; labeling the quality detection information into the first image to generate a second image; displaying the second image to the staff member through the AR glasses; The quality detection information sent by the receiving detection equipment and aiming at the electric vehicle instrument specifically comprises the following steps: After the electric vehicle instrument is detected by the first detection link corresponding to the detection equipment, generating quality detection information; Determining a next associated detection link of the first detection link from the electronic instruction to obtain a second detection link, wherein a causal association relation exists between a detection result corresponding to the first detection link and a detection result corresponding to the second detection link; and based on the second detection link, acquiring and storing quality detection information, which is sent by the detection equipment and is aimed at the electric vehicle instrument, wherein the detection equipment corresponding to the second detection link comprises the AR glasses.
  2. 2. The method for implementing the electronic instruction book of the electric vehicle instrument according to claim 1, wherein the step of obtaining the working procedure position and the working content of the worker in the production work of the electric vehicle instrument specifically comprises the following steps: Acquiring the position information of the AR glasses; Determining a first position of the staff member according to the position information; acquiring working images of the staff photographed by the AR glasses; determining the environment where the staff is located from the working image to obtain a second position; Determining the process position by combining the first position and the second position; and carrying out image feature recognition on the working image to determine the working content.
  3. 3. The method for implementing the electronic instruction of the electric vehicle instrument according to claim 1, wherein the determining the electronic instruction content from the electronic instruction according to the process position and the work content, and generating the first image specifically includes: Determining the electronic guidance content according to the procedure position and the working content; Performing text conversion and image conversion on the electronic guidance content to generate voice information and action information; Inputting the voice information and the action information into an initial digital person model to generate a target digital person for explaining the voice information and displaying the action information; And generating the first image according to the target digital person.
  4. 4. The method for implementing the electronic instruction of the electric vehicle instrument according to claim 1, wherein the labeling the quality detection information into the first image, and generating a second image, specifically includes: Classifying the quality detection information to obtain the operated step information, the operated step completion time and the defective product condition; Marking the operated step information and the operated step completion time into a dynamic area to obtain first image content, wherein the dynamic area is used for displaying or hiding the operated step completion time of the operated step information; determining coordinate information of the defective products according to the defective product conditions; marking coordinate information of the defective products on the electric vehicle instrument in a space coordinate system by adopting a color coding mode, and generating second image content; And generating the second image according to the first image content and the second image content.
  5. 5. The method for implementing the electronic instruction of the electric vehicle instrument according to claim 2, characterized in that the method further comprises: Performing action recognition on the working image, and determining a production action corresponding to the working personnel; calculating the action similarity between the production action and the preset action corresponding to the working content, and judging whether the key production action contained in the production action is consistent with the key production action contained in the preset action; if the action similarity between the production action and the preset action is larger than or equal to a preset threshold, and the key production action contained in the production action is consistent with the key production action contained in the preset action, determining that the production action corresponding to the staff is qualified.
  6. 6. The method for implementing an electronic guidebook for an electric vehicle according to claim 5, wherein the method further comprises: If the action similarity between the production action and the preset action is larger than or equal to a preset threshold value, and the key production action contained in the production action is inconsistent with the key production action contained in the preset action, determining that the production action corresponding to the staff is not qualified, or, If the action similarity between the production action and the preset action is smaller than a preset threshold, determining that the production action corresponding to the staff is unqualified, and generating abnormal action alarm information; And displaying the abnormal action alarm information to the staff through the AR glasses.
  7. 7. An electric vehicle instrument electronic instruction realizing device is characterized in that the device comprises an acquisition module (31) and a processing module (32), wherein, The acquisition module (31) is used for acquiring the working procedure positions and working contents of a worker in the production work of the electric vehicle instrument, and the worker wears AR glasses; The processing module (32) is used for determining electronic guidance content from an electronic guidance book according to the working procedure position and the working content, and generating a first image; -the processing module (32) further for presenting the first image to the staff member through the AR glasses; The acquisition module (31) is further configured to receive quality detection information for the electric vehicle instrument sent by a detection device, where the quality detection information includes information about an operated step, a time for completing the operated step, and a defective product condition, and the quality detection information is used to indicate whether the quality of the electric vehicle instrument is qualified; The processing module (32) is further configured to annotate the quality detection information into the first image to generate a second image; The processing module (32) is further configured to display the second image to the staff member through the AR glasses.
  8. 8. An electronic device, characterized in that the electronic device comprises a processor (41), a memory (45), a user interface (43) and a network interface (44), the memory (45) being arranged to store instructions, the user interface (43) and the network interface (44) being arranged to communicate to other devices, the processor (41) being arranged to execute the instructions stored in the memory (45) to cause the electronic device to perform the method according to any one of claims 1 to 7.
  9. 9. A computer readable storage medium storing instructions which, when executed, perform the method of any one of claims 1 to 6.

Description

Method and device for realizing electronic instruction book of electric vehicle instrument and electronic equipment Technical Field The application relates to the technical field of data processing, in particular to a method and a device for realizing an electronic instruction book of an electric vehicle instrument and electronic equipment. Background In the production process of electric vehicle meters, it is important to ensure the consistency of product quality. However, the conventional production line detection and guidance management methods have certain limitations. On one hand, traditional detection relies on manual experience and off-line detection equipment, so that after defective products are detected, support of real-time and accurate process guidance data is lacked. On the other hand, the production process involves multiple complex links, such as welding, assembling and testing, and the operator behavior of each link may affect the product quality, but the operator behaviors often cannot be systematically and real-time guided in the traditional system. Therefore, the related technical mode has the problem that the electronic instruction and the product tracing cannot be reasonably combined, and is not beneficial to the beneficial realization of the electronic instruction. Therefore, an implementation method and device of an electronic instruction book of an electric vehicle instrument and electronic equipment are urgently needed. Disclosure of Invention The application provides a method, a device and electronic equipment for realizing an electronic instruction of an electric vehicle instrument, which are used for reasonably combining the electronic instruction with the traceability of products, so that the beneficial realization of the electronic instruction is facilitated. The application provides an electric vehicle instrument electronic guide book implementation method, which comprises the steps of obtaining working procedure positions and working contents of workers in electric vehicle instrument production work, determining electronic guide contents from an electronic guide book according to the working procedure positions and the working contents to generate a first image, displaying the first image to the workers through the AR glasses, receiving quality detection information sent by detection equipment and aiming at the electric vehicle instrument, wherein the quality detection information comprises operated step information, operated step completion time and defective product conditions, the quality detection information is used for indicating whether the quality of the electric vehicle instrument is qualified or not, marking the quality detection information into the first image to generate a second image, and displaying the second image to the workers through the AR glasses. By adopting the technical scheme, the system automatically identifies the working procedure position and the working content of the operator, extracts the corresponding operation guide from the electronic instruction book and presents the operation guide in real time in the AR glasses. This ensures that the operator can accurately perform the process criteria in each step, avoiding operating deviations due to unfamiliar procedures. Through the first image that AR glasses show, the operator need not to look over the instruction book on paper or the handheld device, directly sees operation step and notice in the field of view, reduces operation interruption, improves efficiency. The system receives quality detection information from the detection equipment, including completed operation steps, defective product information and the like, and judges whether the current product meets quality standards. The real-time labeling of the detection information helps operators to find problems in time and avoid bad products from entering the next working procedure. When abnormal conditions are detected, the system can visually present defective product information through the AR glasses, so that operators can quickly adjust or redo defective steps, the reworking waste is reduced, and the overall production efficiency is improved. The quality detection information is automatically recorded and marked in the corresponding operation instruction image. The data mark is helpful for realizing transparent tracing in a production chain, and is convenient for searching for specific links producing defective products. The second image with the quality information not only contains real-time detection data, but also integrates the completion condition of specific operation steps, is convenient for the traceability analysis of each operation step and quality detection afterwards, and provides data support for process improvement. After the quality problem is detected, a second image is generated through real-time labeling, and specific bad information is displayed to an operator. The feedback closed loop enables an operator to immediat