Search

CN-121982380-A - Shooting and checking method, device, equipment and storage medium in picking up process

CN121982380ACN 121982380 ACN121982380 ACN 121982380ACN-121982380-A

Abstract

The invention relates to the technical field of information processing, in particular to a photographing and checking method, a device, equipment and a storage medium in a piece taking process, wherein an intelligent checking combined model is utilized to extract image characteristics of primary single-package internal panoramic shots, the image characteristics are compared with declaration information, when a consistency score is larger than a scoring threshold value, a batch checking mode is recommended, standard full-package box-sealing portraits shot by couriers and standard single-package internal panoramic shots taken by couriers are obtained as standard photo groups, sensitive information in the standard photo groups is subjected to fuzzy processing by utilizing the intelligent checking combined model, the information safety is improved, suspected contraband in the standard photo groups is detected by utilizing the intelligent checking combined model, the accuracy of object consistency judgment and contraband detection is improved, the manual misjudgment risk is obviously reduced, when a detection result is passed, all packages corresponding to an order form of the standard photo groups are associated, the operation efficiency is improved, and the checking time of multiple package orders is shortened.

Inventors

  • CHEN SHAOYU

Assignees

  • 上海东普信息科技有限公司

Dates

Publication Date
20260505
Application Date
20260109

Claims (10)

  1. 1. A photographing and checking method in a picking process is characterized by comprising the following steps: Constructing a data set based on the express item image, the sensitive information image and the contraband image, and training an intelligent vision inspection combined model by utilizing the data set; Acquiring a primary single-package internal part panoramic shot by an express delivery person, extracting image features of the primary single-package internal part panoramic shot by using the intelligent vision inspection combined model, and comparing the image features with declaration information of corresponding orders to obtain consistency scores; When the consistency score is larger than a preset score threshold, a batch inspection mode is recommended to the courier, and when all the items of the packages of the order are consistent and the courier selects the batch inspection mode, standard full package box-sealing waybills and standard single package trim panoramic shots shot by the courier are obtained to serve as standard photo groups; performing fuzzy processing on sensitive information in the standard photo group by using the intelligent vision inspection combined model, and detecting suspected contraband in the standard photo group by using the intelligent vision inspection combined model to obtain a detection result; And when the detection result passes, associating the standard photo group with all packages corresponding to the order, and uploading the standard photo group to a cloud server for storage.
  2. 2. The method for photographing and checking in a process of taking a piece according to claim 1, wherein the constructing a data set based on the express item image, the sensitive information image and the contraband image, training the intelligent checking combination model by using the data set, comprises: acquiring an express item image, a sensitive information image and a contraband image; Performing image cleaning on the express item image, the sensitive information image and the contraband image, wherein the image cleaning comprises the steps of removing a fuzzy image, removing a repeated image and removing an invalid image; classifying and labeling the express item image, the sensitive information image and the contraband image to obtain a labeled image as a data set; And training an intelligent vision inspection combined model by utilizing the data set, wherein the intelligent vision inspection combined model comprises an article consistency judging model, a sensitive information identifying model and a contraband detecting model.
  3. 3. The shooting and checking method in the process of picking up the package according to claim 1, wherein the obtaining the preliminary single package internal panoramic photograph shot by the courier, extracting the image characteristics of the preliminary single package internal panoramic photograph by using the intelligent checking combination model, and comparing the image characteristics with the declaration information of the corresponding order to obtain the consistency score comprises the following steps: Identifying basic information corresponding to the order, wherein the basic information comprises sender desensitization information, recipient desensitization information, names of declared objects, classes of declared objects, the number of declared objects, specifications of declared objects and the number of packages; Synchronizing the basic information to a vision inspection photographing function, and acquiring a preliminary single package internal panoramic photograph shot by an express delivery person; Preprocessing the primary single-package trim panorama; And extracting image features of the primary single-package internal part panorama by using an object consistency judging model in the intelligent inspection combined model, and comparing the image features with declaration information in the image features to obtain comparison matching degree as consistency scores.
  4. 4. The method for shooting and checking in a picking process according to claim 1, wherein when the consistency score is greater than a preset score threshold, a batch checking mode is recommended to the courier, and when all the items of the packages of the order are consistent and the courier selects the batch checking mode, a standard full package box-sealing waybill shot by the courier and a standard single package trim panorama shot by the courier are obtained as a standard photo group, including: when the consistency score is larger than a preset score threshold, recommending a batch inspection mode to the courier; When all the wrapped articles of the order form are consistent and the express delivery person selects a batch inspection mode, acquiring standard full-package box-sealing waybills and standard single-package trim panoramic shots shot by the express delivery person; The photo quality of the standard full-package box-sealing waybill and the photo quality of the standard single-package interior panoramic photo are checked to obtain a check result, and when the check result passes, the standard full-package box-sealing waybill and the standard single-package interior panoramic photo are packaged into a standard photo group; When the articles of all packages of the order are inconsistent or the express delivery person selects an independent checking mode, generating checking tasks according to the packages, and guiding the express delivery person to shoot a plurality of packages one by one according to the checking tasks.
  5. 5. The method for photographing and checking in a process of taking a piece according to claim 1, wherein the performing fuzzy processing on the sensitive information in the standard photo group by using the intelligent checking combination model, and detecting suspected contraband in the standard photo group by using the intelligent checking combination model to obtain a detection result comprises: identifying the sensitive information in the standard photo group by using a sensitive information identification model in the intelligent inspection combination model, and grading the sensitive information to obtain a sensitive grade; Performing corresponding fuzzy processing on the sensitive information based on the sensitive grade; identifying suspected contraband in the standard photo group by utilizing a contraband detection model in the intelligent visual inspection combined model, and grading the suspected contraband to obtain a risk grade; And generating corresponding alarm information based on the risk level.
  6. 6. The method for photographing and checking in a pick-up process according to claim 1, wherein when the detection result passes, associating the standard photo group with all packages corresponding to the order, and uploading the standard photo group to a cloud server for storage, comprises: when the detection result passes, associating the standard photo group with all packages corresponding to the order; encrypting the standard photo group to obtain encrypted photo information; and uploading the encrypted photo information to a cloud server for storage.
  7. 7. The method for checking and photographing in the process of taking a piece according to claim 1, wherein when the detection result passes, associating the standard photo group with all packages corresponding to the order, and uploading the standard photo group to a cloud server for storage, further comprising: Generating a visual inspection report, wherein the visual inspection report comprises order basic information, package internals and declared objects consistency scores, contraband detection results and standard photo group storage path information; determining an administrator terminal according to the mail sending area of the order; the vision inspection report is sent to the administrator terminal.
  8. 8. Shooting and checking device in a piece taking process is characterized by comprising: the construction training module is used for constructing a data set based on the express item image, the sensitive information image and the contraband image, and training the intelligent vision inspection combined model by utilizing the data set; The system comprises an extraction and comparison module, a comparison module and a comparison module, wherein the extraction and comparison module is used for obtaining a primary single-package internal part panoramic image shot by an express delivery person, extracting image features of the primary single-package internal part panoramic image by utilizing the intelligent vision inspection combined model, and comparing the image features with declaration information of corresponding orders to obtain consistency scores; The recommendation acquisition module is used for recommending a batch inspection mode to the express delivery person when the consistency score is larger than a preset score threshold value, and acquiring a standard full-package box-sealing freight list shot by the express delivery person and a standard single package trim panorama shot as a standard photo group when the articles of all packages of the order are consistent and the express delivery person selects the batch inspection mode; The fuzzy detection module is used for carrying out fuzzy processing on the sensitive information in the standard photo group by utilizing the intelligent vision inspection combined model, and detecting suspected contraband in the standard photo group by utilizing the intelligent vision inspection combined model to obtain a detection result; And the association uploading module is used for associating the standard photo group with all packages corresponding to the order when the detection result passes, and uploading the standard photo group to a cloud server for storage.
  9. 9. The photographing and optometry equipment in the picking process is characterized by comprising a memory and at least one processor, wherein the memory stores instructions; At least one of the processors invokes the instructions in the memory to cause the in-process photo inspection device to perform the steps of the in-process photo inspection method of any one of claims 1-7.
  10. 10. A computer readable storage medium having instructions stored thereon, wherein the instructions when executed by a processor perform the steps of the method for taking a photograph for inspection in a process according to any one of claims 1-7.

Description

Shooting and checking method, device, equipment and storage medium in picking up process Technical Field The present invention relates to the field of information processing technologies, and in particular, to a photographing and optometry method, device, apparatus, and storage medium in a pickup process. Background At present, the express receiving and sending link must execute a full-open box inspection system to ensure that the articles to be sent have no contraband and are consistent with the declaration information, but the consistency of the articles and the contraband depend on manual judgment, the efficiency is low and are easily influenced by subjective factors, the risk of misjudgment exists, especially in a multi-package order scene, the inspection time is overlong due to repeated operation, in addition, in the inspection process, the express person is required to take a photograph for recording, sensitive information in an inspection photo cannot be subjected to fuzzy processing, personal privacy is easily leaked, and the information safety is reduced. Disclosure of Invention In order to overcome the defects of the prior art, the invention aims to provide a photographing inspection method, a photographing inspection device, photographing inspection equipment and a storage medium for improving the operation efficiency in a batch inspection mode, only photographing single packages, only opening boxes for other packages, and not photographing, shortening inspection time of multiple package orders, improving accuracy of object consistency judgment and contraband detection, obviously reducing risk of manual misjudgment, and improving information security. The first aspect of the invention provides a photographing and optometry method in a piece taking process, which comprises the steps of constructing a data set based on an express item image, a sensitive information image and a contraband item image, training an intelligent optometry combined model by using the data set, acquiring a primary single-package internal panoramic photo shot by an express person, extracting image features of the primary single-package internal panoramic photo by using the intelligent optometry combined model, comparing the image features with declaration information of corresponding orders to obtain consistency scores, recommending a batch optometry mode to the express person when the consistency scores are larger than a preset scoring threshold, acquiring a standard full-package seal box photo shot by the express person and a standard single-package internal panoramic photo shot by using the intelligent optometry combined model as a standard photo group when all the items of the packages of the express person are consistent and the express person selects the batch optometry mode, detecting the contraband items in the forbidden photo group by using the intelligent optometry combined model to obtain a consistency score, and storing a suspected photo corresponding to the service package group when the detected result passes through the intelligent optometry combined model. Optionally, in a first implementation manner of the first aspect of the present invention, the constructing a data set based on the express item image, the sensitive information image and the contraband image, training the intelligent vision inspection combined model by using the data set, including acquiring the express item image, the sensitive information image and the contraband image, performing image cleaning on the express item image, the sensitive information image and the contraband image, including removing a blurred image, removing a repeated image and removing an invalid image, classifying and labeling the express item image, the sensitive information image and the contraband image to obtain a labeled image as the data set, and training the intelligent vision inspection combined model by using the data set, wherein the intelligent vision inspection combined model includes an item consistency judging model, a sensitive information identifying model and a contraband detecting model. Optionally, in a second implementation manner of the first aspect of the present invention, the obtaining a preliminary single package internal panoramic photograph taken by an courier, extracting image features of the preliminary single package internal panoramic photograph by using the intelligent vision inspection combined model, comparing the image features with declaration information of a corresponding order to obtain a consistency score, including identifying basic information corresponding to the order, where the basic information includes desensitization information of a sender, desensitization information of a recipient, names of declaration items, categories of declaration items, numbers of declaration items, specifications of declaration items and number of packages, synchronizing the basic information to a vision inspection photographing function, obtaini