CN-122024215-A - Book layer height misplacement detection system and method

CN122024215ACN 122024215 ACN122024215 ACN 122024215ACN-122024215-A

Abstract

The invention discloses a book layer high misplacement detection system and a method, which belong to the technical field of library intelligent management, and the book layer high misplacement detection system acquires image data of a bookshelf through a handheld image acquisition module, and a multi-mode feature fusion processing module performs serial number character recognition according to the image data and outputs a book serial number recognition result; the layer height positioning and reference comparing module is used for identifying the layer height number of each book on the bookshelf and calling a reference book number set corresponding to the layer height number, and the layer height misplacement judging and outputting module is used for judging whether each book is misplaced or not according to the book number identification result and the reference book collection data. The book layer height misplacement detection system not only can accurately detect and identify books in a complex environment and accurately detect the positions of a large number of books, but also can remarkably improve the book detection efficiency and reduce the detection cost.

Inventors

SHI YANLING
ZHANG ZIYI
CAO LONGCHAO
CAI WANG
LI YUANTAI

Assignees

武汉纺织大学

Dates

Publication Date: 20260512
Application Date: 20260414

Claims (10)

1. A book layer height misplacement detection system, comprising: The handheld image acquisition module is used for acquiring image data of the bookshelf; the multi-mode feature fusion processing module is used for executing image area detection, spine area segmentation and numbered character recognition according to the image data and outputting the recognized book number; the layer height positioning and reference comparison module is used for calculating the layer height number of each identified book on the bookshelf according to the image visual characteristics in the image data and the bookshelf physical structure, and calling a reference book number set corresponding to each layer height number; and the layer height misplacement judging and outputting module is used for comparing the book number output by the multi-mode feature fusion processing module with the reference book number set provided by the layer height positioning and reference comparison module, judging whether each book is misplaced or not and generating a visual report of misplaced books.
2. The book layer high misplacement detection system set forth in claim 1, wherein the multi-modal feature fusion processing module comprises: The spine region detection unit comprises a target detection model for positioning and framing the spine region of each book according to the image data and outputting a spine boundary frame set ; A numbered text recognition unit for, for each spine bounding box Image preprocessing is carried out, and each spine bounding box is analyzed The candidate number and the confidence coefficient thereof, and when the maximum confidence coefficient of the identification is not less than the confidence coefficient threshold value, directly outputting the candidate number corresponding to the maximum confidence coefficient as the book number; And the multi-feature auxiliary verification unit is used for extracting the feature vector of the spine region when the maximum confidence coefficient of the identification is lower than the confidence coefficient threshold value, and carrying out similarity matching on the feature vector and the book feature database to obtain the final book number of the book.
3. The book layer height misplacement detection system set forth in claim 2, wherein the layer height positioning and reference comparison module comprises: The visual layer height positioning unit is used for constructing a mapping model from an image coordinate system to a bookshelf local coordinate system according to a spine boundary frame sequence, bookshelf partition line characteristics and camera internal references in the image data, and calculating the layer height number of each identified book ; The reference set calling unit is used for numbering according to the layer height Retrieving a reference book number set corresponding to the layer high number from the library management system 。
4. The book layer height misplacement detection system set forth in claim 3, wherein the visual layer height locating unit is configured to: Detecting horizontal partition lines of the bookshelf through an image processing algorithm, and dividing the vertical direction of an image into a plurality of high-layer areas; And determining the layer height number according to the central ordinate of the spine bounding box.
5. The book layer high misplacement detection system set forth in claim 4, wherein the layer high misplacement determination and output module comprises: the layer height matching judging unit is configured to check whether the identified book number is in a reference book number set corresponding to the layer height number where the identified book number is located; And the report generation unit is configured to generate a misplaced book number, a current layer height and a misplaced detection report of a correct layer height, generate a visual report for marking misplaced positions and suggesting correct positions and output the visual report to the library management system.
6. The book layer high misplacement detection system set forth in any one of claims 2 to 5, further comprising an adaptive learning optimization module, the adaptive learning optimization module comprising: The feedback data collection unit is used for collecting the manual confirmation result after each detection and the real-time borrowing and returning data and the on-shelf record of the library management system; The recognition model increment learning unit is used for training the numbered text recognition unit according to the collected new spine image samples with correct labels; The reference library dynamic updating unit is used for synchronizing book allocation, new book loading and old book unloading information confirmed by the library management system and correct homing information of foreign books verified manually to the reference book distribution database in real time or at fixed time.
7. The book layer high misplacement detection method is characterized in that the book layer high misplacement detection system as claimed in any one of claims 1-6 is adopted to finish the detection of books, and comprises the following steps: S1, acquiring image data of a bookshelf; S2, analyzing the image data in real time, detecting the spine areas of all books, and outputting the book numbers of each book; S3, calculating the layer height number of each identification book through image data; S4, calling a reference book number set corresponding to the layer height number; S5, judging whether the book number of each book is in a reference book number set corresponding to the layer height number, if so, judging that the book is layer height correct, and if not, judging that the book is layer height misplacement, and generating a misplacement detection report.
8. The book layer high misplacement detection method as set forth in claim 7, wherein the step S2 comprises the steps of: S21, performing text extraction and analysis on the spine area of each book by adopting an OCR engine to obtain candidate numbers and confidence degrees of each book; s22, judging the maximum confidence coefficient of each book Whether the number is not smaller than the first confidence threshold value or not, if so, determining the candidate number corresponding to the maximum confidence coefficient If not, extracting the feature vector of the spine, performing similarity matching with a book feature database, and determining the final book number according to the following formula: Wherein, the For maximum confidence in each book for OCR recognition, As a first confidence threshold value, As a result of the second confidence threshold value, C k is the confidence of the candidate number k in the OCR recognition result, S k is the similarity score of the candidate number k in the feature matching result, As the weight coefficient of the light-emitting diode, For the most similar numbering, For the most similarly numbered similarity score, Is a feature similarity threshold.
9. The book layer high misplacement detection method as claimed in claim 7, wherein the construction method of the reference book number set in step S4 is as follows: S41, constructing a reference book number set for each bookshelf unit and each layer height of the library; S42, filling all book numbers which are to be contained in each layer into the corresponding book number set.
10. The book layer high misplacement detection method as claimed in claim 7, wherein the layer high misplacement determination rule in step S5 comprises: if the identified book number is in the reference book number set corresponding to the layer height number where the identified book number is located, judging that the book is correct in layer height; if the identified book number is not in the reference book number set corresponding to the layer height number, judging that the book is misplaced; If the identified book numbers cannot find the matching items in all the reference book number sets, marking the book numbers as foreign books; If a certain book number in the reference book number set cannot be identified in the image with the whole layer height corresponding to the reference book number set, marking that the book is missing.

Description

Book layer height misplacement detection system and method Technical Field The invention belongs to the technical field of library intelligent management, and particularly relates to a book layer high misplacement detection system and method. Background The library is used as a core battle place for knowledge propagation and public culture service, and ordered placement of library books is a core foundation for guaranteeing service efficiency and realizing book collection value. In daily operation, a reading room is used as a core area for readers to directly read and review the literature, so that the problem of misplacement management of books is always faced, namely, in the process that the readers read books by themselves to read and pick or return the borrowed books, the situation that the books are not returned to the accurate position of the original books, namely, the misplacement of the books called in the industry, often occurs due to various subjective and objective factors such as rapid borrowing time, unfamiliar classification and arrangement rules (such as book classification numbers and shelf position numbers) of the libraries, unclear bookshelf identification, subjective negligence and the like. Firstly, the misplaced books can directly cause the phenomenon of dead book, namely the books are actually still on the bookshelf in the library, but because the positions deviate from the original bookshelf system, no matter a reader searches according to search information or a librarian carries out collection check, the books are difficult to quickly position, and finally the books are in a collection state but cannot be effectively utilized, secondly, the misplaced books can damage the integrity of the whole bookshelf system of the books, the accumulation of a large number of misplaced books can lead the classification of the bookshelf to be disordered, the daily arrangement and homing labor cost of the librarian is increased, the integral circulation efficiency of the books can be reduced, and more importantly, the use experience of the readers can be directly influenced after the readers encounter the conditions of searching books and no books on the bookshelf for many times, the satisfaction degree of library service is reduced, and even the public trust of the library serving as a public culture service platform is weakened. In conclusion, if the problem of misplacement of books cannot be effectively solved for a long time, the utilization rate of the collection resources is fundamentally reduced, and the initial purpose of the library of 'making knowledge tentacles accessible' is overcome. At present, the problem of misplacement of books is mainly solved by three modes, namely manual regular inspection, RFID-based inventory system and monitoring based on a fixed camera. The manual regular inspection is checked by librarian according to the sequence of the books, the method is time-consuming, labor-consuming and low in efficiency, is easy to generate omission due to fatigue, and is difficult to be normally executed in large and medium-sized libraries. The RFID-based inventory system uses a handheld or track RFID reader to read tags in batches by embedding RFID tags in each book, and compares the tags with a system database to find out an error shelf. However, the scheme has the obvious defects that firstly, RFID labels are required to be deployed in a large number of books, the transformation cost is extremely high, secondly, an RFID reader only can sense whether the labels exist and the approximate distance, which book is in a specific misplaced position cannot be intuitively judged, secondary searching still needs to be carried out manually according to the signal intensity of a reader-writer, and finally, the reading success rate is reduced under the conditions that the spine of the book faces outwards and the labels are blocked by a metal bookend or an adjacent book. The monitoring based on the fixed camera monitors book changes through image analysis by installing the camera above the bookshelf. However, the method has limited monitoring range, high cost for deploying and maintaining a large number of high-definition cameras, and complex multi-target continuous tracking and illumination change processing algorithm, and is difficult to accurately position misplacement behaviors of specific numbers. Disclosure of Invention Aiming at one or more of the defects or improvement demands of the prior art, the invention provides a book layer high misplacement detection system and method, which not only can realize accurate detection and identification of books in a complex environment and accurately detect the positions of a large number of books, but also can obviously improve the book detection efficiency and reduce the detection cost. In order to achieve the above object, the present invention provides a book layer high misplacement detection system, comprising: The handheld image acquisition