CN-115908386-B - Flash memory card circuit auxiliary repair system and method based on mixed reality

CN115908386BCN 115908386 BCN115908386 BCN 115908386BCN-115908386-B

Abstract

The invention relates to a flash memory card circuit auxiliary repair system and a method based on mixed reality, wherein in the system, detection light of optical coherence tomography equipment is focused on a flash memory card sample, and sample detection spectrum data is obtained through detection; the projection equipment projects and displays the projection image of the flash memory card circuit on the surface of the flash memory card, and the internal circuit of the flash memory card is checked in an auxiliary way. The invention can rapidly and nondestructively acquire the internal circuit of the flash memory card and project the circuit image on the surface of the flash memory card so as to check and repair the circuit.

Inventors

ZHANG NING
ZHAO LU
SUN ZHENWEN

Assignees

公安部鉴定中心

Dates

Publication Date: 20260505
Application Date: 20221223

Claims (8)

1.A flash memory card circuit auxiliary repair system based on mixed reality is characterized by comprising optical coherence tomography equipment, an image conversion module and projection equipment, wherein, The optical coherence tomography device is used for scanning the flash memory card sample through the emitted detection light to obtain sample detection spectrum data; the image conversion module is used for carrying out image processing according to the sample detection spectrum data to obtain a flash memory card circuit projection image; The projection equipment is used for projecting and displaying the projection image of the flash memory card circuit onto the surface of the flash memory card to assist in checking the internal circuit of the flash memory card, projecting the projection image of the flash memory card circuit onto a flash memory card sample, and adjusting the size and the position of the projection image to enable the projection image to coincide with the flash memory card sample in equal proportion; The image conversion module comprises a data processing module and an image processing module, wherein: The data processing module is used for converting the sample detection spectrum data into an internal circuit image under the flash memory card insulating layer; The image processing module is used for performing field curvature compensation, light intensity correction and splicing fusion on the internal circuit image of the flash memory card and then converting the internal circuit image of the flash memory card into a flash memory card circuit projection image, wherein the field curvature compensation is performed in a mode of extracting the upper surface boundary of a flash memory card sample, performing surface fitting on the extracted upper surface boundary and compensating according to a fitting surface; The optical coherence tomography device comprises a super-radiation light-emitting diode light source (1), a circulator (2), a coupler (3), a first polarization controller (4-1), a second polarization controller (4-2), a first collimator (5-1), a second collimator (5-2), a plane mirror (6), an indicator lamp (7), a spectrometer (8) and a two-dimensional galvanometer scanning unit (10), wherein light emitted by the super-radiation light-emitting diode light source (1) enters the circulator (2) through a first port (2-1) of the circulator (2) and then is output to the coupler (3) through a second port (2-2), and the coupler (3) divides light emitted by the super-radiation light-emitting diode light source (1) into detection light and reference light; the reference light irradiates onto a plane mirror (6) through a second polarization controller (4-2) and a second collimator (5-2) and returns to the coupler (3) along the original path; The detection light irradiates the two-dimensional galvanometer scanning unit (10) through the first polarization controller (4-1) and the first collimator (5-1), the two-dimensional galvanometer scanning unit (10) is used for adjusting the internal galvanometer to control the detection light to scan the flash memory card sample, the detection light returns to the coupler (3) after being reflected by the surface of the flash memory card sample, on one hand, the detection light enters the indicator lamp (7) to be used for emitting visible light to indicate the current scanning position in the scanning process, on the other hand, the detection light interferes with the reference light returned from the original path of the plane mirror (6) to form interference light, the interference light is output to the third port (2-3) in the circulator (2) to enter the spectrometer (8), and the spectrometer (8) acquires the detection spectrum data of the sample for the interference light.
2. The flash memory card circuit auxiliary repair system based on mixed reality according to claim 1, wherein the two-dimensional galvanometer scanning unit (10) and the spectrometer (8) are synchronously controlled.
3. A mixed reality based flash memory card circuit assisted repair system according to claim 1, characterized in that the system further comprises a microscopic viewing device (14) and a beam splitter (11), the microscopic viewing device (14) comprising an objective lens (12) and an eyepiece lens (15), the beam splitter (11) being placed between the eyepiece lens (15) and the objective lens (12); The detection light output in the horizontal direction through the two-dimensional galvanometer scanning unit (10) enters the spectroscope (11) to be converted into detection light in the vertical direction, and the detection light is focused through the objective lens (12) to scan the flash memory card sample; The projection device is arranged on the microscopic observation device (14), the projection light path and the observation light path are common light paths, and the ocular (15) is used for observing scanning light spots and observing flash memory card circuit projection images projected by the projection device.
4. The mixed reality based flash card circuit assisted repair system of claim 1, further comprising a flash card limit assembly (16) for securing a flash card and adjusting a flash card position; Under the condition of fixing the scanning light spot position of the detection light, the flash memory card limiting assembly (16) and the spectrometer (8) are synchronously controlled, and the flash memory card limiting assembly (16) drives the flash memory card to move through space displacement to realize regional scanning.
5. The auxiliary repair system for the flash memory card circuit based on mixed reality according to claim 4, further comprising a scanning mechanical arm, wherein the scanning mechanical arm is used for bearing the two-dimensional galvanometer scanning unit (10), the spectroscope (11) and the objective lens (12), and the mechanical arm drives the two-dimensional galvanometer scanning unit (10), the spectroscope (11) and the objective lens (12) to integrally translate, so that the flash memory card regional scanning is realized.
6. A method of assisted repair of flash memory card circuits based on the system of any one of claims 1 to 5, the method comprising: Scanning the flash memory card by using detection light of the optical coherence tomography equipment to obtain flash memory card sample detection spectrum data; Performing image processing according to the sample detection spectrum data to obtain a flash memory card circuit projection image under the flash memory card insulating layer; and the flash memory card circuit image is projected and displayed on the surface of the flash memory card in equal proportion, so that the projected image of the flash memory card circuit is completely overlapped with the surface of the flash memory card, and the flash memory card circuit image is used for assisting in checking the internal circuit of the flash memory card storage device.
7. The method for auxiliary repair of flash memory card circuit according to claim 6, wherein, The image processing according to the sample detection spectrum data to obtain a flash memory card circuit projection image comprises the following steps: converting the flash memory card sample detection spectrum data into an internal circuit image under the flash memory card insulating layer; and performing field curvature compensation and light intensity correction on the internal circuit image of the flash memory card to convert the field curvature compensation and the light intensity correction into a projection image of the flash memory card circuit.
8. According to claim 6 an auxiliary repair method for a flash memory card circuit, characterized in that the method further comprises: Carrying out regional multi-time scanning imaging on the flash memory card with the size exceeding the scanning range, and carrying out splicing and fusion on a plurality of regional images by using an automatic splicing algorithm under the condition of keeping the resolution unchanged to obtain a complete image, wherein the steps comprise feature extraction, feature matching, image matching and fusion; the feature extraction is to extract feature points of each regional image, wherein the feature points comprise PCB circuit wires and through holes in a flash memory card sample; X-Y slice imaging is carried out in the area below the PCB circuit layer of the flash memory card, the position of the through hole is obtained through filtering and binarization, and the extracted position of the through hole is marked in the PCB circuit structure image; feature matching, namely detecting feature points of each circuit image of the flash memory card sample by searching extreme values on the scale and the space and performing feature matching; Image matching, namely identifying and aligning the same characteristic points on pixels in the two images; Fusion, in which two images are fused into one image after alignment.

Description

Flash memory card circuit auxiliary repair system and method based on mixed reality Technical Field The invention relates to the technical field of electronic product detection evidence obtaining, in particular to a flash memory card circuit auxiliary repair system and method based on mixed reality. Background FLASH memory cards generally comprise integrally packaged FLASH memory devices such as micro-SD cards. Because the production technology of the flash memory card product is very mature, the silk-screen character marks on the surface of the flash memory card can be polished and re-carved, and meanwhile, the market lacks effective supervision, and illegal manufacturers can forge by removing and even imitating the silk-screen character marks of large factories. Therefore, the surface silk-screen character mark which can be used as the model judgment basis loses the utilization value, and the model cannot be judged only by the character mark of the appearance, so that the circuit characteristics under the insulating surface layer of the flash memory card are used as the unique judgment basis of the model in the industry. In forensic science electronic data evidence obtaining process, circuit characteristics under an insulating surface layer of a flash memory card are also required to be obtained, so that the stored data are extracted and recovered. Since the circuits inside the flash memory card are covered and protected by the surface insulating layer, the characteristics of the internal circuits cannot be directly observed from the appearance. The most commonly adopted mode at present is to polish the surface insulation layer until the circuit of the lower layer is exposed and then to conduct circuit characteristic analysis. The mode of removing the insulating layer through polishing is a destructive operation, secondary damage is easily brought in the process, even storage equipment is damaged, and the circuit is easily oxidized due to the fact that a copper layer is covered on the circuit PCB and is not timely operated after the circuit PCB is exposed to air, so that follow-up work is seriously affected. At the same time, this also creates considerable difficulties in finding more models of products, since the circuit features must be seen after removal of the insulation by grinding. Optical coherence tomography (Optical Coherence Tomography, OCT for short) is a non-invasive, high-resolution, real-time optical imaging technique developed in recent years, and has the capability of cross-sectional tomography. OCT technology is widely applied to biomedical images with the characteristics of no damage, no wound, real-time, micron-level high resolution, higher penetration depth (1-2 mm) and the like, and plays an increasingly important role in a plurality of biomedical fields such as ophthalmology, brain science, cardiology, gastroenterology and the like by virtue of the advantages. OCT technology is similar to ultrasonic tomography in principle, and can obtain micron-level resolution fine structure tomographic image of the measured sample in a nondestructive and noncontact way through coherent gate and other methods, computer digital signals and image processing technology. In recent years, OCT technology has also shown its potential in the field of evidence collection, such as counterfeit coin inspection, potential fingerprint detection, automotive paint recognition, and the like. Disclosure of Invention In view of the above problems, an object of the present invention is to provide a system and a method for auxiliary repair of a flash memory card circuit based on mixed reality, which are used for directly and rapidly observing the internal circuit structure of the flash memory card under the non-destructive condition, and for auxiliary repair of the flash memory card circuit and extraction of recovery data. In order to achieve the above purpose, the present invention adopts the following technical scheme: The invention provides a flash memory card circuit auxiliary repair system based on mixed reality, which comprises optical coherence tomography equipment, an image conversion module and projection equipment, wherein, The optical coherence tomography device is used for scanning the flash memory card sample through the emitted detection light to obtain sample detection spectrum data; the image conversion module is used for carrying out image processing according to the sample detection spectrum data to obtain a flash memory card circuit projection image; And the projection equipment is used for projecting and displaying the projection image of the flash memory card circuit onto the surface of the flash memory card and assisting in checking the internal circuit of the flash memory card. Preferably, the image conversion module comprises a data processing module and an image processing module, wherein: The data processing module is used for converting the sample detection spectrum data into an internal circ