Search

CN-121659365-B - Traceable segmented data acquisition method, traceable segmented data acquisition device and storage medium

CN121659365BCN 121659365 BCN121659365 BCN 121659365BCN-121659365-B

Abstract

The invention provides a traceable segmented data acquisition method, a traceable segmented data acquisition device and a traceable segmented data acquisition storage medium, and relates to the technical field of data acquisition and safety recording. Generating a segment check point and obtaining time witness information to form segment anchoring information when the segment is finished, and realizing consistency check and traceable verification of the record sequence in the segment by outputting a replay check data packet. The scheme is suitable for sequential proving and trusted recording under a continuous acquisition scene.

Inventors

  • CHENG JIANQUN
  • QIN BOQI
  • ZHOU WENYI

Assignees

  • 泉州信息工程学院

Dates

Publication Date
20260505
Application Date
20260204

Claims (5)

  1. 1. A traceable segmented data collection method, comprising: S1, determining at least two data acquisition segments for one data acquisition session, and generating corresponding segment identifiers for each data acquisition segment; s2, registering at least one data source to generate data source anchoring information and distributing data source anchoring references to the data source anchoring information, wherein the data source anchoring information at least comprises a data source identifier, a registration sequence number and an anchoring abstract value generated based on data source description information; In the execution process of the data acquisition session, acquiring data from at least one data source, mapping the acquired data into a unified record body, and binding the unified record body with the segmentation mark; S3, generating a corresponding evidence header aiming at each unified record body, wherein the evidence header at least comprises a segment identifier, a sequence number in a segment, a data source anchoring reference and an evidence abstract value; The evidence header comprises a preamble evidence abstract value, wherein the evidence abstract value is generated based on the record abstract value of the unified record body, the preamble evidence abstract value and the sequence number in the segment; Wherein the leading evidence digest value points to the evidence digest value of the last evidence head adjacent within the same segment to form the sequential evidence chain; S4, when the segmentation is finished, generating a segmentation check point based on the sequential evidence chain in the segmentation, wherein the segmentation check point at least comprises a segmentation abstract value, the segmentation is finished triggered by a preset closed segment criterion, and the closed segment criterion is determined according to a time stamp sequence of a collected unified record in the data collection session and defines a tolerance range of late record which allows the integration of the finished segmentation; S5, acquiring time witness information aiming at the segmentation check point, binding the time witness information with the segmentation check point to generate segmentation anchoring information, and writing the segmentation anchoring information into the additional evidence storage area; If after generating the segment check point, receiving a unified record body which belongs to the finished segment in time but is delayed to arrive, and the delay of the unified record body exceeds a tolerance range, creating an associated compensation segment for the finished segment; the time witness information is obtained in a batch time witness mode, and the method comprises the following steps: aggregating the segment digest values of the segment check points to be witnessed to generate an aggregate digest value; Performing time witness on the aggregated digest value to a time witness service request to obtain corresponding time witness information; Generating, for each segment checkpoint participating in the aggregation, a proof of inclusion whose segment digest value is included in the aggregate digest value; storing the inclusion evidence and segment anchoring information in an evidence index storage area in an associated mode, and incorporating a replay check data packet; And S6, writing the unified record body into an original data storage area, and writing index items corresponding to the evidence header, the segmentation check point and the segmentation anchor information into an evidence index storage area so as to support playback verification of the sequential evidence chain based on the segmentation anchor information, thereby verifying the sequential consistency and traceability of the unified record body.
  2. 2. The method of claim 1, wherein the segment digest value is generated based on a last evidence header of the last evidence header in the segment, and wherein the segment check point further records a start sequence number and an end sequence number of the segment.
  3. 3. The method of claim 1, wherein the evidence header further comprises record references pointing to corresponding unified records in the original data store; Comprising outputting a replay check packet containing at least segment anchor information, a scope reference for locating a scope of a relevant evidence header, and said inclusion proof for proving that a corresponding segment digest value is included in said aggregated digest value; And when the preset difference condition is met, generating a difference mark and writing a corresponding evidence head.
  4. 4. A traceable segmented data collection device comprising a processor and a memory, wherein the memory has stored therein a computer program which, when executed by the processor, causes the processor to perform the traceable segmented data collection method of any of claims 1 to 3.
  5. 5. A computer readable storage medium having stored thereon a computer program, which, when executed by a processor, causes the processor to perform the traceable segmented data collection method of any of claims 1 to 3.

Description

Traceable segmented data acquisition method, traceable segmented data acquisition device and storage medium Technical Field The present invention relates to the field of data acquisition and security recording technologies, and in particular, to a traceable segmented data acquisition method, device and storage medium. Background In a system related to data processing and network communication, data acquisition results are often directly used for transaction confirmation, evidence preservation, experiment reproduction, equipment operation evaluation and other purposes. Besides the correctness of the data content, more and more application scenes also require that verifiable basis can be provided for the source of data generation, the recorded time sequence and the continuity of the acquisition process, so that the traceability and verification of the data formation process are supported when disputes occur or rechecking is required. In the prior art, common credibility guarantee modes comprise the steps of generating check values for data and carrying out consistency comparison in a subsequent link, submitting data summaries to external timestamp service to obtain time proofs, and carrying out non-falsifiable evidence storage on the summaries or records in a blockchain mode and the like. The method can provide integrity certification for static data or final results to a certain extent, but has the defect of applicability when facing continuously generated and streaming data acquisition session, wherein the verification value of single data can only prove that the content of the single data is not tampered, and is difficult to simultaneously prove the strict sequence relationship among records, so that the sequence consistency damage caused by record insertion, deletion or rearrangement is difficult to be resisted, the interaction times and processing cost are obviously increased when external time certification is acquired one by one for a high-frequency acquisition process, and the whole process data is submitted to an external verification platform, and is easy to be constrained by throughput and storage cost, so that the real-time performance and expandability are difficult to be considered. On the other hand, delay arrival and out-of-order arrival phenomena caused by factors such as network jitter, buffering, asynchronous transmission and the like commonly exist in the continuous acquisition process. When the existing scheme processes such anomalies, the existing record is often modified by write-back, post-event supplementary note or large-range verification information is regenerated, and the formed verification basis is easily destroyed or recalculation cost is obviously increased. In addition, some schemes mix audit information with raw data, resulting in the need for the verifier to contact a large amount of raw data when performing the verification, creating a constraint between third party verification feasibility and minimal exposure of the data. Disclosure of Invention In order to overcome the defects of the prior art, the technical problem to be solved by the invention is to provide a traceable segmented data acquisition method, a traceable segmented data acquisition device and a traceable segmented data storage medium, which adopt the following technical scheme: In one aspect, the present invention provides a traceable segmented data collection method, including: S1, determining at least two data acquisition segments for one data acquisition session, and generating corresponding segment identifiers for each data acquisition segment; S2, in the execution process of the data acquisition session, acquiring data from at least one data source, mapping the acquired data into a unified record body, and binding the unified record body with the segmentation mark; s3, generating a corresponding evidence head for each unified record body, wherein the evidence head at least comprises the segment identification, a segment internal sequence number, a data source anchoring reference and an evidence abstract value; s4, generating a segment check point based on the sequential evidence chain in the segment at the end of the segment, wherein the segment check point at least comprises a segment digest value; s5, acquiring time witness information aiming at the segmentation check point, binding the time witness information with the segmentation check point to generate segmentation anchoring information, and writing the segmentation anchoring information into the additional evidence storage area; And S6, writing the unified record body into an original data storage area, and writing the evidence header, the segmentation check point and the index item corresponding to the segmentation anchor information into an evidence index storage area so as to support playback verification of the sequential evidence chain based on the segmentation anchor information, thereby verifying the sequential consistency and traceability