CN-122027827-A - Video stream concurrent processing method, system, electronic equipment and storage medium

CN122027827ACN 122027827 ACN122027827 ACN 122027827ACN-122027827-A

Abstract

The disclosure relates to a video stream concurrency processing method, a system, electronic equipment and a storage medium. The method comprises the steps of responding to a video acquisition instruction, obtaining a target video stream, establishing a data distribution link aiming at the target video stream, determining a data format corresponding to the data distribution link, converting the target video stream into first data corresponding to a first format and second data corresponding to a second format according to the data format, and writing the first data and the second data into a computing storage device and a data storage device respectively based on the data distribution link. According to the technical scheme provided by the disclosure, the parallel distribution and multi-format writing of the same video source data can be realized by establishing the data distribution link for the video stream, converting the video stream into data with different formats on the basis of determining the data formats and then writing the data into the computing storage device and the data storage device respectively, so that the concurrency of video writing processing can be improved and the blocking time in the writing process can be reduced.

Inventors

LEI HUA
WANG YUXUAN
SHENG YUANJIE
ZENG MING

Assignees

天链芯(武汉)半导体有限公司

Dates

Publication Date: 20260512
Application Date: 20251231

Claims (10)

1. The video stream concurrency processing method is characterized by being applied to host equipment, wherein the host equipment is respectively in communication connection with computing storage equipment and data storage equipment, and the method comprises the following steps: Responding to a video acquisition instruction, and acquiring a target video stream; Establishing a data distribution link aiming at the target video stream, wherein the data distribution link represents a logic channel set for transmitting the same video source data to different hardware interfaces in parallel; determining a data format corresponding to the data distribution link, wherein the data format comprises a first format and a second format; according to the data format, converting the target video stream into first data corresponding to the first format and second data corresponding to the second format; Based on the data distribution link, the first data and the second data are written to the computing storage device and the data storage device, respectively.
2. The method of claim 1, wherein the data distribution link includes a first transmission path to the computing storage device and a second transmission path to the data storage device, wherein writing the first data and the second data to the computing storage device and the data storage device, respectively, based on the data distribution link, includes: Acquiring a calculation trigger address of the calculation storage device; the computation trigger address is configured to route the written data to a computation unit of the computation storage device; writing the first data into the calculation trigger address through the first transmission path to trigger the calculation unit to perform analysis processing on the first data; Determining a logical storage area of the data storage device; and writing the second data into the logic storage area through the second transmission path so as to store the second data.
3. The method of claim 2, wherein the first transmission path is a computing channel established based on a computer expansion bus standard, the second transmission path is a storage channel established based on a serial storage interface standard, and the determining the data format corresponding to the data distribution link comprises: determining that the data format is the first format when the data distribution link is the first transmission path; the first format is adapted to the input requirements of the computing unit; And determining the data format as the second format when the data distribution link is the second transmission path, wherein the second format is adapted to the writing bandwidth of the data storage device.
4. The method of claim 2, wherein the first transmission path has a direct access control module configured thereon, and wherein the writing the first data to the computation trigger address via the first transmission path comprises: The physical buffer address represents the actual storage position of the first data in the host device; Generating a direct access request for the first transmission path based on the calculated trigger address and the physical buffer address; Submitting the direct access request to the direct access control module to trigger the direct access control module to directly transmit the first data at the physical buffer address to the computation trigger address in response to the direct access request.
5. The method of claim 2, wherein the host device runs a file system, wherein the file system includes a first logical path and a second logical path, wherein the establishing a data distribution link for the target video stream includes: The method comprises the steps of obtaining a preset mounting strategy, wherein the preset mounting strategy is used for mapping the computing storage equipment to the first logic path and mapping the data storage equipment to the second logic path; Constructing a first data receiving object pointing to the first logic path and a second data receiving object pointing to the second logic path; designating the first data receiving object as an output target of the target video stream to establish the first transmission path; designating the second data reception object as an output target of the target video stream to establish the second transmission path.
6. The method according to claim 2, wherein the method further comprises: Acquiring a computing state of the computing storage device for the first data; Reading a structured analysis result from the computing storage device in a case where the computing state characterizes the computing unit as completing the analysis processing for the first data; generating storage index information pointing to the second data under the condition that the second data is written into the data storage equipment, wherein the storage index information comprises a storage position of the second data in the data storage equipment and a recording time stamp; and establishing a time sequence association relation between the structural analysis result and the stored index information.
7. The method of claim 6, wherein the target video stream is captured output by an image capture component, the method further comprising: Obtaining a pixel position coordinate under a pixel coordinate system for a monitoring main body based on the structural analysis result, wherein the monitoring main body represents a target object identified by the computing unit from the first data; acquiring spatial inclination angle data matched with an acquisition time stamp of the first data, wherein the acquisition time stamp represents the moment of generation of the first data, and the spatial inclination angle data represents the physical inclination angle of the image acquisition component corresponding to the acquisition time stamp; Determining a coordinate correction parameter mapped from the pixel coordinate system to an absolute coordinate system based on the spatial tilt data; Converting the pixel position coordinates into absolute position coordinates in the absolute coordinate system according to the coordinate correction parameters; updating the structured analysis result based on the absolute position coordinates.
8. A video stream concurrency processing system, comprising: the video acquisition module is used for responding to the video acquisition instruction and acquiring a target video stream; the system comprises a link establishing module, a link processing module and a data processing module, wherein the link establishing module is used for establishing a data distribution link aiming at the target video stream, and the data distribution link represents a logic channel set for transmitting the same video source data to different hardware interfaces in parallel; The format determining module is used for determining a data format corresponding to the data distribution link, wherein the data format comprises a first format and a second format; The data conversion module is used for converting the target video stream into first data corresponding to the first format and second data corresponding to the second format according to the data format; And the concurrent writing module is used for writing the first data and the second data into the computing storage device and the data storage device respectively based on the data distribution link.
9. An electronic device, comprising: A processor; a memory for storing the processor-executable instructions; Wherein the processor is configured to execute the instructions to implement the video stream concurrency processing method of any one of claims 1 to 7.
10. A computer readable storage medium, characterized in that instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the video stream concurrency processing method of any one of claims 1 to 7.

Description

Video stream concurrent processing method, system, electronic equipment and storage medium Technical Field The disclosure relates to the technical field of video processing, and in particular relates to a video stream concurrent processing method, a system, electronic equipment and a storage medium. Background In maritime surveillance and offshore operations, etc., the shipboard platform typically requires video surveillance and event retention of the work area, aisle area, or critical equipment area. Due to offshore distance and offshore communication conditions limitations, links often implement remote backhaul through cellular networks or satellite links, such as LTE (Long Term Evolution ), 5G (5 th Generation, fifth Generation mobile communication) or VSAT (VERY SMALL Aperture Terminal, very small bore terminal), etc. The link is easy to fluctuate in bandwidth, time delay and stability, and the remote backhaul can have intermittent interruption or insufficient available bandwidth, so that the engineering implementation of 'backhaul while acquisition and backhaul while leaving' faces higher uncertainty. In the above application, the video source may be from a local camera acquisition link or from a pull stream input of the network camera device, such as a compressed code stream carried by RTSP (REAL TIME STREAMING Protocol). Often, the concurrent requirements of real-time preview, intelligent analysis, video retention and the like are met in engineering practice. The preview, analysis and persistence requirements are different, the analysis side often uses frame data formats that facilitate pixel level computation, such as YUV (Luminance-Chrominance) related formats, and the persistence side often uses compression Coding formats, such as h.264 (Advanced Video Coding ) or HEVC (HIGH EFFICIENCY Video Coding). The data morphology difference easily introduces additional data conversion, buffer arrangement and cross-component transfer overhead, and may cause the problem of memory copy and scheduling overhead superposition. In addition, shipboard platforms often need to keep video and log data locally for longer periods to cope with the retention requirements in offline or low-network conditions. The platform may have access to different types of storage media simultaneously to achieve both capacity and throughput, such as solid state storage media based on NVMe (Non-Volatile Memory Express, non-volatile memory host controller interface specification) and capacity storage media based on SATA (SERIAL ATA, serial advanced technology attachment interface). Under the environment of an embedded system or Android (Android Open Source Project, android open source system), factors such as mounting time sequence, path stability, access authority, security policy configuration and the like of multiple storage media can increase storage management complexity, and under the conditions of high-frequency writing and concurrent processing, phenomena such as bandwidth contention, writing jitter or resource occupation increase can also occur. Meanwhile, the attitude change of the offshore platform has typical characteristics, and the ship body roll and pitch can cause the camera view angle to change along with the platform motion. For analysis tasks that rely on image geometry and time sequence stability, the situations of inconsistent frame of reference and gravitational frame of reference, and "man-ship movement" may affect the stability of detection and recognition results, and increase the risk of false alarm or false omission. Under the condition of weak network, the acquisition of video and result by the remote end may be affected by feedback delay, packet loss and the like, so as to amplify the requirements of on-site side processing and retention strategies on system stability. Disclosure of Invention The disclosure provides a video stream concurrency processing method, a system, an electronic device and a storage medium, so as to at least solve the problem of how to write multiple paths of same video source data in parallel on a host device and adapt to different storage purposes in the related art. The technical scheme of the present disclosure is as follows: According to a first aspect of embodiments of the present disclosure, there is provided a method for processing concurrent video streams, where the host device establishes communication connection with a computing storage device and a data storage device respectively, including: Responding to a video acquisition instruction, and acquiring a target video stream; Establishing a data distribution link aiming at the target video stream, wherein the data distribution link represents a logic channel set for transmitting the same video source data to different hardware interfaces in parallel; determining a data format corresponding to the data distribution link, wherein the data format comprises a first format and a second format; according to the data format, converti