CN-118196928-B - Intelligent driving automobile desensitization video data bypass acquisition system and method based on PCIE

CN118196928BCN 118196928 BCN118196928 BCN 118196928BCN-118196928-B

Abstract

The invention relates to the technical field of intelligent driving automobiles and discloses an intelligent driving automobile desensitization video data bypass acquisition system based on PCIE, wherein original camera data output by a vehicle-mounted camera are respectively transmitted to an acquisition system and an automobile-mounted ECU (electronic control unit) through two independent transmission paths, a lower computer subsystem of the acquisition system comprises a data acquisition host, a PCIE video acquisition card and a network attached storage device, wherein the PCIE video acquisition card and the network attached storage device are connected with the data acquisition host, a video desensitization algorithm module, a video coding processing module and a system state module are arranged in the data acquisition host, an upper computer subsystem of the acquisition system comprises a data communication module and an event triggering module, synchronous acquisition, desensitization, coding and packaging of vehicle-mounted camera data are carried out through interaction of the upper computer subsystem and the lower computer subsystem, NAS storage and uploading are carried out simultaneously, real-time updating and sharing of data are realized, the performance and safety of the intelligent driving automobile are improved, privacy of a main road user and other road users of the intelligent driving automobile is effectively protected, and high-quality data is provided for supporting autonomous navigation and decision of the intelligent driving automobile.

Inventors

ZHANG QIANG
TAN WENKE
PAN DENG
YU DAXIA
LI YI
GONG AN
LI LIKAI
CHEN YUANYUAN
XIA SHENG
YANG MAOXING

Assignees

中国汽车工程研究院股份有限公司
中汽院智能网联科技有限公司

Dates

Publication Date: 20260508
Application Date: 20240315

Claims (10)

1. The intelligent driving automobile desensitization video data bypass acquisition system based on PCIE is characterized by acting on an intelligent driving automobile with a vehicle-mounted camera and a vehicle-mounted ECU, wherein the input ends of the acquisition system and the vehicle-mounted ECU are respectively connected with the output ends of the vehicle-mounted camera so that original camera data output by the vehicle-mounted camera are respectively transmitted to the acquisition system and the vehicle-mounted ECU through two independent transmission paths; The lower computer subsystem comprises a data acquisition host, a PCIE video acquisition card and a network attached storage device, wherein the PCIE video acquisition card and the network attached storage device are connected with the data acquisition host, a video desensitization algorithm module, a video coding processing module and a system state module are arranged in the data acquisition host, the PCIE video acquisition card is used for receiving and processing original camera data to form YUV data, the video desensitization algorithm module is used for receiving the YUV data and carrying out desensitization processing to form desensitized data, the video coding processing module is used for receiving the desensitized data and synchronously carrying out first coding encapsulation and second coding, wherein the first data is formed through the first coding encapsulation and is sent to the network attached storage device, the second data is formed through the second coding and is sent to the upper computer subsystem, and the system state module is used for acquiring the system state data and sending the system state data to the upper computer subsystem and the network attached storage device; The upper computer subsystem comprises a data communication module and an event triggering module, wherein the data communication module is used for receiving and processing second data and system state data sent by the lower computer subsystem, and the event triggering module is used for carrying out event annotation according to the second data and the system state data to form annotation information and transmitting the annotation information to the network attached storage equipment; The network attached storage device is used for receiving and storing the first data, the system state data and the labeling information which are associated with the time stamp, and uploading the first data, the system state data and the labeling information to the server in real time.
2. The intelligent driving automobile desensitization video data bypass acquisition system based on PCIE according to claim 1, wherein the upper computer subsystem further comprises a configuration module and a first instruction processing module, wherein the configuration module is used for parameter setting of instruction interaction of the upper computer subsystem and the lower computer subsystem, and the first instruction processing module is used for issuing instructions to control the action of the lower computer subsystem; The data acquisition host is also internally provided with a second instruction processing module, and the second instruction processing module is used for receiving the instruction issued by the first instruction processing module and calling equipment connected with a corresponding interface of the data acquisition host according to the instruction to act.
3. The intelligent driving automobile desensitization video data bypass acquisition system based on PCIE according to claim 1, wherein the upper computer subsystem further comprises an online state monitoring module, and the online state monitoring module is used for receiving and carrying out the second data and the system state data transmitted by the real-time preview display data communication module.
4. The PCIE-based intelligent-driven automobile desensitization video data bypass acquisition system according to claim 1, wherein the system status data includes on-vehicle camera on-off status information, lower computer subsystem network status information, device on-line information, disk remaining capacity, and CPU utilization.
5. The PCIE-based intelligent-driven automobile desensitization video data bypass acquisition system according to claim 1, wherein the events include vehicle-mounted camera running conditions, driving road conditions and weather conditions.
6. The intelligent driving automobile desensitization video data bypass acquisition system based on PCIE according to claim 1, wherein the lower computer subsystem further comprises a PTP switch, and the PTP switch is connected between the data acquisition host and the PCIE video acquisition card and used for timing the data acquisition host for the PCIE video acquisition card.
7. The PCIE-based intelligent driving car desensitization video data bypass acquisition system according to claim 1, wherein said lower computer subsystem further comprises a power supply voltage stabilizing module connected with a data acquisition host.
8. The intelligent driving automobile desensitization video data bypass acquisition method based on PCIE is characterized by acting on an intelligent driving automobile with a vehicle-mounted camera and a vehicle-mounted ECU, and comprises the following steps of: s1, original camera data output by a vehicle-mounted camera are respectively transmitted to a PCIE video acquisition card and a vehicle-mounted ECU through two independent transmission paths; S2, the PCIE video acquisition card receives the original camera data and deserializes the original camera data to form YUV data, and the YUV data is transmitted to the data acquisition host; S3, the data acquisition host receives YUV data and desensitizes the YUV data to form desensitized data; S4, synchronously carrying out first coding encapsulation and second coding on the desensitized data by the data acquisition host, wherein the first data is formed through the first coding encapsulation and sent to the network auxiliary storage equipment, and the second data is formed through the second coding and sent to the upper computer subsystem; s5, the upper computer subsystem receives the second data and the system state data, performs real-time preview display and event triggering annotation, and sends annotation information formed by the event triggering annotation to the data acquisition host; and S6, the first data, the system state data and the labeling information are synchronously stored into the network auxiliary storage device through the data acquisition host, and are uploaded to the server in real time through the network auxiliary storage device.
9. The PCIE-based intelligent driving car desensitization video data bypass acquisition method according to claim 8, wherein the first code in S4 is H264/H265 code and the second code is JPEG code.
10. The PCIE-based intelligent driving automobile desensitization video data bypass acquisition method according to claim 8, wherein the event triggering labeling method in S5 is characterized in that analysis and judgment of at least the running condition of an on-vehicle camera, the running road condition and/or the weather condition are carried out on the second data and the system state data which are displayed in a real-time preview mode, the second data and the system state data which meet the labeling condition are labeled, labeling information and labeling instructions are formed and sent to a data acquisition host, and the data acquisition host correlates the labeling information with corresponding first data and system state data by a timestamp according to the labeling instructions.

Description

Intelligent driving automobile desensitization video data bypass acquisition system and method based on PCIE Technical Field The invention relates to the technical field of intelligent driving automobiles, in particular to a PCIE-based intelligent driving automobile desensitization video data bypass acquisition system and method. Background Along with the development of intelligent driving technology, vehicle-mounted camera data are used as data sources for intelligent driving algorithm training, and various car manufacturers can acquire a large amount of vehicle-mounted camera data in the product development stage. In one aspect, such data may be used to improve the design and performance of the automobile to enhance the driving experience and safety. On the other hand, this data can also be used to study and develop intelligent driving techniques to achieve a more autonomous and intelligent vehicle. Meanwhile, in order to meet legal supervision requirements, the acquired vehicle-mounted camera data must be subjected to desensitization processing. The data desensitization refers to the deformation of data of certain sensitive information through a desensitization rule, so that the reliable protection of sensitive privacy data, such as license plates, face information and the like, is realized. The prior art is generally desensitized when in vehicle-mounted data transmission or directly desensitized when in acquisition, and due to shortage of vehicle-end hardware resources and limited calculation power, the problems of high data processing hardware requirements, waste of processing capacity, transmission delay and the like can occur in two modes. Disclosure of Invention The invention aims to provide an intelligent driving automobile desensitization video data bypass acquisition system based on PCIE, which is used for solving the technical problem of low data desensitization efficiency caused by high hardware and calculation force requirements of the existing vehicle-mounted data desensitization technology. The intelligent driving automobile desensitization video data bypass acquisition system based on PCIE is used for an intelligent driving automobile with a vehicle-mounted camera and a vehicle-mounted ECU, and is characterized in that the input ends of the acquisition system and the vehicle-mounted ECU are respectively connected with the output end of the vehicle-mounted camera, so that original camera data output by the vehicle-mounted camera are respectively transmitted to the acquisition system and the vehicle-mounted ECU through two independent transmission paths; The lower computer subsystem comprises a data acquisition host, a PCIE video acquisition card and a network attached storage device, wherein the PCIE video acquisition card and the network attached storage device are connected with the data acquisition host, a video desensitization algorithm module, a video coding processing module and a system state module are arranged in the data acquisition host, the PCIE video acquisition card is used for receiving and processing original camera data to form YUV data, the video desensitization algorithm module is used for receiving the YUV data and carrying out desensitization processing to form desensitized data, the video coding processing module is used for receiving the desensitized data and synchronously carrying out first coding encapsulation and second coding, wherein the first data is formed through the first coding encapsulation and is sent to the network attached storage device, the second data is formed through the second coding and is sent to the upper computer subsystem, and the system state module is used for acquiring the system state data and sending the system state data to the upper computer subsystem and the network attached storage device; The upper computer subsystem comprises a data communication module and an event triggering module, wherein the data communication module is used for receiving and processing second data and system state data sent by the lower computer subsystem, and the event triggering module is used for carrying out event annotation according to the second data and the system state data to form annotation information and transmitting the annotation information to the network attached storage equipment; The network attached storage device is used for receiving and storing the first data, the system state data and the labeling information which are associated with the time stamp, and uploading the first data, the system state data and the labeling information to the server in real time. The intelligent driving system based on the intelligent network has the advantages that the synchronous acquisition, desensitization, encoding and packaging of the vehicle-mounted camera data are carried out through interaction of the upper computer subsystem and the lower computer subsystem, and meanwhile NAS (network attached storage) storage and uploading servers are carried out, s