Search

CN-116257317-B - Data processing method, system, device, equipment and storage medium

CN116257317BCN 116257317 BCN116257317 BCN 116257317BCN-116257317-B

Abstract

The disclosure provides a data processing method, a system, a device, equipment and a storage medium, relates to the technical field of data processing, and particularly relates to the technical field of automatic driving. The method comprises the steps of receiving a data acquisition request for target service sent by a client, responding to the received data acquisition request, obtaining a target data matching model set for the target service, carrying out data screening processing on takeover type data with labels based on screening items of the target data matching model, wherein contents represented by the labels belong to candidate contents of the screening items, and feeding back processing results of the data screening processing to the client. Therefore, through the scheme, the data acquisition efficiency can be improved.

Inventors

  • WU HANG
  • LI FAN

Assignees

  • 北京百度网讯科技有限公司

Dates

Publication Date
20260505
Application Date
20230307

Claims (12)

  1. 1. A data processing method applied to a server, the method comprising: receiving a data acquisition request for a target service sent by a client, wherein the target service is a service for performing data processing by using takeover type data; The method comprises the steps of receiving a data acquisition request, obtaining a target data matching model which is obtained by setting the target service, wherein the target data matching model is a model obtained by carrying out content configuration processing on a screening item of an initial data matching model; Performing data screening processing on takeover class data with labels based on screening items of the target data matching model, wherein contents represented by the labels belong to candidate contents of the screening items; Feeding back a processing result of the data screening processing to the client; The data screening process is performed on the takeover class data with the tag based on the screening item of the target data matching model, and the data screening process comprises the following steps: Selecting a screening item which is not utilized and has the highest priority from a plurality of screening items, and taking the screening item as a screening item to be utilized; and selecting the filter item which is not utilized and has the highest priority from a plurality of filter items to be used as the step of the filter item to be utilized, wherein the filter item is selected from the non-filtered filter item and the filter item with the highest priority.
  2. 2. The method of claim 1, wherein the content characterized by the tag of the takeover class data includes a data takeover reason for the takeover class data.
  3. 3. The method of claim 1, wherein the obtaining the target data matching model for the target business setting comprises: Obtaining a target data matching model which is obtained by setting the target service in the client; the setting mode of the target data matching model in the client comprises the following steps: Outputting a target configuration interface in the client, wherein the target configuration interface is an interface for carrying out content configuration on a screening item of an initial data matching model; and obtaining contents obtained by carrying out content configuration processing on the screening items based on the target configuration interface, and obtaining a target data matching model.
  4. 4. The method of claim 1, wherein the acquiring manner of the takeover class data with the tag comprises: acquiring initial takeover class data obtained from a designated data source; and performing label labeling processing on the initial takeover class data based on the semantic features of the initial takeover class data to obtain the takeover class data with labels.
  5. 5. A data processing system comprises a client and a server; The method comprises the steps of receiving a data acquisition request for a target service sent by a client, responding to the received data acquisition request, obtaining a target data matching model set for the target service, carrying out data screening processing on takeover class data with labels based on screening items of the target data matching model, feeding back processing results of the data screening processing to the client, wherein the target service is a service for carrying out data processing by utilizing the takeover class data, contents represented by the labels belong to candidate contents of the screening items, the target data matching model is a model obtained after carrying out content configuration processing on the screening items of an initial data matching model, and the content configuration processing comprises configuration of the candidate contents and configuration of priority; the client is used for receiving the processing result fed back by the server; The data screening process is performed on the takeover class data with the tag based on the screening item of the target data matching model, and the data screening process comprises the following steps: Selecting a screening item which is not utilized and has the highest priority from a plurality of screening items, and taking the screening item as a screening item to be utilized; and selecting the filter item which is not utilized and has the highest priority from a plurality of filter items to be used as the step of the filter item to be utilized, wherein the filter item is selected from the non-filtered filter item and the filter item with the highest priority.
  6. 6. A data processing apparatus for use at a server, the apparatus comprising: the system comprises a receiving module, a receiving module and a sending module, wherein the receiving module is used for receiving a data acquisition request aiming at a target service sent by a client, wherein the target service is a service for carrying out data processing by using takeover type data; the acquisition module is used for responding to the received data acquisition request and acquiring a target data matching model which is obtained by setting the target service, wherein the target data matching model is a model obtained by carrying out content configuration processing on a screening item of an initial data matching model; The screening module is used for carrying out data screening processing on the takeover class data with the tag based on the screening item of the target data matching model, wherein the content represented by the tag belongs to candidate content of the screening item; the feedback module is used for feeding back the processing result of the data screening processing to the client; Wherein, the screening module is specifically used for: Selecting a screening item which is not utilized and has the highest priority from a plurality of screening items, and taking the screening item as a screening item to be utilized; and selecting the filter item which is not utilized and has the highest priority from a plurality of filter items to be used as the step of the filter item to be utilized, wherein the filter item is selected from the non-filtered filter item and the filter item with the highest priority.
  7. 7. The apparatus of claim 6, wherein the content characterized by the tag of the takeover class data includes a data takeover reason for the takeover class data.
  8. 8. The apparatus of claim 6, wherein the obtaining the target data matching model for the target business setting comprises: Obtaining a target data matching model which is obtained by setting the target service in the client; the setting mode of the target data matching model in the client comprises the following steps: Outputting a target configuration interface in the client, wherein the target configuration interface is an interface for carrying out content configuration on a screening item of an initial data matching model; and obtaining contents obtained by carrying out content configuration processing on the screening items based on the target configuration interface, and obtaining a target data matching model.
  9. 9. The apparatus of claim 6, wherein the means for obtaining the tagged takeover class data comprises: acquiring initial takeover class data obtained from a designated data source; and performing label labeling processing on the initial takeover class data based on the semantic features of the initial takeover class data to obtain the takeover class data with labels.
  10. 10. An electronic device, comprising: at least one processor, and A memory communicatively coupled to the at least one processor, wherein, The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.
  11. 11. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-4.
  12. 12. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-4.

Description

Data processing method, system, device, equipment and storage medium Technical Field The disclosure relates to the technical field of data processing, in particular to the technical field of automatic driving, and specifically relates to a data processing method, a system, a device, equipment and a storage medium. Background In the field of autopilot, takeover class data is extremely important for iteration of a simulation test algorithm as more valuable class scene data in a drive test scene. The takeover class data may include vehicle state data, road structure data, obstacle data, etc. collected during the vehicle drive test, and is typically formed due to some data takeover reasons. In the related art, for simulation tests of different algorithm directions, users are required to manually scoop out takeover class data required for the simulation tests of the algorithm directions from massive takeover class data. Disclosure of Invention The present disclosure provides a data processing method, system, apparatus, device, and storage medium. According to an aspect of the present disclosure, there is provided a data processing method, applied to a server, the method including: receiving a data acquisition request for a target service sent by a client, wherein the target service is a service for performing data processing by using takeover type data; responding to the received data acquisition request, and obtaining a target data matching model obtained by setting the target service; Performing data screening processing on takeover class data with labels based on screening items of the target data matching model, wherein contents represented by the labels belong to candidate contents of the screening items; And feeding back a processing result of the data screening processing to the client. According to another aspect of the present disclosure, there is provided a data processing system, including a client and a server; The server is used for receiving a data acquisition request for a target service sent by a client, responding to the received data acquisition request, obtaining a target data matching model set for the target service, carrying out data screening processing on takeover type data with labels based on a screening item of the target data matching model, and feeding back a processing result of the data screening processing to the client, wherein the target service is a service for carrying out data processing by utilizing the takeover type data, and contents represented by the labels belong to candidate contents of the screening item; The client is used for receiving the processing result fed back by the server. According to another aspect of the present disclosure, there is provided a data processing apparatus applied to a server, the apparatus including: the system comprises a receiving module, a receiving module and a sending module, wherein the receiving module is used for receiving a data acquisition request aiming at a target service sent by a client, wherein the target service is a service for carrying out data processing by using takeover type data; The acquisition module is used for responding to the received data acquisition request and acquiring a target data matching model which is set for the target service; The screening module is used for carrying out data screening processing on the takeover class data with the tag based on the screening item of the target data matching model, wherein the content represented by the tag belongs to candidate content of the screening item; and the feedback module is used for feeding back the processing result of the data screening processing to the client. According to another aspect of the present disclosure, there is provided an electronic device comprising at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any one of the data processing methods described above. According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the data processing method according to any one of the above. According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements a data processing method according to any of the above. It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification. Drawings The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosur