CN-115330122-B - Operation data processing method, device, computer equipment and storage medium

CN115330122BCN 115330122 BCN115330122 BCN 115330122BCN-115330122-B

Abstract

The disclosure relates to the technical field of data processing, and particularly discloses an operation data processing method, an operation data processing device, computer equipment, a storage medium and a computer program product. The method comprises the steps of obtaining a timing task for processing operation data, obtaining the timing task matched with the current moment according to the task starting moment as a task to be executed, and executing each subtask of the task to be executed according to the task type of at least one subtask of the task to be executed so as to obtain target data after task execution. The timing task can realize the marking and the statistics of the operation data, so that an object marking code does not need to be added to a conversion key point, and the marking code and the statistics code are decoupled, thereby accelerating the response speed. The timing task can flexibly configure the task execution time, so that the task execution time can be configured to be executed at idle time, the risk of task execution failure can be avoided, the response speed can be further improved, and the data processing efficiency is improved.

Inventors

GU CHENGZHI
LIU WANZHEN
JIANG KUIDONG
XIAO MIN
HE KAIFENG

Assignees

中国建设银行股份有限公司
建信金融科技有限责任公司

Dates

Publication Date: 20260505
Application Date: 20220711

Claims (10)

1. An operation data processing method, applied to an operation server, comprising: acquiring task configuration information, wherein the task configuration information comprises task starting time obtained by timing task configuration through the operation server, and execution sequence and processing logic of at least one subtask; When the processing logic is a marking rule for marking the operation data, generating a task type corresponding to the subtask as a marking task type; or when the processing logic is a statistical rule for carrying out statistical processing on the operation data, generating a task type corresponding to the subtask as a statistical task type; the method comprises the steps of generating a timing task according to task starting time, execution sequence of at least one subtask, task type and processing logic, wherein operation data comprise data generated in the interaction process of a plurality of channel servers and the operation server, the timing task comprises task starting time, at least one subtask and task type of the at least one subtask, all subtasks in the at least one subtask are of mark task types, or all subtasks in the at least one subtask are of statistic task types, or molecular tasks in the middle of the at least one subtask are of mark task types, and the other part of subtasks are of statistic task types; The method comprises the steps of obtaining a timing task matched with a current moment according to the task starting moment to serve as a task to be executed, determining that the timing task is a first task to be executed when the first starting moment arrives and executing all sub-tasks of the first task to be executed by a first thread according to the task type of at least one sub-task of the first task to be executed, determining that the timing task is a second task to be executed when the second starting moment arrives and the first task to be executed is not executed, and executing all sub-tasks of the second task to be executed by a second thread according to the task type of at least one sub-task of the second task to be executed when the second starting moment arrives; executing each subtask of the task to be executed according to the task type of at least one subtask of the task to be executed, so as to perform marking processing on the operation data according to the marking rule or perform statistical processing on the operation data according to the statistical rule, and obtaining target data after task execution.
2. The method of claim 1, wherein the timing task further includes an execution order of at least one subtask, and wherein executing each subtask of the task to be executed according to a task type of the at least one subtask of the task to be executed, to perform a marking process on the operation data according to the marking rule or perform a statistical process on the operation data according to the statistical rule, to obtain target data after task execution, includes: sequencing the at least one subtask according to the execution sequence of the at least one subtask to obtain a sequenced task queue; And sequentially executing corresponding subtasks on the operation data according to the task type of at least one subtask in the task queue so as to perform marking processing or statistical processing on the operation data until the last subtask in the task queue is executed, and obtaining target data after task execution.
3. The method according to claim 1, wherein after the timing task matching the current time is acquired as the task to be executed according to the task start time, the method further comprises: And when a plurality of tasks to be executed exist, asynchronously executing the plurality of tasks to be executed based on a plurality of threads.
4. The method of claim 1, wherein executing each sub-task of the task to be executed according to a task type of at least one sub-task of the task to be executed comprises: when the task type of the subtask is a marking task type, marking the operation data according to a corresponding marking rule to obtain marked operation data; and when the task type of the subtask is the statistical task type, extracting corresponding data from the operation data according to the corresponding statistical rule and performing data cleaning to obtain the corresponding statistical data.
5. The method of claim 4, wherein the extracting the corresponding data from the operation data according to the corresponding statistical rule and performing data cleaning to obtain the corresponding statistical data comprises: And extracting data corresponding to the statistical dimension from the operation data according to the at least one statistical dimension, and cleaning the data to obtain the statistical data of the at least one statistical dimension.
6. The method of claim 5, wherein after obtaining the statistical data for the at least one statistical dimension, the method further comprises: and generating a visual chart according to the statistical data of the at least one statistical dimension and displaying the visual chart.
7. An operation data processing apparatus, characterized by being applied to an operation server, the apparatus comprising: The system comprises a timing task acquisition module, a processing logic, a statistics task type generation module and a statistics task type generation module, wherein the timing task acquisition module is used for acquiring task configuration information, the task configuration information comprises task starting time obtained by timing task configuration through the operation server and task types of at least one subtask, the task types of the corresponding subtasks are marking task types when the processing logic is marking rules for marking operation data, the task types of the corresponding subtasks are statistics task types when the processing logic is statistics rules for carrying out statistics processing on the operation data, the timing task is generated according to the task starting time, the execution sequence of at least one subtask, the task types and the processing logic, the operation data comprises data generated in the interaction process of a plurality of channel servers and the operation server, the timing task comprises task starting time, at least one subtask and the task types of at least one subtask, all the subtasks in the at least one timing task are marking task types, all the subtasks in the at least one subtask are statistics task types, or all the subtasks in the at least one subtask middle subtasks are statistics task types, the other subtasks are statistics task types, the statistics task types are the other channel types are marking channel types, the statistics task types are the statistics task types, the user access to the user access rule comprises the user access rule through the statistics rule, the statistics rule is carried out the statistics rule through the operation server and the statistics rule is carried out the statistics rule, the statistics rule is carried out the user access rule through the operation channel access rule, and the statistics rule is carried out the statistics rule comprises the user access rule, and, a spatial dimension for statistics of the specified one or more channel servers; The system comprises a task starting time acquisition module, a task to be executed determining module and a task processing module, wherein the task starting time acquisition module is used for acquiring a timing task matched with a current time as a task to be executed according to the task starting time, the task starting time at least comprises a first starting time and a second starting time of the timing task, the second starting time is later than the first starting time, when the first starting time arrives, the timing task is determined to be a first task to be executed, each subtask of the first task to be executed is executed on the operation data by adopting a first thread according to a task type of at least one subtask of the first task to be executed, when the second starting time arrives, and the first task to be executed is not executed, the timing task is determined to be a second task to be executed, and each subtask of the second task to be executed is executed on the operation data by adopting a second thread according to a task type of at least one subtask of the second task to be executed; and the task execution module is used for executing each subtask of the task to be executed according to the task type of at least one subtask of the task to be executed so as to carry out marking processing on the operation data according to the marking rule or carrying out statistical processing on the operation data according to the statistical rule to obtain target data after task execution.
8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.

Description

Operation data processing method, device, computer equipment and storage medium Technical Field The present application relates to the field of data processing technology, and in particular, to an operation data processing method, apparatus, computer device, storage medium, and computer program product. Background With the development of internet technology, operation data is widely used. Generally, the processing of operation data includes summary processing of data and processing of log-type data. For example, the collection process is to obtain statistical data such as the number of enterprise units, the number of physical canteen, the number of clients, etc. by statistics. The log data is processed by recording user behavior, user state and the like through the embedded point interface. In the conventional technology, an owner of data can issue or use important information hidden in massive data in a compliance form through analysis mining of operation data. At present, in a common operation data processing method, an object marking code is added to a product, service and other transformation key points, marking rules are formulated according to service requirements, objects conforming to the marking rules are marked, and real-time data statistics and summarization processing is performed when data is queried in the background. However, if the marking rule is complex and the object data stored in the database is more, the complexity of the service interface, the execution time and the maintenance cost of the service interface are increased, so that the processing efficiency of the operation data is lower. Disclosure of Invention In view of the foregoing, it is desirable to provide an operation data processing method, apparatus, computer device, computer readable storage medium, and computer program product that can improve the operation data processing efficiency, in order to solve the above-described technical problem of low operation data processing efficiency. In a first aspect, the present application provides an operation data processing method. The method comprises the following steps: Acquiring a timing task for processing operation data, wherein the timing task comprises a task starting time, at least one subtask and a task type of the at least one subtask, and the task type comprises a marking task type for marking the operation data or a statistical task type for counting the operation data; acquiring a timing task matched with the current moment according to the task starting moment as a task to be executed; and executing each subtask of the task to be executed according to the task type of at least one subtask of the task to be executed so as to perform marking processing or statistical processing on the operation data to obtain target data after the task is executed. In one embodiment, the timing task further comprises an execution sequence of at least one subtask, each subtask of the task to be executed is executed according to a task type of the at least one subtask of the task to be executed so as to perform marking processing or statistics processing on the operation data to obtain target data after task execution, the method comprises the steps of sequencing the at least one subtask according to the execution sequence of the at least one subtask to obtain a sequenced task queue, and sequentially executing corresponding subtasks on the operation data according to the task type of the at least one subtask in the task queue so as to perform marking processing or statistics processing on the operation data until the last subtask in the task queue is executed to obtain the target data after task execution. In one embodiment, the task starting time at least comprises a first starting time and a second starting time of the timing task, wherein the second starting time is later than the first starting time, the method further comprises the steps of determining that the timing task is a first task to be executed when the first starting time arrives, executing all sub-tasks of the first task to be executed on the operation data by adopting a first thread according to the task type of at least one sub-task of the first task to be executed, determining that the timing task is a second task to be executed when the second starting time arrives and the first task to be executed is not completed, and executing all sub-tasks of the second task to be executed on the operation data by adopting a second thread according to the task type of at least one sub-task of the second task to be executed. In one embodiment, after the timing task matched with the current moment is obtained according to the task starting moment to serve as a task to be executed, the method further comprises the step of asynchronously executing a plurality of tasks to be executed based on a plurality of threads when the tasks to be executed are multiple. In one embodiment, before the timing task for processing the operation data is ac