CN-116483839-B - Data processing method and device and terminal equipment

CN116483839BCN 116483839 BCN116483839 BCN 116483839BCN-116483839-B

Abstract

The embodiment of the application provides a data processing method, a data processing device and terminal equipment. The method comprises the steps of obtaining a data processing request, wherein the data processing request comprises a plurality of fields and a statistics period, the statistics period comprises a plurality of sub-periods, the plurality of sub-periods comprise a current sub-period, according to the data processing request, obtaining a first data set and a second data set in an SAP HANA database, the first data set comprises business data of each field in at least one sub-period, the second data set comprises business data of each field in a historical reference period, the first data set and the second data set are processed through a first calculation view to obtain a target data set, the target data set comprises business data of each field in a plurality of target periods, the plurality of target periods comprise the current sub-period, the statistics period and the historical reference period, and generating a target report corresponding to the target data set through a second calculation view. The efficiency of data processing is improved.

Inventors

YANG BO
QIU WEIYUAN
LIU XINCHAO
ZHANG DAPENG
Ao Yugang
JIANG ZHANGPENG
QIN YIWEN

Assignees

中国人民财产保险股份有限公司

Dates

Publication Date: 20260512
Application Date: 20230608

Claims (10)

1. A method of data processing, comprising: Acquiring a data processing request, wherein the data processing request comprises a plurality of fields and a statistical period, the statistical period comprises a plurality of sub-periods, and the plurality of sub-periods comprise the current sub-period; According to the data processing request, a first data set and a second data set are obtained from a memory computing platform SAP HANA database supporting enterprise preset deployment and cloud deployment modes, wherein the first data set comprises service data of each field in at least one subperiod, and the second data set comprises service data of each field in a historical reference period; Performing filling processing on the first data set through a first calculation view to obtain a first filling data set, performing accumulation processing on a plurality of business data in the first filling data set to obtain a first accumulation data set, and combining the first accumulation data set and the second data set to obtain a target data set, wherein the target data set comprises business data of each field in a plurality of target time periods, and the plurality of target time periods comprise the current sub-time period, the statistical time period and the historical reference time period; and generating a target report corresponding to the target data set according to a preset format by the target connection set.
2. The method of claim 1, wherein performing a padding process on the first data set to obtain a first padded data set, comprises: For any one field, determining a blank subperiod corresponding to the field in the multiple subperiods, wherein the first data set does not comprise business data of the field in the blank subperiod; and filling the first data set according to the blank subperiod corresponding to each field to obtain the first filling data set.
3. The method of claim 2, wherein padding the first data set according to the blank subinterval corresponding to each field to obtain the first padded data set, comprises: determining service data of the field in the blank subperiod as a preset value for any one field to obtain filling data corresponding to the field, wherein the filling data comprises the field, the blank subperiod and the preset value; And adding filling data corresponding to each field in the first data set to obtain the first filling data set.
4. The method of claim 1, wherein accumulating the plurality of traffic data in the first set of padding data to obtain a first set of accumulated data, comprising: For any one field in the first filling data set, accumulating the business data of the field in each sub-period to obtain a plurality of first accumulated data corresponding to the field; And generating the first accumulated data set according to a plurality of first accumulated data corresponding to each field.
5. The method of claim 4, wherein generating the first accumulated data set from the first accumulated data for each field comprises: For any one field, accumulating the plurality of first accumulated data to obtain second accumulated data; And generating the first accumulation data set according to the second accumulation data corresponding to each field and the first accumulation data corresponding to the current sub-period.
6. The method according to any one of claims 1-5, further comprising: acquiring a data query request, wherein the data query request comprises a target field and a target period; determining at least one target data corresponding to the data query request in the target report; and generating a query result according to the at least one target data and displaying the query result.
7. A data processing apparatus, the apparatus comprising: the first acquisition module is used for acquiring a data processing request, wherein the data processing request comprises a plurality of fields and a statistical period, the statistical period comprises a plurality of sub-periods, and the plurality of sub-periods comprise the current sub-period; The second acquisition module is used for acquiring a first data set and a second data set from a memory computing platform SAP HANA database supporting enterprise preset deployment and cloud deployment modes according to the data processing request, wherein the first data set comprises service data of each field in at least one subperiod, and the second data set comprises service data of each field in a historical reference period; The processing module is used for carrying out filling processing on the first data set through a first calculation view to obtain a first filling data set, carrying out accumulation processing on a plurality of business data in the first filling data set to obtain a first accumulation data set, carrying out combination processing on the first accumulation data set and the second data set to obtain a target data set, wherein the target data set comprises business data of each field in a plurality of target time periods, and the plurality of target time periods comprise the current sub-time period, the statistical time period and the historical reference time period; the generation module is used for carrying out database connection operation on the target data set through the second calculation formula graph to obtain a target connection set, and generating a target report corresponding to the target data set according to a preset format by the target connection set.
8. A terminal device, comprising: at least one processor, and A memory communicatively coupled to the at least one processor, wherein, The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 6.
9. A non-transitory computer readable storage medium storing computer instructions, wherein the computer instructions are for causing a computer to perform the method of any one of claims 1 to 6.
10. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the method of any of claims 1 to 6.

Description

Data processing method and device and terminal equipment Technical Field The embodiment of the application relates to the technical field of big data, in particular to a data processing method, a device and terminal equipment. Background The enterprise can classify and process the data generated in the business transaction process to obtain the business report corresponding to the business transaction. In the related art, service data can be processed and a report can be generated by processing a plurality of service data according to a preset time period in a memory computing platform (System Applications and Products High-Performance ANALYTIC APPLIANCE, SAP HANA) database supporting enterprise preset deployment and cloud deployment modes by utilizing a standard algorithm set in advance in the SAP HANA database, so as to generate the service report. The business report may include a plurality of business data over a current period of time and a historical period of time. In the process, when the report is generated, the plurality of business data in the current period and the historical period are required to be obtained through real-time calculation by the enhanced variable program in the application layer of the SAP HANA database, so that the data processing efficiency is low. Disclosure of Invention The embodiment of the application provides a data processing method, a data processing device and terminal equipment, which are used for solving the problem of low data processing efficiency. In a first aspect, an embodiment of the present application provides a data processing method, including: Acquiring a data processing request, wherein the data processing request comprises a plurality of fields and a statistical period, the statistical period comprises a plurality of sub-periods, and the plurality of sub-periods comprise the current sub-period; According to the data processing request, a first data set and a second data set are obtained from a memory computing platform SAP HANA database supporting enterprise preset deployment and cloud deployment modes, wherein the first data set comprises service data of each field in at least one subperiod, and the second data set comprises service data of each field in a historical reference period; Processing the first data set and the second data set through a first calculation view to obtain a target data set, wherein the target data set comprises business data of each field in a plurality of target time periods, and the plurality of target time periods comprise the current sub-time period, the statistical time period and the historical reference time period; And generating a target report corresponding to the target data set through the second calculation view. In a possible implementation manner, processing the first data set and the second data set to obtain a target data set includes: filling the first data set to obtain a first filled data set; accumulating the plurality of business data in the first filling data set to obtain a first accumulated data set; And merging the first accumulated data set and the second data set to obtain the target data set. In one possible implementation manner, the filling processing is performed on the first data set to obtain a first filled data set, which includes: For any one field, determining a blank subperiod corresponding to the field in the multiple subperiods, wherein the first data set does not comprise business data of the field in the blank subperiod; and filling the first data set according to the blank subperiod corresponding to each field to obtain the first filling data set. In a possible implementation manner, the filling processing is performed on the first data set according to the blank subperiod corresponding to each field to obtain the first filled data set, which includes: determining service data of the field in the blank subperiod as a preset value for any one field to obtain filling data corresponding to the field, wherein the filling data comprises the field, the blank subperiod and the preset value; And adding filling data corresponding to each field in the first data set to obtain the first filling data set. In one possible implementation manner, the accumulating processing is performed on the plurality of service data in the first filling data set to obtain a first accumulated data set, which includes: For any one field in the first filling data set, accumulating the business data of the field in each sub-period to obtain a plurality of first accumulated data corresponding to the field; And generating the first accumulated data set according to a plurality of first accumulated data corresponding to each field. In one possible implementation manner, generating the first accumulated data set according to the first accumulated data corresponding to each field includes: For any one field, accumulating the plurality of first accumulated data to obtain second accumulated data; And generating the first acc