CN-116483954-B - Data processing method, device, equipment and storage medium

CN116483954BCN 116483954 BCN116483954 BCN 116483954BCN-116483954-B

Abstract

The present disclosure provides a data processing method, apparatus, device, and storage medium, which can be applied to the field of big data and the field of data retrieval. The method comprises the steps of determining a request type of initial request data, extracting search data in the initial request data when the request type is a search request type, determining a target search container from a plurality of search containers according to index update attribute information of the target index data corresponding to the search data and container update time attributes of the plurality of search containers, wherein the target search container is suitable for executing a search task according to the search data, and processing the search data based on the target search container to obtain a target search result corresponding to the initial request data.

Inventors

WU YUGUANG
LI YANGYING
ZHANG RONGCHEN
CHEN ZHIYU
YIN CHUANWEI
QIN WENJING
ZHANG YUAN
FANG CHI
SHAO LIJIE
XU ZHIXUAN

Assignees

中国建设银行股份有限公司
建信金融科技有限责任公司

Dates

Publication Date: 20260505
Application Date: 20230508

Claims (10)

1. A data processing method, comprising: Determining a request type of initial request data; extracting retrieval data in the initial request data under the condition that the request type is a retrieval request type; Determining a target search container from a plurality of search containers according to index update attribute information of the target index data corresponding to the search data and container update time attributes of each of the plurality of search containers, wherein the target search container is suitable for executing a search task according to the search data, and Processing the search data based on the target search container to obtain a target search result corresponding to the initial request data, wherein a plurality of search containers comprise a source search container and at least one mirror image search container, the target search container is determined from at least one mirror image search container, the index update attribute information comprises index update frequency, the container update time attribute comprises container generation time for generating the mirror image search container, and the mirror image search container comprises a plurality of mirror image search containers; Wherein the determining the target search container from the plurality of search containers according to the index update attribute information of the target index data corresponding to the search data and the container update time attribute of each of the plurality of search containers includes: Comparing the index updating frequency of the target index data with a preset updating frequency threshold value to obtain a first comparison result, wherein the first comparison result represents the updating frequency grade of the target index data; determining a target container generation time from among the mirror container generation times of the respective mirror search containers based on the first comparison result, and And determining the target retrieval container from a plurality of mirror retrieval containers according to the generation time of the target container.
2. The method of claim 1, wherein the data processing method further comprises: extracting updated index data in the initial request data under the condition that the request type is an index update request type; updating the source search container according to the update index data to obtain an updated target source search container, and And carrying out mirror image processing on the target source retrieval container to generate a new mirror image retrieval container.
3. The method of claim 2, wherein the index update attribute information includes an index update time, the container update time attribute includes a container generation time at which the mirror retrieval container is generated; Wherein the determining the target search container from the plurality of search containers according to the index update attribute information of the target index data corresponding to the search data and the container update time attribute of each of the plurality of search containers includes: When a plurality of index update times are associated with the target index data, determining a target index update time closest to a current time from the plurality of index update times; determining a target container generation time from among the mirror container generation times of the respective mirror search containers based on the target index update time, and And determining the target retrieval container from a plurality of mirror retrieval containers according to the generation time of the target container.
4. The method of claim 3, wherein said determining a target container generation time from among the mirror container generation times of each of the plurality of mirror search containers based on the target index update time comprises: Determining a mirror image container generation time later than the target index update time among the plurality of mirror image container generation times as a candidate container generation time, and And when the candidate container generation time includes a plurality of candidate container generation time, determining candidate container generation time with the time length between the candidate container generation time and the target index updating time being smaller than a preset time length threshold value as the target container generation time.
5. The method of claim 1, further comprising: Determining the duration to be updated of each of the plurality of search containers according to the container update time attribute of each of the plurality of search containers; determining a search container to be deleted from a plurality of search containers according to the respective duration to be updated of the plurality of search containers, and And deleting the search container to be deleted.
6. The method of claim 1, wherein the determining a request type for initial request data comprises: And analyzing the initial request header data of the initial request data to obtain the request type.
7. A data processing apparatus comprising: the first determining module is used for determining the request type of the initial request data; The extraction module is used for extracting retrieval data in the initial request data under the condition that the request type is a retrieval request type; A second determining module for determining a target search container from a plurality of search containers according to index update attribute information of the target index data corresponding to the search data and container update time attributes of each of the plurality of search containers, wherein the target search container is suitable for executing a search task according to the search data, and A target search result obtaining module, configured to process the search data based on the target search container to obtain a target search result corresponding to the initial request data, where a plurality of the search containers include a source search container and at least one mirror search container, the target search container is determined from at least one mirror search container, the index update attribute information includes an index update frequency, the container update time attribute includes a container generation time when the mirror search container is generated, and the mirror search container includes a plurality of mirror search containers; wherein the second determining module includes: The first comparison unit is used for comparing the index updating frequency of the target index data with a preset updating frequency threshold value to obtain a first comparison result, wherein the first comparison result represents the updating frequency level of the target index data; a first target container generation time obtaining unit for determining a target container generation time from among the mirror container generation times of the respective mirror search containers based on the first comparison result, and A first target search container obtaining unit configured to determine the target search container from among the plurality of mirror image search containers according to the target container generation timing.
8. An electronic device, comprising: One or more processors; storage means for storing one or more programs, Wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-6.
9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method according to any of claims 1-6.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-6.

Description

Data processing method, device, equipment and storage medium Technical Field The present disclosure relates to the field of big data and the field of data retrieval, and in particular, to a data processing method, apparatus, device, medium and program product. Background With the rapid development of technology, related enterprises increasingly rely on data retrieval service resources to realize data retrieval. The related data retrieval service resource may return a retrieval result related to the retrieval key to the client based on the retrieval key. For example, the search can be performed based on the search keywords, and documents, reports and other files containing the search keywords can be returned, so that the user can be helped to quickly inquire the required data information. The inventor finds that the corresponding searching efficiency of the related searching service resources is low, and the problems that the searching result is wrong and the like possibly exist, so that the actual requirement of the user is difficult to meet. Disclosure of Invention In view of the foregoing, the present disclosure provides data processing methods, apparatus, devices, media, and program products. According to a first aspect of the present disclosure, there is provided a data processing method comprising: Determining a request type of initial request data; Extracting retrieval data in the initial request data under the condition that the request type is the retrieval request type; Determining a target search container from a plurality of search containers based on index update attribute information of the target index data corresponding to the search data and container update time attributes of each of the plurality of search containers, wherein the target search container is adapted to perform a search task based on the search data, and And processing the search data based on the target search container to obtain a target search result corresponding to the initial request data. According to an embodiment of the present disclosure, the plurality of search containers includes a source search container and at least one mirror search container, and the target search container is determined from the at least one mirror search container; The data processing method further comprises the following steps: Extracting updated index data from the initial request data under the condition that the request type is an index updating request type; updating the source search container based on the update index data to obtain an updated target source search container, and And carrying out mirror image processing on the target source retrieval container to generate a new mirror image retrieval container. According to an embodiment of the present disclosure, the index update attribute information includes an index update frequency, the container update time attribute includes a container generation time at which the image search container is generated, and the image search container includes a plurality of containers; Wherein the determining a target search container from among the plurality of search containers based on the index update attribute information of the target index data corresponding to the search data and the container update time attribute of each of the plurality of search containers includes: comparing the index updating frequency of the target index data with a preset updating frequency threshold value to obtain a first comparison result, wherein the first comparison result represents the updating frequency grade of the target index data; determining a target container generation time from among the mirror container generation times of the respective mirror search containers based on the first comparison result, and And determining the target search container from the plurality of mirror image search containers according to the target container generation time. According to an embodiment of the present disclosure, the index update attribute information includes an index update time, the container update time attribute includes a container generation time at which the image retrieval container is generated, and the image retrieval container includes a plurality of containers; Wherein the determining a target search container from among the plurality of search containers based on the index update attribute information of the target index data corresponding to the search data and the container update time attribute of each of the plurality of search containers includes: When a plurality of index update times are associated with the target index data, determining a target index update time closest to a current time from among the plurality of index update times; Determining a target container generation time from among the mirror container generation times of the plurality of mirror search containers based on the target index update time, and And determining the target search container from the plurality of mirror