Search

CN-121996745-A - Data processing method and system

CN121996745ACN 121996745 ACN121996745 ACN 121996745ACN-121996745-A

Abstract

The embodiment of the specification provides a data processing method and a data processing system, which are applied to the field of computers and comprise the steps of determining a current query, rewriting the current query based on historical query data corresponding to the current query to obtain a target query, searching from a first data source to obtain a first search result according to the target query, determining a target search strategy according to an evaluation result obtained by evaluating the first search result, searching from a second data source to obtain a second search result according to the target search strategy and the target query, generating a prompt text according to the first search result and the second search result, obtaining a target query result corresponding to the current query according to the target query and the prompt text, determining a target search strategy according to the evaluation result to realize more accurate search, obtaining search results from a plurality of data sources and generating the prompt text to obtain more accurate target query results.

Inventors

  • JIANG YONG
  • XIE PENGJUN
  • HUANG FEI

Assignees

  • 阿里巴巴（中国）有限公司

Dates

Publication Date
20260508
Application Date
20241107

Claims (14)

  1. 1. A data processing method, comprising: Determining a current query, and rewriting the current query based on historical query data corresponding to the current query to obtain a target query; according to the target query, searching from a first data source to obtain a first search result, and determining a target search strategy according to an evaluation result obtained by evaluating the first search result; Searching from a second data source according to the target search strategy and the target query to obtain a second search result, and generating a prompt text according to the first search result and the second search result; And obtaining a target query result corresponding to the current query according to the target query and the prompt text.
  2. 2. The data processing method according to claim 1, wherein the searching from the first data source to obtain a first search result according to the target query, and determining the target search policy according to an evaluation result obtained by evaluating the first search result, comprises: determining a target intention corresponding to the target query according to the target query; And searching from a first data source according to the target intention to obtain a first search result, and determining a target search strategy according to an evaluation result obtained by evaluating the first search result.
  3. 3. The data processing method according to claim 1 or 2, the target search strategy comprising modifying a query strategy or continuing a search strategy; The determining a target search strategy according to an evaluation result obtained by evaluating the first search result includes: and carrying out relevance and quality evaluation on the first search result to obtain an evaluation result, and determining the modified query strategy or the continuous search strategy according to the evaluation result.
  4. 4. The data processing method according to claim 1 or 2, the target search strategy comprising modifying a query strategy or continuing a search strategy; the searching from the second data source according to the target searching strategy and the target query to obtain a second searching result comprises the following steps: Under the condition that the target search strategy is determined to be the modified query strategy, re-writing the current query according to historical query data corresponding to the current query to obtain modified query; And determining the modified query as a target query, and continuing to execute the step of searching from a first data source according to the target query to obtain a first search result until the target search strategy is determined to be the continued search strategy according to an evaluation result obtained by evaluating the first search result, and searching from the second data source according to the target query under the condition that the target search strategy is determined to be the continued search strategy to obtain the second search result.
  5. 5. The data processing method according to claim 1 or 2, the target search strategy comprising a continuation search strategy; According to the target search strategy and the target query, retrieving from a second data source to obtain a second retrieval result, including: And searching from the second data source according to the continuous search strategy and the target query to obtain the second search result.
  6. 6. The data processing method according to claim 1, wherein the obtaining, according to the target query and the prompt text, the target query result corresponding to the current query includes: and inputting the target query and the prompt text into a language model to obtain a target answer corresponding to the current query and an associated query related to the current query, wherein the associated query is a query with an association relationship with the current query.
  7. 7. The data processing method according to claim 6, wherein after the target answer corresponding to the current query and the associated query related to the current query are obtained by inputting the target query and the prompt text into a language model, further comprising: Responding to a query request of a client to the associated query, determining the current query and the target answer as the historical query data, determining the associated query as the current query, executing the determined current query, and rewriting the current query based on the historical query data corresponding to the current query to obtain the target query.
  8. 8. The data processing method of claim 1, the determining a current query comprising: receiving a current query sent by a client, wherein the current query is determined by the client based on interactive operation on a user interactive interface; The method further comprises the steps of obtaining a target query result corresponding to the current query according to the target query and the prompt text; and sending the target query result to the client so as to display the target query result on the user interaction interface of the client.
  9. 9. A data processing system includes a rewrite unit, an evaluation unit, a generation unit, and an acquisition unit, wherein, The rewrite unit is used for determining the current query, and rewriting the current query based on historical query data corresponding to the current query to obtain a target query; The evaluation unit is used for searching from a first data source according to the target query to obtain a first search result, and determining a target search strategy according to an evaluation result obtained by evaluating the first search result; The generating unit is used for searching from a second data source according to the target search strategy and the target query to obtain a second search result, and generating a prompt text according to the first search result and the second search result; The obtaining unit is configured to obtain a target query result corresponding to the current query according to the target query and the prompt text.
  10. 10. The data processing system of claim 9, wherein the evaluation unit comprises an intent determination module, a first search module, and an evaluation module, wherein, The intention determining module is used for determining a target intention corresponding to the target query according to the target query; the first search module is used for searching from a first data source according to the target intention to obtain a first search result; And the evaluation module is used for determining a target search strategy according to an evaluation result obtained by evaluating the first retrieval result.
  11. 11. The data processing system of claim 9, wherein the generation unit comprises a second search module, wherein, And the second search module is used for searching from the second data source according to a continuous search strategy and the target query to obtain the second search result.
  12. 12. A computing device, comprising: A memory and a processor; The memory is adapted to store a computer program/instruction, the processor being adapted to execute the computer program/instruction, which when executed by the processor, implements the steps of the data processing method according to any one of claims 1 to 8.
  13. 13. A computer readable storage medium storing a computer program/instruction which, when executed by a processor, implements the steps of the data processing method of any one of claims 1 to 8.
  14. 14. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the data processing method of any of claims 1 to 8.

Description

Data processing method and system Technical Field Embodiments of the present disclosure relate to the field of computer technologies, and in particular, to a data processing method and system. Background With the rapid development of information technology, the data volume has been explosively increased, and how to efficiently and accurately acquire required knowledge from massive information has become an important challenge. Traditional information retrieval techniques have certain limitations in processing large-scale, complex data sets, particularly in understanding user needs and providing personalized services. In recent years, a large model has made remarkable progress in the field of natural language processing due to its strong language understanding and generating capability, but the large model has limitations in retrieving generated answers and cannot be personalized for users, so that the relevance and accuracy of the provided answers are to be improved. Disclosure of Invention In view of this, the present embodiments provide a data processing method. One or more embodiments of the present specification also relate to a data processing system, a computing device, a computer readable storage medium, and a computer program product, which solve the technical drawbacks of the prior art that a large model has limitations in retrieving and generating answers, and cannot be individually adjusted for users, so that the relevance and accuracy of the provided answers are improved. According to a first aspect of embodiments of the present specification, there is provided a data processing method, including: Determining a current query, and rewriting the current query based on historical query data corresponding to the current query to obtain a target query; according to the target query, searching from a first data source to obtain a first search result, and determining a target search strategy according to an evaluation result obtained by evaluating the first search result; Searching from a second data source according to the target search strategy and the target query to obtain a second search result, and generating a prompt text according to the first search result and the second search result; And obtaining a target query result corresponding to the current query according to the target query and the prompt text. According to a second aspect of the embodiments of the present specification, there is provided a data processing system including a rewriting unit, an evaluating unit, a generating unit, and an obtaining unit, wherein, The rewrite unit is used for determining the current query, and rewriting the current query based on historical query data corresponding to the current query to obtain a target query; The evaluation unit is used for searching from a first data source according to the target query to obtain a first search result, and determining a target search strategy according to an evaluation result obtained by evaluating the first search result; The generating unit is used for searching from a second data source according to the target search strategy and the target query to obtain a second search result, and generating a prompt text according to the first search result and the second search result; The obtaining unit is configured to obtain a target query result corresponding to the current query according to the target query and the prompt text. According to a third aspect of embodiments of the present specification, there is provided a computing device comprising: A memory and a processor; the memory is used for storing computer programs/instructions, and the processor is used for executing the computer programs/instructions, and the computer programs/instructions realize the steps of the data processing method when being executed by the processor. According to a fourth aspect of embodiments of the present specification, there is provided a computer readable storage medium storing a computer program/instruction which, when executed by a processor, implements the steps of the data processing method described above. According to a fifth aspect of embodiments of the present specification, there is provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the data processing method described above. According to the data processing method provided by the embodiment of the specification, aiming at the current query of a user, the current query can be rewritten according to historical query data corresponding to the current query, so that a target query which is closer to the real intention of the user is obtained, a first search result can be obtained by searching from a first data source aiming at the target, the searched first search result can be evaluated, so that an evaluation result of the first search result is obtained, under the condition that a target search strategy can be determined according to the ev