CN-120994702-B - Data query method, device, medium, equipment and product based on edge calculation

CN120994702BCN 120994702 BCN120994702 BCN 120994702BCN-120994702-B

Abstract

Responding to received data query requests, determining a plurality of target edge computing nodes for data query of the data query requests through a data service instance, and grouping the plurality of target edge computing nodes based on a preset grouping strategy to obtain a plurality of groups; and carrying out data query on the target edge computing nodes in each group through the data query engine, and determining a target data query result aiming at the data query request according to the data query result of each group. Therefore, the data query of the target edge computing nodes can be split into a plurality of sub-queries, and the sub-queries can be executed through the data query engine in parallel, so that the data query efficiency is improved, and the waiting time of a user is reduced.

Inventors

Lou Xiwenyang
LAI MINLI

Assignees

北京火山引擎科技有限公司

Dates

Publication Date: 20260508
Application Date: 20250807

Claims (11)

1. The data query method based on the edge calculation is characterized by being applied to a central machine room, wherein the central machine room is provided with a data service instance and a data query engine, and the data query method based on the edge calculation comprises the following steps: Responding to a received data query request, determining a plurality of target edge computing nodes for carrying out data query on the data query request through the data service instance, and grouping the plurality of target edge computing nodes based on a preset grouping strategy to obtain a plurality of groups, wherein the grouping strategy is used for grouping the plurality of target edge computing nodes with the complexity of minimizing the data query time as a target; And carrying out data query on target edge computing nodes in each group through the data query engine in parallel to obtain a data query result of each group, and determining a target data query result aiming at the data query request according to the data query result of each group.
2. The edge computing-based data query method according to claim 1, wherein grouping the plurality of target edge computing nodes according to the evolution operation result corresponding to the number of nodes to obtain a plurality of groups comprises: and under the condition that the evolution operation result corresponding to the number of the nodes is an integer, determining the evolution operation result as the grouping number, and carrying out average distribution on the plurality of target edge computing nodes according to the grouping number to obtain a plurality of groupings.
3. The edge computing-based data query method according to claim 1, wherein grouping the plurality of target edge computing nodes according to the evolution operation result corresponding to the number of nodes to obtain a plurality of groups comprises: Under the condition that the evolution operation result corresponding to the node number is not an integer, determining the integer part in the evolution operation result as the grouping number, and distributing the plurality of target edge computing nodes according to the grouping number to obtain a plurality of groups, wherein the difference of the number of the target edge computing nodes in any two groups is not more than 1 in the plurality of groups, or And under the condition that the evolution operation result corresponding to the number of the nodes is not an integer, dividing a first group according to the integer part in the evolution operation result, and dividing target edge calculation nodes which are not distributed to the first group in the plurality of target edge calculation nodes into a second group to obtain a plurality of groups, wherein the number of the target edge calculation nodes in each first group is equal to the integer part.
4. The edge-computing-based data query method of claim 1, further comprising: And taking the packet as a target packet to be processed and circularly executing the following steps under the condition that the data query result represents that the data query engine fails to perform data query in the packet: grouping the target edge computing nodes in the target group based on the preset grouping strategy through the data service instance to obtain a plurality of sub-groups; carrying out data query on the target edge computing nodes in each sub-packet through the data query engine in parallel to obtain a new data query result of each sub-packet; and under the condition that the new data query result indicates that the data query engine fails to perform data query in the sub-packet, taking the sub-packet as a new target packet until the new data query result indicates that the data query engine succeeds in performing data query in the sub-packet or until the number of the target edge computing nodes in the target packet is a preset number.
5. The edge computing-based data query method according to any one of claims 1 to 4, wherein the central office is further configured with a caching device, and the caching device is configured to store a correspondence between a node identifier of an edge computing node and data in the edge computing node, and the edge computing-based data query method further includes: performing data query in the cache device based on node identifiers of the plurality of edge computing nodes by a data query engine; the grouping, by the data service instance, the plurality of edge computing nodes based on a preset grouping policy, to obtain a plurality of groups, including: And grouping the plurality of edge computing nodes based on a preset grouping strategy through the data service instance under the condition that the data is not queried in the caching device, so as to obtain a plurality of groups.
6. The edge computing-based data query method of claim 5, wherein the caching device is a key-value database, wherein keys of key-value pairs in the key-value database correspond to node identities of the edge computing nodes, and values correspond to data in the edge computing nodes.
7. The edge-computing-based data query method of claim 6, wherein the data service instance comprises a plurality of data service instances, the edge-computing-based data query method further comprising: Determining a primary data service instance from the plurality of data service instances based on an instance selection primary policy; And inquiring target data from the data inquiry engine based on a preset cache inquiry statement and a preset cache update frequency through the main data service instance, and caching the target data into the value of the key value pair.
8. The utility model provides a data query device based on edge calculation which characterized in that is applied to central computer lab, the central computer lab is disposed with data service instance and data query engine, and data query device based on edge calculation includes: The first processing module is used for responding to a received data query request, determining a plurality of target edge computing nodes for carrying out data query on the data query request through the data service instance, and grouping the plurality of target edge computing nodes based on a preset grouping strategy to obtain a plurality of groups, wherein the grouping strategy is used for grouping the plurality of target edge computing nodes with the complexity of minimizing the data query time as a target; And the second processing module is used for carrying out data query on the target edge computing nodes in each group through the data query engine, obtaining the data query result of each group, and determining the target data query result aiming at the data query request according to the data query result of each group.
9. A computer readable medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processing device, carries out the steps of the method according to any one of claims 1-7.
10. An electronic device, comprising: A storage device having a computer program stored thereon; processing means for executing said computer program in said storage means to carry out the steps of the method according to any one of claims 1-7.
11. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the steps of the method according to any of claims 1-7.

Description

Data query method, device, medium, equipment and product based on edge calculation Technical Field The disclosure relates to the technical field of edge computing, in particular to a data query method, a device, a medium, equipment and a product based on edge computing. Background In an edge computing monitoring system, a Prometheus combined Thanos architecture is generally adopted for data query. Specifically, when the service party initiates the query request, thanos distributes the query request to each Prometaus instance, after each Prometaus instance returns the local data, thanos query engine aggregates and processes the data, and finally returns a unified query result and feeds the query result back to the service party. However, edge computing monitoring systems face the characteristics of a large number of edge computing nodes and a large amount of data generated by each edge computing node. In this case, the above-mentioned direct query manner may result in an excessively long query response time, and low data return efficiency, so that it is difficult to satisfy the service requirement. Disclosure of Invention This content section is provided to introduce concepts in a simplified form that are further described below in the detailed description section. This section of content is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. In a first aspect, the present disclosure provides a data query method based on edge computation, applied to a central machine room, where the central machine room is deployed with a data service instance and a data query engine, the data query method based on edge computation includes: In response to receiving a data query request, determining a plurality of target edge computing nodes for data query of the data query request through the data service instance, and grouping the plurality of target edge computing nodes based on a preset grouping strategy to obtain a plurality of groups, wherein the grouping strategy is used for grouping the plurality of target edge computing nodes with the aim of minimizing the complexity of data query time; And carrying out data query on the target edge computing nodes in each group through the data query engine in parallel to obtain a data query result, and determining a target data query result aiming at the data query request according to the data query result of each group. In a second aspect, the present disclosure provides an edge computation-based data query device applied to a central machine room, where a data service instance and a data query engine are deployed in the central machine room, the edge computation-based data query device includes: The first processing module is used for responding to the received data query request, determining a plurality of target edge computing nodes for carrying out data query on the data query request through the data service instance, and grouping the plurality of target edge computing nodes based on a preset grouping strategy to obtain a plurality of groups, wherein the grouping strategy is used for grouping the plurality of target edge computing nodes with the aim of minimizing the complexity of the data query time; And the second processing module is used for carrying out data query on the target edge computing nodes in each group through the data query engine, obtaining a data query result, and determining a target data query result aiming at the data query request according to the data query result of each group. In a third aspect, the present disclosure provides a computer readable medium having stored thereon a computer program which, when executed by a processing device, implements the steps of the method described in the first aspect. In a fourth aspect, the present disclosure provides an electronic device comprising: A storage device having a computer program stored thereon; processing means for executing said computer program in said storage means to carry out the steps of the method described in the first aspect. In a fifth aspect, the present disclosure provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the method described in the first aspect. According to the technical scheme, under the condition that the data query request is received, a plurality of target edge computing nodes for data query of the data query request can be determined through the data service instance, the plurality of target edge computing nodes are grouped based on the preset grouping strategy to obtain a plurality of groups, the data query can be performed on the target edge computing nodes in each group through the concurrency of the data query engine, and the target data query result aiming at the data query request can be determined according to the data query result of each group. Therefore, the data query of