CN-121547407-B - Electronic mall data communication method and system

CN121547407BCN 121547407 BCN121547407 BCN 121547407BCN-121547407-B

Abstract

The invention provides a method and a system for electronic mall data communication, and relates to the technical field of electronic mall data communication. The method comprises the steps of evaluating the value grade of operation data generated by a local data generation point based on a data grading rule, determining a transmission channel and a transmission strategy according to the value grade, transmitting the operation data to a central data processing point, controlling the central data processing point to analyze the system state of the operation data, and transmitting the system state back to a transmission scheduling node so that the transmission scheduling node forwards the operation data to a corresponding system component through the transmission channel, and driving the system component to respond. The method aims to solve the problems of low communication efficiency, network congestion and key data transmission delay caused by a unified data communication strategy in the prior art under the complex scene of the electronic mall system, improves the overall stability and response speed of the electronic mall system, and ensures that an analysis result can timely drive feedback and actions inside the system.

Inventors

HUANG YANBO
TANG GUOSHENG
WANG JUNJIE

Assignees

佛山建发智慧城市科技有限公司

Dates

Publication Date: 20260512
Application Date: 20260120

Claims (10)

1. The electronic mall data communication method is applied to an electronic mall data communication system and is characterized in that the electronic mall data communication system comprises a local data generation node, a transmission scheduling node and a central data processing node; the electronic mall data communication method comprises the following steps: S1, after each local data generation point of an electronic mall system is deployed with a local evaluation unit, controlling the local data generation point, performing value grade evaluation on operation data generated by the local data generation point through a corresponding local evaluation unit based on a preset data grading rule to obtain the value grade of the operation data, and packaging the value grade and the corresponding operation data into bundle binding data to be sent to a transmission scheduling node; S2, after the transmission scheduling node receives the binding data, controlling the transmission scheduling node, determining a transmission channel and a transmission strategy according to the value grade of the operation data, and transmitting the corresponding operation data to a central data processing point through the determined transmission channel based on the determined transmission strategy; S3, after the central data processing point receives the operation data from the transmission channel, the central data processing point is controlled to conduct system state analysis on the operation data to obtain a first analysis result, and the first analysis result is transmitted back to the transmission scheduling node so that the transmission scheduling node can transmit the operation data to the corresponding system component through the transmission channel, and the system component is driven to respond.
2. The electronic mall data communication method according to claim 1, wherein in step S1, the step of performing value level evaluation on the operation data generated by the local data generating point by the corresponding local evaluation unit based on the preset data classification rule, to obtain the value level of the operation data includes: S11, performing value grade evaluation on the operation data generated by the local data generation point based on a preset data grading rule through a local evaluation unit to obtain an initial value grade of the operation data; S12, periodically acquiring service identifiers with dependency relations with local data generation points; S13, acquiring an aggregation state brief of the neighbor service by sending a request to the corresponding neighbor service based on the service identifier; S14, judging whether the initial value grade of the operation data is a medium priority grade; S15, if the initial value grade of the operation data is the medium priority, judging whether the local data generation point and the neighbor service have a common performance decline trend or not based on the operation data generated by the local data generation point and the acquired aggregation state brief of the neighbor service, and if so, increasing the value grade of the operation data to be high priority, otherwise, maintaining the value grade of the operation data unchanged.
3. The electronic mall data communication method according to claim 2, wherein in step S15, the step of determining whether the local data generating point and the neighboring service have a common performance degradation trend based on the operation data generated by the local data generating point and the acquired aggregate status briefing of the neighboring service includes: s151, distributing weights for performance indexes in operation data and aggregation state briefs; S152, calculating an aggregate risk score according to the weight distributed by the performance index; s153, comparing the aggregation risk score with a first preset threshold value; S154, when the aggregate risk score exceeds a first preset threshold, judging that the local data generation point and the neighbor service have a common performance decline trend.
4. The electronic mall data communication method according to claim 1, wherein the local data generation point is a front-end server, a back-end micro-service, a database proxy layer or a network device.
5. The electronic mall data communication method according to claim 1, wherein the local evaluation unit is embodied as a separate process, a proxy component in a service grid or a log collection function module in an application program.
6. The electronic mall data communication method of claim 1, wherein the data classification rule is used to classify the operation data into high priority data, medium priority data, and low priority data; The transmission channels include a priority transmission channel for transmitting high priority data, a standard transmission channel for transmitting medium priority data, and an optimized transmission channel for transmitting low priority data.
7. The electronic mall data communication method of claim 1, wherein the central data processing point is a distributed stream processing system, wherein a rule engine is maintained in the distributed stream processing system, and the rule engine comprises an average response time threshold of a payment service API and an alarm threshold of a payment failure rate; In step S3, the specific steps of controlling the central data processing point to perform system state analysis on the operation data to obtain a first analysis result include: s31, controlling a distributed stream processing system to monitor the sales promotion of the electronic mall system through subscription service, and obtaining an adjusted rule engine by improving the average response time threshold of the payment service API and the alarm threshold for reducing the payment failure rate when the sales promotion exists in the electronic mall system; S32, analyzing and judging whether the operation data has payment abnormality or not by using the regulated rule engine; S33, if the payment abnormality exists, outputting a first analysis result related to the operation scene.
8. The electronic marketplace data communication method according to claim 7, wherein in step S31, the step of controlling the distributed stream processing system to monitor the promotional program of the electronic marketplace system through the subscription service includes: S311, analyzing the received information of each promotion event to obtain the priority information and the expected resource consumption information contained in the information; s312, determining a monitoring strategy according to the priority information and the expected resource consumption information of the sales promotion activities; S313, controlling the distributed stream processing system to monitor operation data related to the sales promotion activity based on the determined monitoring strategy, wherein the operation data specifically comprises continuously evaluating the matching degree of actual resource consumption and expected resource consumption of the sales promotion activity during the operation of the sales promotion activity; S314, when the matching degree is lower than a second preset threshold value, updating the corresponding monitoring strategy.
9. The electronic mall data communication method as claimed in claim 1, wherein the step of continuously evaluating the degree of matching of the actual resource consumption and the expected resource consumption of the promotional program in step S313 includes: s3131, acquiring current information and industry information related to a sales promotion through an external platform; s3132, dynamically adjusting expected resource consumption according to current information and industry information; S3133, carrying out trend analysis on actual resource consumption data of the sales promotion, and obtaining a trend and a change rate of actual resource consumption; s3134, according to the trend and the change rate of the actual resource consumption, the matching degree of the actual resource consumption and the expected resource consumption is judged by combining the dynamically adjusted expected resource consumption, the time information and the industry information.
10. An electronic mall data communication system is characterized by comprising a local data generation node, a transmission scheduling node and a central data processing node; Further comprises: The first control module is used for controlling the local data generation points after the local evaluation units are deployed at the local data generation points of the electronic mall system, performing value grade evaluation on the operation data generated by the local data generation points through the corresponding local evaluation units based on preset data grading rules to obtain the value grade of the operation data, and packaging the value grade and the corresponding operation data into bundle binding data to be sent to the transmission scheduling node; The second control module is used for controlling the transmission scheduling node to determine a transmission channel and a transmission strategy according to the value grade of the operation data after the transmission scheduling node receives the binding data, and transmitting the corresponding operation data to the central data processing point through the determined transmission channel based on the determined transmission strategy; and the third control module is used for controlling the central data processing point to perform system state analysis on the operation data after the central data processing point receives the operation data from the transmission channel, obtaining a first analysis result, and transmitting the first analysis result back to the transmission scheduling node so that the transmission scheduling node forwards the operation data to the corresponding system component through the transmission channel, thereby driving the system component to respond.

Description

Electronic mall data communication method and system Technical Field The invention relates to the technical field of electronic mall data communication, in particular to an electronic mall data communication method and system. Background Electronic marketplace systems, as a central component of modern commerce, rely on complex and bulky data communication networks for efficient operation. With the continued increase in user access and the increase in business complexity, data traffic within electronic marketplace systems has shown explosive growth. Each user operation, from simple page browsing to complex transaction completion, involves the exchange of data between multiple system components. In addition, the system can generate massive operation data when running, and the data are key indexes for evaluating the performance and health state of the system, such as server response delay, error rate, database query time, resource utilization rate and the like. To ensure stable operation and timely response of the electronic marketplace system, it is necessary to collect and transmit these operational data from multiple nodes throughout the system at high granularity and high frequency for detailed system state analysis to quickly identify potential problems. However, such high volume, high granularity operational data communication transmissions can certainly place a significant network traffic and processing burden on the infrastructure of the system. This huge communication burden may not only adversely affect the performance of the electronic mall core functions, but may also lead to delays in critical operational data transmission, which in turn may affect the timeliness and accuracy of the system state analysis. In the prior art, electronic mall systems typically employ a unified data communication strategy, i.e., all operational data is transmitted at the same time, regardless of its importance or degree of urgency. This lack of differentiated transmission means allows critical operation data with high priority and low delay requirements to share limited communication resources with low priority and high tolerance data, resulting in inefficient communication. When the system is faced with high concurrency or burst traffic, the unified transmission strategy is easier to cause network congestion, and further aggravates the delay of key data transmission, thereby influencing the early warning and quick response capability of the system to potential problems. In view of the above problems, no effective technical solution is currently available. Disclosure of Invention The invention aims to provide a data communication method and a data communication system for an electronic mall, which aim to solve the problems of low communication efficiency, network congestion and key data transmission delay caused by a unified data communication strategy in the prior art under the complex scene that an electronic mall system faces continuous increase of user access volume, huge operation data volume and high-granularity and high-frequency acquisition and transmission, improve the overall stability and response speed of the electronic mall system and ensure that an analysis result can timely drive feedback and actions inside the system. In a first aspect, the present invention provides an electronic mall data communication method, applied to an electronic mall data communication system, where the electronic mall data communication system includes a local data generating node, a transmission scheduling node, and a central data processing node; the electronic mall data communication method comprises the following steps: S1, after each local data generation point of an electronic mall system is deployed with a local evaluation unit, controlling the local data generation point, performing value grade evaluation on operation data generated by the local data generation point through a corresponding local evaluation unit based on a preset data grading rule to obtain the value grade of the operation data, and packaging the value grade and the corresponding operation data into bundle binding data to be sent to a transmission scheduling node; S2, after the transmission scheduling node receives the binding data, controlling the transmission scheduling node, determining a transmission channel and a transmission strategy according to the value grade of the operation data, and transmitting the corresponding operation data to a central data processing point through the determined transmission channel based on the determined transmission strategy; S3, after the central data processing point receives the operation data from the transmission channel, the central data processing point is controlled to conduct system state analysis on the operation data to obtain a first analysis result, and the first analysis result is transmitted back to the transmission scheduling node so that the transmission scheduling node can transmit the operation da