CN-116910607-B - Basic social management data integrated decision analysis method and system based on big data
Abstract
The application provides a basic social treatment data integrated decision analysis method and system based on big data, wherein the method comprises the following steps of constructing a plurality of databases in advance; the method comprises the steps of classifying collected social management data, storing the classified social management data in corresponding databases respectively, extracting business data from a plurality of databases, cleaning and integrating the business data extracted from different databases, and collecting the business data to a business platform. And analyzing and processing the business data of the business platform based on a pre-constructed decision analysis model, and outputting data service for management decision. The application avoids the problems of data island among multiple systems, low data utilization rate, weak inquiry capability and low data decision analysis efficiency.
Inventors
- XUE SHOUNING
- MENG GANG
- XU WENPENG
- SUN SHITAO
- YUAN XIN
- WANG ZHAOSEN
- Zhao Lianduo
- ZOU RENQIU
- LIN QI
- QIAO JIANMING
Assignees
- 河北志晟信息技术股份有限公司
Dates
- Publication Date
- 20260508
- Application Date
- 20230621
Claims (9)
- 1. A basic social management data integrated decision analysis method based on big data is characterized by comprising the following steps: pre-constructing a plurality of databases; classifying the collected social management data, and respectively storing the classified social management data in a corresponding database; Extracting business data from a plurality of databases; the service data extracted from different databases are cleaned and integrated and are collected to a service platform, so that the fusion of various service data is realized; based on a pre-constructed decision analysis model, analyzing and processing the business data of the business platform, and outputting data service for management decision; The method for integrating the business data extracted from different databases comprises the following steps: collecting associated attribute characteristic data of service data; calculating the association value of any two business data under the same business analysis requirement according to the association attribute characteristic data of the business data; comparing the association value with a preset threshold value, if the association value is larger than the preset threshold value, integrating the two business data, otherwise, not integrating the two business data; under the same service analysis requirement, the calculation formula of the association value of any two service data is as follows: ; Wherein, the Representing the association value of any two business data; representing the correlation factor of the area to which the two business data belong, if the sources of the two business data belong to one social management area Otherwise; ; A service scene type association factor representing two service data, if the service scene types corresponding to the two service data are the same Otherwise; ; Representing the influence weight of the number of keywords; representing the incidence relation influence weight of the keywords; representing the incidence relation influence weight of service data sources; ; the category number of the same keywords in the current business analysis requirement is represented by the two business data; Represent the first Influence weight of the seed keywords; Indicating that the first service data contains the first The number of seed keywords; Indicating that the second service data contains the first service data The number of seed keywords; Represent the first Seed keyword and the first The association factor of the seed keywords; representing a correlation factor between the sources of two traffic data.
- 2. The big data-based integrated decision analysis method for primary social management data according to claim 1, characterized in that the method comprises the following steps: and calling the data service and loading and displaying.
- 3. The big data based integrated decision analysis method for base social management data according to claim 2, wherein the method for invoking the data service comprises the steps of: Collecting evaluation index data of data services for management decision; calculating a reliable value of the data service for management decision according to the collected evaluation index data; The data service with the largest reliability value is invoked.
- 4. The method for integrated decision analysis of big data based on primary social management data according to claim 1, wherein the plurality of databases comprises a spatial database, a public database, a business database and/or a population database.
- 5. The big data based integrated decision analysis method for primary social management data according to claim 1, wherein the method for extracting business data comprises batch data extraction and/or stream data extraction.
- 6. The big data based integrated decision analysis method for basic social management data according to claim 1, wherein the method for data cleaning of business data extracted from different databases comprises data deduplication, denoising and filling.
- 7. The integrated decision analysis method for the base social management data based on big data according to claim 1, wherein the method for analyzing and processing the business data of the business platform comprises spatial analysis, temporal analysis and/or association analysis.
- 8. A big data based integrated decision analysis system for primary social management data, the system being adapted to perform the method of any of claims 1-7, the system comprising: a base layer for providing social management data and transmitting the social management data to the database layer; The database layer is used for classifying and storing the social treatment data, accessing the social treatment data into the service platform and providing service data for the service platform; the business platform is used for extracting business data from a plurality of databases, cleaning and integrating the business data extracted from different databases, and analyzing and processing the business data of the business platform based on a pre-constructed decision analysis model; And the business application layer is used for calling the data service to load and display according to the business scene and the theme.
- 9. The big data based integrated decision analysis system of the base layer social management data of claim 8, wherein the base layer comprises a data source, a gateway and a server; The data source is in communication connection with the server through the gateway, and the data source transmits data to the server through the gateway.
Description
Basic social management data integrated decision analysis method and system based on big data Technical Field The application relates to the technical field of big data and data integration application, in particular to a basic social management data integration decision analysis method and system based on big data. Background Along with the development of science and technology and society, social organization structure, social contradiction, events and the like show a multi-source development trend, and the events in the social operation process show multi-source, multi-element and multi-point distribution characteristics along with the development of society. Each department has a corresponding event handling platform or system for assisting the work of the respective function. The application of the basic social treatment group prevention and treatment management platform system in basic social treatment and the like is more and more frequent, various events existing and occurring in the basic society can be acquired from multiple sources, and the system and the method provide a distributed data integration and visualization application method for solving the problems of complex integration of social treatment distributed data and weak visibility of data analysis. The method is based on a big data processing mode, database data scattered in different network routes are accessed, extracted and integrated, mining analysis is carried out, data dynamic description and Web capability are enhanced, and service-oriented intelligent base layer social management decision analysis and application are provided. The basic social management system is a complex system based on big data, and relates to a plurality of functional departments such as politics, comprehensive treatment, urban management, municipal administration, civil administration, personal society, planning, security supervision, emergency and the like and management service resources of a multi-level system of the city, district, street office (village) and community (village), and the system has the characteristics of big data volume, multiple variable levels, big metadata composition difference and high dynamic property. Traditional relational databases lose performance, functionality and cost advantages when storing large data sets and are more compelling when processing and querying large data sets, so that an application system with large storage capacity, high processing efficiency and high querying efficiency is needed. Therefore, the technical problems to be solved are that the data island among the multiple systems is low in data utilization rate, weak in query capability and low in data decision analysis efficiency. Disclosure of Invention The application aims to provide a basic social treatment data integrated decision analysis method and system based on big data, which avoid the problems of data island among multiple systems, low data utilization rate, weak query capability and low data decision analysis efficiency. In order to achieve the aim, the application provides a basic social management data integrated decision analysis method based on big data, which comprises the following steps of constructing a plurality of databases in advance; the method comprises the steps of classifying collected social management data, storing the classified social management data in corresponding databases respectively, extracting business data from a plurality of databases, cleaning and integrating the business data extracted from different databases, and collecting the business data to a business platform. And analyzing and processing the business data of the business platform based on a pre-constructed decision analysis model, and outputting data service for management decision. The basic social management data integrated decision analysis method based on big data comprises the following steps of calling data service and loading and displaying. The basic social management data integration decision analysis method based on big data comprises the steps of collecting associated attribute feature data of service data, calculating associated values of any two service data under the same service analysis requirement according to the associated attribute feature data of the service data, comparing the associated values with a preset threshold value, and integrating the two service data if the associated values are larger than the preset threshold value, otherwise, integrating the two service data without integrating the two service data. The basic social management data integrated decision analysis method based on big data comprises the steps of collecting evaluation index data of data services for management decision, calculating a reliable value of the data services for management decision according to the collected evaluation index data, and calling the data services with the maximum reliable value. The integrated decision analysis method for the base soci