Data processing system and method for network flow monitoring

A data processing system and network traffic technology, which is applied in the field of data processing systems for network traffic monitoring, can solve a large number of data processing and analysis problems, achieve efficient data organization forms and systems, avoid leakage risks, and enhance security.

Pending Publication Date: 2022-07-22
INFORMATION & COMM BRANCH OF STATE GRID JIANGSU ELECTRIC POWER
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Purpose of the invention: The purpose of the invention is to provide a data processing system and method for network traffic monitoring, so as to solve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0027] The technical solutions of the present invention will be further described below with reference to the accompanying drawings.

[0028] A data processing system for network traffic monitoring, comprising a data acquisition layer, a data processing layer and a data output and display layer, specifically:

[0029] Data collection layer: collect network traffic monitoring data. There are two sources of network traffic monitoring data. One is the interaction information between the user's intranet client and the server collected by the Kelai probe. The data is passed in through kafka and the format is json. The information mainly includes client_ip, server_ip, client_port, Server_port, flow_end_time and other fields, through which offline statistics and real-time calculations can be performed. The data in Kafka is written to S3 and clickhouse for storage after cleaning and conversion. Clickhouse only saves data for nearly seven days for data query and For ad hoc computing, the

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing system and method for network flow monitoring, the system comprises a data acquisition layer, a data processing layer and a data output and display layer, the data acquisition layer is used for acquiring network flow monitoring data; the data processing layer mainly comprises an offline calculation module and a real-time calculation module; and the data output and display layer is used for displaying, analyzing and processing results after data calculation. According to the invention, a multi-level hierarchical division data processing architecture is adopted, so that the network flow monitoring system has an efficient data organization form and system; the service data with high real-time requirement is processed and calculated, so that the user can be helped to find and solve problems in time; and the network flow data adopts an intranet security isolation storage mode, so that the security of the data is enhanced, and the risk of sensitive data leakage is avoided.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner INFORMATION & COMM BRANCH OF STATE GRID JIANGSU ELECTRIC POWER
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap