Multi-source heterogeneous platform data processing method

A data processing, multi-source and heterogeneous technology, applied in the field of data processing, can solve the problems of complex data format, and achieve the effect of improving processing capacity, accurate positioning and rapid processing capacity

Pending Publication Date: 2021-07-23
KUSN JIUHUA ELECTRONICS EQUIP FACTORY +1
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present technology allows for efficient asset management by combining different sources of information from multiple devices into one system with greater accuracy than existing methods. This can help identify issues or prevent accidents more efficiently through monitoring their impact on various aspects like network performance and reliability.

Problems solved by technology

Technics for analyzing and managing different aspects of an organization's networks involve gathering diverse amounts of data from multiple sources over time. These include assets like equipment used by employees during their working hours, applications installed on servers, web services accessed via HTTP protocol, and other forms of communication between them. Additionally, there may exist many ways to access these resources remotely without interferring with each others. Existing methods require manual input and slow down operations due to increased complexity associated with handling this type of data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-source heterogeneous platform data processing method
  • Multi-source heterogeneous platform data processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0034] This embodiment is a multi-source heterogeneous platform data processing method, in order to be able to collect multi-source, heterogeneous, and massive security element information at high speed, and perform preliminary information fusion on it. This process is mainly through data collection, data processing, and data storage. And apply a few steps to complete.

[0035] In this embodiment, a multi-source heterogeneous platform data processing method specifically includes the following steps:

[0036] Step 1) Data collection: The collected data includes asset information, security events, logs, vulnerabilities, security configuration defects, network traffic metadata, and security intelligence data.

[0037] Step 2) Asset data preprocessing:

[0038] Including asset aggregation, asset deduplication, and asset classification. Among them, asset collection is to collect asset data collected from assets, and collect assets after asset identification to prepare for asset dedu

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-source heterogeneous platform data processing method, which mainly comprises data acquisition, log standardization processing and data storage, and is characterized in that the log standardization processing is used for processing various different types of data to obtain a uniform format; the method specifically comprises the following steps: providing pre-processing such as asset recognition, collection, data deduplication, classification and tagging for collected assets; the collected logs and events are normalized, classified, filtered and merged in real time, and logs in a standard format are input for analysis and storage; performing asset synchronous matching on the collected vulnerabilities and configuration defects; performing threat detection and abnormal flow detection on the collected flow data, outputting analysis processing, and inputting suspicious files and data packets to a big data platform; and performing information collection, cleaning, normalizing, fusion and the like on the connected information. According to the method, management logs and alarm information with various data sources and complex formats can be processed, and normalized management is carried out, so that the data processing capability is improved.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner KUSN JIUHUA ELECTRONICS EQUIP FACTORY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap