Mass data association relationship analysis method, device and system

The invention provides a mass data association relationship analysis method, device and system, and the method comprises the steps: employing a data collection tool to collect data stored in a mass database in real time, and sending the collected data to a message channel in real time; Carrying out real-time data cleaning processing on the data output by the message channel to obtain cleaned data;And performing association relationship analysis on the cleaned data by utilizing a related algorithm in a machine learning library built in a streaming real-time computing framework to obtain an association relationship analysis result. Based on a streaming computing framework, by means of a machine learning library and a built-in algorithm of the streaming computing framework, the real-time analysis task of the incidence relation of the hundred million-level mass data sets can be efficiently completed. As the sample data volume is greatly increased and is not limited, the scheme can improvethe data analysis accuracy.