2 results about "Data warehouse" patented technology

An object of the invention is an automated analysis system for analyzing at least one of scientific, technological and business information. The automated analysis system comprises means 100 for processing a data amount to accomplish a collection data form, means for structuring the collection data form describing the content of a source document, means for automatically identifying input documents in data warehouses comprising similar structured data forms as said structured collection data form, means for preprocessing and tokenizing said input documents, and the automated analysis system comprises a classification engine using the tokenized and preprocessed documents as input classifying each item of the input documents, and said means for processing, means for structuring, means for automatically identifying, means for preprocessing and tokenizing and said classification engine being configured to perform their tasks in one or more modelling round(s).

The invention discloses a user ID association method based on a big data technology. The method comprises the following steps: step A, reading configuration information; step B, according to the configuration information, pulling data from a data warehouse, and constructing vertexes and edges; step C, combining the repetitive items of the vertexes and the edges of the graph through SparkGraphx; step D, searching N-degree relations of vertexes of the graph in a directed manner and collecting the N-degree relations; step E, according to the N-degree relation node of each graph vertex collected in the previous step; step F, conducting confidence coefficient calculation on the ambiguous nodes collected in the last step according to a configured ambiguity rule, and completing affiliation judgment of ambiguous vertexes; and step G, according to the storage configuration, finally storing the output result in a specified database according to a specified format. The user ID association methodprovided by the invention has the advantages of more complete and more accurate mining data.