5 results about "Hash table" patented technology

A system and method for “on-the-fly” de-duplication of data before storing the data in a storage system is provided. A data de-duplication module illustratively cooperates with protocol servers and a file system of a storage operating system executing on the storage system to implement the novel de-duplication technique. The de-duplication module illustratively generates a block store, an index file and a hash table on storage space provided by the storage system. The hash table is utilized for tracking fingerprints and locations of blocks within the block store. The index file is utilized for storing directory information identifying the contents of data containers stored on the storage system, while the block store is utilized to store raw data blocks that comprise the data containers.

The invention belongs to the technical field of streaming data mining, and particularly relates to a large-scale high-dimensional high-speed streaming data online anomaly detection method and system, and the method comprises the steps: employing a matrix sketch model to carry out the processing of a data block transmitted at a high speed, and obtaining a sketch matrix; inputting the sketch matrix into a hash learning model to obtain an optimal model parameter and a feature hash table at the current moment; constructing an abnormal score calculation model according to the optimal model parameters and the feature hash table, inputting to-be-detected sample data into the abnormal score calculation model for detection, and judging whether the sample data is abnormal or not. By adopting the matrix sketch and Hash learning technology, the data scale and the feature dimension can be reduced, the detection speed and the storage efficiency can be improved, and the dynamic change of stream data distribution can be self-adapted by updating the detection model on line; the problem that anomaly detection cannot be efficiently carried out on the streaming data in real time in the current large-scale high-dimensional and high-speed environment is effectively solved.

The invention provides a workpiece allowance rapid solving method based on three-dimensional measurement point cloud data, and the method comprises the following steps: scanning a workpiece through ascanner, and obtaining the point cloud data; filtering and denoising the point cloud data, and solving a point cloud normal by adopting a kd-tree method; importing the three-dimensional point cloud data into a theoretical model of the workpiece, and completing registration of the filtered and denoised three-dimensional point cloud data and the theoretical model by adopting a method of combining NDT and ICP; carrying out space division on the point cloud data by using an octree data structure, constructing a hash table, and carrying out triangular patch coding on a divided space block to finishpoint cloud data preprocessing; performing dimensionality reduction on the preprocessed point cloud data, and screening out and removing triangular patches irrelevant to margins of points to be selected; applying the vector product and the cross product to the remaining triangular patches to quickly calculate the allowance and judge the effectiveness. The method has the beneficial effects that large-scale point clouds are encoded through space division of the octree and the hash table, so that the search efficiency is effectively improved, and the allowance of the workpiece is quickly solved.