Data statistics method and system

A data statistics and database technology, applied in the field of big data, can solve problems such as poor real-time performance, achieve the effect of improving computing speed and avoiding time loss

Pending Publication Date: 2019-04-19
NANJING GUOTONG INTELLIGENT TECH
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, the statistical method is designed and developed according to the specific needs of different users and cannot be reused; on the other hand, the statistical work is often

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0018] The principles and features of the present invention will be described below with reference to the accompanying drawings. The examples cited are only used to explain the present invention, not to limit the scope of the present invention.

[0019] Such as figure 1 As shown, an embodiment of the present invention provides a data statistics method, and the method includes:

[0020] Step 1. Obtain business data.

[0021] Step 2: Process the business data to obtain persistent data for storage in a permanent storage medium, and store the persistent data in the Kafka cluster.

[0022] Step 3: Read the persistent data in the Kafka cluster according to the Spark technology and the statistical objects preset in the database. The database is also preset with statistical rules and statistical dimensions, and according to the statistical rules and the statistical objects Dimension performs real-time streaming statistics on the persistent data to obtain statistical results.

[0023] Step 4: Outp

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data statistics method and system. The method comprises the following steps: step 1, obtaining service data; step 2, processing the service data to obtain persistent data used for being stored in a permanent storage medium, and storing the persistent data in a Kafka cluster; step 3, reading the persistent data in the Kafka cluster according to Spark technology and a preset statistical object in a database, setting a statistical rule and a statistical dimension in the database, and performing real-time streaming statistics on the persistent data according to the statistical rule and the statistical dimension to obtain a statistical result; and step 4, outputting the statistical result according to a preset display mode. According to the technical scheme, the universality and the real-time performance of the statistical method and system can be greatly improved.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner NANJING GUOTONG INTELLIGENT TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products