General method for big data acquisition, processing and storage

[0045] Example one

[0046] reference Figure 1-3 Shown.

[0047] Specifically, this embodiment provides a general method for big data collection, processing and storage, and the method includes the following steps:

[0048] S1. If the big data platform receives the data storage request fed back by the storage device, it will divide the data information to be stored in the storage device in the terminal device into a first data packet and a second data packet of equal amount of data.

[0049] Wherein, the data storage request is a request that is fed back to the bound big data platform through the network of the terminal device after the storage device bound to the big data platform is inserted into the terminal device; the amount of data divided into equal parts is in this embodiment The segmentation method that is applicable to and when the data information storage capacity is less than 1GB; the data information segmentation is performed based on the user's storage operation, that is,

[0067] Example two

[0068] reference Figure 4-5 Shown.

[0069] This embodiment is basically the same as the first embodiment. The difference is that in this embodiment, after the big data platform performs storage identification for the storage device inserted in the terminal device, the method further includes the following steps:

[0070] S42. If the storage device is inserted into the terminal device again, and the stored data is exported, the storage identification is fed back to the big data platform, and the storage identification of the storage device is changed to the backup identification.

[0071] Among them, after the storage device feeds back the storage identification to the big data platform, the storage identification of the storage device is automatically changed to the backup identification, that is, the storage identification of the storage device is one-time; and the storage device is inserted into the terminal for the second to the Nth time Inside the device, the

[0088] Example three

[0089] reference Image 6 Shown.

[0090] This embodiment is basically the same as the first embodiment. The difference is that in this embodiment, before the big data platform divides the data information into the first data packet and the second data packet of equal amount of data, the method It also includes the following steps:

[0091] S10. Calculate the first time information imported into the storage device connected to the terminal device through the big data platform according to the amount of space occupied by the data information, and calculate the average network upload speed of the terminal device connected to the storage device.

[0092] Among them, before dividing the data information into the first data packet and the second data packet of equal data amount, you can also choose not to divide the first data packet and the second data packet of equal data amount to calculate the data information The time required to import to the storage device, and