Data synchronization method and device

一种数据同步、数据的技术,应用在数据处理领域,能够解决SEM分析系统数据同步效率低等问题,达到避免入库效率低、提高数据同步效率、高并发性能的效果

Active Publication Date: 2019-07-16
BEIJING GRIDSUM TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In view of this, the present invention provides a data synchronization method and device to solve the problem of low data synchronization efficiency in the current SEM analysis system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0052] The data synchronization method and device provided by the embodiments of the present invention are applied to a search engine marketing SEM analysis system. The SEM analysis system includes multiple accounts, and the multiple accounts belong to at least one account group respectively. Moreover, the embodiment of the present invention still divides the system business into a data production part and a data consumption part, and provides corresponding dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data synchronization method and device which are applied to a search engine marketing SEM analysis system, the SEM analysis system comprises a plurality of accounts, and the accounts respectively belong to at least one account group. The method includes: obtaining first full-material data and second full-material data of each account in the at least one account, and determining first persistent data of each account; storing the first persistent data of each account into a shared directory; obtaining second persistent data of any account group from the shared directory;and inserting each piece of data in the second persistent data of any account group into the target database in parallel. According to the technical scheme, the high concurrency performance of multiple accounts in the data production stage is fully utilized, the consistency of the first persistent data of all the accounts and the first full material data is guaranteed, the data storage efficiencyis improved, and then the data synchronization efficiency is improved on the whole.

Description

technical field [0001] The invention relates to the field of data processing, and more specifically, to a data synchronization method and device. Background technique [0002] Search Engine Marketing (SEM, Search Engine Marketing) analysis system needs to obtain the latest material data from the media side within a specified time, and complete data synchronization of locally stored consumption data, so as to facilitate timely data analysis and provide data reports to customers . [0003] With the increase of customers and the needs of customer business, the SEM analysis system is usually divided according to business type, and multiple accounts (30-200) are formed into an account group. When synchronizing the material data corresponding to an account group to the database, usually With account as the granularity, the material data of each account in the account group is synchronized to the database in sequence by means of serial processing. However, when there are many acc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/953
CPCG06F16/27G06F16/951
Inventor 商平锋
Owner BEIJING GRIDSUM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products