Data acquisition method
A data collection and data source technology, applied in the field of big data, can solve problems such as low collection efficiency and inability to access the data source website normally, and achieve the effect of improving collection efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Examples
Example Embodiment
[0017] The present invention will be specifically introduced below with reference to specific embodiments.
[0018] An embodiment of the present invention provides a data collection method, which includes the following steps:
[0019] S101, using the Q-Learning algorithm to establish a Q table for each data source website respectively, wherein the Q table takes the best access frequency of each data source website to be accessed as a field, and takes the URL corresponding to each data source website as a primary key;
[0020] S102, visit the corresponding data source website according to the best visit frequency in the Q table.
[0021] Optionally, the calculation process of the optimal access frequency of each data source website to be accessed includes:
[0022] Use different access frequencies to visit the data source website, until the data source website cannot be accessed normally;
[0023] Extract the access frequency that can normally access the data source website, and
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap