Batch task processing method, device and equipment and storage medium
A batch task and processing method technology, applied in the field of data processing, can solve problems such as slow task execution speed, complicated installation process, affecting operation efficiency, etc., to achieve the effect of balancing task allocation, reducing execution time, and improving efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Example Embodiment
[0051] Embodiment two
[0052] figure 2 It is a flow chart of the batch task processing method in the second embodiment of the present invention, and the second embodiment is further optimized on the basis of the first embodiment. like figure 2 As shown, the method includes:
[0053] Step 201. Query pending task requests according to a preset task configuration table.
[0054] Wherein, the task configuration table refers to a table storing generation control information of all batch tasks, and the generation control information is used to control the generation of tasks in the batch task queue. Wherein, the generation control information includes the primary key, the type of the scheduled task, the start time of the scheduled task, the end time of the scheduled task, whether the task is repeated, the time interval of the task, the last execution date of the task, and the last execution time of the task, etc. The task request to be processed refers to the task request upload
Example Embodiment
[0076] Embodiment Three
[0077] image 3 It is a schematic structural diagram of a batch task processing device in Embodiment 3 of the present invention. This embodiment is applicable to the situation where it is necessary to improve batch task processing efficiency when processing a large number of batch tasks. like image 3 As shown, the device includes:
[0078] A batch task queue acquiring module 310, configured to acquire a batch task queue to be executed, wherein the batch task queue is composed of at least one task to be executed;
[0079] Execution step determination module 320, configured to determine the execution steps of the target tasks in the batch task queue;
[0080] Execution node allocation module 330, configured to allocate the at least two parallel execution steps to at least two execution nodes to execute the batch task queue if it is determined according to the step attributes of the execution steps that there are at least two parallel execution steps o
Example Embodiment
[0098] Embodiment Four
[0099] Figure 4 It is a schematic structural diagram of a computer device provided in Embodiment 4 of the present invention. Figure 4 A block diagram of an exemplary computer device 12 suitable for implementing embodiments of the invention is shown. Figure 4 The computer device 12 shown is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.
[0100] like Figure 4 As shown, computer device 12 takes the form of a general-purpose computing device. Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16 , system storage 28 , bus 18 connecting various system components including system storage 28 and processing unit 16 .
[0101] Bus 18 represents one or more of several types of bus structures, including a storage device bus or controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap