Batch task processing method, device and equipment and storage medium

A batch task and processing method technology, applied in the field of data processing, can solve problems such as slow task execution speed, complicated installation process, affecting operation efficiency, etc., to achieve the effect of balancing task allocation, reducing execution time, and improving efficiency

Active Publication Date: 2020-02-18
CHINA CONSTRUCTION BANK
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the existing task scheduling tools need to adopt the C/S (Client/Server, client/server) mode, which needs to be installed before use, and the installation process is complicated, which affects the operation efficiency
Each execution step o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch task processing method, device and equipment and storage medium
  • Batch task processing method, device and equipment and storage medium
  • Batch task processing method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0051] Embodiment two

[0052] figure 2 It is a flow chart of the batch task processing method in the second embodiment of the present invention, and the second embodiment is further optimized on the basis of the first embodiment. like figure 2 As shown, the method includes:

[0053] Step 201. Query pending task requests according to a preset task configuration table.

[0054] Wherein, the task configuration table refers to a table storing generation control information of all batch tasks, and the generation control information is used to control the generation of tasks in the batch task queue. Wherein, the generation control information includes the primary key, the type of the scheduled task, the start time of the scheduled task, the end time of the scheduled task, whether the task is repeated, the time interval of the task, the last execution date of the task, and the last execution time of the task, etc. The task request to be processed refers to the task request upload

Example Embodiment

[0076] Embodiment Three

[0077] image 3 It is a schematic structural diagram of a batch task processing device in Embodiment 3 of the present invention. This embodiment is applicable to the situation where it is necessary to improve batch task processing efficiency when processing a large number of batch tasks. like image 3 As shown, the device includes:

[0078] A batch task queue acquiring module 310, configured to acquire a batch task queue to be executed, wherein the batch task queue is composed of at least one task to be executed;

[0079] Execution step determination module 320, configured to determine the execution steps of the target tasks in the batch task queue;

[0080] Execution node allocation module 330, configured to allocate the at least two parallel execution steps to at least two execution nodes to execute the batch task queue if it is determined according to the step attributes of the execution steps that there are at least two parallel execution steps o

Example Embodiment

[0098] Embodiment Four

[0099] Figure 4 It is a schematic structural diagram of a computer device provided in Embodiment 4 of the present invention. Figure 4 A block diagram of an exemplary computer device 12 suitable for implementing embodiments of the invention is shown. Figure 4 The computer device 12 shown is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.

[0100] like Figure 4 As shown, computer device 12 takes the form of a general-purpose computing device. Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16 , system storage 28 , bus 18 connecting various system components including system storage 28 and processing unit 16 .

[0101] Bus 18 represents one or more of several types of bus structures, including a storage device bus or controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a batch task processing method and device, equipment and a storage medium. The method comprises. The method comprises the following steps: obtaining a to-be-executed batch task queue which consists of at least one to-be-executed task; determining an execution step of a target task in the batch task queue; If it is determined that at least two parallel execution steps exist according to the step attributes of the execution steps, allocating the at least two parallel execution steps to at least two execution nodes to execute the target task in the batchtask queue. According to the embodiment of the invention, the steps which can be executed in parallel in the target task are simultaneously allocated to different execution nodes, so that each execution step of a single task is prevented from being executed in sequence, and the execution time of the target task is shortened. Multiple execution nodes concurrently process tasks to improve the efficiency of batch task processing, and the effect of balancing task allocation of each execution node is achieved.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products