Workflow group scheduling method in multi-cloud environment and based on embodiment self-adaptive distribution and integration

A scheduling method and self-adaptive technology, applied in office automation, data processing applications, instruments, etc., can solve problems such as discussion of multiple types of examples

Active Publication Date: 2018-06-12
FUJIAN NORMAL UNIV
View PDF17 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Malawski et al. designed a static and dynamic scheduling algorithm for workflow groups based on double constraints of budget and deadline, which took into account the uncertainty of task execution time in the workflow, the delay of virtual machine startup and other factors, and utilized the key workflow The admission technology guarantees the completion rate of the workflow group under the premise of double constraints. This work has a certain reference effect on the consideration of task execution time and virtual machine startup delay factors in the workflow group scheduling process of the present invention, but it only considers a virtual machine instance types, and did not discuss multi-type instances in a multi-cloud environment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Workflow group scheduling method in multi-cloud environment and based on embodiment self-adaptive distribution and integration
  • Workflow group scheduling method in multi-cloud environment and based on embodiment self-adaptive distribution and integration
  • Workflow group scheduling method in multi-cloud environment and based on embodiment self-adaptive distribution and integration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] Such as Figure 1-5 As shown in one of them, the present invention discloses a workflow group scheduling method based on instance self-adaptive allocation and integration in a multi-cloud environment. The scheduling principle assigns and schedules workflow group tasks, and sets the scanning cycle N scan is 0, then the present invention is a real-time supervisory algorithm, which comprises the following steps:

[0066] Step 1: Scan the workflow group to be executed to obtain valid instance types, started virtual machine resources and task execution information on the started virtual machine resources in the multi-cloud environment;

[0067] Step 2: Perform compression "directed edge cutting" preprocessing operation on each workflow of the workflow group to be executed;

[0068] Step 3: Each workflow performs deadline reassignment operations, calculates hypothetical execution intervals, and converts parallel small tasks to serial operations;

[0069] Step 4: Calculate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a workflow group scheduling method in multi-cloud environment and based on embodiment self-adaptive distribution and integration. The method includes that workflow tasks are compressed by means of preprocessing, so that execution time of an algorithm is reduced; a task deadline dynamic dividing method based on embodiment execution performance is designed, so that utilization rate of execution embodiments is increased from the local level of single workflow; corresponding execution embodiment resources are dynamically distributed and integrated on the basis of performance needs of a current workflow group, so that the execution embodiment utilization rate is increased globally, and cost expenditure is reduced; task sets are dynamically scheduled onto corresponding embodiments for execution according to a principle of prioritizing latest deadline, so that each task is ensured to be executed completely before a corresponding sub deadline. The method is utilized toconduct in-depth study on optimization scheduling and embodiment self-adaptive distribution and integration of workflow groups with deadlines locally and globally, so that the performance needs of theworkflow groups are met while resource utilization rate is increased, and execution cost expenditure is lowered.

Description

technical field [0001] The invention relates to the field of parallel and distributed high-performance computing, in particular to a workflow group scheduling method based on instance self-adaptive allocation and integration in a multi-cloud environment. Background technique [0002] In the cloud environment, the instance self-adaptive allocation and integrated scheduling mechanism needs to balance the performance requirements of the workflow group and the system cost expenditure. In the face of unpredictable workflow groups, the scheduling mechanism needs to ensure that the minimum amount of instance resources that the workflow group completes before the corresponding deadline is provided, and the tasks of the workflow are scheduled to be executed on the corresponding instance resources. In case of oversupply, redundant instances are shut down in time to reduce costs. In a multi-cloud environment, each cloud service provider provides many different types of instance resour...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/06G06Q10/10
CPCG06Q10/06312G06Q10/103
Inventor 林兵卢奕轩何志杰卢宇黄志高郭文忠
Owner FUJIAN NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products