Multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning

A multi-path transmission and reinforcement learning technology, applied in the field of multi-path transmission control protocols, can solve the problems of inability to adapt to complex and diverse dynamic network environments, MPTCP performance degradation, etc., to achieve the effect of improving optimization efficiency and speeding up training

Active Publication Date: 2019-09-24
NANJING UNIV
View PDF4 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

This patented technology allows companies or organizations to efficiently train their own machine learning algorithms that can handle complicated networks with varying environmental factors such as bandwidth usage patterns over different periods during operation. It also uses advanced techniques like Deep Learning (DL) and Artificial Intelligence (Al), which help improve its effectiveness even more effectively than traditional methods.

Problems solved by technology

Technologies described in this patents involve optimizing communication between devices over wireless local area networks (WLAN). These techniques aim to optimize resource usage while maximizing system efficiency without compromising any important factors like latency or jitter. One technique called MultiPath Transport Scheme (MTPS)-based Time Division Multiple Access protocol (TDMA PON) uses a combination of Random Interval Repeated Packet Sequencing (RISC)/Minirculate Network Reflective Algorithm (MINTRA) and Fast Retransformer (FRS) algorithms to efficiently allocate resources across WLAN connections. Another approach involves selecting certain paths based on their importance to ensure fair allocation of data streams within specific subnet boundaries.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning
  • Multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning
  • Multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings. It should be understood that the embodiments provided below are only intended to disclose the present invention in detail and completely, and fully convey the technical concept of the present invention to those skilled in the art. The present invention can also be implemented in many different forms, and does not Limited to the embodiments described herein. The terms used in the exemplary embodiments shown in the drawings do not limit the present invention.

[0026] figure 1 It is a frame diagram of the multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning. As shown in the figure, in order to improve the learning efficiency of the strategy, the present invention uses the Actor-Critic reinforcement learning framework and adopts the deep reinforcement learning algorithm based on the policy gradie

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-path transmission control protocol data packet scheduling method based on deep reinforcement learning. In a multi-path transmission control protocol (MPTCP), a data packet scheduling process is converted into a Markov decision process by setting a periodic scheduling mechanism, a data packet scheduling strategy of the MPTCP is represented by a neural network through deep reinforcement learning, and an optimal data packet scheduling strategy under various network environments is learned. The problem that heuristic MPTCP data packet scheduling cannot adapt to complex and diverse dynamic network environments, and consequently MPTCP performance is reduced is fundamentally solved. According to the method, an Actor-Critic reinforcement learning framework is used, a deep reinforcement learning algorithm based on strategy gradient is adopted, and modeling and learning are directly carried out on an MPTCP data packet scheduling strategy, so that strategy optimization efficiency is improved, and training of an MPTCP data packet scheduling strategy neural network is accelerated.

Description

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products