Communication Dans Un Congrès Année : 2020

Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning

Communications Pub / Sub améliorées pour un trafic IoT massif avec l'apprentissage par renforcement SARSA

Carlos E Arruda
  • Fonction : Auteur
  • PersonId : 1089774
Pedro F Moraes
  • Fonction : Auteur
  • PersonId : 1089775
Joberto S B Martins

Résumé

Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart cities, intelligent traffic systems, smart grid, and e-health. Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data. However, cloud, edge, and fog-based solutions need to tackle the distribution of a high volume of IoT data efficiently through constrained and limited resource network infrastructures. This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources (bandwidth) using a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm. The proposed network infrastructure (PSIoTRL) uses a Publish/ Subscribe architecture to access massive and highly distributed IoT data. It is demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on SARSA enhances the IoT aggregator buffer occupation and network link utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing according to the Pub/Sub topic's priority and network constraint requirements.
Fichier principal
Vignette du fichier
2020_Paper___MLN___Paris___Final_Submission___HAL.pdf (438.05 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03126086 , version 1 (30-01-2021)

Licence

Identifiants

Citer

Carlos E Arruda, Pedro F Moraes, Nazim Agoulmine, Joberto S B Martins. Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning. 3rd International Conference on Machine Learning for Networking (MLN 2020), Paul Mühlethaler and Éric Renault; Selma Boumerdassi and Éric Renault, Nov 2020, Paris, France. pp.204-225, ⟨10.5281/zenodo.4413404⟩. ⟨hal-03126086⟩
61 Consultations
62 Téléchargements

Altmetric

Partager

More