Q-learning based Routing Scheduling for a Multi-Task Autonomous Agent

Omar Bouhamed, Hakim Ghazzai, Hichem Besbes, Yehia Massoud

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations


In this paper, we design a routing scheduling framework for multi-task agent using reinforcement learning. The objective is to employ an autonomous agent to cover the maximum of pre-scheduled tasks spatially and temporally distributed in a given geographical area over a pre-determined period of time. In this approach, we train the agent using Q-learning (QL), an off-policy temporal difference learning algorithm, that finds effective near-optimal solutions. The agent uses the feedback received from previously taken decisions to learn and adapt its next actions accordingly. A customized reward function was developed to consider the time windows of task and the delays caused by agent navigation between tasks. Numerical simulations show the behavior of the autonomous agent for different selected scenarios and corroborate the ability of QL to handle complex vehicle routing problems with several constraints.
Original languageEnglish (US)
Title of host publicationMidwest Symposium on Circuits and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages4
ISBN (Print)9781728127880
StatePublished - Aug 1 2019
Externally publishedYes

Bibliographical note

Generated from Scopus record by KAUST IRTS on 2022-09-13


Dive into the research topics of 'Q-learning based Routing Scheduling for a Multi-Task Autonomous Agent'. Together they form a unique fingerprint.

Cite this