Séminaire de Martin Cousineau11h00 | Polytech Angers |salle 10 | 62 Notre Dame du Lac - 49000 Angers

Le 5 juillet 2024

Sujet : Deep Reinforcement Learning for Electric Vehicle Fleet Management and Gamified Routing.

Résumé

In this presentation, we delve into the realm of deep reinforcement learning (DRL) and its applications in transportation problems, encompassing two distinct projects. The first project tackles the intricate problem of managing a fleet of electric vehicles in a ride-hailing service. Here, the primary objective for the operator is to maximize profit, which involves the strategic assignment of vehicles to incoming requests and the foresighted management of recharging and repositioning for future demands. To address this, we have developed advanced policies using DRL, leveraging Q-value approximations learned through deep neural networks. Our approach stands in comparison to a reoptimization-based policy and against dual bounds on the value of an optimal policy, including the value of an optimal policy with perfect information, which we establish using a Benders-based decomposition. Empirical assessments, utilizing real-world data from Manhattan, New York City, affirm that our DRL-trained policies surpass traditional reoptimization methods in performance and demonstrate scalability to larger instances without the need for retraining. The second project presents a novel modeling technique for research problems, conceptualizing them as Atari-like video games. This method aligns seamlessly with the advances in DRL. Our flexible and innovative approach is applicable across a wide array of problem domains and is demonstrated through its application in a well-known vehicle routing problem, i.e., the vehicle routing problem with stochastic service requests. The results from this project show potential and suggest that this ‘gamification’ could be a valuable modeling tool for researchers engaged in problems involving sequential decision-making under uncertain conditions.

Martin Cousineau is an assistant professor in the Department of Logistics and Operations Management at HEC Montréal and a professor of the Institute for Data Valorization (IVADO). He is a co-head researcher of the Sustainable Health research theme of the International Observatory on the Societal Impacts of AI and Digital Technology (OBVIA) and a member of the Interuniversity Research Centre on Enterprise Networks, Logistics and Transportation (CIRRELT). He is specialized in methods at the intersection of operations research and artificial intelligence, with applications to logistics, transportation and healthcare