Event
Ph.D. Dissertation Defense: Erfaun Noorani
Friday, June 30, 2023
2:00 p.m.
AVW1146
Emily Irwin
301 405 0680
eirwin@umd.edu
ANNOUNCEMENT: Ph.D. Dissertation Defense
Name: Erfaun Noorani
Committee:
Professor John S. Baras (Chair)
Professor Eyad Abed
Professor Kaiqing Zhang
Professor Sanghamitra Dutta
Professor Michael C. Fu, Dean's Representative
Date/Time: Friday, June 30th, 2023, 2:00 pm - 4:00 pm
Location: A.V. Williams Building, Room 1146
Title: "Robust Reinforcement Learning via Risk-Sensitivity"
Abstract:
This research aims to develop robust-resilient-adaptive Reinforcement Learning (RL) systems that are generic, provide performance guarantees, and can generalize-reason-improve in complex and unknown task environments. To achieve this objective, we focus on exploring the concept of risk-sensitive RL and its extensions to Multi-Agent (MA) systems. The development of resilient reinforcement learning algorithms is crucial to address challenges such as model misspecification, parameter uncertainty, disturbances, and more. Risk-sensitive methods offer an approach to developing robust RL algorithms by hedging against undesirable outcomes in a probabilistic manner. The robustness properties of risk-sensitive controllers have long been established. We investigate risk-sensitive RL (as a generalization of risk-sensitive stochastic control), by theoretically analyzing the risk-sensitive exponential (exponential of the total reward) criteria and the benefits and improvements the introduction of risk-sensitivity brings to conventional RL.