DCL Seminar: Kyriakos G. Vamvoudakis - A Control Learning Framework for Smart, Secure and Efficient Cyber-Physical Autonomy

Decision and Control Lecture Series

Coordinated Science Laboratory

 “A Control Learning Framework for Smart, Secure
and Efficient Cyber-Physical Autonomy”

Kyriakos G. Vamvoudakis, Ph.D.

Virginia Tech

Wednesday, March 14, 2018

3:00 p.m. to 4:00 p.m.

CSL Auditorium (B02)

____________________________________________________________________________________________________________________________________________________________________

Abstract:

Embedded sensors, computation, and communication have enabled the development of sophisticated control devices for a wide range of cyber-physical applications that include safety monitoring, surveillance, healthcare, motion planning, search and rescue, traffic monitoring, and power systems. However, the deployment of such devices has been slowed down by concerns regarding their sensitivity to modeling accuracy and their vulnerability to both stochastic failures and malicious attacks. Nowadays the efficiency will be defined by our potentials to adapt (complete autonomy) in decentralized, unknown and complex environments to enable capabilities beyond human limits. Until the achievement of such autonomy, cyber-physical technologies remain a critical issue. In the first part of the talk, I will combine methods from network security and control theory to design a new paradigm of proactive defense control mechanisms. For such a problem, we will define different modes of operation for the system that will let us isolate and identify suspicious actuators and sensors. Following the principles of moving target defense, we seek to maximize the unpredictability, quantified by the information entropy, in order to dynamically and stochastically switch the attack surface while optimally controlling the system. To better understand the behavior of the attackers that act on this system, a framework of bounded reasoning will be introduced to approximate the strategies utilized by attackers of different levels of intelligence. In the second part of the talk, I will present a novel model-free deep Q-learning control framework that will converge online, in real time to game-theoretic control solutions in the presence of persistent adversaries while guaranteeing closed-loop stability of the equilibrium point. The proposed approaches combine networked feedback control, game theory, network security, reinforcement learning, and serve as a tool for approaching difficult problems that without learning-based approaches are hard or impossible to solve.

Bio:

Kyriakos G. Vamvoudakis was born in Athens, Greece. He received the Diploma (a 5-year degree, equivalent to a Master of Science) in Electronic and Computer Engineering from Technical University of Crete, Greece in 2006 with highest honors. After moving to the United States of America, he studied at The University of Texas with Frank L. Lewis as his advisor and he received his M.S. and Ph.D. in 2008 and 2011 respectively. During the period from 2012 to 2016, he was a project research scientist at the Center for Control, Dynamical Systems and Computation (CCDC) at the University of California, Santa Barbara. He currently serves as an Assistant Professor at the Kevin T. Crofton Department of Aerospace and Ocean Engineering (AOE) at Virginia Tech. His research interests include learningbased control, game theory, autonomy, and cyber-physical security. He is coauthor of 1 patent, 15 book chapters, more than 100 technical publications, and 2 books; Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles (IET) and Complex Systems: Theory and Applications (Elsevier). Dr. Vamvoudakis is the recipient of several international awards including the 2016 International Neural Network Society Young Investigator (INNS) Award, the Best Paper Award for Autonomous/Unmanned Vehicles at the 27th Army Science Conference in 2010, the Best Presentation Award at the World Congress of Computational Intelligence in 2010, and the Best Researcher Award from the Automation and Robotics Research Institute in 2011. He is a member of Tau Beta Pi, Eta Kappa Nu and Golden Key honor societies and is listed in Who's Who in the World, Who's Who in Science and Engineering, and Who's Who in America. He has also served on various international program committees and has organized special sessions, tutorials and workshops for several international conferences. He currently is an Associate Editor of the IEEE Computational Intelligence Magazine, and of the Journal of Optimization Theory and Applications, and serves on the IEEE Control Systems Society Conference Editorial Board. He is a registered engineer (PE) and a member of the Technical Chamber of Greece. He is a Senior Member of IEEE.