Mario Sznaier, PhD
Title: “Easy, hard or convex?: the role of sparsity and structure in learning dynamical models”
Abstract: Arguably, one of the hardest challenges faced now by the dynamical systems community stems from the exponential explosion in the availability of data, fueled by recent advances in sensing and actuation capabilities. Simply stated, classical techniques are ill-equipped to handle very large volumes of (heterogeneous) data, due to poor scaling properties, and to impose the structural constraints required to implement ubiquitous sensing and control. For example, the powerful Linear Matrix Inequality framework developed in the past 20 years and associated semidefinite program-based methods have proven very successful in providing global solutions to many control and identification problems. However, in many cases, these methods break down when considering problems involving just a few hundred data points. On the other hand, several in-principle non-convex problems (e.gidentification and robust control of classes of switched systems) can be efficiently solved in cases involving large amounts of data. Thus the traditional convex/non-convex dichotomy may fail to completely capture the intrinsic difficulty of some problems.
The goal of this talk is to explore how this “curse of dimensionality” can be potentially overcome by exploiting the twin “blessings” of self-similarity(high degree of Spatio-temporal correlation in the data) and inherent underlying sparsity, and to answer the question of”what is Big Data in dynamical systems theory?”.While these ideas have already been recently used in machine learning (for instance in the context of dimensionality reduction and variable selection), they have hitherto not been fully exploited in systems theory. By appealing to a deep connection to semi-algebraic optimization, rank minimization, and matrix completion we will show that, in the context of systems theory, the limiting factor is given by the “memory” of the system rather than the size of the data itself, and discuss the implications of this fact. These concepts will be illustrated by examining examples of”easy” and “hard” problems, including identification and control of hybrid systems and (in)validation of switched models. We will conclude the talk by exploring the connection between hybrid systems identification, information extraction, and machine learning, and point out to new research directions in systems theory and in machine learning motivated by these problems.
Bio: Mario Sznaieris currently the Dennis Picard Chaired Professor at the Electrical and Computer Engineering Department, Northeastern University, Boston. Prior to joining Northeastern University, Dr. Sznaierwas a Professor of Electrical Engineering at the Pennsylvania State University and also held visiting positions at the California Institute of Technology. His research interest include robust identification and control of hybrid systems, robust optimization, and dynamical vision. Dr. Sznaieris currently serving as an associate editor for the journal Automaticaand as chair of the IFAC Technical Committee on Robust Control. Past recent service include Program Chair of the 2017 IEEE Conf. on Decision and Control, General Chair of the 2016 IEEE Multi Systems Conference, Chair of theIEEE Control Systems Society Technical Committee on Computational Aspects of Control Systems Design (2013-2017),Executive Director of the IEEECSS (2007-2011) andmember of the Board of Governors of the CSS (2006-2014). He is a distinguished member of the IEEE Control Systems Societyand a Fellow of the IEEE for his contributions to robust control, identification and dynamic vision. A list of publications and current research projects can be found at: https://nam02.safelinks.protection.outlook.com/?url=http%3A%2F%2Frobustsystems.coe.neu.edu%2F&data=04%7C01%7Cjsulam1%40jhu.edu%7Cc568d7e5a82f414e8e4508d8cc50bc47%7C9fa4f438b1e6473b803f86f8aedf0dec%7C0%7C0%7C637483994418193664%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=2ngKt8DuptQ9d2M7QVeM5wvURHtKesMpAgueOo4hwNM%3D&reserved=0