Jump to Navigation

A Representation Learning Method for Linear Dynamical System Identification

Mahdi Karami

Mr. Mahdi Karami is a Ph.D. student in the department of electrical and computer engineering, University of Alberta, Canada. He is working in the area of statistical machine learning and signal processing;  and his Ph.D. project is on optimal linear dynamical system identification using representation learning techniques. His main research interests are statistical machine learning, time-series analysis, convex optimization and signal processing  for communications. Mr. Karami has obtained his B.Sc. in electrical engineering with honor from Isfahan University of technology in 2005 and his M.Sc. from the University of Tehran in the field of Communications in 2008.

A Representation Learning Method for Linear Dynamical System Identification
مسئول برگزاری: محمد حسین منشئی
محل: سالن اجتماعات دانشکده برق و کامپیوتر / تاریخ: 1395-10-22 / زمان: 1:30 بعدازظهر

In this talk, I will first introduce representation learning and new insights into efficiently learning data representations in a convex fashion. In particular, a globally optimal and computationally efficient  algorithm will be presented for the problem of matrix completion, dictionary learning and multi-view learning. In the second part of the talk, new techniques for analysis of time series data will be presented. I consider maximum likelihood estimation of linear dynamical systems (LDS). Maximum likelihood is typically considered to be hard in this setting, since both the latent states and transition parameters need to be inferred jointly.
Given that expectation-maximization does not scale and is prone to local minima, moment matching approaches from the subspace identification literature have become the standard methods for linear dynamical system estimation, despite known issues with their statistical efficiency. In this paper, I instead reconsider likelihood maximization and develop a new global estimation strategy that can simultaneously recover the latent states and transition parameters. The key insight is a two-view reformulation of maximum likelihood estimation for linear dynamical systems that enables the use of recent boosting algorithms for matrix factorization. I show that the proposed estimation strategy outperforms N4SID, a widely used subspace identification model, both in terms of accuracy and runtime. Part of this work has been presented in the NIPS time series workshop in December 2016 and was awarded the best poster of the workshop.



Seminars | by Dr. Radut

ارتقاء امنیت وب با وف بومی آسپا-وف