1st Edition

Recursive Identification and Parameter Estimation

By Han-Fu Chen, Wenxiao Zhao Copyright 2014
    429 Pages 75 B/W Illustrations
    by CRC Press

    430 Pages 75 B/W Illustrations
    by CRC Press

    Recursive Identification and Parameter Estimation describes a recursive approach to solving system identification and parameter estimation problems arising from diverse areas. Supplying rigorous theoretical analysis, it presents the material and proposed algorithms in a manner that makes it easy to understand—providing readers with the modeling and identification skills required for successful theoretical research and effective application.

    The book begins by introducing the basic concepts of probability theory, including martingales, martingale difference sequences, Markov chains, mixing processes, and stationary processes. Next, it discusses the root-seeking problem for functions, starting with the classic RM algorithm, but with attention mainly paid to the stochastic approximation algorithms with expanding truncations (SAAWET) which serves as the basic tool for recursively solving the problems addressed in the book.

    The book not only identifies the results of system identification and parameter estimation, but also demonstrates how to apply the proposed approaches for addressing problems in a range of areas, including:

    • Identification of ARMAX systems without imposing restrictive conditions
    • Identification of typical nonlinear systems
    • Optimal adaptive tracking
    • Consensus of multi-agents systems
    • Principal component analysis
    • Distributed randomized PageRank computation

    This book recursively identifies autoregressive and moving average with exogenous input (ARMAX) and discusses the identification of non-linear systems. It concludes by addressing the problems arising from different areas that are solved by SAAWET. Demonstrating how to apply the proposed approaches to solve problems across a range of areas, the book is suitable for students, researchers, and engineers working in systems and control, signal processing, communication, and mathematical statistics.

    Dependent Random Vectors
    Some Concepts of Probability Theory
    Independent Random Variables, Martingales, and Martingale Difference Sequences
    Markov Chains with State Space (Rm;Bm)
    Mixing Random Processes
    Stationary Processes
    Notes and References

    Recursive Parameter Estimation
    Parameter Estimation as Root-Seeking for Functions
    Classical Stochastic Approximation Method: RM Algorithm
    Stochastic Approximation Algorithm with Expanding Truncations
    SAAWET with Nonadditive Noise
    Linear Regression Functions
    Convergence Rate of SAAWET
    Notes and References

    Recursive Identification for ARMAX Systems
    LS and ELS for Linear Systems
    Estimation Errors of LS/ELS
    Hankel Matrices Associated with ARMA
    Coefficient Identification of ARMAX by SAAWET
    Order Estimation of ARMAX
    Multivariate Linear EIV Systems
    Notes and References

    Recursive Identification for Nonlinear Systems
    Recursive Identification of Hammerstein Systems
    Recursive Identification of Wiener Systems
    Recursive Identification of Wiener–Hammerstein Systems
    Recursive Identification of EIV Hammerstein Systems
    Recursive Identification of EIV Wiener Systems
    Recursive Identification of Nonlinear ARX Systems
    Notes and References

    Other Problems Reducible to Parameter Estimation
    Principal Component Analysis
    Consensus of Networked Agents
    Adaptive Regulation for Hammerstein and Wiener Systems
    Convergence of Distributed Randomized PageRank Algorithms
    Notes and References

    Appendices:

    Proof of Some Theorems in Chapter 1
    Nonnegative Matrices

    References
    Index

    Biography

    Han-Fu Chen graduated from the Leningrad (St. Petersburg) State University and joined the Institute of Mathematics, Chinese Academy of Sciences (CAS). Since 1979, he has been with the Institute of Systems Science, being now a part of the Academy of Mathematics and Systems Science, CAS. He is a professor of the Key Laboratory of Systems and Control of CAS. His research interests are mainly in stochastic systems, including system identification, adaptive control, and stochastic approximation and its applications to systems, control, and signal processing. He authored and coauthored more than 200 journal papers and seven books.

    Han-Fu Chen served as an IFAC Council member (2002–2005), president of the Chinese Association of Automation (1993–2002), and a permanent member of the Council of the Chinese Mathematics Society (1991–1999). He is an IEEE fellow, IFAC fellow, a member of TWAS, and a member of CAS.

    Wenxiao Zhao received his BSc degree from the Department of Mathematics, Shandong University, China in 2003 and the PhD degree from the Institute of Systems Science, AMSS, the Chinese Academy of Sciences (CAS) in 2008. After this he was a postdoctoral student at the Department of Automation, Tsinghua University.

    During this period he visited the University of Western Sydney, Australia, for nine months. Then, Dr. Zhao joined the Institute of Systems Sciences, CAS in 2010. He now is with the Key Laboratory of Systems and Control, CAS as an associate professor. His research interests are in system identification, adaptive control, and system biology. He serves as the general secretary of the IEEE Control Systems Beijing Chapter and an associate editor of the Journal of Systems Science and Mathematical Sciences