navbox:information-theory

(edit) Topics in Information Theory and Control Theory (📁) Entropy Shannon entropy • Conditional entropy • Mutual Information • Joint entropy • Relative entropy • Rényi entropy • Tsallis entropy • Hartley's measure • Transfer entropy Information Geometry Fisher information (metric) • Exponential family • Kullback–Leibler divergence • Bregman divergence • f-divergence • Statistical divergence • Amari's alpha-divergence • Information manifold • Statistical structure • Cramér-Rao bound Model Selection Maximum likelihood estimation • Parameter space • Likelihood function (log-likelihood) • Bayesian inference • Akaike Information Criterion (AIC) • Bayesian Information Criterion (BIC) • Cross-validation • Bootstrap method • Minimum description length Network Information Theory Multiuser information theory • Broadcast channels • Multiple-access channels • Interference channels • Relay channels • Network coding • Slepian-Wolf coding Algorithmic Information Theory Kolmogorov complexity • Kolmogorov invariance theorem • Algorithmic probability • Chaitin's constant • Solomonoff's theory of inductive inference • Universal Turing machine Quantum Information Theory Quantum entropy • Quantum mutual information • Quantum channel capacity • Quantum error correction • Quantum cryptography Coding Theory Source Coding Shannon's source coding theorem • Huffman coding • Arithmetic coding • LZW coding • Run-length encoding • Golomb coding • Kraft-McMillan Inequality Channel Coding Shannon's channel coding theorem • Error detection and correction • Hamming codes • Reed-Solomon codes • Turbo codes • Convolutional codes • LDPC codes • Viterbi algorithm State Spaces State variables • State-transition matrix • Controllability • Observability • Stability • Kalman filter • Luenberger observer • Covariance intersection • Sensor fusion Control Theory Classical Transfer functions • Block diagrams • PID controllers • Root locus • Bode plots • Nyquist stability criterion • Routh-Hurwitz stability criterion Optimal Pontryagin's maximum principle • Hamilton-Jacobi-Bellman equation • Linear-quadratic regulator (LQR) • Dynamic programming • Model-predictive control Robust H-infinity methods • Sliding mode control • Robust stability • Uncertainty modeling • Youla–Kucera parametrization Adaptive Model reference adaptive control (MRAC) • Self-tuning regulator • Adaptive observers • Gain scheduling Nonlinear Feedback linearization • Backstepping • Passivity-based control • Lyapunov stability • Nonlinear system identification Stochastic Wiener filter • Stochastic optimal control • Markov decision processes • Stochastic stability • Stochastic differential equations Networks Networked Control System Architectures • Time Delay Systems • Multi-Agent Networks Applications Process control (Robotics, Aerospace, Automotive) • Biological Systems