Joint spectral radius

In mathematics, the joint spectral radius is a generalization of the classical notion of spectral radius of a matrix, to sets of matrices. In recent years this notion has found applications in a large number of engineering fields and is still a topic of active research.

General description

The joint spectral radius of a set of matrices is the maximal asymptotic growth rate of products of matrices taken in that set. For a finite (or more generally compact) set of matrices ${\mathcal {M}}=\{A_{1},\dots ,A_{m}\}\subset \mathbb {R} ^{n\times n},$ the joint spectral radius is defined as follows:

\rho ({\mathcal {M}})=\lim _{k\to \infty }\max {\{\|A_{i_{1}}\cdots A_{i_{k}}\|^{1/k}:A_{i}\in {\mathcal {M}}\}}.\,

It can be proved that the limit exists and that the quantity actually does not depend on the chosen matrix norm (this is true for any norm but particularly easy to see if the norm is sub-multiplicative). The joint spectral radius was introduced in 1960 by Gian-Carlo Rota and Gilbert Strang,^[1] two mathematicians from MIT, but started attracting attention with the work of Ingrid Daubechies and Jeffrey Lagarias.^[2] They showed that the joint spectral radius can be used to describe smoothness properties of certain wavelet functions.^[3] A wide number of applications have been proposed since then. It is known that the joint spectral radius quantity is NP-hard to compute or to approximate, even when the set ${\mathcal {M}}$ consists of only two matrices with all nonzero entries of the two matrices which are constrained to be equal.^[4] Moreover, the question " $\rho \leq 1?$ " is an undecidable problem.^[5] Nevertheless, in recent years much progress has been done on its understanding, and it appears that in practice the joint spectral radius can often be computed to satisfactory precision, and that it moreover can bring interesting insight in engineering and mathematical problems.

Computation

Approximation algorithms

In spite of the negative theoretical results on the joint spectral radius computability, methods have been proposed that perform well in practice. Algorithms are even known, which can reach an arbitrary accuracy in an a priori computable amount of time. These algorithms can be seen as trying to approximate the unit ball of a particular vector norm, called the extremal norm.^[6] One generally distinguishes between two families of such algorithms: the first family, called polytope norm methods, construct the extremal norm by computing long trajectories of points.^[7]^[8] An advantage of these methods is that in the favorable cases it can find the exact value of the joint spectral radius and provide a certificate that this is the exact value.

The second family of methods approximate the extremal norm with modern optimization techniques, such as ellipsoid norm approximation,^[9] semidefinite programming,^[10]^[11] Sum Of Squares,^[12] and conic programming.^[13] The advantage of these methods is that they are easy to implement, and in practice, they provide in general the best bounds on the joint spectral radius.

The finiteness conjecture

Related to the computability of the joint spectral radius is the following conjecture:^[14]

"For any finite set of matrices ${\mathcal {M}}\subset \mathbb {R} ^{n\times n},$ there is a product $A_{1}\dots A_{t}$ of matrices in this set such that

\rho ({\mathcal {M}})=\rho (A_{1}\dots A_{t})^{1/t}.

"

In the above equation " $\rho (A_{1}\dots A_{t})$ " refers to the classical spectral radius of the matrix $A_{1}\dots A_{t}.$

This conjecture, proposed in 1995, was proven to be false in 2003.^[15] The counterexample provided in that reference uses advanced measure-theoretical ideas. Subsequently, many other counterexamples have been provided, including an elementary counterexample that uses simple combinatorial properties matrices ^[16] and a counterexample based on dynamical systems properties.^[17] Recently an explicit counterexample has been proposed in.^[18] Many questions related to this conjecture are still open, as for instance the question of knowing whether it holds for pairs of binary matrices.^[19]^[20]

Applications

The joint spectral radius was introduced for its interpretation as a stability condition for discrete-time switching dynamical systems. Indeed, the system defined by the equations

x_{t+1}=A_{t}x_{t},\quad A_{t}\in {\mathcal {M}}\,\forall t

is stable if and only if $\rho ({\mathcal {M}})<1.$

The joint spectral radius became popular when Ingrid Daubechies and Jeffrey Lagarias showed that it rules the continuity of certain wavelet functions. Since then, it has found many applications, ranging from number theory to information theory, autonomous agents consensus, combinatorics on words,...

Related notions

The joint spectral radius is the generalization of the spectral radius of a matrix for a set of several matrices. However, many more quantities can be defined when considering a set of matrices: The joint spectral subradius characterizes the minimal rate of growth of products in the semigroup generated by ${\mathcal {M}}$ . The p-radius characterizes the rate of growth of the $L_{p}$ average of the norms of the products in the semigroup. The Lyapunov exponent of the set of matrices characterizes the rate of growth of the geometric average.

References

^ G. C. Rota and G. Strang. "A note on the joint spectral radius." Proceedings of the Netherlands Academy, 22:379–381, 1960. [1]
^ Vincent D. Blondel. The birth of the joint spectral radius: an interview with Gilbert Strang. Linear Algebra and its Applications, 428:10, pp. 2261–2264, 2008.
^ I. Daubechies and J. C. Lagarias. "Two-scale difference equations. ii. local regularity, infinite products of matrices and fractals." SIAM Journal of Mathematical Analysis, 23, pp. 1031–1079, 1992.
^ J. N. Tsitsiklis and V. D. Blondel. "Lyapunov Exponents of Pairs of Matrices, a Correction." Mathematics of Control, Signals, and Systems, 10, p. 381, 1997.
^ Vincent D. Blondel, John N. Tsitsiklis. "The boundedness of all products of a pair of matrices is undecidable." Systems and Control Letters, 41:2, pp. 135–140, 2000.
^ N. Barabanov. "Lyapunov indicators of discrete inclusions i–iii." Automation and Remote Control, 49:152–157, 283–287, 558–565, 1988.
^ V. Y. Protasov. "The joint spectral radius and invariant sets of linear operators." Fundamentalnaya i prikladnaya matematika, 2(1):205–231, 1996.
^ N. Guglielmi, F. Wirth, and M. Zennaro. "Complex polytope extremality results for families of matrices." SIAM Journal on Matrix Analysis and Applications, 27(3):721–743, 2005.
^ Vincent D. Blondel, Yurii Nesterov and Jacques Theys, On the accuracy of the ellipsoid norm approximation of the joint spectral radius, Linear Algebra and its Applications, 394:1, pp. 91–107, 2005.
^ T. Ando and M.-H. Shih. "Simultaneous contractibility." SIAM Journal on Matrix Analysis and Applications, 19(2):487–498, 1998.
^ V. D. Blondel and Y. Nesterov. "Computationally efficient approximations of the joint spectral radius." SIAM Journal of Matrix Analysis, 27(1):256–272, 2005.
^ P. Parrilo and A. Jadbabaie. "Approximation of the joint spectral radius using sum of squares." Linear Algebra and its Applications, 428(10):2385–2402, 2008.
^ V. Protasov, R. M. Jungers, and V. D. Blondel. "Joint spectral characteristics of matrices: a conic programming approach." SIAM Journal on Matrix Analysis and Applications, 2008.
^ J. C. Lagarias and Y. Wang. "The finiteness conjecture for the generalized spectral radius of a set of matrices." Linear Algebra and its Applications, 214:17–42, 1995.
^ T. Bousch and J. Mairesse. "Asymptotic height optimization for topical IFS, Tetris heaps, and the finiteness conjecture." Journal of the American Mathematical Society, 15(1):77–111, 2002.
^ V. D. Blondel, J. Theys and A. A. Vladimirov, An elementary counterexample to the finiteness conjecture, SIAM Journal on Matrix Analysis, 24:4, pp. 963–970, 2003.
^ V. Kozyakin Structure of Extremal Trajectories of Discrete Linear Systems and the Finiteness Conjecture, Automat. Remote Control, 68 (2007), no. 1, 174–209/
^ Kevin G. Hare, Ian D. Morris, Nikita Sidorov, Jacques Theys. An explicit counterexample to the Lagarias–Wang finiteness conjecture, Advances in Mathematics, 226, pp. 4667-4701, 2011.
^ A. Cicone, N. Guglielmi, S. Serra Capizzano, and M. Zennaro. "Finiteness property of pairs of 2 × 2 sign-matrices via real extremal polytope norms." Linear Algebra and its Applications, 2010.
^ R. M. Jungers and V. D. Blondel. "On the finiteness property for rational matrices." Linear Algebra and its Applications, 428(10):2283–2295, 2008.