The following interesting theorem bounds the "distance" between the eigenvalues of normal matrices using the Frobenius matrix norm.
Theorem [Hoffman-Wielandt 1953]: Let A and B be normal matrices with eigenvalues a1,⋯,an and b1,⋯,bn, respectively. There exists an ordering of the eigenvalues such that
∑i|ai−bi|2≤‖A−B‖2F
where ‖⋅‖F is the Frobenius matrix norm.
Let us look at the proof of this result from Ref. [1]. Note that ‖A‖F=tr(AA∗)=tr(A∗A) is unitarily invariant, i.e. if V and U are unitary matrices, then ‖UAV‖F=‖A‖F. Since both A and B are normal, A=VA0V∗ and B=WB0W∗ where V and W are unitary matrices and A0 and B0 are diagonal matrices of the eigenvalues of A and B respectively. By the unitarily invariant property of the Frobenius norm, ‖A−B‖F=‖VA0V∗−WB0W∗‖F=‖A0−V∗WB0W∗V‖F=‖A0−UB0U∗‖F where U=V∗W is a unitary matrix. Thus the Hoffman-Wielandt theorem states that among all unitary matrices U, ‖A0−UB0U∗‖F is minimized (not necessarily uniquely) when U is equal to a permutation matrix P. Now
‖A0−UB0U∗‖F=tr((A0−UB0U∗)(A∗0−UB∗0U∗))=tr(A0A∗0+B0B∗0)−tr(UB0U∗A∗0)−tr(A0UB∗0U∗)
Since UB0U∗A∗0 and A0UB∗0U∗ are conjugate of each other, this means that
‖A0−UB0U∗‖F=∑i|ai|2+|bi|2−2Re(tr(UB0U∗A∗0))
Next note that tr(UB0U∗A∗0)=∑ijbi¯ajuij¯uij and thus
Re(tr(UB0U∗A∗0))=∑ijRe(bi¯aj)xij
where xij=|uij|2. Since the rows and columns of U are orthonormal vectors, this implies that
X={xij} is a bi-stochastic matrix and minimizing ‖A0−UB0U∗‖F will result in a value no lower than minimizing the linear function ∑ijRe(bi¯aj)xij over the convex set of all bi-stochastic matrices X. By the definition of convexity, the value of a linear function of any point in the convex set is a convex combination of the values of the function evaluated at the vertices. This implies that the minimum value of a linear function over a convex set will be attained at a vertex. By the Birkhoff-von Neumann theorem, the set of vertices of the convex set of bi-stochastic matrices is exactly the set of permutation matrices and this means that the minimum occurs when X is a permutation matrix, i.e. the minimum is also achieved for ‖A0−UB0U∗‖F when U is a permutation matrix.
[1] A. J. Hoffman and H. W. Wielandt, "The variation of the spectrum of a normal matrix," Duke Mathematical Journal, vol. 20, no. 1 (1953), pp. 37-40.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment