Processing math: 100%

Friday, June 6, 2014

The Hoffman-Wielandt theorem

The following interesting theorem bounds the "distance" between the eigenvalues of normal matrices using the Frobenius matrix norm.

Theorem [Hoffman-Wielandt 1953]: Let A and B be normal matrices with eigenvalues a1,,an and b1,,bn, respectively.  There exists an ordering of the eigenvalues such that
i|aibi|2AB2F
where F is the Frobenius matrix norm.

Let us look at the proof of this result from Ref. [1].  Note that AF=tr(AA)=tr(AA) is unitarily invariant, i.e. if V and U are unitary matrices, then UAVF=AF.  Since both A and B are normal, A=VA0V and B=WB0W where V and W are unitary matrices and A0 and B0 are diagonal matrices of the eigenvalues of A and B respectively.  By the unitarily invariant property of the Frobenius norm,  ABF=VA0VWB0WF=A0VWB0WVF=A0UB0UF where U=VW is a unitary matrix.  Thus the Hoffman-Wielandt theorem states that among all unitary matrices U,  A0UB0UF is minimized (not necessarily uniquely) when U is equal to a permutation matrix P.  Now
A0UB0UF=tr((A0UB0U)(A0UB0U))=tr(A0A0+B0B0)tr(UB0UA0)tr(A0UB0U)
Since UB0UA0 and A0UB0U are conjugate of each other, this means that
A0UB0UF=i|ai|2+|bi|22Re(tr(UB0UA0))
Next note that tr(UB0UA0)=ijbi¯ajuij¯uij and thus
Re(tr(UB0UA0))=ijRe(bi¯aj)xij
where xij=|uij|2.  Since the rows and columns of U are orthonormal vectors, this implies that
X={xij} is a bi-stochastic matrix and minimizing  A0UB0UF will result in a value no lower than minimizing the linear function ijRe(bi¯aj)xij over the convex set of all bi-stochastic matrices X.  By the definition of convexity, the value of a linear function of any point in the convex set is a convex combination of the values of the function evaluated at the vertices.  This implies that the minimum value of a linear function over a convex set will be attained at a vertex.  By the Birkhoff-von Neumann theorem, the set of vertices of  the convex set of bi-stochastic matrices is exactly the set of  permutation matrices and this means that the minimum occurs when X is a permutation matrix, i.e. the minimum is also achieved for A0UB0UF when U is a permutation matrix.

[1] A. J. Hoffman and H. W. Wielandt, "The variation of the spectrum of a normal matrix," Duke Mathematical Journal, vol. 20, no. 1 (1953), pp. 37-40.

No comments:

Post a Comment