Spectral norm

The spectral norm of a matrix is defined as

It can be shown that, when is a square matrix, this is equivalent to maximizing

The conceptual interpretation is that, if a matrix is seen as linear combination of ‘amplifications’ (its eigenvectors), then the spectral norm is the maximum possible ‘amplification’ that it can achieve.