Eigenvalue decomposition rewrites a square matrix in terms of its eigenvalues and eigenvectors. This cheat sheet helps college students follow worked examples without losing track of the algebra. It is especially useful for diagonalizing matrices, solving repeated matrix powers, and understanding symmetric matrices.
The focus is on clear steps, common patterns, and checks that confirm the decomposition is correct.
The main goal is to express a matrix as when enough linearly independent eigenvectors exist. The columns of are eigenvectors, and contains the corresponding eigenvalues on its diagonal. For a real symmetric matrix, the stronger form uses orthonormal eigenvectors.
Worked examples usually begin with , then solve for each eigenspace.
Key Facts
- An eigenvalue and nonzero eigenvector satisfy .
- Eigenvalues are found from the characteristic equation .
- For each eigenvalue , eigenvectors come from the null space equation .
- A matrix is diagonalizable when it has linearly independent eigenvectors for an matrix.
- If and , then .
- Matrix powers are easier after diagonalization because , where .
- A real symmetric matrix has an orthogonal eigenvalue decomposition , where .
- The trace and determinant provide checks because and .
Vocabulary
- Eigenvalue
- An eigenvalue is a scalar that tells how much an eigenvector is stretched or reversed by a matrix transformation.
- Eigenvector
- An eigenvector is a nonzero vector whose direction is unchanged by the transformation, so .
- Characteristic Polynomial
- The characteristic polynomial is , whose roots are the eigenvalues of .
- Diagonalization
- Diagonalization is the process of writing a matrix as using a basis of eigenvectors.
- Eigenspace
- The eigenspace for is the set of all vectors satisfying , including .
- Orthogonal Diagonalization
- Orthogonal diagonalization writes a real symmetric matrix as using orthonormal eigenvectors.
Common Mistakes to Avoid
- Using in one step and in another, then mixing signs, is wrong because inconsistent characteristic polynomials can change intermediate coefficients.
- Forgetting that eigenvectors cannot be is wrong because holds for every and gives no direction information.
- Putting eigenvalues in in a different order than the eigenvectors in is wrong because each column must match the diagonal entry .
- Assuming repeated eigenvalues always give enough eigenvectors is wrong because algebraic multiplicity can be larger than geometric multiplicity.
- Using instead of without checking orthonormality is wrong because only when .
Practice Questions
- 1 Find the eigenvalues of using .
- 2 For , find eigenvectors for each eigenvalue and write if possible.
- 3 Given with , compute and explain how it helps find .
- 4 Explain why a real symmetric matrix can be diagonalized using orthonormal eigenvectors, and describe why this makes easier to use than .
Understanding Eigenvalue Decomposition Worked Examples
A worked example is easiest to manage when every eigenvalue is kept paired with its own eigenvector from the start. Suppose a two by two matrix has eigenvalues three and negative one. After finding a vector for the value three, place that vector in the first column of the change of basis matrix.
Put the value three in the first diagonal position. Do the same for negative one in the second column and second diagonal position.
This matching matters. A correct pair placed in the wrong order creates a decomposition that fails when multiplied back together.
Repeated eigenvalues need extra care. An eigenvalue may occur twice in the characteristic polynomial, yet its eigenspace may contain only one independent direction. In that case, there are not enough eigenvectors to build a full basis.
Students often assume that repeated roots automatically give repeated eigenvectors. They do not. Row reduction reveals the number of free variables in the null space.
That number is the dimension of the eigenspace. For a two by two matrix with one repeated eigenvalue, two independent eigenvectors are needed for ordinary diagonalization. If only one appears, the matrix has a different near diagonal form called a Jordan form, which is studied later in many courses.
The geometric meaning helps explain why the method works. A matrix can stretch, shrink, reverse, or rotate vectors. Eigenvectors identify directions that are not turned away from their line.
The associated eigenvalue tells how the length and direction change along that line. A negative value reverses direction. A zero value sends the eigenvector direction to the zero vector, so the matrix cannot have an inverse.
Values with absolute size greater than one grow under repeated multiplication. Values with absolute size less than one fade away. This appears in population models, web page ranking, vibration patterns, image compression, and systems that change step by step over time.
Good checking prevents most algebra mistakes. First verify each proposed vector by multiplying the original matrix by it. The result must equal the stated eigenvalue times that vector.
Next check that the vectors used as columns are independent. For a square change of basis matrix, a nonzero determinant confirms this. Finally, reconstruct the original matrix from the factors.
Trace and determinant are useful quick checks, but they are not enough by themselves because different matrices can share both values. For symmetric real matrices, normalize each eigenvector and check that different eigenvectors have dot product zero. This makes the inverse especially simple because it is the transpose, reducing both computation and rounding error.