Linear algebra/Orthogonal matrix

Alternative notations

$Q^{-1}=Q^{\mathrm{T}}$	$Q^{\mathrm{T}}Q=Q{Q}^{\mathrm{T}}=I$
${\underset{\_}{\underset{\_}{Q}}}^{-1}={\underset{\_}{\underset{\_}{Q}}}^{\mathrm{T}}$	${\underset{\_}{\underset{\_}{Q}}}^{\mathrm{T}}\cdot {\underset{\_}{\underset{\_}{Q}}}^{-1}={\underset{\_}{\underset{\_}{Q}}}^{-1}\cdot {\underset{\_}{\underset{\_}{Q}}}^{\mathrm{T}}=\underset{\_}{\underset{\_}{I}}$
$Q_{jk}^{-1}=Q_{kj}\equiv Q_{jk}^{\mathrm{T}}$	$\sum _k{Q}_{ki}{Q}_{kj}^{-1}=\sum _k{Q}_{ik}^{-1}{Q}_{jk}={\delta }_{ij}$

• This article contains excerpts from Wikipedia's Orthogonal matrix.
• If complex numbers are involved, see Unitary matrix.

A real square matrix is orthogonal (orthogonal) if and only if its columns form an orthonormal basis in a Euclidean space in which all numbers are real-valued and dot product is defined in the usual fashion. An orthonormal basis in an N dimensional space is one where, (1) all the basis vectors have unit magnitude.

Fundamental properties

• A real square matrix is orthogonal if and only if its columns form an orthonormal basis on the Euclidean space Template:Math, which is the case if and only if its rows form an orthonormal basis of Template:Math.
• The determinant of any orthogonal matrix is +1 or −1. But the converse is not true; having a determinant of ±1 is no guarantee of orthogonality. An orthogonal matrix with a determinant equal to +1 is called a special orthogonal matrix.
• An orthogonal matrix can always be diagonalized over the complex numbers to exhibit a full set of eigenvalues, all of which must have (complex) modulus 1.
• All permutation matrices are orthogonal (but the converse is not true.)
• All orthogonal matrices are unitary (but the converse is not true.)
• Under the operation of multiplication, the Template:Math orthogonal matrices form the orthogonal group known as Template:Math.

Visual understanding of multiplication by the transpose of a matrix. If A is an orthogonal matrix and B is its transpose, the ij-the element of the product AA^T=0 because the i-th row of A is orthogonal to the j-th row of A.

Three important results that are easy to prove

Among the first things a novice should learn are those that are easy to prove.

Orthonormal basis vectors are hiding in plain sight

Theorem:

• If the rows of a square matrix form an orthonormal set of (basis) vectors,

then the transpose of that matrix is its own inverse $({𝐌}^T={𝐌}^{-1})$

Visual understanding

Suppose the rows of a matrix form an orthonormal set of basis vectors, as shown in the i-th row in matrix A to the right. The ij-the element of the product AB takes the dot product of the i-th row of A with the j-th column of matrix B, as shown in the upper part of the diagram. in the diagram's upper part, the j-th column is higlighted in yellow. In the diagram's lower part, matrix B is replaced by it's transpose, which shifts the elements in column j to a row (highlighted in cyan.) This establishes that the product of A with the transpose of B creates elements that are the dot product of rows of A with rows of B.

If A is a orthogonal matrix and B is its transpose, this procedure creates matrix elements that are dot products among the rows of the orthogonal matrix.

Rigorous proof

This proof illustrates how subscripts are used to manipulate and understand tensors.

1. Suppose

${𝐯}_{𝐢}={\mathrm{\Sigma }}_j{v}_j{\widehat{𝐞}}_{𝐣}={\mathrm{\Sigma }}_j{M}_{ij}{\widehat{𝐞}}_{𝐣}$ is the i-th element of a orthonormal set of basis vectors.

Here ${\widehat{𝐞}}_{𝐣}$ are the original unit vectors used to define the new set of unit vectors that extract from the rows of matrix $\underset{\_}{\underset{\_}{𝐌}}$

2. Now we relabel how we write the sums for ${𝐯}_{𝐢}$ and ${𝐯}_{𝐣}$ as follows:

${𝐯}_{𝐢}={\mathrm{\Sigma }}_{\alpha }{M}_{i\alpha }{\widehat{𝐞}}_{\mathit{\alpha }}$

${𝐯}_{𝐣}={\mathrm{\Sigma }}_{\beta }{M}_{j\beta }{\widehat{𝐞}}_{\mathit{\beta }}$

Hint: In the first of these two equations, I replace $j$ by $\alpha$because summed variables can be changed at will. Sometimes they are called "dummy variables" because they "do not speak" after the sum is done. For example, summing n from 1 to 3 equals 1+2+3, which is the same as summing m from 1 to 3. In the second one I relabeled my dummy variable as $\beta$ because the same dummy variable cannot serve two purposes in a single expression.

3. This yields the following expression for the dot product between our two vectors:

${𝐯}_{𝐢}\cdot {𝐯}_{𝐣}\cdot =\left(\sum _{\alpha }{M}_{i\alpha }{\widehat{𝐞}}_{\mathit{\alpha }}\right)\cdot \left(\sum _{\beta }{M}_{j\beta }{\widehat{𝐞}}_{\mathit{\beta }}\right)$

${𝐯}_{𝐢}\cdot {𝐯}_{𝐣}\cdot =\left(\sum _{\alpha }{M}_{i\alpha }{\widehat{𝐞}}_{\mathit{\alpha }}\right)\cdot \left(\sum _{\beta }{M}_{j\beta }{\widehat{𝐞}}_{\mathit{\beta }}\right)=\sum _{\alpha \beta }({\widehat{𝐞}}_{\mathit{\alpha }}\cdot {\widehat{𝐞}}_{\mathit{\beta }})M_{i\alpha }{M}_{j\beta }$

4. This last term introduces the Kronecker delta symbol:

${𝐯}_{𝐢}\cdot {𝐯}_{𝐣}\cdot =\left(\sum _{\alpha }{M}_{i\alpha }{\widehat{𝐞}}_{\mathit{\alpha }}\right)\cdot \left(\sum _{\beta }{M}_{j\beta }{\widehat{𝐞}}_{\mathit{\beta }}\right)=\sum _{\alpha \beta }{M}_{i\alpha }{M}_{j\beta }\underset{{\delta }_{\alpha \beta }}{\underbrace{{\widehat{𝐞}}_{\mathit{\alpha }}\cdot {\widehat{𝐞}}_{\mathit{\beta }}}}=\sum _{\alpha }{M}_{i\alpha }{M}_{j\alpha }$

The last term almost looks like the product of the matrix with itself. It can be turned into a product using the transpose on the second term in the product, using $M_{j\alpha }=M_{\alpha j}^T.$

5. If $\underset{\_}{\underset{\_}{M}}$ is orthogonal, then ${\underset{\_}{\underset{\_}{M}}}^T={\underset{\_}{\underset{\_}{M}}}^{-1},$ and we conclude that the rows of $\underset{\_}{\underset{\_}{M}}$ (i.e., the vectors ${𝐯}_{𝐢})$ form an orthonormal collection of vectors (i.e. a "rotated" basis for the vector space.)

${𝐯}_{𝐢}\cdot {𝐯}_{𝐣}\cdot =\left(\sum _{\alpha }{M}_{i\alpha }{\widehat{𝐞}}_{\mathit{\alpha }}\right)\cdot \left(\sum _{\beta }{M}_{j\beta }{\widehat{𝐞}}_{\mathit{\beta }}\right)=\sum _{\alpha }{M}_{i\alpha }{M}_{j\alpha }=\sum _{\alpha }{M}_{i\alpha }{M}_{\alpha j}^T=\sum _{\alpha }{M}_{i\alpha }{M}_{\alpha j}^{-1}={\delta }_{ij}$

Change of basis for tensors

A common use of the orthogonal matrix is to express a vector in one reference frame into a "rotated" frame.

Here, we let $\underset{\_}{\underset{\_}{M}}$ denote any matrix (i.e. "tensor"), while $\underset{\_}{\underset{\_}{R}}$ is any orthogonal matrix (typically a rotation.) Let $\underset{\_}{v}$ and $\underset{\_}{p}$ be two vectors, and let ${\underset{\_}{v}}^{\prime }$ and ${\underset{\_}{p}}^{\prime }$ represent the same vectors in a rotated reference frame.

Theorem

• If   ${\underset{\_}{v}}^{\prime }=\underset{\_}{\underset{\_}{R}}\cdot \underset{\_}{v}$,   then:  ${\underset{\_}{\underset{\_}{M}}}^{\prime }=\underset{\_}{\underset{\_}{R}}\cdot \underset{\_}{\underset{\_}{M}}\cdot {\underset{\_}{\underset{\_}{R}}}^{-1}$

Proof

1. Define $\underset{\_}{p}=\underset{\_}{\underset{\_}{M}}\cdot \underset{\_}{v}.$
2. Assume ${\underset{\_}{v}}^{\prime }=\underset{\_}{\underset{\_}{R}}\cdot \underset{\_}{v}$ and ${\underset{\_}{p}}^{\prime }=\underset{\_}{\underset{\_}{R}}\cdot \underset{\_}{p}.$
3. Do some tensor algebra and express ${\underset{\_}{p}}^{\prime }$ in terms of ${\underset{\_}{v}}^{\prime }.$

In this context, the only difference between the tensor and scalar algebras is that with tensors, vector's do not always commute: $\underset{\_}{\underset{\_}{A}}\cdot \underset{\_}{\underset{\_}{B}}-\underset{\_}{\underset{\_}{B}}\cdot \underset{\_}{\underset{\_}{A}}$ does not always vanish.

Derivation of the rotation tensor

Rotation of basis vectors. Since it is an active transformation this sign on $\theta$ is opposite to the the case for rotating a point.

This image illustrates a proof for a passive transformation, based on the rules for the sine and cosine of the sum of two angles.

The rotation matrix usually the first orthogonal matrix students encounter. While it is conceptually easier to rotate vectors than to rotate a coordinate system, it is algebraically easier to rotate a coordinate system. From the figure, the unit vectors in a rotated reference frame obey:

$$\begin{array}{cccc}\hat{x}=& {\hat{x}}^{\prime }\cos \theta -{\hat{y}}^{\prime }\sin \theta & \hat{y}=& {\hat{x}}^{\prime }\sin \theta +{\hat{y}}^{\prime }\cos \theta \end{array}$$

Students will quickly see the sine and cosine components in this equation, but the minus sign might seem confusing. It comes from the fact that $\hat{x}$ has a negative component when projected along the ${\hat{y}}^{\prime }$ direction. Now express the vector $\underset{\_}{V}$, first in the unprimed coordinate system, then in primed:

$$\underset{\_}{V}=V_x\hat{x}+{\underset{\_}{V}}_y\hat{y}$$

To complete the proof, substitute the expressions that expressed the $(\hat{x},\hat{y})$ unit vectors in terms of the $({\hat{x}}^{\prime },{\hat{y}}^{\prime })$ unit vectors:

$$\underset{\_}{V}=V_x\stackrel{\hat{x}}{\overbrace{({\hat{x}}^{\prime }\cos \theta -{\hat{y}}^{\prime }\sin \theta )}}+V_y\stackrel{\hat{y}}{\overbrace{({\hat{x}}^{\prime }\sin \theta +{\hat{y}}^{\prime }\cos \theta )}}$$ $$\underset{\_}{V}=+V_x{\hat{x}}^{\prime }\cos \theta -V_x{\hat{y}}^{\prime }\sin \theta +V_y{\hat{x}}^{\prime }\sin \theta +V_y{\hat{y}}^{\prime }\cos \theta$$

$$\underset{\_}{V}=+\underset{{V_x}^{\prime }}{\underbrace{(V_x\cos \theta +V_y\sin \theta )}}{\hat{x}}^{\prime }+\underset{{V_x}^{\prime }}{\underbrace{(-V_x\sin \theta +V_y\cos \theta )}}{\hat{y}}^{\prime }$$

This latter expression solves our problem, as we were seeking an expression of the form, $\underset{\_}{V}={V_x}^{\prime }{\hat{x}}^{\prime }+{V_y}^{\prime }{\hat{y}}^{\prime }.$

Note how in this formalism, there is no distinction between the primed and unprimed vector $\underset{\_}{V}.$ This tends to confuse everyone, including the author. Such confusion can be avoided when writing a textbook or article. But in the free-wheeling world of both scientific literature, as well as wikis, such chaos cannot be avoided. That's why it is good to carefully read books.

Going back to the notation of many WMF pages, we have the following formula for the components of a vector if the coordinate system is rotated by $\theta$ about the z axis: $$\left[\begin{array}{c}V{\text{'}}_x\\ V{\text{'}}_y\end{array}\right]=\left[\begin{array}{cc}\cos \theta & \sin \theta \\ -\sin \theta & \cos \theta \end{array}\right]\left[\begin{array}{c}{V}_x\\ V_y\end{array}\right]$$

See also

• Linear algebra/Orthogonal matrix
• Coordinate transformations
• Tensors/Transformation rule under a change of basis
• w:Rotation matrix

Notes

Template:Linear algebra/Rotation of axes