Tensors/Calculations with index notation

Mathematics

Tensor

This article presumes that the reader has read Tensors/Bases, components, and dual spaces.

In this article, all vector spaces are real and finite-dimensional.

Tensors allow a certain level of abstraction to help apply what mathematicians have learned about linear algebra. Tensors afford a cleaner notation to represent complex linear relationships at a more abstract level. This article explains the index notation, thereby giving the reader a feeling for the power of using tensors.

Definition of the components

We begin with the observation, from the preceding article in this series, that, once a basis $\hat{x}$, $\hat{y}$, $\hat{z}$ for the vector space has been chosen (giving rise to the natural basis $\hat{e}$, $\hat{f}$, $\hat{g}$ for the form space), the components of a vector of form are just the results of operating on the appropriate basis items. For vectors:

$V^1=\hat{e}(V)$

$V^2=\hat{f}(V)$

$V^3=\hat{g}(V)$

For forms:

${\mathrm{\Phi }}_1=\mathrm{\Phi }(\hat{x})$

${\mathrm{\Phi }}_2=\mathrm{\Phi }(\hat{y})$

${\mathrm{\Phi }}_3=\mathrm{\Phi }(\hat{z})$

This covers all 1^st rank tensors, covariant or contravariant. We can extend this to higher-rank tensors. If $\mathrm{\Omega }$ is a 2^nd rank covariant tensor (that is, a bilinear form), it is completely determined by the results of applying it to all combinations of basis vectors. (Why? Because it is determined by the result of its application to pairs of vectors, those vectors can be broken down into combinations of basis vectors, and $\mathrm{\Omega }$ is linear.)

So we can call those results the components of the tensor:

${\mathrm{\Omega }}_{11}=\mathrm{\Omega }(\hat{x},\hat{x}){\mathrm{\Omega }}_{12}=\mathrm{\Omega }(\hat{x},\hat{y}){\mathrm{\Omega }}_{13}=\mathrm{\Omega }(\hat{x},\hat{z})$

${\mathrm{\Omega }}_{21}=\mathrm{\Omega }(\hat{y},\hat{x}){\mathrm{\Omega }}_{22}=\mathrm{\Omega }(\hat{y},\hat{y}){\mathrm{\Omega }}_{23}=\mathrm{\Omega }(\hat{y},\hat{z})$

${\mathrm{\Omega }}_{31}=\mathrm{\Omega }(\hat{z},\hat{x}){\mathrm{\Omega }}_{32}=\mathrm{\Omega }(\hat{z},\hat{y}){\mathrm{\Omega }}_{33}=\mathrm{\Omega }(\hat{z},\hat{z})$

The numbers ${\mathrm{\Omega }}_{11}\dots {\mathrm{\Omega }}_{33}$ are the components of $\mathrm{\Omega }$. It follows that the space of 2^nd rank tensors is 9-dimensional. In the general case, the space of K^th rank tensors on an underlying N-dimensional space is of dimension N^K.

We can work out the formula for evaluating tensor operations in terms of the components. We already have, from the preceding article, that, if $\mathrm{\Phi }$ is a form and V is a vector:

$\mathrm{\Phi }(V)=\sum _{i=1}^3{\mathrm{\Phi }}_i{V}^i$

In the case of a bilinear form $\mathrm{\Omega }$,

$\mathrm{\Omega }(V,W)=\mathrm{\Omega }(V^1\hat{x}+V^2\hat{y}+V^3\hat{z},W^1\hat{x}+W^2\hat{y}+W^3\hat{z})$

$=V^1{W}^1\mathrm{\Omega }(\hat{x},\hat{x})+V^1{W}^2\mathrm{\Omega }(\hat{x},\hat{y})+V^1{W}^3\mathrm{\Omega }(\hat{x},\hat{z})$

$+V^2{W}^1\mathrm{\Omega }(\hat{y},\hat{x})+V^2{W}^2\mathrm{\Omega }(\hat{y},\hat{y})+V^2{W}^3\mathrm{\Omega }(\hat{y},\hat{z})$

$+V^3{W}^1\mathrm{\Omega }(\hat{z},\hat{x})+V^3{W}^2\mathrm{\Omega }(\hat{z},\hat{y})+V^3{W}^3\mathrm{\Omega }(\hat{z},\hat{z})$

$=V^1{W}^1{\mathrm{\Omega }}_{11}+V^1{W}^2{\mathrm{\Omega }}_{12}+V^1{W}^3{\mathrm{\Omega }}_{13}$

$+V^2{W}^1{\mathrm{\Omega }}_{21}+V^2{W}^2{\mathrm{\Omega }}_{22}+V^2{W}^3{\mathrm{\Omega }}_{23}$

$+V^3{W}^1{\mathrm{\Omega }}_{31}+V^3{W}^2{\mathrm{\Omega }}_{32}+V^3{W}^3{\mathrm{\Omega }}_{33}$

$=\sum _{i,j=1}^3{\mathrm{\Omega }}_{ij}{V}^i{W}^j$

We can similarly work out the formula for the operation of a 2^nd rank mixed tensor $T$ on a form and a vector. The components of $T$ are, as always, defined by the action on basis forms and basis vectors:

$T_1^1=T(\hat{e},\hat{x})T_2^1=T(\hat{e},\hat{y})T_3^1=T(\hat{e},\hat{z})$

$T_1^2=T(\hat{f},\hat{x})T_2^2=T(\hat{f},\hat{y})T_3^2=T(\hat{f},\hat{z})$

$T_1^3=T(\hat{g},\hat{x})T_2^3=T(\hat{g},\hat{y})T_3^3=T(\hat{g},\hat{z})$

The numbers $T_1^1\dots T_3^3$ are the components of $T$.

As before:

$T(\mathrm{\Phi },V)=T({\mathrm{\Phi }}_1\hat{e}+{\mathrm{\Phi }}_2\hat{f}+{\mathrm{\Phi }}_3\hat{g},V^1\hat{x}+V^2\hat{y}+V^3\hat{z})$

$={\mathrm{\Phi }}_1{V}^{1}T(\hat{e},\hat{x})+{\mathrm{\Phi }}_1{V}^{2}T(\hat{e},\hat{y})+{\mathrm{\Phi }}_1{V}^{3}T(\hat{e},\hat{z})$

$+{\mathrm{\Phi }}_2{V}^{1}T(\hat{f},\hat{x})+{\mathrm{\Phi }}_2{V}^{2}T(\hat{f},\hat{y})+{\mathrm{\Phi }}_2{V}^{3}T(\hat{f},\hat{z})$

$+{\mathrm{\Phi }}_3{V}^{1}T(\hat{g},\hat{x})+{\mathrm{\Phi }}_3{V}^{2}T(\hat{g},\hat{y})+{\mathrm{\Phi }}_3{V}^{3}T(\hat{g},\hat{z})$

$={\mathrm{\Phi }}_1{V}^1{T}_1^1+{\mathrm{\Phi }}_1{V}^2{T}_2^1+{\mathrm{\Phi }}_1{V}^3{T}_3^1$

$+{\mathrm{\Phi }}_2{V}^1{T}_1^2+{\mathrm{\Phi }}_2{V}^2{T}_2^2+{\mathrm{\Phi }}_2{V}^3{T}_3^2$

$+{\mathrm{\Phi }}_3{V}^1{T}_1^3+{\mathrm{\Phi }}_3{V}^2{T}_2^3+{\mathrm{\Phi }}_3{V}^3{T}_3^3$

$=\sum _{i,j=1}^3{T}_j^i{\mathrm{\Phi }}_i{V}^j$

Linear transformations (mixed tensors)

A linear transformation A, that is, a linear function that maps vectors into vectors, is essentially the same as a 2^nd rank mixed tensor. A is the same as the tensor T that was analyzed above, so

$\mathrm{\Phi }(A(V))=T(\mathrm{\Phi },V)=\sum _{i,j=1}^3{T}_j^i{\mathrm{\Phi }}_i{V}^j=\sum _{i,j=1}^3{\mathrm{\Phi }}_i{A}_j^i{V}^j$

The converse is also true—If T is a mixed tensor, then there is a linear transformation A, having the same components, such that

$\mathrm{\Phi }(A(V))=T(\mathrm{\Phi },V)$    for all linear forms $\mathrm{\Phi }$.

The proof is just like the proof of the "double dual" theorem of the preceding article.

Now since

$\mathrm{\Phi }(A(V))=\sum _{i=1}^3{\mathrm{\Phi }}_i{(A(V))}^i=\sum _{i=1}^3{\mathrm{\Phi }}_i\left(\sum _{j=1}^3{A}_j^i{V}^j\right)$    for all values of ${\mathrm{\Phi }}_i$

it must be true that

${(A(V))}^i=\sum _{j=1}^3{A}_j^i{V}^j$    for all i.

This tells us how to calculate the result of a linear transformation A on a vector V, using the components of the equivalent tensor T.

Generalization to arbitrary rank

In the general case, if we have, say, a 4^th rank tensor (1 covariant, 3 contravariant), we define the components (all 81 of them in 3 dimensions) as

${\mathrm{\Theta }}_2^{231}=\mathrm{\Theta }(\hat{y},\hat{f},\hat{g},\hat{e})$    etc., 81 equations in all.

And we can evaluate the tensor on 4 arguments by

$\mathrm{\Theta }(V,\mathrm{\Phi },\mathrm{\Psi },\mathrm{\Lambda })=\sum _{i,j,k,l=1}^3{\mathrm{\Theta }}_i^{jkl}{V}^i{\mathrm{\Phi }}_j{\mathrm{\Psi }}_k{\mathrm{\Lambda }}_l$

The reader has no doubt noticed that we are following the convention that indices are written as subscripts for covariant and superscripts for contravariant.

Pure index notation

At this point, we can stop dealing with with the basis vectors and forms. We used them to define the components, but we now do all calculations directly from the components. This means that we can do everything with numerical indices, without worrying about running out of letters. We can also let the dimensionality of the space be anything, not just 3. (In relativity, it is 4.)

The formulas we have gathered so far look like these:

$\mathrm{\Phi }(V)=\sum _{i=1}^N{\mathrm{\Phi }}_i{V}^i$

$\mathrm{\Omega }(V,W)=\sum _{i,j=1}^N{\mathrm{\Omega }}_{ij}{V}^i{W}^j$

$T(\mathrm{\Phi },V)=\sum _{i,j=1}^N{T}_j^i{\mathrm{\Phi }}_i{V}^j$

${(A(V))}^i=\sum _{j=1}^N{A}_j^i{V}^j$

$\mathrm{\Theta }(V,\mathrm{\Phi },\mathrm{\Psi },\mathrm{\Lambda })=\sum _{i,j,k,l=1}^N{\mathrm{\Theta }}_i^{jkl}{V}^i{\mathrm{\Phi }}_j{\mathrm{\Psi }}_k{\mathrm{\Lambda }}_l$

These formulas are examples of the famous index notation for tensors.

Einstein summation

Summations such as these, with a summation index appearing once in a superscript and once in a subscript, are extremely common in tensor calculations. The Einstein summation convention, named after Albert Einstein, who struggled with tensors when he was developing General Relativity, says that one can leave out the summation; it is implicit.

$\mathrm{\Phi }(V)={\mathrm{\Phi }}_i{V}^i$

$\mathrm{\Omega }(V,W)={\mathrm{\Omega }}_{ij}{V}^i{W}^j$

$T(\mathrm{\Phi },V)=T_j^i{\mathrm{\Phi }}_i{V}^j$

${(A(V))}^i=A_j^i{V}^j$

$\mathrm{\Theta }(V,\mathrm{\Phi },\mathrm{\Psi },\mathrm{\Lambda })={\mathrm{\Theta }}_i^{jkl}{V}^i{\mathrm{\Phi }}_j{\mathrm{\Psi }}_k{\mathrm{\Lambda }}_l$

People doing serious tensor work make one other simplification—they don't bother with the left-hand-sides of the above equations. They treat the right-hand-sides as though they are the actual operations. That is,

${\mathrm{\Phi }}_i{V}^i$

literally means the application of the form $\mathrm{\Phi }$ to the vector $V$. It's not just a shorthand formula telling how to calculate $\mathrm{\Phi }(V)$, it actually denotes the operation.

${\mathrm{\Omega }}_{ij}{V}^i{W}^j$

literally means the application of the bilinear form $\mathrm{\Omega }$ to the vector $V$ and $W$.

How can we tell that ${\mathrm{\Omega }}_{ij}$ is a 2^nd rank covariant tensor? Because it has two subscripts. Similarly, $V^i$ is a vector because it has one superscript. The number and position of superscripts and subscripts on a symbol indicate its rank and covariance. By being careful with the positions of superscripts and subscripts, the notation is expressive and unambiguous.

The rules for tensor equations are that indices in any term that appear once in a superscript and once in a subscript use the Einstein summation convention. When terms are added, or terms appear on both sides of an equation, the unsummed indices must match, and there is an implicit "for all" applying to them.

Another example of a tensor equation would be

$V^i=3W^i+X^i$

meaning that $V=3W+X$ as vectors.

Conventional notation for linear transformations

There is one more thing to notice about linear transformations. There is a conventional notation for describing them, in terms of matrices. The standard formula in conventional notation is that if

$W=A(V)$

then

$W_i=\sum _{j=1}^N{A}_{i,j}{V}_j$

where $A_{i,j}$ is the matrix of the transformation A. In the tensor formalism,

$W^i=A_j^i{V}^j=\sum _{j=1}^N{A}_j^i{V}^j$

so, aside from the fact that the superscript/subscript issue only applies in tensor notation,

$A_{i,j}$  (conventional notation)  $=A_j^i$  (tensor notation)

The next article in this series is Tensors/Transformation rule under a change of basis.

See also

• Tensors/Definitions
• Tensors/Bases, components, and dual spaces
• Tensors/Transformation rule under a change of basis

External links

• Brown University