Tensor Product - Tensor Product of Vector Spaces

Tensor Product of Vector Spaces

The tensor product V ⊗_K W of two vector spaces V and W over a field K can be defined by the method of generators and relations. (The tensor product is often denoted V ⊗ W when the underlying field K is understood.)

To construct V ⊗ W, one begins with the set of ordered pairs in the Cartesian product V × W. For the purposes of this construction, regard this Cartesian product as a set rather than a vector space. The free vector space F on V × W is defined by taking the vector space in which the elements of V × W are a basis. In set-builder notation,

where we have used the symbol e_(v,w) to emphasize that these are taken to be linearly independent by definition for distinct (v, w) ∈ V × W.

The tensor product arises by defining the following four equivalence relations in F(V × W):

where v, v₁ and v₂ are vectors from V, while w, w₁, and w₂ are vectors from W, and c is from the underlying field K. Denoting by R the space generated by these four equivalence relations, the tensor product of the two vector spaces V and W is then the quotient space

It is also called the tensor product space of V and W and is a vector space (which can be verified by directly checking the vector space axioms). The tensor product of two elements v and w is the equivalence class (e_(v,w) + R) of e_(v,w) in V ⊗ W, denoted v ⊗ w. This notation can somewhat obscure the fact that tensors are always cosets: manipulations performed via the representatives (v,w) must always be checked that they do not depend on the particular choice of representative.

The space R is mapped to zero in V ⊗ W, so that the above three equivalence relations become equalities in the tensor product space:

Given bases {v_i} and {w_i} for V and W respectively, the tensors {v_i ⊗ w_j} form a basis for V ⊗ W. The dimension of the tensor product therefore is the product of dimensions of the original spaces; for instance Rm ⊗ Rn will have dimension mn.

Elements of V ⊗ W are sometimes referred to as tensors, although this term refers to many other related concepts as well. An element of V ⊗ W of the form v ⊗ w is called a pure or simple tensor. In general, an element of the tensor product space is not a pure tensor, but rather a finite linear combination of pure tensors. That is to say, if v₁ and v₂ are linearly independent, and w₁ and w₂ are also linearly independent, then v₁ ⊗ w₁ + v₂ ⊗ w₂ cannot be written as a pure tensor. The number of simple tensors required to express an element of a tensor product is called the tensor rank, (not to be confused with tensor order, which is the number of spaces one has taken the product of, in this case 2; in notation, the number of indices) and for linear operators or matrices, thought of as (1,1) tensors (elements of the space V ⊗ V*), it agrees with matrix rank.