27. Tensor Products

3y ago
67 Views
2 Downloads
240.97 KB
24 Pages
Last View : 23d ago
Last Download : 3m ago
Upload by : Baylee Stein
Transcription

27. Tensor ons, uniqueness, existenceFirst examplesTensor products f g of mapsExtension of scalars, functoriality, naturalityWorked examplesIn this first pass at tensor products, we will only consider tensor products of modules over commutativerings with identity. This is not at all a critical restriction, but does offer many simplifications, while stillilluminating many important features of tensor products and their applications.1. DesiderataIt is time to take stock of what we are missing in our development of linear algebra and related matters.Most recently, we are missing the proof of existence of determinants, although linear algebra is sufficient togive palatable proofs of the properties of determinants.We want to be able to give a direct and natural proof of the Cayley-Hamilton theorem (without using thestructure theorem for finitely-generated modules over PIDs). This example suggests that linear algebra overfields is insufficient.We want a sufficient conceptual situation to be able to finish the uniqueness part of the structure theorem forfinitely-generated modules over PIDs. Again, linear or multi-linear algebra over fields is surely insufficientfor this.We might want an antidote to the antique styles of discussion of vectors vi [sic], covectors v i [sic], mixedtensors Tkij , and other vague entities whose nature was supposedly specified by the number and patternof upper and lower subscripts. These often-ill-defined notions came into existence in the mid-to-late 19thcentury in the development of geometry. Perhaps the impressive point is that, even without adequatealgebraic grounding, people managed to envision and roughly formulate geometric notions.In a related vein, at the beginning of calculus of several variables, one finds ill-defined notions and ill-made389

390Tensor productsdistinctions betweendx dyanddx dywith the nature of the so-called differentials dx and dy even less clear. For a usually unspecified reason,dx dy dy dxthough perhapsdx dy dy dxIn other contexts, one may find confusion between the integration of differential forms versus integrationwith respect to a measure. We will not resolve all these confusions here, only the question of what a bmight mean.Even in fairly concrete linear algebra, the question of extension of scalars to convert a real vector space toa complex vector space is possibly mysterious. On one hand, if we are content to say that vectors are columnvectors or row vectors, then we might be equally content in allowing complex entries. For that matter, oncea basis for a real vector space is chosen, to write apparent linear combinations with complex coefficients(rather than merely real coefficients) is easy, as symbol manipulation. However, it is quite unclear whatmeaning can be attached to such expressions. Further, it is unclear what effect a different choice of basismight have on this process. Finally, without a choice of basis, these ad hoc notions of extension of scalarsare stymied. Instead, the construction below of the tensor productV Rof a real vectorspace V withC complexification of VC over R is exactly right, as will be discussed later.The notion of extension of scalars has important senses in situations which are qualitatively different thancomplexification of real vector spaces. For example, there are several reasons to want to convert abelian groupsA ( -modules) into -vectorspaces in some reasonable, natural manner. After explicating a minimalistnotion of reasonability, we will see that a tensor productZQA ZQis just right.There are many examples of application of the construction and universal properties of tensor products.

Garrett: Abstract Algebra3912. Definitions, uniqueness, existenceLet R be a commutative ring with 1. We will only consider R-modules M with the property [1] that 1·m mfor all m M . Let M , N , and X be R-modules. A mapB : M N Xis R-bilinear if it is R-linear separately in each argument, that is, ifB(m m0 , n) B(m, n) B(m0 , n)B(rm, n) r · B(m, n)B(m, n n0 ) B(m, n) B(m, n0 )B(m, rn) r · B(m, n)for all m, m0 M , n, n0 N , and r R.As in earlier discussion of free modules, and in discussion of polynomial rings as free algebras, we will definetensor products by mapping properties. This will allow us an easy proof that tensor products (if they exist)are unique up to unique isomorphism. Thus, whatever construction we contrive must inevitably yield thesame (or, better, equivalent) object. Then we give a modern construction.A tensor product of R-modules M , N is an R-module denoted M R N together with an R-bilinear mapτ : M N M R Nsuch that, for every R-bilinear mapϕ : M N Xthere is a unique linear mapΦ : M R N Xsuch that the diagramM O R HNHτM NHΦϕHH /Xcommutes, that is, ϕ Φ τ .The usual notation does not involve any symbol such as τ , but, rather, denotes the image τ (m n) of m nin the tensor product bym n image of m n in M R NIn practice, the implied R-bilinear mapM N M R Nis often left anonymous. This seldom causes serious problems, but we will be temporarily more careful aboutthis while setting things up and proving basic properties.The following proposition is typical of uniqueness proofs for objects defined by mapping propertyrequirements. Note that internal details of the objects involved play no role. Rather, the argument proceedsby manipulation of arrows.[1] Sometimes such a module M is said to be unital, but this terminology is not universal, and, thus, somewhatunreliable. Certainly the term is readily confused with other usages.

392Tensor products[2.0.1] Proposition: Tensor products M R N are unique up to unique isomorphism. That is, giventwo tensor productsτ1 : M N T1τ2 : M N T2there is a unique isomorphism i : T1 T2 such that the diagram6 T1nnnnnnnnnnnnniM NPPPPPPτP2PPPPPP (T2τ1commutes, that is, τ2 i τ1 .Proof: First, we show that for a tensor product τ : M N T , the only map f : T T compatiblewith τ is the identity. That is the identity map is the only map f such that6Tnnnnnτ nnnnnnnnfM NPPPPPPτPPPPPPP (Tcommutes. Indeed, the definition of a tensor product demands that, given the bilinear mapτ : M N T(with T in the place of the earlier X) there is a unique linear map Φ : T T such that the diagramTO P PP PΦPPτPPτ/( TM Ncommutes. The identity map on T certainly has this property, so is the only map T T with this property.Looking at two tensor products, first take τ2 : M N T2 in place of the ϕ : M N X. That is,there is a unique linear Φ1 : T1 T2 such thatTO 1 PPPP ΦP1τ1PPP'τ2/ T2M Ncommutes. Similarly, reversing the roles, there is a unique linear Φ2 : T2 T1 such thatTO 2 PPPP ΦP2τ2PPP'τ1/ T1M N

Garrett: Abstract Algebra393commutes. Then Φ2 Φ1 : T1 T1 is compatible with τ1 , so is the identity, from the first part of the proof.And, symmetrically, Φ1 Φ2 : T2 T2 is compatible with τ2 , so is the identity. Thus, the maps Φi aremutual inverses, so are isomorphisms.///For existence, we will give an argument in what might be viewed as an extravagant modern style. Itsextravagance is similar to that in E. Artin’s proof of the existence of algebraic closures of fields, in whichwe create an indeterminate for each irreducible polynomial, and look at the polynomial ring in these myriadindeterminates. In a similar spirit, the tensor product M R N will be created as a quotient of a truly hugemodule by an only slightly less-huge module.[2.0.2] Proposition: Tensor products M R N exist.Proof: Let i : M N F be the free R-module on the set M N . Let Y be the R-submodule generatedby all elementsi(m m0 , n) i(m, n) i(m0 , n)i(rm, n) r · i(m, n)i(m, n n0 ) i(m, n) i(m, n0 )i(m, rn) r · i(m, n)for all r R, m, m0 M , and n, n0 N . Letq : F F/Ybe the quotient map. We claim that τ q i : M N F/Y is a tensor product.Given a bilinear map ϕ : M N X, by properties of free modules there is a unique Ψ : F X suchthat the diagramFO P PP PΨPPiPPϕ/( XM Ncommutes. We claim that Ψ factors through F/Y , that is, that there is Φ : F/Y X such thatΨ Φ q : F XIndeed, since ϕ : M N X is bilinear, we conclude that, for example,ϕ(m m0 , n) ϕ(m, n) ϕ(m0 , n)Thus,(Ψ i)(m m0 , n) (Ψ i)(m, n) (Ψ i)(m0 , n)Thus, since Ψ is linear,Ψ( i(m m0 , n) i(m, n) i(m0 , n) ) 0A similar argument applies to all the generators of the submodule Y of F , so Ψ does factor through F/Y .Let Φ be the map such that Ψ Φ q.A similar argument on the generators for Y shows that the compositeτ q i : M N F/Yis bilinear, even though i was only a set map.The uniqueness of Ψ yields the uniqueness of Φ, since q is a surjection, as follows. For two maps Φ1 and Φ2withΦ1 q Ψ Φ 2 q

394Tensor productsgiven x F/Y let y F be such that q(y) x. ThenΦ1 (x) (Φ1 q)(y) Ψ(y) (Φ2 q)(y) Φ2 (x)Thus, Φ1 Φ2 .///[2.0.3] Remark: It is worthwhile to contemplate the many things we did not do to prove the uniquenessand the existence.Lest anyone think that tensor products M R N contain anything not implicitly determined by the behaviorof the monomial tensors [2] m n, we prove[2.0.4] Proposition: The monomial tensors m n (for m M and n N ) generate M R N as anR-module.Proof: Let X be the submodule of M R N generated by the monomial tensors, Q M R N )/X thequotient, and q : M R N Q the quotient map. LetB : M N Qbe the 0-map. A defining property of the tensor product is that there is a unique R-linearβ : M R N Qmaking the usual diagram commute, that is, such that B β τ , where τ : M N M R N . Both thequotient map q and the 0-map M R N Q allow the 0-map M N Q to factor through, so by theuniqueness the quotient map is the 0-map. That is, Q is the 0-module, so X M R N .///[2.0.5] Remark: Similarly, define the tensor productτ : M1 . . . Mn M1 R . . . R Mnof an arbitrary finite number of R-modules as an R-module and multilinear map τ such that, for any Rmultilinear mapϕ : M1 M2 . . . Mn Xthere is a unique R-linear mapΦ : M1 R M2 R . . . R Mn Xsuch that ϕ Φ τ . That is, the diagramM1 R M2 O R . . . U R MnU UU ΦUτU UU UϕU/*M1 M2 . . . MnXcommutes. There is the subordinate issue of proving associativity, namely, that there are naturalisomorphisms(M1 R . . . R Mn 1 ) R Mn M1 R (M2 R . . . R Mn )to be sure that we need not worry about parentheses.3. First examples[2] Again, m n is the image of m n M N in M N under the map τ : M N M N .RR

Garrett: Abstract Algebra395We want to illustrate the possibility of computing [3] tensor products without needing to make any use ofany suppositions about the internal structure of tensor products.First, we emphasize that to show that a tensor product M R N of two R-modules (where R is a commutativering with identity) is 0, it suffices to show that all monomial tensors are 0, since these generate the tensorproduct (as R-module). [4]Second, we emphasize [5] that in M R N , with r R, m M , and n N , we can always rearrange(rm) n r(m n) m (rn)Also, for r, s R,(r s)(m n) rm n sm n[3.0.1] Example: Let’s experiment [6] first with something likeZ/5 Z Z/7Even a novice may anticipate that the fact that 5 annihilates the left factor, while 7 annihilates the rightfactor, creates an interesting dramatic tension. What will come of this? For any m /5 and n /7, wecan do things like0 0 · (m n) (0 · m) n (5 · m) n m 5nZZand0 0 · (m n) m (0 · n) m (7 · n) 7m n 2m nThen(5m n) 2 · (2m n) (5 2 · 2)m n m nbut also(5m n) 2 · (2m n) 0 2 · 0 0That is, every monomial tensor inZ/5 Z Z/7 is 0, so the whole tensor product is 0.[3.0.2] Example: More systematically, given relatively prime integers [7] a, b, we claim thatZ/a Z Z/b 0Indeed, using the Euclidean-ness of Z, let r, s Z such that1 ra sb[3] Of course, it is unclear in what sense we are computing. In the simpler examples the tensor product is the 0module, which needs no further explanation. However, in other cases, we will see that a certain tensor product is theright answer to a natural question, without necessarily determining what the tensor product is in some other sense.[4] This was proven just above.[5] These are merely translations into this notation of part of the definition of the tensor product, but deserveemphasis.[6] Or pretend, disingenuously, that we don’t know what will happen? Still, some tangible numerical examples areworthwhile, much as a picture may be worth many words.Z. Further, a restated formworks for arbitrary commutative rings R with identity: given two ring elements a, b such that the ideal Ra Rbgenerated by both is the whole ring, we have R/a R R/b 0. The point is that this adjusted hypothesis again givesus r, s R such that 1 ra sb, and then the same argument works.[7] The same argument obviously works as stated in Euclidean rings R, rather than just

396Tensor productsThenm n 1 · (m n) (ra sb) · (m n) ra(m n) s b(m n) a(rm n) b(m sn) a · 0 b · 0 0Thus, every monomial tensor is 0, so the whole tensor product is 0.[3.0.3] Remark: Yes, it somehow not visible that these should be 0, since we probably think of tensorsare complicated objects, not likely to be 0. But this vanishing is an assertion that there are no non-zero-bilinear maps from /5 /7, which is a plausible more-structural assertion.ZZZ[3.0.4] Example: Refining the previous example: let a, b be arbitrary non-zero integers. We claim thatZ/a Z Z/b Z/gcd(a, b)First, take r, s Z such thatgcd(a, b) ra sbThen the same argument as above shows that this gcd annihilates every monomial(ra sb)(m n) r(am n) s(m bn) r · 0 s · 0 0Unlike the previous example, we are not entirely done, since we didn’t simply prove that the tensor productis 0. We need something like[3.0.5] Proposition: Let {mα : α A} be a set of generators for an R-module M , and {nβ : β B} aset of generators for an R-module N . Then{mα nβ : α A, β B}is a set of generators [8] for M R N .Proof: Since monomial tensors generate the tensor product, it suffices to show that every monomial tensoris expressible in terms of the mα nβ . Unsurprisingly, taking rα and sβ in R (0 for all but finitely-manyindices), by multilinearityXXX(rα mα ) (sβ nβ ) rα sβ mα nβαβα,βThis proves that the special monomials mα nβ generate the tensor product.ZZ///Z generates Z/b, the proposition assures usReturning to the example, since 1 a generates /a and 1 bthat 1 1 generates the tensor product. We already know thatgcd(a, b) · 1 1 0Thus, we know thatZ/a Z/b is isomorphic to some quotient of Z/gcd(a, b).But this does not preclude the possibility that something else is 0 for a reason we didn’t anticipate. Onemore ingredient is needed to prove the claim, namely exhibition of a sufficiently non-trivial bilinear mapto eliminate the possibility of any further collapsing. One might naturally contrive a -blinear map withformulaic expressionB(x, y) xy . . .Z[8] It would be unwise, and generally very difficult, to try to give generators and relations for tensor products.

Garrett: Abstract Algebra397but there may be some difficulty in intuiting where that xy resides. To understand this, we must bescrupulous about cosets, namelyZZZZZZZZ(x a ) · (y b ) xy ay bx ab xy a b xy gcd(a, b)That is, the bilinear map isZZZB : /a /b /gcd(a, b)By construction,ZB(1, 1) 1 /gcd(a, b)soZβ(1 1) B(1, 1) 1 /gcd(a, b)In particular, the map is a surjection. Thus, knowing that the tensor product is generated by 1 1, andthat this element has order dividing gcd(a, b), we find that it has order exactly gcd(a, b), so is isomorphic to/gcd(a, b), by the mapx y xyZ4. Tensor products fg of mapsStill R is a commutative ring with 1.An important type of map on a tensor product arises from pairs of R-linear maps on the modules in thetensor product. That is, letf : M M 0 g : N N 0be R-module maps, and attempt to definef g : M R N M 0 R N 0by(f g)(m n) f (m) g(n)Justifiably interested in being sure that this formula makes sense, we proceed as follows.If the map is well-defined then it is defined completely by its values on the monomial tensors, since thesegenerate the tensor product. To prove well-definedness, we invoke the defining property of the tensor product,by first considering a bilinear mapB : M N M 0 R N 0given byB(m n) f (m) g(n)To see that this bilinear map is well-defined, letτ 0 : M 0 N 0 M 0 R N 0For fixed n N , the compositem f (m) τ 0 (f (m), g(n)) f (m) g(n)is certainly an R-linear map in m. Similarly, for fixed m M ,n g(n) τ 0 (f (m), g(n)) f (m) g(n)

398Tensor productsis an R-linear map in n. Thus, B is an R-bilinear map, and the formula for f g expresses the inducedlinear map on the tensor product.Similarly, for an n-tuple of R-linear mapsfi : Mi Nithere is an associated linearf1 . . . fn : M1 . . . Mn N1 . . . Nn5. Extension of scalars, functoriality, naturalityHow to turn an R-module M into an S-module? [9] We assume that R and S are commutative rings withunit, and that there is a ring homomorphism α : R S such that α(1R ) 1S . For example the situationthat R S with 1R 1S is included. But also we want to allow not-injective maps, such as quotient maps /n. This makes S an R-algebra, byZZr · s α(r)sBefore describing the internal details of this conversion, we should tell what criteria it should meet. LetF : {R modules} {S modules}be this conversion. [10] Our main requirement is that for R-modules M and S-modules N , there should bea natural [11] isomorphism [12]HomS (F M, N ) HomR (M, N )where on the right side we forget that N is an S-module, remembering only the action of R on it. If we wantto make more explicit this forgetting, we can writeResSR N R-module obtained by forgetting S-module structure on Nand then, more carefully, write what we want for extension of scalars asHomS (F M, N ) HomR (M, ResSR N )[9] As an alert reader can guess, the anticipated answer involves tensor products. However, we can lend some dignityto the proceedings by explaining requirements that should be met, rather than merely contriving from an R-modulea thing that happens to be an S-module.[10] This F would be an example of a functor from the category of R-modules and R-module maps to thecategory of S-modules and S-module maps. To be a genuine functor, we should also tell how F converts Rmodule homomorphisms to S-module homomorphisms. We do not need to develop the formalities of category theoryjust now, so will not do so. In fact, direct development of a variety of such examples surely provides the only sensibleand genuine motivation for a later formal development of category theory.[11] This sense of natural will be made precise shortly. It is the same sort of naturality as discussed earlier in thesimplest example of second duals of finite-dimensional vector spaces over fields.[12] It suffices to consider the map as an isomorphism of abelian groups, but, in fact, the isomorphism potentiallymakes sense as an S-module map, if we give both sides S-module structures. For Φ HomS (F M, N ), there is anunambiguous and unsurprising S-module structure, namely (sΦ)(m0 ) s · Φ(m0 ) s · Φ(m0 ) for m0 F M and s S.For ϕ HomR (M, N ), since N does have the additional structure of S-module, we have (s · ϕ)(m) s · ϕ(m).

Garrett: Abstract Algebra399Though we’ll not use it much in the immediate sequel, this extra notation does have the virtue that it makesclear that something happened to the module N .This association of an S-module F M to an R-module M is not itself a module

RN) Xthe quotient, and q: M RN! Qthe quotient map. Let B: M N! Q be the 0-map. A de ning property of the tensor product is that there is a unique R-linear : M RN! Q making the usual diagram commute, that is, such that B , where : M N! M RN. Both the quotient map qand the 0-map M RN! Qallow the 0-map M N! Qto factor through, so by the .

Related Documents:

02 - tensor calculus 1 02 - tensor calculus - tensor algebra tensor calculus 2 tensor the word tensor was introduced in 1846 by william rowan hamilton . it was used in its current meaning by woldemar voigt in 1899. tensor calculus was deve-loped around 1890 by

LA, a tensor contraction, and a possible tensor contractions design using Einstein summation notation and a Domain Speci c Embedded Language (or DSEL ) . Right: Illustration of tensor contractions needed and viable approaches to solve them in machine learning. Figure 1 Left illustrates the notion of tensor and tensor contraction in DLA, as well .

on tensor decomposition, which aims to dissolve tensors into separable representations, while Song et al.(2019) reviewed tensor completion, which aims to impute the unobserved entries of a partially observed tensor. Tensor decomposition and tensor completion are both fundamen-tal problems i

tensor. Similarly, the vector is a rst order tensor, and a scalar is a zeroth order tensor. The order of the tensor equals the number of free indices (see SectionA.3) that the tensor has, and it can also be interpreted as the dimensionality of the array needed to represent the

Example 6.16 is the tensor product of the filter {1/4,1/2,1/4} with itself. While we have seen that the computational molecules from Chapter 1 can be written as tensor products, not all computational molecules can be written as tensor products: we need of course that

ADVANCED ALGEBRA Prof. Dr. B. Pareigis Winter Semester 2001/02 Table of Contents 1. Tensor Products and Free Modules 3 1.1. Modules 3 1.2. Tensor products I 5 1.3. Free modules 6 1.4. Tensor products II 8 1.5. Bimodules 9 1.6. Complexes and exact sequences 12 2. Algebras and Coalgebras 15 2.1. Algebras 15 2.2. Tensor algebras 17 2.3. Symmetric algebras 19 2.4.

§1.3. Tensor decomposition 11 §1.4. P v. NP and algebraic variants 17 §1.5. Algebraic Statistics and tensor networks 21 §1.6. Geometry and representation theory 24 Chapter 2. Multilinear algebra 27 §2.1. Rust removal exercises 28 §2.2. Groups and representations 30 §2.3. Tensor products 32 §2.4. The rank and border rank of a tensor 35 .

Concept of Tensor A TENSOR is an algebraic entity with various components which generalizes the concepts of scalar, vector and matrix. Many physical quantities are mathematically represented as tensors. Tensors are independent of any reference system but, by need, are commonly represented in one by means of their “component matrices”. The components of a tensor will depend on the