Unit #20 : Directional Derivatives And The Gradient

Unit #20 :Directional Derivatives and the GradientGoals: To learn about dot and scalar products of vectors. To introduce the directional derivative and the gradient vector. To learn how to compute the gradient vector and how it relates to the directionalderivative. To explore how the gradient vector relates to contours.

Vector Multiplication - 1Vector MultiplicationUnlike for addition and subtraction, vector quantities differ from scalars in thatvector multiplication can be defined in several ways. There are twosuch operations that we will need to use: scalar multiplication dot productScalar multiplication: λ v combines a scalar, e.g. λ, with a vector, e.g. v to produce a new vector,λ v . the magnitude of the new vector is λ times the original vector length e.g. 2 v v v twice as long as the original. If λ 0, λ v is a vector in the same direction as v If λ 0, λ v is a vector in the opposite direction as v

Vector Multiplication - 2Example: Choose a vector v and then draw 2 v , 0 v , and ( 1.5) v .

Vector Multiplication - 3Example:form: 2 v , 0 v , and ( 1.5) v .For the vector v h5, 2i, express the following in component

Vector Multiplication - 4Linearity of Vector OperationsAddition, subtraction, and scalar multiplication all obey consistent rules of operation familiar from your experience with scalar operations. These properties aresummarized on page 617 of Hughes-Hallett. For convenience we repeat them here.Commutativity v w w vDistributivity(λ µ) v λ v µ vλ( v w) λ v λw Associativity u ( v w) ( u v ) w Identity1 v v , v 0 v0 v 0Note that for any vector v , ( 1) v is a vector with the same magnitude/length as v and opposite direction.Because of this property we write ( 1) v v .

Dot Product - Angle Definition - 1Dot Product of Vectors: v · w Remember that the scalar product multiplies a scalar times a vector.Another possible multiplication between two vectors is called the dot product.The dot product combines two vectors, e.g. v , w to produce a scalar, v · w If θ [0, π] is the angle between two vectors v and w, then v · w v w cos(θ)Question: Use this definition to find i · i.(a) -1(b) 0(c) 1(d) 2

Dot Product - Angle Definition - 2 v · w v w cos(θ)Question: Use this definition to find i · j.(a) -1(b) 0(c) 1(d) 2

Dot Product - Angle Definition - 3 v · w v w cos(θ)Suppose that v and w are perpendicular to one another. What can you sayabout v · w? What can you conclude if v · w 0?

Dot Product - Component Definition - 1The previous definition of dot product involved the angle between the two vectors.It is also helpful to compute the dot product purely in terms of the componentsof the vectors.Component Definition of Dot ProductIf v λ1 i λ2 j λ3 k(or hλ1, λ2, λ3i)and w µ1 i µ2 j µ3 k,(or hµ1, µ2, µ3i)then v · w λ1 µ1 λ2 µ2 λ3 µ3.It is not at all obvious that this is the same as the other definition!

Dot Product - Component Definition - 2The fact that the two definitions always give the same result is proven in yourtextbook. We will study an example demonstrating this general property to see aspecific instance of this general rule.Example: Use both definitions of the dot product to calculateh1, 1i · h0, 3iin two different ways.

Dot Product - Component Definition - 3Example: Find a vector u ha, bi of magnitude/length 1 which is perpendicular to the vector 3 i 7 j.

Dot Product - Component Definition - 4 u ha, bi of magnitude/length 1, perpendicular to 3 i 7 j.

Dot Product - Component Definition - 5Are there other possibilities than the perpendicular vector you found?

Using the Dot Product - 1Product Confusion Is ( v1 · v 2) v3 v 1( v2 · v 3)?(a) Yes, the results are equal.(b) No, the results will be different because of the grouping.(c) No,the results will be different because the product types are different.

Using the Dot Product - 2Example: Which pairs (if any) of vectors from the following list(a) Are perpendicular?(b) Have an angle less than π/2 between them?(c) Have an angle of more than π/2 between them? b h1, 3, 0i a h1, 0, 2i c h2, 1, 1i

Directional Derivative - Concept - 1Directional Derivative - ConceptNow we can return to the study of rates of change of a function f (x, y) whosedomain is all or part of IR2 (in other words, functions of two real variables,x and y).In our new terms, The partial derivative fx is the rate of change of f in the direction of the unitvector i (towards larger x values) The partial derivative fy is the rate of change of f in the direction of the unitvector j (towards larger y values)

Directional Derivative - Concept - 2On the surface below, find a point that has fx 0 and fy 0.

Directional Derivative - Concept - 3Suppose we now want to find the rate of change in an arbitrary direction. Any direction can be specified by a vector u of length 1. Vectors of length 1 are called unit vectors. Given a unit vector u, we want to find the rate of change of f (x, y) if we moveaway from (x, y) in the direction of u.From the same point on the graph, indicate a direction where the slope wouldbe steeper than fy .Indicate another direction where the slope would be close to zero.

Directional Derivative - Contour Diagrams - 1 4 2108640 62Example: Consider the contour diagram for a linear function f (x, y) shownbelow.1010864 20286402POn the diagram, mark three directions u, v and w at the point P , chosen sothat D uf (a, b) 0 D v f (a, b) 0 Dw f (a, b) 0

Directional Derivative - Contour Diagrams - 2Example - The following is a contour diagram for a more complex functionf (x, y). A (a, b) is a point in the domain of f .On the diagram, mark three directions u, v and w at the point P , chosen sothat D uf (a, b) 0 D v f (a, b) 0 Dw f (a, b) 0

Directional Derivative - Definition - 1We now define the slope of f (x, y) in an arbitrary direction, with the directionspecified by a unit vector u.Directional DerivativeLet u (u1 i u2 j) hu1, u2iwith u21 u22 1, so that u 1.Then, at the point (a, b) in the domain of f , the rate of change of f in thedirection of u isf (a hu1, b hu2) f (a, b).h 0hThis is called the directional derivative of f at the point (a, b) in thedirection of u and it is denoted bylimD uf (a, b)orf u(a, b)Note: This formula only applies if u is a unit vector.Unfortunately, this derivative definition is cumbersome as it involves limits. Wewould prefer to compute these directional derivatives using our simpler derivativerules if we could.

Directional Derivative - Definition - 2Computing Du f (a, b)How can we go about computing values for D uf (a, b) in a systematic way?Keep in mind the ingredients of our calculation: f (x, y) is a function of two variables, (a, b) is a point in the domain of f ,p u hu1, u2i with u21 u22 1 is a unit vector.Thenf (a hu1, b hu2) f (a, b)D uf (a, b) limh 0hf (x, y) f (a, b)(where x a hu1 and y b hu2) limh 0hUse local linearity to find an alternate expression for f (x, y) f (a, b).

Directional Derivative - Definition - 3Use that alternate expression to express the directional derivative in terms ofpartial derivatives.

Directional Derivative - Calculation - 1Computing the Directional DerivativeIf u hu1, u2i is a unit vector ( u 1), thenD uf (a, b) fx(a, b)u1 fy (a, b)u2NOTE: we don’t define directional derivatives for non-unit vectors. To find theslope in the direction of a non-unit length vector, v , you must normalize itbefore computing the directional derivative.If v hv1, v2i is not a unit vector,11first find u v p 2 v ,2 v v1 v2then compute D uf (a, b)This formula allows us to compute the slope in any direction simply by knowingthe partial derivatives.

Directional Derivative - Calculation - 2Example: Let f (x, y) x2 xy 2 and let u the steps required to calculate D uf (2, 2).Question: First: is u a unit vector?(a) Yes.(b) No.34, 55. We are going to show

Directional Derivative - Calculation - 3f (x, y) x2 xy 2 and u fx(x, y) fy (x, y) fx(2, 2) fy (2, 2) u1 u2 Duf (2, 2) 34, 55.

Directional Derivative - Calculation - 4Now compute the slope in the direction opposite of u. What do you noticeabout the slope?

Directional Derivative - Example - 1Example: Find the slope of the surface f (x, y) x2 y 2 at (x, y) (2, 3)if we were to move directly towards the origin.

Directional Derivative - Example - 2Slope of f (x, y) x2 y 2, at (2, 3), moving directly towards the origin.

The Gradient Vector - 1The Gradient VectorNote that the formula for directional derivatives could be written as a dot product if we so desired:D uf (a, b) fx(a, b)u1 fy (a, b)u2 hfx(a, b), fy (a, b)i · hu1 u2i{z} {z } new vector uThis is the first appearance of an important vector function called the gradientof f . While f assigns a number to each point in its domain, the gradient of fassigns a vector to each point in the domain of f , provided both partial derivatives .of f exist at that point. The gradient is denoted by either grad f or 5f

The Gradient Vector - 2Gradient Vector Definition fx(x, y) i fy (x, y) jgradf 5f hfx(x, y), fy (x, y)iAlternate Directional Derivative DefinitionD uf (x, y) (gradf ) · u

The Gradient Vector - 3Example Let f (x, y) xeygrad f (x, y) grad f (1, 0) grad f (0, 1) grad f (2, 3) For each point in the domain of f where the partial derivatives are both defined,the gradient vector is also defined.

Gradient Vector - Importance - 1Example: Use the gradient-based definition of the directional derivative todetermine the direction in which a surface has the largest positive slope.

Gradient Vector - Importance - 2Relationship between the surface and the gradient at a point (a, b)The direction of grad f (a, b) is the direction of maximum increase of thefunction f at the point (a, b).orThe gradient at (a, b) points in the direction of the steepest uphill slope.

Gradient Vector - Importance - 3Example: Consider the plane z x 2y 3. At the point (x, y) (1, 1),in which (x, y) direction should we move to move uphill the most quickly?

Gradient Vector - Importance - 4Support your answer, using the contour diagram for z x 2y 3 shownbelow.10121410128861086464202 2042864

Gradient Vector - Properties - 1Properties of the Gradient VectorUse the properties of the directional derivative and the dot product to justifythe following conclusions : grad f (a, b) is perpendicular to the contour of f that passes through the point(a, b) –grad f (a, b) gives the direction of maximum decrease of the function f atthe point (a, b).

Gradient Vector - Properties - 2 k grad f (a, b) k (i.e. the length or magnitude of the gradient vector) isthe maximum rate of change of f at (a, b).

Gradient Vector - Properties - 3Reminding ourselves of these properties of the gradient vector, consider the contourdiagram for a function f (x, y)For each of the points. A, B, and C, draw a vector that points in the directionof the gradient vector at that point .At which of the points is the gradient vector longest? At which of the pointsis the gradient vector shortest? Justify your answers.

Gradient and Contours - Example - 1Putting Gradients and Contours TogetherWe said earlier that the gradient is perpendicular to the contour at the same point.However, that isn’t very precise, given that the contours are curves themselves.It is better to say that contours, as curves, have tangent lines, and gradient isperpendicular to those tangent lines.Consider the 2-variable function f (x, y) xy 2.Write an equation for the contour (level curve), C, of f that passes throughthe point (2, 1).

Gradient and Contours - Example - 2Find grad f (2, 1).Find an equation for the tangent line at (2, 1) to the contour (level curve) C,through (2, 1).

Gradient and Contours - Example - 3f (x, y) xy 2On the axes below, sketch the level curve C indicate the vector grad f (2, 1), and draw the tangent line to the contour at (2, 1).y543210x012345

Gradient and Contours - Example - 4For reference, here is a more detailed contour diagram of the function f (x, y) xy 2,used in the previous question.52018416214 12104.54863.5218 14220.5000.511.522.533.544.55