Skip to main content

Section 10.3 Lagrange Multipliers

  • RECALL: \(\displaystyle\grad{g} \perp \{g=\hbox{const}\}\text{.}\)

Thus, in two dimensions, \(\{g(x,y)=\hbox{const}\}\) is a curve whose tangent vector is perpendicular to \(\grad{g}\text{,}\) and in three dimensions \(\{g(x,y,z)=\hbox{const}\}\) is a surface containing many curves each of whose tangent vector is perpendicular to \(\grad{g}\text{.}\)

  • RECALL: \(df = \grad{f} \cdot d\rr\) .

Thus, since \(f\) can only have a local maximum/minimum along a curve if \(df=0\) along the curve, \(\grad{f}\) must be perpendicular to the curve there.

Figure 10.3.1. The geometry behind the method of Lagrange multipliers.

Now consider the problem of finding the local maxima/minima of \(f\) subject to the constraint \(g=\hbox{const}\text{.}\) The idea is to consider the level set (curve or surface) on which \(g\) has the given value. The first fact above implies that \(\grad{g}\) is everywhere perpendicular to this curve or surface. Furthermore, the second fact above implies that, at a local maximum/minimum, \(\grad{f}\) is perpendicular to any curve in the level set. Thus, at a local maximum/minimum, we must have:

\begin{equation} \grad{f}\parallel\grad{g} .\tag{10.3.1} \end{equation}

This relationship is shown geometrically in Figure 10.3.1, which shows the level curves of \(f\text{,}\) together with a heavy line representing the constraint curve \(g=\hbox{const}\text{.}\) The maximum and minimum values of \(f\) clearly take place where the constraint curve is tangent to the level curves.

The method of Lagrange multipliers with one constraint is therefore:

  1. Solve the system of equations  1 

    \begin{align*} \grad{f} \amp= \lambda \grad{g} ,\\ g \amp= { const} , \end{align*}

    for \(\lambda\) and the coordinates of the point.

  2. Determine which of the resulting points are local maxima/minima.

In two dimensions, this procedure yields three equations in three variables (\(\lambda\text{,}\) \(x\text{,}\) \(y\)), and in three dimensions this procedure yields four equations in four variables.

This procedure can be generalized to a method of Lagrange multipliers for maximizing/minimizing functions \(f\) of three variables with two constraints \(g=\hbox{const}\) and \(h=\hbox{const}\text{.}\) The method is based on the fact that \(\grad{f}\text{,}\) \(\grad{g}\text{,}\) and \(\grad{h}\) must lie in a plane at a local maximum/minimum.

  1. Solve the system of equations

    \begin{align*} \grad{f} \amp= \lambda \grad{g} + \mu \grad{h} ,\\ g \amp= \hbox{const} ,\\ h \amp= \hbox{const} , \end{align*}

    for \(\lambda\text{,}\) \(\mu\text{,}\) \(x\text{,}\) \(y\text{,}\) and \(z\text{.}\)

  2. Determine which of the resulting points are local maxima/minima.

Lagrange multipliers can be used when solving absolute maximum/minimum problems in order to find the extreme values on the boundary. This is done by viewing the equation of the boundary as the constraint.

Equivalently, solve the equation \(\grad f\times\grad g=\zero\) (together with \(g=\hbox{const}\)). This approach is particularly efficient in two dimensions.