Math Camp
Lecture 8: Comparative Statics, Envelopes, and Fixed Points
Lectures 6 and 7 solve one optimization problem at a time. Economics rarely stops there: the interesting question is usually how the solution and its value respond when a parameter moves. What does a tax do to the equilibrium price? What does an extra unit of capacity add to profit? The solved problem almost never has a closed form, so the answers must be read from the equations that characterize the solution. This method is called comparative statics. The main tool of comparative statics is the implicit function theorem, which differentiates through a system of equations.
1 The implicit function theorem
1.1 Scalar implicit differentiation
Let be on an open set , with the arguments written : an equation in the endogenous variable , indexed by the parameter . Suppose a differentiable function solves the equation identically, on some interval of parameters. Such a function is a solution branch of the equation. Differentiating the identity using the chain rule from Lecture 4, we get and at any point where , The calculation is conditional: if a differentiable solution branch runs through the point, its slope is determined by the equation above.
1.2 The system theorem
The same logic runs for systems. Let and be open, and let collect equations in the endogenous variables , with parameters . The scalar condition becomes invertibility of the endogenous Jacobian.
Theorem 1.1 (Implicit function theorem). Let be , let , and let be invertible. Then there are neighborhoods of and of and a unique function such that and for each the point is the only solution of in . The derivative satisfies
We use the system statement without proof; the scalar case can be proved with the tools of Lectures 2 and 4.
Proof (optional, for one equation and one parameter). The two signs are symmetric, so suppose . Since is continuous, there is a rectangle on which , so on this rectangle is strictly increasing in for each fixed . Since increases through its zero at , Both signs survive small moves of the parameter: is continuous in , so there is such that and for every within of . For each such , the Theorem 3.7 from Lecture 2 gives a solution of , and strict monotonicity in makes it the only one in the interval: this is the branch. Repeating the argument with a smaller traps the branch in a smaller rectangle, so as : the branch is continuous. We take the differentiability of the branch without proof; its derivative is then the chain-rule formula of Section 1.1. ◻
Everything in the theorem is local: invertibility at one solution gives a branch near that solution and carries no information about solutions elsewhere. Equation (1) is the scalar calculation written with matrices: differentiate the identity by the chain rule and solve. For each of the parameters, the corresponding column of solves one linear system with the same coefficient matrix , as in Lecture 3; in practice, the matrix is inverted once, or each system is solved directly.
Example 1.2 (Incidence of a per-unit tax).
Fix demand and supply primitives and . The parameter is the per-unit tax . The endogenous variables are the producer price and quantity ; consumers pay . Demand and supply are At a reference tax , suppose an equilibrium exists. How do the local equilibrium price , quantity , and consumer price respond to the tax?
Solution. With endogenous vector , equilibrium is the system with , so Theorem 1.1 applies at any equilibrium: the equilibrium price and quantity are differentiable functions of the tax. Differentiating with respect to as in (1), The consumer price moves by The tax splits between the two sides of the market in proportion to the slopes: the producer price falls by of the tax, the consumer price rises by the complementary share , and quantity falls. Note that we never computed the equilibrium.
2 Comparative statics of optimizers and values
2.1 Optimizing systems
When the equations being differentiated are optimality conditions, the implicit function theorem turns into the comparative statics of choice. Let be with and open. At a parameter , suppose is a critical point satisfying Lecture 6’s first-order condition, This is a system , and its endogenous Jacobian is the Hessian: If the Hessian is invertible at , Theorem 1.1 yields a branch of critical points with
For constrained problems, we differentiate the Lagrange system. For subject to , Lecture 7’s Lagrangian produces the system in the stacked endogenous vector . Its endogenous Jacobian is written in blocks, each block a matrix whose dimensions are read off the grouping of equations and variables: where is the Hessian of in alone. When this matrix is invertible at a stationary feasible pair, the implicit function theorem gives a differentiable branch of such pairs. Once the branch is established to consist of optimizers and their multipliers, we write it .
Inequality constraints use the same technique. On a parameter region where the same constraints bind and every slack constraint stays slack, the binding constraints can be carried as equalities and everything above applies; the derivatives are valid strictly within that region, and Section 2.5 discusses what happens at its boundary.
2.2 Envelope theorems
So far we differentiated a critical point of an optimization problem. The second object of comparative statics is the optimized value whose derivative is even simpler.
Theorem 2.1 (Envelope theorems). Assume the functions appearing below are in .
If is a differentiable branch of interior optimizers, so that , then
If is a differentiable branch of optimizers and is its differentiable multiplier branch satisfying Lecture 7’s stationarity and feasibility conditions, and , then with every derivative on the right taken in alone and evaluated along the branch.
For a problem with equalities and inequalities , suppose is a differentiable branch of optimizers, and are its differentiable multiplier branches satisfying the KKT conditions, and the active set is constant near the parameter under consideration. Then
Proof. For the interior case, the chain rule gives and the first term vanishes by stationarity. For the constrained case, the same chain rule step and stationarity give Differentiating the feasibility identity gives , and substituting finishes the proof of part 2.
For part 3, let be the active set, which is constant by hypothesis. The equations and form one equality system, so part 2 applies with multipliers . Every inactive multiplier is zero by complementary slackness. Adding those zero terms gives the displayed formula with the full vectors and . ◻
Notice that does not appear on any right-hand side. To first order, the response of the choice does not affect the value, because the first-order condition makes the objective flat in the choice direction; only the direct effect of the parameter remains.
Example 2.2 (The envelope formula on the quadratic family). For each parameter , the scalar choice variable solves The optimizer and value, respectively, are known to be and (see Example 3.3 in Lecture 6). What does the envelope theorem give for on the interior and corner regimes, and does it agree with the known value function?
Solution.
On the interior regime , part 1 of Theorem 2.1 predicts and differentiating directly confirms it. On the corner regime , write the constraint as . The active set is constant, , and part 3 gives , again matching the derivative of the constant value.
2.3 Interpretation of Lagrange multipliers
Lecture 7 introduced a Lagrange multiplier as an additional unknown in the first-order conditions. We can now interpret that unknown. Start with the equality-constrained problem Here is the vector of choice variables, and are fixed primitives, and is the constraint’s right-hand side. Depending on the application, could be a budget, capacity, time limit, or available material. Changing shifts the constraint and therefore changes the best attainable value.
Using the course’s sign convention, write the constraint and Lagrangian as Let be the optimized value. Suppose the optimizer and its multiplier form differentiable local branches. The equality-constrained envelope formula, restated for this problem, is The last equality follows immediately from the Lagrangian: enters with coefficient . Thus the multiplier is the shadow price of the constraint’s right-hand side—the marginal increase in the optimized value from increasing . For a small change , the first-order approximation is Its units are units of optimized value per unit of .
For an upper-bound inequality , use the course’s KKT convention On a differentiable regime with a fixed active set, a binding constraint has A slack constraint has by complementary slackness and therefore no marginal value on that regime. More generally, if constraint is written as , a positive relaxes it and
The sign of a multiplier cannot be separated from the way its constraint is written. If the equality constraint is instead with multiplier , then and . Writing the constraint as makes the multiplier itself equal to the shadow price.
Example 2.3 (Capacity valued by the envelope formula). Fix parameters and . The scalar choice variable solves The optimizer and capacity multiplier are known to be and (see Example 3.3 in Lecture 7). What do the envelope formulas give for the effects of capacity and productivity on the value, and do those effects agree with the known closed-form solution?
Solution.
The value function is available in closed form: which is , as part 3 of Theorem 2.1 predicts with and : the marginal value of capacity is zero while the capacity constraint is slack and positive once it binds. Differentiating in instead gives on both regimes, which is the direct effect evaluated at the optimum. On each regime the active set is constant and the branch is differentiable, so the formulas apply regime by regime; the switch points belong to Section 2.5.
2.4 Behavior from optimized values
One classical corollary applies the envelope theorem to the theory of the firm.
Example 2.4 (Hotelling’s lemma). A firm chooses an input vector and produces output . The parameters are the output price and input-price vector , and profit is Suppose is a differentiable branch of interior profit maximizers, with maximized profit . What are the derivatives of with respect to and each ?
Solution.
Part 1 of Theorem 2.1 gives the derivative of maximized profit with respect to the output price is the optimal output, and with respect to an input price it is the negative of the optimal input use. Differentiating the value function recovers the firm’s behavior without re-solving its problem. The same calculation with a budget constraint produces Roy’s identity in consumer theory, and with a cost-minimization problem produces Shephard’s lemma; both appear early in the first-year sequence, and both are Theorem 2.1 applied to a particular value function.
2.5 Limits of the formulas
Every formula in this section is local and conditional: it needs a differentiable branch through a regular solution, and for inequality problems it needs the active set to stay constant. The following example shows how the formulas fail where the active set changes.
Example 2.5 (No single marginal value at an active-set change). The scalar choice variable is , and the scalar parameter is . Consider What are the optimizer and value, and how does the value derivative compare with the multiplier on the constraint for , , and at the switch point ?
Solution.
The feasible set is , and the objective is increasing in , so the optimizer and value are . For the constraint binds alone and carries multiplier ; for it is slack and carries multiplier . At both upper constraints are active, stationarity only requires the two multipliers to sum to one, and the value function has left derivative and right derivative . At the switch point the value function is not differentiable, so there is no single marginal value, and correspondingly the multiplier is not unique.
On either side of the switch, the formulas hold regime by regime. Example 2.2 shows the benign case: the active set changes at , yet the two regime values and join with matching derivative, so the value is differentiable even at . After an active-set change, the value may or may not remain differentiable, and this must be checked.
3 Fixed-point theorems
A fixed-point argument looks for a point that a map sends to itself. This section introduces several theorems that give conditions under which such points exist.
3.1 Fixed points and Brouwer’s theorem
Definition 3.1 (Fixed point). Let be a set and . A point is a fixed point of if .
For a function of one variable, a fixed point is a crossing of the graph of with the -degree line. Lecture 2 closed with our first fixed point theorem, Brouwer in : every continuous has a fixed point. The proof applied the intermediate value theorem to , which is nonnegative at and nonpositive at . Figure 3.1 shows the picture: a continuous graph that starts on or above the diagonal and ends on or below it must cross it.
In the interval is replaced by a compact convex set.
Theorem 3.2 (Brouwer). Let be nonempty, compact, and convex, and let be continuous. Then has a fixed point.
3.2 Set-valued maps and Kakutani’s theorem
Definition 3.3 (Set-valued map). A set-valued map (correspondence) assigns to every a nonempty set . A fixed point of is a point with .
For correspondences, the continuity hypothesis of Brouwer’s theorem is replaced by a condition on the set of pairs , the graph of : the graph must be a closed set, in the sequential sense of Lecture 2. In words, if , , and for every , then .
Theorem 3.4 (Kakutani). Let be nonempty, compact, and convex, and let have convex values and a closed graph. Then has a fixed point.
Example 3.5 (Ties close the gap). The variable is ; there are no parameters. Let be the jump map for and for , which has no fixed point. Replace its value at the jump by the whole interval, defining by Does Kakutani’s theorem apply, and what is the fixed point? Why would replacing by the two-point set destroy the conclusion?
Solution.
The jump map has singleton values but not a closed graph: the pairs lie in the graph and converge to , yet . Under , the graph gains the vertical segment and becomes closed, every value is convex, and Theorem 3.4 applies. The fixed point is visible in Figure 3.2: the segment meets the diagonal at , and indeed . If the value at the jump were the two-point set instead, the graph would still be closed, but the value would not be convex and no fixed point would exist. In a game, the interval is the set of mixtures available to a player who is indifferent; allowing the tie restores equilibrium existence.
3.3 The contraction mapping theorem
Brouwer and Kakutani establish existence only: they do not say whether the fixed point is unique, and they do not provide a way to compute it. The third theorem strengthens the hypothesis on the map and gives both uniqueness and an algorithm.
Definition 3.6 (Contraction). Let . A map is a contraction with modulus if and
A contraction shrinks the distance between any two points to at most times its original value. Every contraction is continuous: if , then .
Theorem 3.7 (Contraction mapping theorem). Let be nonempty and closed, and let be a contraction with modulus . Then has exactly one fixed point . Moreover, from any starting point , the iterates converge to , and
Remark 3.8 (Why the fixed point is unique). Uniqueness follows in two lines, and the argument uses directly. If and are both fixed points, then so . Since , this forces , that is, . The error bound is the same inequality applied times: .
Note that in Theorem 3.7 the set need not be bounded or convex; the strong hypothesis on replaces both.
Example 3.9 (A discounted sum as a fixed point). Fix parameters and . The fixed-point variable is , and the map is defined by . Starting from , does have a unique fixed point, what are the iterates , and what economic object does their limit represent?
Solution.
We have , so is a contraction with modulus , and its fixed point solves : Starting the iteration at , since for . The fixed point of “today’s reward plus times the continuation” is the value of receiving in every period, discounted by . In Lecture 9, the central operator has this form, with a function in place of the number .
| Theorem | The set | The map | Conclusion |
|---|---|---|---|
| Brouwer (Theorem 3.2) | nonempty, compact, convex | continuous | a fixed point exists |
| Kakutani (Theorem 3.4) | nonempty, compact, convex | convex values, closed graph | a fixed point exists |
|
Contraction (Theorem 3.7) |
nonempty, closed | contraction with modulus | exactly one fixed point |