Geometric Asymptotic Approximation of Value Functions

Abstract

This paper characterizes the behavior of value functions in dynamic stochastic discounted programming models near fixed points of the state space. When the second derivative of the flow payoff function is bounded, the value function is proportional to a linear function plus x ψ δ . A specific formula for ψ δ is provided, which implies ψ δ continuously falls in the rate of patience.If the state variable is a martingale, the second derivative of the value function is unbounded. If the state variable is instead a strict local submartingale, then the same holds for the first derivative of the value function. Thus, the proposed approximation is more accurate than Taylor series approximation.The approximation result is used to characterize locally optimal policies in several fundamental economic problems. * Thanks to Lones Smith for substantial advice and assistance throughout this project. Any errors are mine. †