22. Dynamics in One Dimension#

Migrated lecture

This lecture has moved from our Intermediate Quantitative Economics with Python lecture series and is now a part of A First Course in Quantitative Economics.

22.1. Overview#

In this lecture we give a quick introduction to discrete time dynamics in one dimension.

  • In one-dimensional models, the state of the system is described by a single variable.

  • The variable is a number (that is, a point in \(\mathbb R\)).

While most quantitative models have two or more state variables, the one-dimensional setting is a good place to learn the foundations of dynamics and understand key concepts.

Let’s start with some standard imports:

%matplotlib inline
import matplotlib.pyplot as plt
import numpy as np

22.2. Some definitions#

This section sets out the objects of interest and the kinds of properties we study.

22.2.1. Composition of functions#

For this lecture you should know the following.

If

  • \(g\) is a function from \(A\) to \(B\) and

  • \(f\) is a function from \(B\) to \(C\),

then the composition \(f \circ g\) of \(f\) and \(g\) is defined by

\[ (f \circ g)(x) = f(g(x)) \]

For example, if

  • \(A=B=C=\mathbb R\), the set of real numbers,

  • \(g(x)=x^2\) and \(f(x)=\sqrt{x}\), then \((f \circ g)(x) = \sqrt{x^2} = |x|\).

If \(f\) is a function from \(A\) to itself, then \(f^2\) is the composition of \(f\) with itself.

For example, if \(A = (0, \infty)\), the set of positive numbers, and \(f(x) = \sqrt{x}\), then

\[ f^2(x) = \sqrt{\sqrt{x}} = x^{1/4} \]

Similarly, if \(n\) is an integer, then \(f^n\) is \(n\) compositions of \(f\) with itself.

In the example above, \(f^n(x) = x^{1/(2^n)}\).

22.2.2. Dynamic systems#

A (discrete time) dynamic system is a set \(S\) and a function \(g\) that sends set \(S\) back into to itself.

Examples of dynamic systems include

  • \(S = (0, 1)\) and \(g(x) = \sqrt{x}\)

  • \(S = (0, 1)\) and \(g(x) = x^2\)

  • \(S = \mathbb Z\) (the integers) and \(g(x) = 2 x\)

On the other hand, if \(S = (-1, 1)\) and \(g(x) = x+1\), then \(S\) and \(g\) do not form a dynamic system, since \(g(1) = 2\).

  • \(g\) does not always send points in \(S\) back into \(S\).

22.2.3. Dynamic systems#

We care about dynamic systems because we can use them to study dynamics!

Given a dynamic system consisting of set \(S\) and function \(g\), we can create a sequence \(\{x_t\}\) of points in \(S\) by setting

(22.1)#\[ x_{t+1} = g(x_t) \quad \text{ with } x_0 \text{ given}.\]

This means that we choose some number \(x_0\) in \(S\) and then take

(22.2)#\[ x_0, \quad x_1 = g(x_0), \quad x_2 = g(x_1) = g(g(x_0)), \quad \text{etc.}\]

This sequence \(\{x_t\}\) is called the trajectory of \(x_0\) under \(g\).

In this setting, \(S\) is called the state space and \(x_t\) is called the state variable.

Recalling that \(g^n\) is the \(n\) compositions of \(g\) with itself, we can write the trajectory more simply as

\[ x_t = g^t(x_0) \quad \text{ for } t \geq 0. \]

In all of what follows, we are going to assume that \(S\) is a subset of \(\mathbb R\), the real numbers.

Equation (22.1) is sometimes called a first order difference equation

  • first order means dependence on only one lag (i.e., earlier states such as \(x_{t-1}\) do not enter into (22.1)).

22.2.4. Example: A Linear Model#

One simple example of a dynamic system is when \(S=\mathbb R\) and \(g(x)=ax + b\), where \(a, b\) are fixed constants.

This leads to the linear difference equation

\[ x_{t+1} = a x_t + b \quad \text{ with } x_0 \text{ given}. \]

The trajectory of \(x_0\) is

(22.3)#\[x_0, \quad a x_0 + b, \quad a^2 x_0 + a b + b, \quad \text{etc.}\]

Continuing in this way, and using our knowledge of geometric series, we find that, for any \(t \geq 0\),

(22.4)#\[ x_t = a^t x_0 + b \frac{1 - a^t}{1 - a}\]

We have an exact expression for \(x_t\) for all \(t\) and hence a full understanding of the dynamics.

Notice in particular that \(|a| < 1\), then, by (22.4), we have

(22.5)#\[x_t \to \frac{b}{1 - a} \text{ as } t \to \infty\]

regardless of \(x_0\)

This is an example of what is called global stability, a topic we return to below.

22.2.5. Example: A Nonlinear Model#

In the linear example above, we obtained an exact analytical expression for \(x_t\) in terms of arbitrary \(t\) and \(x_0\).

This made analysis of dynamics very easy.

When models are nonlinear, however, the situation can be quite different.

For example, recall how we previously studied the law of motion for the Solow growth model, a simplified version of which is

(22.6)#\[k_{t+1} = s z k_t^{\alpha} + (1 - \delta) k_t\]

Here \(k\) is capital stock and \(s, z, \alpha, \delta\) are positive parameters with \(0 < \alpha, \delta < 1\).

If you try to iterate like we did in (22.3), you will find that the algebra gets messy quickly.

Analyzing the dynamics of this model requires a different method (see below).

22.3. Stability#

Consider a fixed dynamic system consisting of set \(S \subset \mathbb R\) and \(g\) mapping \(S\) to \(S\).

22.3.1. Steady states#

A steady state of this system is a point \(x^*\) in \(S\) such that \(x^* = g(x^*)\).

In other words, \(x^*\) is a fixed point of the function \(g\) in \(S\).

For example, for the linear model \(x_{t+1} = a x_t + b\), you can use the definition to check that

  • \(x^* := b/(1-a)\) is a steady state whenever \(a \not= 1\).

  • if \(a = 1\) and \(b=0\), then every \(x \in \mathbb R\) is a steady state.

  • if \(a = 1\) and \(b \not= 0\), then the linear model has no steady state in \(\mathbb R\).

22.3.2. Global stability#

A steady state \(x^*\) of the dynamic system is called globally stable if, for all \(x_0 \in S\),

\[ x_t = g^t(x_0) \to x^* \text{ as } t \to \infty \]

For example, in the linear model \(x_{t+1} = a x_t + b\) with \(a \not= 1\), the steady state \(x^*\)

  • is globally stable if \(|a| < 1\) and

  • fails to be globally stable otherwise.

This follows directly from (22.4).

22.3.3. Local stability#

A steady state \(x^*\) of the dynamic system is called locally stable if there exists an \(\epsilon > 0\) such that

\[ | x_0 - x^* | < \epsilon \; \implies \; x_t = g^t(x_0) \to x^* \text{ as } t \to \infty \]

Obviously every globally stable steady state is also locally stable.

We will see examples below where the converse is not true.

22.4. Graphical analysis#

As we saw above, analyzing the dynamics for nonlinear models is nontrivial.

There is no single way to tackle all nonlinear models.

However, there is one technique for one-dimensional models that provides a great deal of intuition.

This is a graphical approach based on 45 degree diagrams.

Let’s look at an example: the Solow model with dynamics given in (22.6).

We begin with some plotting code that you can ignore at first reading.

The function of the code is to produce 45 degree diagrams and time series plots.

Hide code cell source
def subplots():
    "Custom subplots with axes throught the origin"
    fig, ax = plt.subplots()

    # Set the axes through the origin
    for spine in ['left', 'bottom']:
        ax.spines[spine].set_position('zero')
        ax.spines[spine].set_color('green')
    for spine in ['right', 'top']:
        ax.spines[spine].set_color('none')

    return fig, ax


def plot45(g, xmin, xmax, x0, num_arrows=6, var='x'):

    xgrid = np.linspace(xmin, xmax, 200)

    fig, ax = subplots()
    ax.set_xlim(xmin, xmax)
    ax.set_ylim(xmin, xmax)

    hw = (xmax - xmin) * 0.01
    hl = 2 * hw
    arrow_args = dict(fc="k", ec="k", head_width=hw,
            length_includes_head=True, lw=1,
            alpha=0.6, head_length=hl)

    ax.plot(xgrid, g(xgrid), 'b-', lw=2, alpha=0.6, label='g')
    ax.plot(xgrid, xgrid, 'k-', lw=1, alpha=0.7, label='45')

    x = x0
    xticks = [xmin]
    xtick_labels = [xmin]

    for i in range(num_arrows):
        if i == 0:
            ax.arrow(x, 0.0, 0.0, g(x), **arrow_args) # x, y, dx, dy
        else:
            ax.arrow(x, x, 0.0, g(x) - x, **arrow_args)
            ax.plot((x, x), (0, x), 'k', ls='dotted')

        ax.arrow(x, g(x), g(x) - x, 0, **arrow_args)
        xticks.append(x)
        xtick_labels.append(r'${}_{}$'.format(var, str(i)))

        x = g(x)
        xticks.append(x)
        xtick_labels.append(r'${}_{}$'.format(var, str(i+1)))
        ax.plot((x, x), (0, x), 'k', ls='dotted')

    xticks.append(xmax)
    xtick_labels.append(xmax)
    ax.set_xticks(xticks)
    ax.set_yticks(xticks)
    ax.set_xticklabels(xtick_labels)
    ax.set_yticklabels(xtick_labels)

    bbox = (0., 1.04, 1., .104)
    legend_args = {'bbox_to_anchor': bbox, 'loc': 'upper right'}

    ax.legend(ncol=2, frameon=False, **legend_args, fontsize=14)
    plt.show()

def ts_plot(g, xmin, xmax, x0, ts_length=6, var='x'):
    fig, ax = subplots()
    ax.set_ylim(xmin, xmax)
    ax.set_xlabel(r'$t$', fontsize=14)
    ax.set_ylabel(r'${}_t$'.format(var), fontsize=14)
    x = np.empty(ts_length)
    x[0] = x0
    for t in range(ts_length-1):
        x[t+1] = g(x[t])
    ax.plot(range(ts_length),
            x,
            'bo-',
            alpha=0.6,
            lw=2,
            label=r'${}_t$'.format(var))
    ax.legend(loc='best', fontsize=14)
    ax.set_xticks(range(ts_length))
    plt.show()

Let’s create a 45 degree diagram for the Solow model with a fixed set of parameters

A, s, alpha, delta = 2, 0.3, 0.3, 0.4

Here’s the update function corresponding to the model.

def g(k):
    return A * s * k**alpha + (1 - delta) * k

Here is the 45 degree plot.

xmin, xmax = 0, 4  # Suitable plotting region.

plot45(g, xmin, xmax, 0, num_arrows=0)
_images/3a31d06520670f56bee3a3eef8d1a04b09fecd75dfe522ba2ec5a23c98486d36.png

The plot shows the function \(g\) and the 45 degree line.

Think of \(k_t\) as a value on the horizontal axis.

To calculate \(k_{t+1}\), we can use the graph of \(g\) to see its value on the vertical axis.

Clearly,

  • If \(g\) lies above the 45 degree line at this point, then we have \(k_{t+1} > k_t\).

  • If \(g\) lies below the 45 degree line at this point, then we have \(k_{t+1} < k_t\).

  • If \(g\) hits the 45 degree line at this point, then we have \(k_{t+1} = k_t\), so \(k_t\) is a steady state.

For the Solow model, there are two steady states when \(S = \mathbb R_+ = [0, \infty)\).

  • the origin \(k=0\)

  • the unique positive number such that \(k = s z k^{\alpha} + (1 - \delta) k\).

By using some algebra, we can show that in the second case, the steady state is

\[ k^* = \left( \frac{sz}{\delta} \right)^{1/(1-\alpha)} \]

22.4.1. Trajectories#

By the preceding discussion, in regions where \(g\) lies above the 45 degree line, we know that the trajectory is increasing.

The next figure traces out a trajectory in such a region so we can see this more clearly.

The initial condition is \(k_0 = 0.25\).

k0 = 0.25

plot45(g, xmin, xmax, k0, num_arrows=5, var='k')
_images/897036c12d9971a1eb0e7b14694a4e67540e0dd05386983b20c281820bcaec9e.png

We can plot the time series of capital corresponding to the figure above as follows:

ts_plot(g, xmin, xmax, k0, var='k')
_images/c983f073efe55311fd9b7ac968257528dccbb969c1470d55c89a85260fd3e582.png

Here’s a somewhat longer view:

ts_plot(g, xmin, xmax, k0, ts_length=20, var='k')
_images/cfb6125dad70910e85566533c0e20db7f8aae2e8076521af8448a4f31f7b9fd8.png

When capital stock is higher than the unique positive steady state, we see that it declines:

k0 = 2.95

plot45(g, xmin, xmax, k0, num_arrows=5, var='k')
_images/cf31f221e6f4ab1a1ff472e70021faa101165c4c0bcab079b0f86c0725d46339.png

Here is the time series:

ts_plot(g, xmin, xmax, k0, var='k')
_images/7ff2d0b4bd86964149a49368c4a3263a34ac1703f487f674e3a74178a87944ac.png

22.4.2. Complex dynamics#

The Solow model is nonlinear but still generates very regular dynamics.

One model that generates irregular dynamics is the quadratic map

\[ g(x) = 4 x (1 - x), \qquad x \in [0, 1] \]

Let’s have a look at the 45 degree diagram.

xmin, xmax = 0, 1
g = lambda x: 4 * x * (1 - x)

x0 = 0.3
plot45(g, xmin, xmax, x0, num_arrows=0)
_images/636e79481ee04049e8aa9e8cab202f99c08e924de01960b650f487f0533a3875.png

Now let’s look at a typical trajectory.

plot45(g, xmin, xmax, x0, num_arrows=6)
_images/b2c8f9b602da344164cff978c05694bc8813ee6516e55a20ddc6113756a79e86.png

Notice how irregular it is.

Here is the corresponding time series plot.

ts_plot(g, xmin, xmax, x0, ts_length=6)
_images/86bc799b86d86a25a54662096f22a54ac8987b3820f752a5069cc0cadd1d4a35.png

The irregularity is even clearer over a longer time horizon:

ts_plot(g, xmin, xmax, x0, ts_length=20)
_images/5633b6ab462156ef6701788c713d084e3656162f436562a6862c2b09e5eb8061.png

22.5. Exercises#

Exercise 22.1

Consider again the linear model \(x_{t+1} = a x_t + b\) with \(a \not=1\).

The unique steady state is \(b / (1 - a)\).

The steady state is globally stable if \(|a| < 1\).

Try to illustrate this graphically by looking at a range of initial conditions.

What differences do you notice in the cases \(a \in (-1, 0)\) and \(a \in (0, 1)\)?

Use \(a=0.5\) and then \(a=-0.5\) and study the trajectories

Set \(b=1\) throughout.