Density and CDF¶

Let $f$ be a non-negative function on the real number line and suppose

$$ \int_{-\infty}^\infty f(x)dx ~ = 1 $$

Then $f$ is a probability density function or just density for short.

For example, the function $f$ defined by

$$ f(x) = \begin{cases} 0 ~~~~~~~~~~~~~~~~~~ \text{if } x \le 0 \\ 6x(1-x) ~~~~~ \text{if } 0 < x < 1 \\ 0 ~~~~~~~~~~~~~~~~~~ \text{if } x \ge 1 \\ \end{cases} $$

is a density. It is easy to check by calculus that it integrates to 1.

Note: The calculus used in this section is very straightforward. You should be able to do it easily by hand. Later in this chapter we will give you Python tools for calculus.

Here is a graph of the function $f$. The density puts all the probability on the unit interval.

Density is Not the Same as Probability¶

In the example above, $f(0.5) = 6/4 = 1.5 > 1$. Indeed, there are many values of $x$ for which $f(x) > 1$. So the values of $f$ are clearly not probabilities.

Then what are they? We'll study that in the next section. In this section we will see that we can work with densities just as we did with the normal curve.

First, a labor-saving device: If $f$ is positive only on a subinterval of the line, then usually we will just write its definition on the interval where it is positive. It will be assumed to be 0 elsewhere.

$$ f(x) ~ = ~ 6x(1-x), ~~~ 0 < x < 1 $$

And we will draw the graph of $f$ only over the region where it is positive:

Areas are Probabilities¶

A random variable $X$ is said to have density $f$ if for every pair $a < b$,

$$ P(a < X \le b) ~ = ~ \int_a^b f(x)dx $$

This integral is the area between $a$ and $b$ under the density curve. The graph below shows the area corresponding to $P(0.6 < X \le 0.8)$ for $X$ with the density in our example.

The area is $$ P(0.6 < X \le 0.8) ~ = ~ \int_{0.6}^{0.8} 6x(1-x)dx ~ = ~ 0.248 $$

Cumulative Distribution Function (CDF)¶

The cdf of $X$ is the function $F$ defined by

$$ F(x) ~ = ~ P(X \le x) ~ = ~ \int_{-\infty}^x f(s)ds $$

You are already familiar with the cdf defined as $F(x) = P(X \le x)$; what's new is that we can compute the probability by integrating the density function.

In our example, the only possible values of the random variable $X$ are between 0 and 1, so $F(x) = 0$ for $x \le 0$ and $F(x) = 1$ for $x \ge 1$. For $x$ between 0 and 1,

$$ F(x) ~ = ~ \int_0^x 6s(1-s)ds ~ = ~ 3x^2 - 2x^3 $$

In terms of the graph of the density, $F(x)$ is all the area to the left of $x$ under the density curve. The graph below shows the area corresponding to $F(0.8)$.

$$ P(X \le 0.8) ~ = ~ F(0.8) ~ = ~ 3\cdot0.8^3 - 2\cdot0.8^2 ~ = ~ 0.896 $$

As before, the cdf can be used to find probabilities of intervals. For every pair $a < b$,

$$ P(a < X \le b) ~ = ~ F(b) - F(a) $$

\begin{align*} F(0.6) ~ &= ~ 3\cdot0.6^3 - 2\cdot0.6^2 ~ = ~ 0.648 \\ F(0.8) - F(0.6) ~ &= ~ 0.896 - 0.648 ~ = ~ 0.248 \end{align*}

That's the same as the answer we got earlier in the section by integrating the density between 0.6 and 0.8.

By the Fundamental Theorem of Calculus, the density and cdf can be derived from each other:

$$ F(x) = \int_{-\infty}^x f(s)ds ~~~~~~~~~~~~~~~~~~ f(x) = \frac{d}{dx}F(x) $$

You can use whichever of the two functions is more convenient in a particular application.