Difference between revisions of "Mdm of the Poisson distribution"

Latest revision as of 00:27, 8 November 2017

TODO: Link with Poisson distribution page

Statement

Let [ilmath]X\sim[/ilmath][ilmath]\text{Poi} [/ilmath][ilmath](\lambda)[/ilmath] for some [ilmath]\lambda\in\mathbb{R}_{>0} [/ilmath]. [ilmath]X[/ilmath] may take any value in [ilmath]\mathbb{N}_0[/ilmath]

We will show that

• [math]\text{Mdm}(X)\eq 2\lambda e^{-\lambda}\frac{\lambda^u}{u!} [/math]^[1]
  • Where [ilmath]u:\eq[/ilmath][ilmath]\text{Floor}(\lambda)[/ilmath]

I have confirmed this experimentally in Experimental evidence for the Mdm of the Poisson distribution

Recall the Mdm is defined as:

• [math]\text{Mdm}(X):\eq\mathbb{E}\Big[\ \big\vert X-\mathbb{E}[X]\big\vert\ \Big][/math]

[ilmath]\newcommand{\LHS}[0]{ {\text{Mdm}(X)} } [/ilmath]

Calculation

• [math]\text{Mdm}(X):\eq\mathbb{E}\Big[\ \big\vert X-\mathbb{E}[X]\big\vert\ \Big][/math][math]:\eq\sum^\infty_{k\eq 0}\big\vert X-\mathbb{E}[X]\big\vert\cdot\P{X\eq k} [/math]

  [math]\eq e^{-\lambda}\ \sum^\infty_{k\eq 0}\frac{\lambda^k}{k!}\big\vert k-\mathbb{E}[X]\big\vert[/math] [math]\eq e^{-\lambda}\ \sum^\infty_{k\eq 0}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert[/math]

  • Note that:
    1. if [ilmath]k\ge \lambda\ \implies\ k-\lambda\ge 0\ \implies\ \vert k-\lambda\vert \eq k-\lambda[/ilmath]
    2. if [ilmath]k\le \lambda\ \implies\ k-\lambda\le 0\ \implies \lambda-k\ge 0\ \implies \vert k-\lambda\vert \eq \lambda-k[/ilmath]
  • Define the following two values:
    1. [ilmath]u:\eq\text{RoundDownToInt}(\lambda)[/ilmath]^{[Note 1]} (also known as the floor function^{[Note 2]} and
    2. [ilmath]v:\eq u+1[/ilmath]^{[Note 3]}
    • This means we have [ilmath]u\le \lambda[/ilmath] and [ilmath]v\ge \lambda[/ilmath], specifically, we have the following two cases:
      1. if [ilmath]k\le u[/ilmath] and as [ilmath]u\le \lambda[/ilmath] we see [ilmath]k\le \lambda[/ilmath] and
      2. if [ilmath]k> u[/ilmath] then [ilmath]k \ge u+1\eq v \ge\lambda[/ilmath] so [ilmath]k\ge \lambda[/ilmath]
  • Now, from above: [math]\LHS{}\eq e^{-\lambda}\ \sum^\infty_{k\eq 0}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert[/math]

    [math]\eq e^{-\lambda}{\left[\frac{\lambda^0}{0!}\big\vert 0-\lambda\vert \ +\ \sum^\infty_{k\eq 1}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert\right]} [/math]

    [math]\eq e^{-\lambda}{\left[\lambda\ +\ \sum^u_{k\eq 1}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert\ +\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert \right]} [/math] with the understanding that if [ilmath]u\eq 0[/ilmath] that the sum from [ilmath]k\eq 1[/ilmath] to [ilmath]u[/ilmath] evaluates to [ilmath]0[/ilmath], obviously

  • Notice now that:
    1. For the first sum, where [ilmath]1\le k\le u[/ilmath] (specifically that [ilmath]k\le u[/ilmath]) we have [ilmath]k\le \lambda[/ilmath]
       • and that from further above we noticed if [ilmath]k\le \lambda[/ilmath] then [ilmath]\big\vert k-\lambda\big\vert \eq \lambda-k[/ilmath]
    2. For the second sum, where [ilmath]k > u [/ilmath] that this meant [ilmath]k\ge \lambda[/ilmath]
       • and that from further above we noticed if [ilmath]k\ge\lambda[/ilmath] then [ilmath]\big\vert k-\lambda\big\vert\eq k-\lambda[/ilmath], so
  • [math]\LHS{}\eq e^{-\lambda}{\left[\lambda\ +\ \sum^u_{k\eq 1}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert\ +\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\big\vert k-\lambda\big\vert \right]} [/math]

    [math]\eq e^{-\lambda}{\left[\lambda\ +\ \sum^u_{k\eq 1}\frac{\lambda^k}{k!}(\lambda-k)\ +\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}( k-\lambda)\right]} [/math]

    • we now expand these sums:

    [math]\eq e^{-\lambda}{\Bigg[\lambda\ +\ \overbrace{\sum^u_{k\eq 1}\frac{\lambda^{k+1} }{k!}\ -\ \sum^u_{k\eq 1}\frac{k\lambda^k}{k!} }^\text{first sum}\ +\ \overbrace{\sum^\infty_{k\eq v}\frac{k\lambda^k}{k!}-\sum^\infty_{k\eq v}\frac{\lambda^{k+1} }{k!} }^\text{second sum}\ \Bigg]} [/math]

    [math]\eq e^{-\lambda}{\left[\lambda\ +\ \lambda{\left(\sum^u_{k\eq 1}\frac{\lambda^k}{k!}\ -\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\right)}\ +\ {\left( \sum^\infty_{k\eq v}\frac{\lambda^k}{(k-1)!}\ -\ \sum^u_{k\eq 1}\frac{\lambda^k}{(k-1)!}\right)}\right]} [/math], by grouping the terms and factorising where we can

    [math]\eq e^{-\lambda}{\left[\lambda\ +\ \lambda{\left(\sum^u_{k\eq 1}\frac{\lambda^k}{k!}\ -\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\right)}\ +\ {\left( \sum^\infty_{k\eq v-1}\frac{\lambda^{k+1} }{k!}\ -\ \sum^{u-1}_{k\eq 0}\frac{\lambda^{k+1} }{k!}\right)}\right]} [/math]^{[Note 4]} by reindexing the latter two sums

    [math]\eq e^{-\lambda}{\left[\lambda\ +\ \lambda{\left(\sum^u_{k\eq 1}\frac{\lambda^k}{k!}\ -\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\right)}\ +\ \lambda{\left( \sum^\infty_{k\eq v-1}\frac{\lambda^{k} }{k!}\ -\ \sum^{u-1}_{k\eq 0}\frac{\lambda^{k} }{k!}\right)}\right]} [/math]

    [math]\eq \lambda e^{-\lambda}{\left[1\ +\ {\left(\sum^u_{k\eq 1}\frac{\lambda^k}{k!}\ -\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!}\right)}\ +\ {\left( \sum^\infty_{k\eq v-1}\frac{\lambda^{k} }{k!}\ -\ \sum^{u-1}_{k\eq 0}\frac{\lambda^{k} }{k!}\right)}\right]} [/math]

  • For convienence let us assign the sums letters:
    • [math]\eq \lambda e^{-\lambda}{\Bigg[1\ +\ \underbrace{\sum^u_{k\eq 1}\frac{\lambda^k}{k!} }_\text{A}\ -\ \underbrace{\sum^\infty_{k\eq v}\frac{\lambda^k}{k!} }_\text{B}\ +\ \underbrace{\sum^\infty_{k\eq v-1}\frac{\lambda^{k} }{k!} }_\text{C}\ -\ \underbrace{\sum^{u-1}_{k\eq 0}\frac{\lambda^{k} }{k!} }_\text{D} \Bigg]} [/math]
  • Now we combine the sums:
    • [math]\LHS{}\eq\lambda e^{-\lambda}{\Bigg[1+\underbrace{\sum^{u-1}_{k\eq 1}\frac{\lambda^k}{k!}+\frac{\lambda^u}{u!} }_\text{A}\ -\ \underbrace{\sum_{k\eq v}^\infty \frac{\lambda^k}{k!} }_\text{B}\ +\ \underbrace{ \frac{\lambda^{v-1} }{(v-1)!}\ +\ \sum^\infty_{k\eq v}\frac{\lambda^k}{k!} }_\text{C}\ -\ \underbrace{ \frac{\lambda^0}{0!}\ -\ \sum^{u-1}_{k\eq 1}\frac{\lambda^k}{k!} }_\text{D} \Bigg]} [/math]

      [math]\eq \lambda e^{-\lambda}{\Bigg[ 1\ -\ \frac{\lambda^0}{0!} \ +\ \frac{\lambda^u }{u!} \ +\ \frac{\lambda^{v-1} }{(v-1)!} \Bigg]} [/math] - as the sum above in [ilmath]\text{ A }[/ilmath] cancels with the sum part of [ilmath]\text{ D }[/ilmath], and [ilmath]\text{ B }[/ilmath] cancels with the sum part of [ilmath]\text{ C }[/ilmath]

      [math]\eq \lambda e^{-\lambda}{\left[ 1-1+2\frac{\lambda^u}{u!} \right]} [/math] - using that [ilmath]v-1\eq u[/ilmath] and tidying up

      [math]\eq 2\lambda e^{-\lambda}\frac{\lambda^u}{u!} [/math]

• Thus we see [math]\text{Mdm}(X)\eq 2\lambda e^{-\lambda}\frac{\lambda^u}{u!} [/math]

Notes

1. ↑ Recall [ilmath]\lambda>0[/ilmath], this means [ilmath]u\ge 0[/ilmath] and thus [ilmath]u\in\mathbb{N}_0[/ilmath]
2. ↑ Which is sometimes written:
   • TODO: It's [n] but with the bottom or top notches removed from the square brackets?
3. ↑ Notice:
   • If [ilmath]\lambda[/ilmath] is not [ilmath]\in\mathbb{N}_{\ge 0} [/ilmath] then [ilmath]u+1\eq\text{RoundUpToInt}(\lambda)[/ilmath], so [ilmath]u+1\eq v\ge \lambda[/ilmath]
   • If [ilmath]\lambda[/ilmath] is in [ilmath]\mathbb{N}_{\ge 0} [/ilmath] then [ilmath]u\eq\lambda[/ilmath] and [ilmath]v\eq u+1> u\eq \lambda[/ilmath] so [ilmath]v > \lambda[/ilmath]
     • Notice [ilmath]\big(v > \lambda\big)\implies\big(v\ge \lambda\big)[/ilmath]
   So either way, [ilmath]v\ge \lambda[/ilmath]
4. ↑ Note that the third sum should have "[ilmath]\infty-1[/ilmath]" as its upper index, however remember that when a sum is to [ilmath]\infty[/ilmath] this is actually a limit, it was in this case:
   • [math]\lim_{n\rightarrow\infty}\left(\sum^n_{k\eq v}\cdots\right)[/math]
   and became
   • [math]\lim_{n\rightarrow\infty}\left(\sum^{n-1}_{k\eq v-1}\cdots\right)[/math]

References

1. ↑ Alec's own work, I actually kept muddling it up on paper so this page IS the reference!