Why is this estimator biased?How do I check for bias of an estimator?Bootstrap confidence interval for a...

Invalid date error by date command

Store Credit Card Information in Password Manager?

Why is this estimator biased?

How to say when an application is taking the half of your screen on a computer

What features enable the Su-25 Frogfoot to operate with such a wide variety of fuels?

Does IPv6 have similar concept of network mask?

Non-trope happy ending?

What are the advantages of simplicial model categories over non-simplicial ones?

Creepy dinosaur pc game identification

Add big quotation marks inside my colorbox

What is going on with 'gets(stdin)' on the site coderbyte?

Is there a RAID 0 Equivalent for RAM?

Angel of Condemnation - Exile creature with second ability

Why Shazam when there is already Superman?

Multiplicative persistence

Is there a way to get `mathscr' with lower case letters in pdfLaTeX?

It grows, but water kills it

What to do when eye contact makes your subordinate uncomfortable?

Why did the EU agree to delay the Brexit deadline?

Quoting Keynes in a lecture

Recommended PCB layout understanding - ADM2572 datasheet

Biological Blimps: Propulsion

Can a college of swords bard use blade flourish on an OA from dissonant whispers?

Mimic lecturing on blackboard, facing audience



Why is this estimator biased?


How do I check for bias of an estimator?Bootstrap confidence interval for a biased estimatorConceptual question about bias of an estimatorEstimator, unbiased or biasedCalculating risk for a density estimatorLinear model with biased estimatorBias Correction for Estimator with known biasWhy is OLS estimator of AR(1) coefficient biased?Cramer-Rao lower bound for biased estimatorVariance of distribution for maximum likelihood estimator













1












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    1 hour ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    56 mins ago
















1












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    1 hour ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    56 mins ago














1












1








1


1



$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$




$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias




estimation poisson-distribution bias






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked 1 hour ago









QualityQuality

29019




29019








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    1 hour ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    56 mins ago














  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    1 hour ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    56 mins ago








3




3




$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
1 hour ago






$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
1 hour ago














$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
56 mins ago




$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
56 mins ago










2 Answers
2






active

oldest

votes


















3












$begingroup$

Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
$$
E[e^{s X}] = exp(mu(e^s - 1))
$$
for all $s in mathbb{R}$



Proof.
We just compute:
$$
begin{aligned}
E[e^{s X}]
&= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
&= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
&= e^{-mu} e^{mu e^s} \
&= exp(mu(e^s - 1)).
end{aligned}
$$
We will use this result with $s = -1/n$.



If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
$$
widehat{theta}
= expleft(-frac{1}{n} sum_{i=1}^n X_iright)
= prod_{i=1}^n expleft(-frac{X_i}{n}right),
$$
then, using independence,
$$
begin{aligned}
E[widehat{theta}]
&= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
&= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
&= exp(n mu(e^{-1/n} - 1)) \
&neq e^{-mu},
end{aligned}
$$
so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    42 mins ago



















2












$begingroup$

As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



$$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



, provided the expectations exist.



Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



The equality does not hold because $g$ is not an affine function or a constant function.






share|cite|improve this answer









$endgroup$













    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "65"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    3












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      42 mins ago
















    3












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      42 mins ago














    3












    3








    3





    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$



    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$







    share|cite|improve this answer












    share|cite|improve this answer



    share|cite|improve this answer










    answered 45 mins ago









    Artem MavrinArtem Mavrin

    1,066710




    1,066710












    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      42 mins ago


















    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      42 mins ago
















    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    42 mins ago




    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    42 mins ago













    2












    $begingroup$

    As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



    $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



    , provided the expectations exist.



    Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



    The equality does not hold because $g$ is not an affine function or a constant function.






    share|cite|improve this answer









    $endgroup$


















      2












      $begingroup$

      As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



      $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



      , provided the expectations exist.



      Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



      The equality does not hold because $g$ is not an affine function or a constant function.






      share|cite|improve this answer









      $endgroup$
















        2












        2








        2





        $begingroup$

        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.






        share|cite|improve this answer









        $endgroup$



        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered 41 mins ago









        StubbornAtomStubbornAtom

        2,7671532




        2,7671532






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            Gersau Kjelder | Navigasjonsmeny46°59′0″N 8°31′0″E46°59′0″N...

            Image
            Tidlegare republikkarSkipingar i 1433Kommunar i SchwyzDistrikt i SchwyzNedleggingar i 1798Stader ved Vierwaldstättersee kommunekantonenSchwyzSveitskm²VierwaldstätterseeLauerz Gersau Kommunevåpenet til Gersau Plassering Styresmakter Land   Sveits Kanton kantonen Schwyz Distrikt Gersau Språk tysk Geografi Flatevidd  - kommune 23,70 km² Innbyggjarar  - kommune (desember 2010)    - folketettleik 2 094   88,4 /km² Koordinatar 46°59′0″N 8°31′0″E  Koordinatar: 46°59′0″N 8°31′0″E  Høgd over havet 435 moh Diverse annan informasjon Postnummer 6442 Nettstad: www.gersau.ch Freistaat und Republik Gersau Fristaten og republikken Gersau By-republikk og alliert protektorat i Det gamle sveitsiske eidsforundet ←   ← 1433–1798 1814–1818 →   → Hovudstad Gersau Styreform Republikk Historisk periode Tidleg moderne tid  - Kjøpte fridom frå ...
            Read more

            Nässjö kommun Tettstader | Kjelder | NavigasjonsmenyeVIAFISNIGeoNamesMusicBrainz (area)

            Image
            Nässjö kommunKommunar i Jönköpings län svenskeJönköpings länAdministrasjonssenterNässjöAneby kommunEksjö kommunVetlanda kommunSävsjö kommuneVaggeryd kommuneJönköping kommunejernbaneknutepunktBackyard BabiesEidsbergtettstader31. desember2005 Nässjö kommun kommune Kommunevåpen Land   Sverige Len Jönköpings län Landskap Småland Areal 988,49 km²  - land 930,29 km²  - vatn 58,2 km² Folketal 29 375 Wikimedia Commons: Nässjö Municipality Nässjö kommune ligg i det svenske länet Jönköpings län. Administrasjonssenter i kommunen er Nässjö. Kommunen grensar til Aneby kommun i nord, Eksjö kommun og Vetlanda kommun i aust, Sävsjö kommune og Vaggeryd kommune i sør og Jönköping kommune i vest. Kommunen er kjend som jernbaneknutepunkt, og som heimstaden til rockebandet Backyard Babies. Nässjö er venskapskommune med Eidsberg. Nässjö sentrum sett frå vasstårnet. Tettstader | Nässjö kommune har tol...
            Read more

            Kvitkval Innhaldsliste Taksonomi og utvikling | Utsjånad og levevis | Utbreiing | Åtferd |...

            Image
            Nær truga artarPattedyr i NoregNarkvalfamilien tannkvalarktiskenarkvalenmiocenkvalendelfinanetannkvalarLatinbiosonarenekkolokaliseringisbjørnenspekkhoggarinuittarArktisNew YorkNord-AmerikaEuropaJapan Kvitkval Status i verda: Nær truga Status i Noreg: Datamangel Kvitkval Systematikk Domene: Eukaryota Rike: Animalia Rekkje: Chordata Underrekkje: Vertebrata Klasse: Mammalia Orden: Cetaceae Familie: Monodontidae Slekt: Delphinapterus Art: D. leucas Vitskapleg namn Delphinapterus leucas Pallas, 1776 Kvitkval er ein tannkval som lever i arktiske og subarktiske område. Innhaldsliste 1 Taksonomi og utvikling 2 Utsjånad og levevis 3 Utbreiing 4 Åtferd 5 Bestandsstorleik og menneskeleg påverknad 6 Kjelder Taksonomi og utvikling | Kvitkvalen vart første gongen skildra av Peter Simon Pallas i 1776. Han er medlem av Monodontidae -familien saman med narkvalen. D...
            Read more