Three Questions on Interpreting the Outcome of the Probability Density FunctionI have three questions: What is the interpretation of the outcome of the Probability Density Function (PDF) at a particular point? How is this result related to probability? What we exactly do when we maximize the likelihood?To better explain my questions:(i) Consider a continuous random variable X with a normal distribution such that μ = 1.5 and σ 2 = 2. If we evaluate the PDF at a particular point, say 3.4, using the formula: f ( X ) = 1 2 π σ 2 e − ( X − μ ) 2 2 σ 2 ,we get f ( 3.4 ) = 0.1144. How we interpret this value?(ii) I previously read that the result of 0.1144 is not necessarily the probability that X takes the value of 3.4. But how the result is related to probability concept?(iii) Consider a sample of the continuous random variable X of size N=2.5, such that X 1 = 2 and X 2 = 3.5. We can use this sample to maximize the log-likelihood: max ln ⁡ L ( μ , σ | X 1 , X 2 ) = ln ⁡ f ( X 1 ) + ln ⁡ f ( X 2 )If f(X) is not exactly a probability, what are we maximizing? Some texts detail that "we are maximizing the probability that a model (set of parameters) reproduces the original data". Is this phrase incorrect?

Question

Three Questions on Interpreting the Outcome of the Probability Density FunctionI have three questions: What is the interpretation of the outcome of the Probability Density Function (PDF) at a particular point? How is this result related to probability? What we exactly do when we maximize the likelihood?To better explain my questions:(i) Consider a continuous random variable X with a normal distribution such that   μ  =  1.5 and       σ    2    =  2. If we evaluate the PDF at a particular point, say 3.4, using the formula:  f  (  X  )  =      1                  2        π                  σ          2                          e                            −                                    (                              X                −                μ                            )                        2                                    2                      σ            2                                   ,we get   f  (  3.4  )  =  0.1144. How we interpret this value?(ii) I previously read that the result of 0.1144 is not necessarily the probability that X takes the value of 3.4. But how the result is related to probability concept?(iii) Consider a sample of the continuous random variable X of size N=2.5, such that       X          1        =  2 and       X          2        =  3.5. We can use this sample to maximize the log-likelihood:  max  ln  ⁡  L  (  μ  ,  σ      |        X          1        ,      X          2        )  =  ln  ⁡  f  (      X    1    )  +  ln  ⁡  f  (      X    2    )If f(X) is not exactly a probability, what are we maximizing? Some texts detail that &quot;we are maximizing the probability that a model (set of parameters) reproduces the original data&quot;. Is this phrase incorrect?

Leland Ochoa · Accepted Answer

I&#039;m not an expert, but this is the way I understand it. Denote the cumulative distribution function (CDF) by      F                            X                      (  x  )  =      ∫          −      ∞        x        f                            X                      (  t  )     d  t  .(i) For small ε,      f                            X                      (  x  )  ≈                    F                                            X                                          (      x      +      ε      )      −              F                                            X                                          (      x      )        ε    ,so      F                            X                      (  x  +  ε  )  ≈      F                            X                      (  x  )  +  ε  ⋅      f                            X                      (  x  )  .     (  ∗  )That is, the PDF       f                            X                      (  x  ) gives the &quot;rate of change&quot; of the CDF       F                            X                      (  x  ).To illustrate using your example, we can approximate       F                            X                      (  3.401  ) using (∗) above. We get                              F                                                    X                                                    (        3.401        )                            ≈                  F                                                    X                                                    (        3.4        )        +        0.001        ⋅                  f                                                    X                                                    (        3.4        )                                          =        0.910445404        +        0.001        ⋅        0.114404814                                          =        0.910559808.            Using Excel, we see that       F                            X                      (  3.401  )  =  0.910559754, which is very close to our approximation. (I also used Excel to compute       F                            X                      (  3.4  ).)(ii) As you said,       f                            X                      (  3.4  ) is not the probability that X=3.4. In fact, the probability that X=3.4 if X is a continuous random variable is 0 since      ∫          3.4              3.4            f                            X                      (  t  )     d  t  =  0.In general, the probability that X=x, where x is a real number, is 0.

Tristian Velazquez · Accepted Answer

The probability density function is the unsigned derivative of the cumulative probability function.      f                  X              (  x  )  =      |                                                                                        d                                                                                                                d                                x                                                          P                    (          X          ≤          x          )                      |  It may be considered the &quot;gradient of the tangent&quot; of the curve; that is, the &quot;rate of change&quot; of accumulation of probability, as value for the continuous random variable increases.So you are maximising the amount the parameters contribute to immediate accumulation of probability around the data points.

Three Questions on Interpreting the Outcome of the Probability Density Function I have three questi

Answered question

Answer & Explanation

New Questions in Pre-Algebra