Is there a mathematical basis for the idea that this interpretation of confidence intervals is incorrect, or is it just frequentist philosophy?Suppose the mean time it takes all workers in a particular city to get to work is estimated as 21. A 95% confident interval is calculated to be (18.3,23.7).According to this website, the following statement is incorrect:There is a 95% chance that the mean time it takes all workers in this city to get to work is between 18.3 and 23.7 minutes.Indeed, a lot websites echo a similar sentiment. This one, for example, says:It is not quite correct to ask about the probability that the interval contains the population mean. It either does or it doesn't.The meta-concept at work seems to be the idea that population parameters cannot be random, only the data we obtain about them can be random (related). This doesn't sit right with me, because I tend to think of probability as being fundamentally about our certainty that the world is a certain way. Also, if I understand correctly, there's really no mathematical basis for the notion that probabilities only apply to data and not parameters; in particular, this seems to be a manifestation of the frequentist/bayesianism debate.Question. If the above comments are correct, then it would seem that the kinds of statements made on the aforementioned websites shouldn't be taken too seriously. To make a stronger claim, I'm under the impression that if an exam grader were to mark a student down for the aforementioned "incorrect" interpretation of confidence intervals, my impression is that this would be inappropriate (this hasn't happened to me; it's a hypothetical).In any event, based on the underlying mathematics, are these fair comments I'm making, or is there something I'm missing?

Question

Is there a mathematical basis for the idea that this interpretation of confidence intervals is incorrect, or is it just frequentist philosophy?Suppose the mean time it takes all workers in a particular city to get to work is estimated as 21. A 95% confident interval is calculated to be (18.3,23.7).According to this website, the following statement is incorrect:There is a 95% chance that the mean time it takes all workers in this city to get to work is between 18.3 and 23.7 minutes.Indeed, a lot websites echo a similar sentiment. This one, for example, says:It is not quite correct to ask about the probability that the interval contains the population mean. It either does or it doesn&#039;t.The meta-concept at work seems to be the idea that population parameters cannot be random, only the data we obtain about them can be random (related). This doesn&#039;t sit right with me, because I tend to think of probability as being fundamentally about our certainty that the world is a certain way. Also, if I understand correctly, there&#039;s really no mathematical basis for the notion that probabilities only apply to data and not parameters; in particular, this seems to be a manifestation of the frequentist/bayesianism debate.Question. If the above comments are correct, then it would seem that the kinds of statements made on the aforementioned websites shouldn&#039;t be taken too seriously. To make a stronger claim, I&#039;m under the impression that if an exam grader were to mark a student down for the aforementioned &quot;incorrect&quot; interpretation of confidence intervals, my impression is that this would be inappropriate (this hasn&#039;t happened to me; it&#039;s a hypothetical).In any event, based on the underlying mathematics, are these fair comments I&#039;m making, or is there something I&#039;m missing?

Kiley Hunter · Accepted Answer

We need to distinguish between two claims here:Population parameters cannot be random, only the data we obtain about them can be random.Interpreting confidence intervals as containing a parameter with a certain probability is wrong.The first is a sweeping statement that you correctly describe as frequentist philosophy (in some cases “dogma” would seem more appropriate) and that you don&#039;t need to subscribe to if you find a subjectivist interpretation of probabilities to be interesting, useful or perhaps even true. (I certainly find it at least useful and interesting.)The second statement, however, is true. Confidence intervals are inherently frequentist animals; they&#039;re constructed with the goal that no matter what the value of the unknown parameter is, for any fixed value you have the same prescribed probability of constructing a confidence interval that contains the “true” value of the parameter. You can&#039;t construct them according to this frequentist prescription and then reinterpret them in a subjectivist way; that leads to a statement that&#039;s false not because it doesn&#039;t follow frequentist dogma but because it wasn&#039;t derived for a subjective probability. A Bayesian approach leads to a different interval, which is rightly given a different name, a credible interval.An instructive example is afforded by the confidence intervals for the unknown rate parameter of a Poisson process with known background noise rate. In this case, there are values of the data for which it is certain that the confidence interval does not contain the “true” parameter. This is not an error in the construction of the intervals; they have to be constructed like that to allow them to be interpreted in a frequentist manner. Interpreting such a confidence interval in a subjectivist manner would result in nonsense. The Bayesian credible intervals, on the other hand, always have a certain probability of containing the “random” parameter.I read a nice exposition of this example recently but I can&#039;t find it right now – I&#039;ll post it if I find it again, but for now I think this paper is also a useful introduction. (Example 11 on p. 20 is particularly amusing.)

Sam Hardin · Accepted Answer

The very technical definition of a 95% confidence interval implies that if we were to repeat the experiment 100 times, 95 of those times our confidence interval would have the true population mean.So saying that a confidence interval is the probability that the true population mean lies in it does not seem intuitively wrong, but technically the probabilities might work out differently depending on how we state it.The definition relies upon the true population mean being a constant and our intervals kinda guessing it, whereas the usual, technically incorrect, intuitive answer depends upon our confidence interval being constant and our true mean shifting around randomly.I hope this sheds some light on this topic.