Learn Significance Test with Examples & Questions

Recent questions in Significance tests
College StatisticsAnswered question
Cierra Castillo Cierra Castillo 2022-07-05

I'm having problems to understand the definition of the level of significance α. I thought I knew what α is but I realized I don't.When I stated to study statistics by myself I read this introductory book and everything was fine, the definition is very clear. He says on page 290:
You’re probably wondering, how small does a p-value have to be for us to achieve statistical significance? If we agree that a p-value of 0.0001 is clearly statistically significant and a p-value of 0.50 is not, there must be some point between 0.0001 and 0.50 where we cross the threshold between statistical significance and random chance. That point, measuring when something becomes rare enough to be called “unusual,” might vary a lot from person to person. We should agree in advance on a reasonable cutoff point.
Statisticians call this cutoff point the significance level of a test and usually denote it with the Greek letter α (alpha).
For example, if α=0.05 we say we are doing a 5% test and will call the results statistically significant if the p-value for the sample is smaller than 0.05. Often, short hand notation such as P<0.05 is used to indicate that the p-value is less than 0.05, which means the results are significant at a 5% level.
Now, I'm studying about statistical inference, a more advanced subject, and I realized there are some concepts that don't exactly have the same definition as I studied before. The level of significance is an example.
I'm reading this book and on page 352 he introduces the Neyman-Pearson lemma as a method to find the UMP test.
Example:
On the basis of a random sample of size 1 from the p.d.f. f ( x ; θ ) = θ x θ 1 ,   0 < x < 1   ( θ > 1 )
For θ 1 > θ 0 , the cutoff point is calculated by:
... C = ( 1 α ) 1 θ 0
For θ 1 < θ 0 , we have:
... C = α 1 θ 0
So in this second book, the cutoff point is not necessarily α, I'm confused.
MY ATTEMPT TO UNDERSTAND WITH THE HELP OF THE ANSWERS
The alpha is predetermined, but it doesn't mean I can't have a smaller rejection region. Then I end up having a smaller rejection region using NP lemma with the same level of significance alpha. Some introductory books let the cutoff point to be α by standard (why?), that's the reason of my confusion, I can shrink the rejection region keeping the value of α. Can someone say if I'm right?

College StatisticsAnswered question
woowheedr woowheedr 2022-07-01

I have a question below revolving around two tailed tests, confidence intervals, etc, and I'm really struggling to figure out how to find the correct answers. It's 3am and this is the last question for an assignment due later in the day, and for some reason I can't seem to properly wrap my mind around t-tests and two tail tests and I'm slowly losing my mind. This is my last ditch-attempt and I would really, really appreciate some help.
Below you'll find the question and my attempt at some of the answers, which are probably way off.
Monthly profits (in million dollars) of two phone companies were collected from the past five years (60 months) and some statistics are given in the following table.
Company | Mean | SD
Rogers | 123.7|25.5
Bell | 242.7|15.4
(a) Find a point estimate for the difference in the average monthly profits of these two phone companies.
I subtracted the two means (242.7-123.7) and got 119.
(b) What is the margin of error for a 99% confidence interval for the difference in the average monthly profits of these two phone companies?
z = (1 - 0.99)/2 z = 0.01/2 z =0.005 1 - 0.005 = 0.995 p(z < 3.275) = 0.995
From looking online, I found this formula but I couldn't figure out how to fill in the values: ME = t(stdev/√n)
I don't know where to go from here. I know the formulas for the confidence intervals, but I don't understand what I'm supposed to do given that there are two standard devs and means? I don't know whether n is 60 or 2.
(c) Based on the constructed 99% confidence interval in part (b), can we conclude that there is a difference in the average monthly profits of these two phone companies?
(d) Given the level of significance α = 1%, test whether Bell's average monthly profit is more than Rogers'.

Almost all significance test practice problems that you will encounter below help to find solutions to your questions as the answers deal with the same equations that have been used. Start with any significance test example and you will understand that you only have to change variables to determine each value. It's exactly what makes significance test equation so popular as it provides help with more advanced probability concepts. As you look through significance test questions, look for similar patterns as these are where you must start regardless of whether you deal with a complex engineering project or statistical analysis.