How the false positive value affects accuracy? T P <mtext>&#xA0;</mtext> ( t r

Azzalictpdv 2022-05-07 Answered
How the false positive value affects accuracy?
T P   ( t r u e   p o s i t i v e )   =   2739
T N   ( t r u e   n e g a t i v e )   =   103217
F P   ( f a l s e   p o s i t i v e )   =   43423
F N   ( f a l s e   n e g a t i v e )   =   5022
a c c u r a c y = T P + T N T P + T N + F P + F N
In this case the accuracy is 0.68. Can I say that I have low accuracy because the value false positive is high? There is any relathion between false positive and the parameters true positive or true negative?
You can still ask an expert for help

Expert Community at Your Service

  • Live experts 24/7
  • Questions are typically answered in as fast as 30 minutes
  • Personalized clear answers
Learn more

Solve your problem for the price of one coffee

  • Available 24/7
  • Math expert for every subject
  • Pay only if we can solve it
Ask Question

Answers (1)

Calvin Oneill
Answered 2022-05-08 Author has 17 answers
You might be interested in the false positive rate. This is
F P R = F P / ( T N + F P ) = 43423 / ( 43423 + 103217 ) = 0.3
F N R = F N / ( T P + F N ) = 5022 / ( 2739 + 5022 ) = 0.65
Your false positive rate is actually very low. You are mostly classifying negatives correctly as negative. But your false negative rate is higher at 0.65. You are not detecting enough images that are actually true images. For a more detailed discussion, read on.
The accuracy is an overall summary of the success of your tests. It is sometimes helpful to look at a breakdown of it into sensitivity and specificity. Sensitivity is the true positive rate, i.e. the chance your program predicts a positive given that it's supposed to be positive. Specificity is the true negative rate, i.e. the proportion of negatives correctly predicted as negative.
s e n s i t i v i t y = T P T P + F N = 2739 2739 + 5022 = 0.35
s p e c i f i c i t y = T N T N + F P = 103217 103217 + 43423 = 0.7
Based on these results, it seems that your test is not as good as identifying positives as it is at correctly identifying negatives. One possible problem could be that there is a difference in the prevalence of images from the truth and produced by your computer algorithm. Here a confusion matrix of the data you have collected:
a c t u a l p r e d i c t e d t r u t h a l g o r i t h m t r u t h 2739 43423 a l g o r i t h m 5022 103217
If you compute the accuracies separately for the true images and the algorithm images, you find that the accuracy for the true images is 2739 2739 + 5022 = 0.35 and the accuracy for your algorithmic images is 103217 103217 + 43423 = 0.7. (Notice these are the definitions of sensitivity and specificity, the same above.) The reason that your overall accuracy is high is because you have a much higher prevalence of algorithm-generated images; your algorithm tends to guess conservatively, and the fact that there are more algorithm generated images pushes your overall accuracy up.
A useful one-number summary combining sensitivity and specificity is the F 1 score, defined as
1 β 2 β 2 + 1 1 s e n s i t i v i t y + 1 1 + β 2 1 s p e c i f i c i t y
When β = 1, a common choice, this is the harmonic average of sensitivity and specificity:
1 1 2 ( 1 s e n s i t i v i t y + 1 s p e c i f i c i t y )
The F 1 score of your test is 0.47. The closer to 1, the better. You might try to optimize your algorithm based on the F 1 score.
There is some difference between your F 1 score and accuracy:
F 1 : 0.47
a c c u r a c y : 0.68
Not exactly what you’re looking for?
Ask My Question

Expert Community at Your Service

  • Live experts 24/7
  • Questions are typically answered in as fast as 30 minutes
  • Personalized clear answers
Learn more

Relevant Questions

asked 2022-05-01
The latest worldwide virus has an infection rate of 0.1 % (that is, 1 in 1000 people actually have the virus). The chance that someone who has the virus tests positive is said to be 99 %. The chance that someone who does not have the virus tests negative is also said to be 99 %. What are the chances that someone who tests positive does not in fact have the virus (a “false positive”)?
asked 2022-05-10
in order to remember stuff i need to understand their reason. Right now i cannot remember what is type 1 error and what is type 2 error why is the reason type 1 is false positive?
asked 2022-04-06
What is the rationale behind ROC curves?
I am not sure how ROC curves work. I see that the X-Axis is the false positive rate while the Y axis is the true positive rate.
1) I don't understand how for a given statistical learning model, you could have the true positive and false positive rate to vary from 0 to
1. Are you changing parameters in the model to make it so?
2) What about true negatives and false negatives? How are these represented in the curve?
asked 2022-04-06
The occurrence of false positives [in some experiment] is 40%
What does this mean? Does it mean that 40% of positives are false? Or 40% of all tested patients are specifically both false and positive? Or say 40% of those that are false are positive?
asked 2022-04-07
The prevalence of breast cancer in women over 40 in country X is estimated to be 0.8% (i.e., 8 in every 1,000 women in that age group).
Mammograms test for the presence of breast cancer. A positive result indicates that the disease is present. A negative result indicates that it is not.
The sensitivity of a mammogram test for breast cancer is estimated to be 90%. This is the probability that the mammogram will give a positive result when the person being tested does have breast cancer.
The false positive rate for the mammogram is 7.5%. This is the probability that the mammogram will give a positive test result when the person being tested does not have breast cancer.
All women who test positive (816) in the mammogram are referred for a further, different examination, which however has the same sensitivity and false positive rates as the first test.
What is the probability that a woman referred for this examination and testing positive again, actually does have breast cancer?
asked 2022-05-08
My problem is the following. I like to know if there exist a sentence true in complex a field but false in a field of positive characteristic.
asked 2022-05-10
"A certain disease has an incidence rate of 2%. If the false negative rate is 10% and the false positive rate is 1%, compute the probability that a person who tests positive actually has the disease."
Why do we need to use Bayes' Theorem for this question?