Conditional Probability

Conditional Probability

Conditional probability is the probability of an event occurring given that another event has already occurred. It helps us to refine the probability of an event when we know some additional information about the situation.

In formal terms, the conditional probability of an event $A$ given that another event $B$ has occurred is denoted as $P(A \mid B)$, and is defined as:

Where:

• $P(A \mid B)$ is the probability of event $A$ occurring given that event $B$ has occurred.
• $P(A \cap B)$ is the probability of both events $A$ and $B$ occurring (i.e., the intersection of $A$ and $B$).
• $P(B)$ is the probability of event $B$ occurring. It must be greater than zero ($P(B) > 0$), since we're conditioning on the occurrence of $B$.

Key Points:

1. Conditional Probability refines the probability of an event by considering the restriction imposed by the occurrence of another event.
2. The denominator $P(B)$ is the probability of event $B$ occurring, and the numerator $P(A \cap B)$ reflects the probability of both events occurring together.

Example 1: Drawing a Card from a Deck

Let's use a standard deck of 52 cards to demonstrate conditional probability.

• Event $A$: Drawing a face card (Jack, Queen, King).
• Event $B$: Drawing a red card (Hearts or Diamonds).

We are interested in finding the probability of drawing a face card (event $A$) given that a red card (event $B$) has already been drawn.

1. Calculate $P(B)$: The deck has 26 red cards (13 Hearts and 13 Diamonds). Therefore, the probability of drawing a red card is:

   $$P(B) = \frac{26}{52} = \frac{1}{2}$$

2. Calculate $P(A \cap B)$: The red face cards are the Jack, Queen, and King of Hearts and Diamonds, so there are 6 red face cards in total. Therefore, the probability of drawing a red face card is:

   $$P(A \cap B) = \frac{6}{52} = \frac{3}{26}$$

3. Apply the formula for conditional probability:

   $$P(A \mid B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{3}{26}}{\frac{1}{2}} = \frac{3}{13}$$

Thus, the probability of drawing a face card given that a red card has been drawn is $\frac{3}{13}$.

General Formula for Conditional Probability with Multiple Events

When there are more than two events, the concept of conditional probability can be extended. For instance, the conditional probability of event $A$ given events $B$ and $C$ is:

Here, you are conditioning on the occurrence of both $B$ and $C$, and you need to adjust for the intersection of all three events.

Conditional Probability in Terms of Bayes' Theorem

One of the most important applications of conditional probability is Bayes' Theorem, which relates conditional probabilities in the reverse direction (i.e., given $A$, we calculate $B$).

Bayes' Theorem states that:

Where:

• $P(B \mid A)$ is the conditional probability of event $B$ given event $A$.
• $P(A \mid B)$ is the conditional probability of event $A$ given event $B$.
• $P(B)$ is the prior probability of event $B$.
• $P(A)$ is the total probability of event $A$, which can be computed using the law of total probability.

Bayes' Theorem is especially useful in fields like medical diagnostics, spam filtering, and machine learning, where you need to update your beliefs about the probability of an event (e.g., having a disease, being a spam message) based on new evidence.

Example 2: Disease Testing (Bayes' Theorem)

Suppose a test is conducted for a disease, and we know the following:

• $P(\text{Disease}) = 0.01$: The prior probability of having the disease is 1%.
• $P(\text{No Disease}) = 0.99$: The probability of not having the disease is 99%.
• $P(\text{Positive Test} \mid \text{Disease}) = 0.95$: The probability of testing positive given that the person has the disease (True Positive Rate).
• $P(\text{Positive Test} \mid \text{No Disease}) = 0.05$: The probability of testing positive given that the person does not have the disease (False Positive Rate).

We want to know the probability that a person actually has the disease, given that they tested positive. This is $P(\text{Disease} \mid \text{Positive Test})$.

Using Bayes' Theorem:

We first need to calculate $P(\text{Positive Test})$, the total probability of testing positive. This is the sum of the probabilities of testing positive for both disease and no disease:

Now, applying Bayes' Theorem:

Thus, even if a person tests positive, there is only about a 16.1% chance that they actually have the disease, which is a relatively low probability due to the low prior probability of the disease and the false positive rate.

Summary of Key Concepts

• Conditional Probability ($P(A \mid B)$) is the probability of event $A$ occurring given that event $B$ has already occurred. It is calculated using: $$P(A \mid B) = \frac{P(A \cap B)}{P(B)}$$
• Bayes' Theorem allows us to reverse the condition, updating the probability of an event $B$ given evidence $A$, using: $$P(B \mid A) = \frac{P(A \mid B) P(B)}{P(A)}$$
• Conditional probability is fundamental in real-world applications like medical diagnosis, risk analysis, and decision-making under uncertainty.

Understanding conditional probability is crucial because it allows us to refine our predictions and decisions based on additional information, making it a powerful tool in both theoretical and applied statistics.