Courses
Courses for Kids
Free study material
Offline Centres
More
Store Icon
Store

Understanding Probability and Likelihood in Statistics

Reviewed by:
ffImage
hightlight icon
highlight icon
highlight icon
share icon
copy icon

Difference between probability and likelihood with formula and examples

The likelihood is the condition of being likely or probable; the probability of a chance or a probability of something. Example: There is a strong likelihood of him being the class monitor. The probability of an event is a number telling the possibility that the event will happen. An event that is sure to occur has a probability of 1.

An event that possibly cannot occur has a probability of zero. If there is a possibility that an event can occur or not, then its probability is between zero and 1. In this article, we will see the terms related to probability.

Probability chart


Probability chart


What is Probability?

Probability defines the likelihood of the occurrence of an event. Probability can be defined as the ratio of the number of favorable outcomes to an event's total number of outcomes. Probability generally has great applications in games and in business to make probability-based predictions, and also, probability has extensive applications in this new area of artificial intelligence.

Terms Related to Probability

Following are some of the terms related to probability:

Experiment- A process that can deliver some well-defined results is called an experiment. Each outcome is known as an event.

Random Experiment- In an experiment where all probable results are known in advance, but the exact result cannot be predicted is known as a random experiment.

Thus, when we toss a coin, we know all possible outcomes: Heads or Tails.

Though, when we toss a coin randomly, we cannot foresee in advance whether it will be a head or a tail.

So, tossing a coin is a random experiment.

Likewise, tossing a die is also a random experiment.

Trial- Through a trial, we understand conducting a random experiment.

For instance:- Tossing a dice or tossing a coin etc.

Probability of Happening of an Event- The probability of happening of an event can be defined as $P$ (happening of an event) $=E_2$ (Number of trials in which the event successfully happened.) divided by $E_1$ (the total number of trials.)

$P=\dfrac{E_2}{E_1}$.

What is Likelihood?

Things that will certain to happen i.e. if you mean something is likely to happen, and you give the idea that no matter what plot you come up with to wind things around but it will still happen sooner or later.


Difference Between Sure and Impossible Event

Following is the difference between a sure and impossible event:


Sure Event

Impossible Event

If the probability of occurrence of an event is 1, it is called a sure event.

If the probability of occurrence of an event is 0, such an event is called an impossible event.

The sample space S is a sure event.

The empty set $\phi$ is an impossible event.

The probability of a sure event is always 1.

The probability of an impossible event is always 0.

Sure event examples will be getting the number 6 when a die is rolled or getting head when tossing a coin.

An example of an impossible event will be getting a number greater than 6 when a die is rolled.


Types of events

Types of events

Real-Life Example of Probability

Probability in day-to-day life, we come across mentions such as

  1. Most probably, it will be sunny today.

  2. Chances are high that the prices of diesel will go up.

  3. I doubt that he will win the match.

The words ‘most probably’, ‘chances,’ ‘doubt’, etc., indicate the probability of happening an event.

Fun Activity

Tell whether the given below is certain to occur, impossible to occur, or can occur but not certain.

(i) You are older today than yesterday.

(ii) A tossed coin will land with heads-up.

(iii) A dice, when tossed, shall land up with 9 on top.

(iv) The next traffic light seen will be yellow.

(v) Tomorrow will be a rainy day.

Make your Guess.

Ans:

i) Certain to happen.

ii) It can occur but not certain.

iii) Impossible

iv) It can occur but not certain.

v) It can occur but not certain

Solved Examples

Q 1. There are 6 cushions in the bed. 3 are yellow, 2 are red, and 1 is green. What is the probability of picking a red cushion?

Ans: The probability is = to the number of red cushions divided by the total number of cushions, that is $\dfrac{2}{6} = \dfrac{1}{3}$.

Q 2. There is a box full of colored jars, red, blue, green, and orange. Some of the jars are picked out and displaced. Aditi did this 1000 times and reached the given results:

Number of blue jars picked out: 300

Number of red jars: 200

Number of orange jars: 450

Number of green jars: 50

What is the probability that Aditi will pick a green jar?

Ans: For every 1000 jars picked out, 450 are orange.

Therefore, P(orange) = $\dfrac{450}{1000}$

= 0.45

Practice Questions

Q 1. In a toss of a coin, what is the probability of getting a head?

Ans: $\dfrac{1}{2}$

Summary

The probability of an event occurring is defined by likelihood. The outcome of an event may be sure or not sure to us. When this happens, we say there is a chance that the event will happen. In this article, we saw how Probability plays an important role in everyday life. Even in sports and gaming strategies, weather forecasts, selling or buying insurance, online shopping, online games, checking blood groups, and analyzing political strategies. With the right sense of probability leading, life can be easier. So it is necessary to learn the basic concept of probability.

FAQs on Understanding Probability and Likelihood in Statistics

1. What is the difference between probability and likelihood?

The main difference is that probability measures the chance of data given a fixed parameter, while likelihood measures how plausible a parameter is given observed data.

  • Probability: P(Data | Parameter) — the parameter is fixed, and outcomes vary.
  • Likelihood: L(Parameter | Data) — the data is fixed, and the parameter varies.
  • In probability, outcomes are random; in likelihood, parameters are unknown and estimated.
For example, in a coin toss, probability finds the chance of 3 heads if the coin bias is known, while likelihood helps estimate the coin’s bias after observing 3 heads.

2. What is probability in statistics?

In statistics, probability is the numerical measure of how likely an event is to occur, ranging from 0 to 1.

  • Formula for equally likely outcomes: P(A) = (Number of favorable outcomes) / (Total outcomes)
  • P(A) = 0 means impossible event.
  • P(A) = 1 means certain event.
For example, the probability of getting a head when tossing a fair coin is 1/2.

3. What is likelihood in statistics?

In statistics, likelihood is a function that measures how likely a parameter value is given observed data.

  • Written as L(θ) = P(Data | θ), where θ is the parameter.
  • The data is fixed, and θ varies.
  • Used mainly in maximum likelihood estimation (MLE).
For example, if we observe 8 heads in 10 tosses, likelihood helps determine which coin bias θ makes this outcome most plausible.

4. What is the formula for likelihood?

The likelihood function is given by L(θ) = P(X = x | θ), where θ is the parameter and x is observed data.

  • For independent observations: L(θ) = ∏ P(xᵢ | θ)
  • For a binomial model: L(p) = (nCx) pˣ (1−p)ⁿ⁻ˣ
Here, n is number of trials, x is successes, and p is probability of success. In likelihood, n and x are fixed while p varies.

5. How do you calculate probability?

Probability is calculated using P(A) = (Favorable outcomes) / (Total possible outcomes) when outcomes are equally likely.

  • Step 1: Count total possible outcomes.
  • Step 2: Count favorable outcomes.
  • Step 3: Divide favorable by total.
Example: For a fair die, probability of rolling a 4 is 1/6 because there is 1 favorable outcome out of 6 possible outcomes.

6. How do you calculate likelihood with an example?

Likelihood is calculated by fixing observed data and expressing the probability as a function of the parameter.

  • Example: 3 heads in 5 tosses.
  • Likelihood function: L(p) = (5C3) p³ (1−p)²
  • Here, 5C3 and data (3 heads) are fixed; p varies.
To find the most likely value of p, maximize L(p). For this example, the maximum occurs at p = 3/5 = 0.6.

7. Why is likelihood not a probability?

Likelihood is not a probability because it does not sum or integrate to 1 over parameter values.

  • Probability sums to 1 over all possible outcomes.
  • Likelihood compares relative support for different parameter values.
  • It is a function of θ, not a probability distribution over θ.
Thus, likelihood measures plausibility, not the probability of a parameter.

8. What is maximum likelihood estimation (MLE)?

Maximum likelihood estimation (MLE) is a method that finds the parameter value that maximizes the likelihood function.

  • Step 1: Write the likelihood L(θ).
  • Step 2: Take the natural log to get log-likelihood (optional but easier).
  • Step 3: Differentiate and set derivative equal to 0.
  • Step 4: Solve for θ.
For a binomial model with x successes in n trials, the MLE is θ̂ = x/n.

9. Can probability and likelihood have the same formula?

Yes, probability and likelihood can have the same mathematical formula, but they are interpreted differently.

  • Both may use (nCx) pˣ (1−p)ⁿ⁻ˣ in a binomial setting.
  • In probability, p is fixed and x varies.
  • In likelihood, x is fixed and p varies.
The formula looks identical, but the role of parameter and data is reversed.

10. What is an example that explains probability vs likelihood clearly?

A clear example is a biased coin tossed 4 times with 3 heads observed.

  • Probability: If p = 0.5, then P(3 heads) = (4C3)(0.5)³(0.5)¹ = 0.25.
  • Likelihood: Given 3 heads, the likelihood function is L(p) = (4C3) p³ (1−p).
Probability asks, “What is the chance of 3 heads if p = 0.5?” while likelihood asks, “Which value of p best explains 3 heads?”