Please visit, subscribe and share 10 Minutes Lectures in Computer Science

# Multiple choices questions in NLP, Natural Language Processing solved MCQ, HMM is a generative model, Why HMM is referred as generative model?

## Natural Language Processing MCQ - Hidden Markov Model (HMM) is a generative model

 Next >

1. A Hidden Markov Model (HMM) is a _____ which means that the model is specified by ______.

a) Discriminative model, P(X, Y)

b) Discriminative model, P(Y|X)

c) Generative model, P(X, Y)

d) Generative model, P(Y|X)

 Answer: (c) Generative model, P(X, Y) Hidden Markov Model (HMM) is a generative model. Generative models capture the joint probability p(X, Y). Generative models calculate the conditional probability P(y|x) using the joint probability as follows; P(y|x) = P(x,y) / P(x) = joint probability / prior probability of x A generative model includes the distribution of the data itself, and tells you how likely a given example is. For example, models that predict the next word in a sequence are typically generative models because they can assign a probability to a sequence of words. Discriminative models, in contrast, use no knowledge about the probability distributions that underlie a data set. They directly calculate the conditional probability, p(y|x), for a data set. They focus on discriminating between classes, as their name suggests, by analyzing the data to calculate decision boundaries between classes.

 Next >

*****************