Some moments occur when we notice that we have seen this term somewhere and we don’t remember what it exactly means. Entropy and information gain belong to the same categories of terminologies.

We will try to understand entropy and information gain in a very simple and uncomplicated way. A basic understanding of the decision tree is required to understand these two terminologies. If you haven’t yet seen what is a decision tree, that really cool you are at the right address, you’ll take away something memorable from here.