Entropy o Let us say, I am considering an action like a coin toss. Say, I have five coins with probabilities for heads 0, 0.25, 0.5, 0.75 and 1. When I toss them which one has highest uncertainty and which one has the least? o Information gain= Entropy of the system before split-Entropy of the system after split 1515 Entropy ⚫ Let us say, I am considering an action like a coin toss. Say, I have five coins with probabilities for heads 0, 0.25, 0.5, 0.75 and 1. When I toss them which one has highest uncertainty and which one has the least? ⚫ Information gain= Entropy of the system before split – Entropy of the system after split