Information Gain Calculator
This page exists due to the efforts of the following people:
 | Patrick Sor
|
 | Timur
|
Karen Luckhurst
|
This content is licensed under Creative Commons Attribution/Share-Alike License 3.0 (Unported). That means you may freely redistribute or modify this content under the same license conditions and must attribute the original author by placing a hyperlink from your site to this work https://planetcalc.com/8403/. Also, please do not modify any references to the original work (if any) contained in this content.
Is use in decision tree.
Formula as below:
def two_group_ent(first, tot):
return -(first/totnp.log2(first/tot) +
(tot-first)/totnp.log2((tot-first)/tot))
tot_ent = two_group_ent(10, 24)
g17_ent = 15/24 two_group_ent(11,15) +
9/24 two_group_ent(6,9)
answer = tot_ent - g17_ent
Created by this request
| Information gain calculator This online calculator calculates information gain, the change in information entropy from a prior state to a state that takes some information as given |
Comments