Information Gain Calculator

Is use in decision tree.
Formula as below:

def two_group_ent(first, tot):
return -(first/totnp.log2(first/tot) +
(tot-first)/tot
np.log2((tot-first)/tot))

tot_ent = two_group_ent(10, 24)
g17_ent = 15/24 two_group_ent(11,15) +
9/24
two_group_ent(6,9)

answer = tot_ent - g17_ent

Created by this request

Information Gain Calculator

This online calculator calculates information gain, the change in information entropy from a prior state to a state that takes some information as given

Creative Commons Attribution/Share-Alike License 3.0 (Unported) PLANETCALC, Information Gain Calculator

Comments