
Mushroom data set (UCI)
Number of features = 22
Total number of instances = 8124
Number of classes: 2
probability of class 0 in the whole set: 0.482029
probability of class 1 in the whole set: 0.517971
feature 0, with number of values = 6
feature 1, with number of values = 4
feature 2, with number of values = 10
feature 3, with number of values = 2
feature 4, with number of values = 9
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 12
feature 9, with number of values = 2
feature 10, with number of values = 4
feature 11, with number of values = 4
feature 12, with number of values = 4
feature 13, with number of values = 9
feature 14, with number of values = 9
feature 15, with number of values = 1
feature 16, with number of values = 4
feature 17, with number of values = 3
feature 18, with number of values = 5
feature 19, with number of values = 9
feature 20, with number of values = 6
feature 21, with number of values = 7
Conditional probability table for naive Bayes classifier trained on the whole data set:
0/1 loss if no feature was used (error of random):0.482029
feature: 0, with gini loss: 0.469583, with 0/1 loss: 0.43582 (when used alone for prediction)
class: 0
value: 0, prob: 0.435747
value: 1, prob: 0.0124936
value: 2, prob: 0.000254972
value: 3, prob: 0.396991
value: 4, prob: 0.153238
value: 5, prob: 0.00127486
class: 1
value: 0, prob: 0.462506
value: 1, prob: 0.0961082
value: 2, prob: 0.00783104
value: 3, prob: 0.378975
value: 4, prob: 0.0543427
value: 5, prob: 0.000237304
feature: 1, with gini loss: 0.480107, with 0/1 loss: 0.419585 (when used alone for prediction)
class: 0
value: 0, prob: 0.360459
value: 1, prob: 0.444133
value: 2, prob: 0.194133
value: 3, prob: 0.00127551
class: 1
value: 0, prob: 0.271842
value: 1, prob: 0.357312
value: 2, prob: 0.370608
value: 3, prob: 0.000237417
feature: 2, with gini loss: 0.475891, with 0/1 loss: 0.404948 (when used alone for prediction)
class: 0
value: 0, prob: 0.260061
value: 1, prob: 0.171421
value: 2, prob: 0.0817626
value: 3, prob: 0.206062
value: 4, prob: 0.223383
value: 5, prob: 0.0226694
value: 6, prob: 0.0308202
value: 7, prob: 0.000254712
value: 8, prob: 0.00331126
value: 9, prob: 0.000254712
class: 1
value: 0, prob: 0.299905
value: 1, prob: 0.0950688
value: 2, prob: 0.170934
value: 3, prob: 0.244903
value: 4, prob: 0.148174
value: 5, prob: 0.0135135
value: 6, prob: 0.0116169
value: 7, prob: 0.00403035
value: 8, prob: 0.00782361
value: 9, prob: 0.00403035
feature: 3, with gini loss: 0.37388, with 0/1 loss: 0.256153 (when used alone for prediction)
class: 0
value: 0, prob: 0.15952
value: 1, prob: 0.84048
class: 1
value: 0, prob: 0.653919
value: 1, prob: 0.346081
feature: 4, with gini loss: 0.0306557, with 0/1 loss: 0.0158426 (when used alone for prediction)
class: 0
value: 0, prob: 0.0654777
value: 1, prob: 0.000254777
value: 2, prob: 0.000254777
value: 3, prob: 0.030828
value: 4, prob: 0.550573
value: 5, prob: 0.049172
value: 6, prob: 0.147006
value: 7, prob: 0.147006
value: 8, prob: 0.00942675
class: 1
value: 0, prob: 0.000237135
value: 1, prob: 0.0950913
value: 2, prob: 0.0950913
value: 3, prob: 0.808395
value: 4, prob: 0.000237135
value: 5, prob: 0.000237135
value: 6, prob: 0.000237135
value: 7, prob: 0.000237135
value: 8, prob: 0.000237135
feature: 5, with gini loss: 0.491106, with 0/1 loss: 0.482029 (when used alone for prediction)
class: 0
value: 0, prob: 0.995151
value: 1, prob: 0.00484941
class: 1
value: 0, prob: 0.954157
value: 1, prob: 0.0458432
feature: 6, with gini loss: 0.438862, with 0/1 loss: 0.38411 (when used alone for prediction)
class: 0
value: 0, prob: 0.971159
value: 1, prob: 0.0288412
class: 1
value: 0, prob: 0.714727
value: 1, prob: 0.285273
feature: 7, with gini loss: 0.353892, with 0/1 loss: 0.243845 (when used alone for prediction)
class: 0
value: 0, prob: 0.567892
value: 1, prob: 0.432108
class: 1
value: 0, prob: 0.0686461
value: 1, prob: 0.931354
feature: 8, with gini loss: 0.269366, with 0/1 loss: 0.195867 (when used alone for prediction)
class: 0
value: 0, prob: 0.0165479
value: 1, prob: 0.0287678
value: 2, prob: 0.128564
value: 3, prob: 0.163187
value: 4, prob: 0.0628819
value: 5, prob: 0.134674
value: 6, prob: 0.0124745
value: 7, prob: 0.000254582
value: 8, prob: 0.440173
value: 9, prob: 0.00636456
value: 10, prob: 0.0058554
value: 11, prob: 0.000254582
class: 1
value: 0, prob: 0.0817536
value: 1, prob: 0.222038
value: 2, prob: 0.0590047
value: 3, prob: 0.202133
value: 4, prob: 0.226777
value: 5, prob: 0.0485782
value: 6, prob: 0.10545
value: 7, prob: 0.0229858
value: 8, prob: 0.000236967
value: 9, prob: 0.000236967
value: 10, prob: 0.0154028
value: 11, prob: 0.0154028
feature: 9, with gini loss: 0.494162, with 0/1 loss: 0.447095 (when used alone for prediction)
class: 0
value: 0, prob: 0.485197
value: 1, prob: 0.514803
class: 1
value: 0, prob: 0.384086
value: 1, prob: 0.615914
feature: 10, with gini loss: 0.43515, with 0/1 loss: 0.352562 (when used alone for prediction)
class: 0
value: 0, prob: 0.118981
value: 1, prob: 0.0208333
value: 2, prob: 0.859722
value: 3, prob: 0.000462963
class: 1
value: 0, prob: 0.247709
value: 1, prob: 0.146907
value: 2, prob: 0.550115
value: 3, prob: 0.0552692
feature: 11, with gini loss: 0.327061, with 0/1 loss: 0.225768 (when used alone for prediction)
class: 0
value: 0, prob: 0.392092
value: 1, prob: 0.0369898
value: 2, prob: 0.568622
value: 3, prob: 0.00229592
class: 1
value: 0, prob: 0.864435
value: 1, prob: 0.0971035
value: 2, prob: 0.0344255
value: 3, prob: 0.00403609
feature: 12, with gini loss: 0.334679, with 0/1 loss: 0.234129 (when used alone for prediction)
class: 0
value: 0, prob: 0.392092
value: 1, prob: 0.0369898
value: 2, prob: 0.0196429
value: 3, prob: 0.551276
class: 1
value: 0, prob: 0.807455
value: 1, prob: 0.1085
value: 2, prob: 0.0496201
value: 3, prob: 0.0344255
feature: 13, with gini loss: 0.362933, with 0/1 loss: 0.284071 (when used alone for prediction)
class: 0
value: 0, prob: 0.436433
value: 1, prob: 0.000254777
value: 2, prob: 0.330446
value: 3, prob: 0.110318
value: 4, prob: 0.110318
value: 5, prob: 0.000254777
value: 6, prob: 0.000254777
value: 7, prob: 0.00942675
value: 8, prob: 0.00229299
class: 1
value: 0, prob: 0.652834
value: 1, prob: 0.136827
value: 2, prob: 0.136827
value: 3, prob: 0.0040313
value: 4, prob: 0.000237135
value: 5, prob: 0.0230021
value: 6, prob: 0.0457671
value: 7, prob: 0.000237135
value: 8, prob: 0.000237135
feature: 14, with gini loss: 0.368156, with 0/1 loss: 0.286037 (when used alone for prediction)
class: 0
value: 0, prob: 0.42828
value: 1, prob: 0.330446
value: 2, prob: 0.000254777
value: 3, prob: 0.110318
value: 4, prob: 0.114395
value: 5, prob: 0.000254777
value: 6, prob: 0.00636943
value: 7, prob: 0.000254777
value: 8, prob: 0.00942675
class: 1
value: 0, prob: 0.641451
value: 1, prob: 0.136827
value: 2, prob: 0.136827
value: 3, prob: 0.000237135
value: 4, prob: 0.0154138
value: 5, prob: 0.0230021
value: 6, prob: 0.000237135
value: 7, prob: 0.0457671
value: 8, prob: 0.000237135
feature: 15, with gini loss: 0.499354, with 0/1 loss: 0.482029 (when used alone for prediction)
class: 0
value: 0, prob: 1
class: 1
value: 0, prob: 1
feature: 16, with gini loss: 0.487951, with 0/1 loss: 0.481045 (when used alone for prediction)
class: 0
value: 0, prob: 0.997194
value: 1, prob: 0.000255102
value: 2, prob: 0.000255102
value: 3, prob: 0.00229592
class: 1
value: 0, prob: 0.953704
value: 1, prob: 0.0230294
value: 2, prob: 0.0230294
value: 3, prob: 0.000237417
feature: 17, with gini loss: 0.476525, with 0/1 loss: 0.461881 (when used alone for prediction)
class: 0
value: 0, prob: 0.971932
value: 1, prob: 0.0186272
value: 2, prob: 0.00944118
class: 1
value: 0, prob: 0.874139
value: 1, prob: 0.125623
value: 2, prob: 0.000237473
feature: 18, with gini loss: 0.318251, with 0/1 loss: 0.224859 (when used alone for prediction)
class: 0
value: 0, prob: 0.208365
value: 1, prob: 0.45116
value: 2, prob: 0.330783
value: 3, prob: 0.000255037
value: 4, prob: 0.00943637
class: 1
value: 0, prob: 0.748398
value: 1, prob: 0.239497
value: 2, prob: 0.000237361
value: 3, prob: 0.0116307
value: 4, prob: 0.000237361
feature: 19, with gini loss: 0.217985, with 0/1 loss: 0.13277 (when used alone for prediction)
class: 0
value: 0, prob: 0.0573248
value: 1, prob: 0.0573248
value: 2, prob: 0.000254777
value: 3, prob: 0.403822
value: 4, prob: 0.461911
value: 5, prob: 0.0185987
value: 6, prob: 0.000254777
value: 7, prob: 0.000254777
value: 8, prob: 0.000254777
class: 1
value: 0, prob: 0.391036
value: 1, prob: 0.413801
value: 2, prob: 0.0116196
value: 3, prob: 0.0116196
value: 4, prob: 0.136827
value: 5, prob: 0.000237135
value: 6, prob: 0.0116196
value: 7, prob: 0.0116196
value: 8, prob: 0.0116196
feature: 20, with gini loss: 0.381268, with 0/1 loss: 0.278515 (when used alone for prediction)
class: 0
value: 0, prob: 0.0940847
value: 1, prob: 0.000254972
value: 2, prob: 0.000254972
value: 3, prob: 0.726415
value: 4, prob: 0.165477
value: 5, prob: 0.0135135
class: 1
value: 0, prob: 0.209065
value: 1, prob: 0.095159
value: 2, prob: 0.0913621
value: 3, prob: 0.283104
value: 4, prob: 0.252729
value: 5, prob: 0.0685809
feature: 21, with gini loss: 0.403113, with 0/1 loss: 0.310014 (when used alone for prediction)
class: 0
value: 0, prob: 0.0695896
value: 1, prob: 0.188886
value: 2, prob: 0.00943156
value: 3, prob: 0.323477
value: 4, prob: 0.257201
value: 5, prob: 0.000254907
value: 6, prob: 0.15116
class: 1
value: 0, prob: 0.023013
value: 1, prob: 0.334282
value: 2, prob: 0.0609727
value: 3, prob: 0.446263
value: 4, prob: 0.032503
value: 5, prob: 0.0457888
value: 6, prob: 0.0571767
Average number of times each feature was queried using the single-feature
look-ahead algorithm (depth 50) under a budget of 300. Feature 4 was
queried the most, and it is the most discriminative as well.
Feature query statistics:
0: 5.53333
1: 1.23333
2: 24.3667
3: 0.166667
4: 110.367
5: 0.133333
6: 0.3
7: 0.166667
8: 56.6333
9: 0.3
10: 1.36667
11: 1.06667
12: 1.53333
13: 19.7667
14: 20.1333
15: 0
16: 1.5
17: 0.933333
18: 2.83333
19: 39.4
20: 4.93333
21: 7.33333
Average number of times each feature was queried using the biased-robin
algorithm under a budget of 300. Feature 4 was queried the most, and it is the most discriminative as well.
Feature query statistics:
0: 8.94
1: 8.84
2: 10.48
3: 12.5
4: 72.3
5: 7.54
6: 9.42
7: 12.06
8: 17.2
9: 7.56
10: 4.02
11: 15.74
12: 12.46
13: 11
14: 12.02
15: 2.64
16: 7.74
17: 7.9
18: 13.04
19: 21.72
20: 11.5
21: 11.5
Nursery data set (UCI)
Number of features = 8
Total number of instances = 12960
Number of classes: 5
probability of class 0 in the whole set: 0.000154321
probability of class 1 in the whole set: 0.329167
probability of class 2 in the whole set: 0.333333
probability of class 3 in the whole set: 0.0253086
probability of class 4 in the whole set: 0.312037
feature 0, with number of values = 3
feature 1, with number of values = 5
feature 2, with number of values = 4
feature 3, with number of values = 4
feature 4, with number of values = 3
feature 5, with number of values = 2
feature 6, with number of values = 3
feature 7, with number of values = 3
Naive Bayes trained on the whole data set:
0/1 loss if no feature was used (error of random):0.666667
feature: 0, with gini loss: 0.657509, with 0/1 loss: 0.581088 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2
class: 1
value: 0, prob: 0.450925
value: 1, prob: 0.347857
value: 2, prob: 0.201218
class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333
class: 3
value: 0, prob: 0.595166
value: 1, prob: 0.401813
value: 2, prob: 0.00302115
class: 4
value: 0, prob: 0.187546
value: 1, prob: 0.312577
value: 2, prob: 0.499876
feature: 1, with gini loss: 0.61129, with 0/1 loss: 0.508383 (when used alone for prediction)
class: 0
value: 0, prob: 0.428571
value: 1, prob: 0.142857
value: 2, prob: 0.142857
value: 3, prob: 0.142857
value: 4, prob: 0.142857
class: 1
value: 0, prob: 0.314915
value: 1, prob: 0.314915
value: 2, prob: 0.211894
value: 3, prob: 0.108874
value: 4, prob: 0.049403
class: 2
value: 0, prob: 0.2
value: 1, prob: 0.2
value: 2, prob: 0.2
value: 3, prob: 0.2
value: 4, prob: 0.2
class: 3
value: 0, prob: 0.393393
value: 1, prob: 0.399399
value: 2, prob: 0.201201
value: 3, prob: 0.003003
value: 4, prob: 0.003003
class: 4
value: 0, prob: 0.0624846
value: 1, prob: 0.0624846
value: 2, prob: 0.187454
value: 3, prob: 0.312423
value: 4, prob: 0.375154
feature: 2, with gini loss: 0.681264, with 0/1 loss: 0.655882 (when used alone for prediction)
class: 0
value: 0, prob: 0.5
value: 1, prob: 0.166667
value: 2, prob: 0.166667
value: 3, prob: 0.166667
class: 1
value: 0, prob: 0.270023
value: 1, prob: 0.255972
value: 2, prob: 0.243326
value: 3, prob: 0.230679
class: 2
value: 0, prob: 0.25
value: 1, prob: 0.25
value: 2, prob: 0.25
value: 3, prob: 0.25
class: 3
value: 0, prob: 0.358434
value: 1, prob: 0.304217
value: 2, prob: 0.213855
value: 3, prob: 0.123494
class: 4
value: 0, prob: 0.219615
value: 1, prob: 0.239377
value: 2, prob: 0.260128
value: 3, prob: 0.280879
feature: 3, with gini loss: 0.679735, with 0/1 loss: 0.647408 (when used alone for prediction)
class: 0
value: 0, prob: 0.5
value: 1, prob: 0.166667
value: 2, prob: 0.166667
value: 3, prob: 0.166667
class: 1
value: 0, prob: 0.28267
value: 1, prob: 0.255972
value: 2, prob: 0.230679
value: 3, prob: 0.230679
class: 2
value: 0, prob: 0.25
value: 1, prob: 0.25
value: 2, prob: 0.25
value: 3, prob: 0.25
class: 3
value: 0, prob: 0.448795
value: 1, prob: 0.304217
value: 2, prob: 0.123494
value: 3, prob: 0.123494
class: 4
value: 0, prob: 0.198864
value: 1, prob: 0.239377
value: 2, prob: 0.280879
value: 3, prob: 0.280879
feature: 4, with gini loss: 0.678216, with 0/1 loss: 0.639995 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2
class: 1
value: 0, prob: 0.379246
value: 1, prob: 0.327243
value: 2, prob: 0.293511
class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333
class: 3
value: 0, prob: 0.63142
value: 1, prob: 0.305136
value: 2, prob: 0.0634441
class: 4
value: 0, prob: 0.260193
value: 1, prob: 0.342229
value: 2, prob: 0.397578
feature: 5, with gini loss: 0.681514, with 0/1 loss: 0.658035 (when used alone for prediction)
class: 0
value: 0, prob: 0.75
value: 1, prob: 0.25
class: 1
value: 0, prob: 0.526007
value: 1, prob: 0.473993
class: 2
value: 0, prob: 0.5
value: 1, prob: 0.5
class: 3
value: 0, prob: 0.663636
value: 1, prob: 0.336364
class: 4
value: 0, prob: 0.458972
value: 1, prob: 0.541028
feature: 6, with gini loss: 0.678949, with 0/1 loss: 0.639379 (when used alone for prediction)
class: 0
value: 0, prob: 0.4
value: 1, prob: 0.4
value: 2, prob: 0.2
class: 1
value: 0, prob: 0.355118
value: 1, prob: 0.355118
value: 2, prob: 0.289763
class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333
class: 3
value: 0, prob: 0.498489
value: 1, prob: 0.498489
value: 2, prob: 0.00302115
class: 4
value: 0, prob: 0.296763
value: 1, prob: 0.296763
value: 2, prob: 0.406474
feature: 7, with gini loss: 0.346904, with 0/1 loss: 0.29055 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2
class: 1
value: 0, prob: 0.565238
value: 1, prob: 0.434528
value: 2, prob: 0.000234247
class: 2
value: 0, prob: 0.000231321
value: 1, prob: 0.000231321
value: 2, prob: 0.999537
class: 3
value: 0, prob: 0.993958
value: 1, prob: 0.00302115
value: 2, prob: 0.00302115
class: 4
value: 0, prob: 0.390166
value: 1, prob: 0.609587
value: 2, prob: 0.000247097
Number of features = 16
Total number of instances = 435
number of classes: 2
probability of class 0 in the whole set: 0.386207
probability of class 1 in the whole set: 0.613793
feature 0, with number of values = 2
feature 1, with number of values = 2
feature 2, with number of values = 2
feature 3, with number of values = 2
feature 4, with number of values = 2
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 2
feature 9, with number of values = 2
feature 10, with number of values = 2
feature 11, with number of values = 2
feature 12, with number of values = 2
feature 13, with number of values = 2
feature 14, with number of values = 2
feature 15, with number of values = 2
Naive Bayes trained on the whole data set:
0/1 loss if no feature was used (error of random):0.386207
feature: 0, with gini loss: 0.396761, with 0/1 loss: 0.31716 (when used alone for prediction)
class: 0
value: 0, prob: 0.808383
value: 1, prob: 0.191617
class: 1
value: 0, prob: 0.396154
value: 1, prob: 0.603846
feature: 1, with gini loss: 0.474093, with 0/1 loss: 0.386207 (when used alone for prediction)
class: 0
value: 0, prob: 0.506667
value: 1, prob: 0.493333
class: 1
value: 0, prob: 0.502075
value: 1, prob: 0.497925
feature: 2, with gini loss: 0.213477, with 0/1 loss: 0.123792 (when used alone for prediction)
class: 0
value: 0, prob: 0.861446
value: 1, prob: 0.138554
class: 1
value: 0, prob: 0.114504
value: 1, prob: 0.885496
feature: 3, with gini loss: 0.0782587, with 0/1 loss: 0.0422133 (when used alone for prediction)
class: 0
value: 0, prob: 0.982036
value: 1, prob: 0.0179641
class: 1
value: 0, prob: 0.0574713
value: 1, prob: 0.942529
feature: 4, with gini loss: 0.235713, with 0/1 loss: 0.154558 (when used alone for prediction)
class: 0
value: 0, prob: 0.946108
value: 1, prob: 0.0538922
class: 1
value: 0, prob: 0.217899
value: 1, prob: 0.782101
feature: 5, with gini loss: 0.389962, with 0/1 loss: 0.334111 (when used alone for prediction)
class: 0
value: 0, prob: 0.892857
value: 1, prob: 0.107143
class: 1
value: 0, prob: 0.476923
value: 1, prob: 0.523077
feature: 6, with gini loss: 0.347355, with 0/1 loss: 0.235299 (when used alone for prediction)
class: 0
value: 0, prob: 0.756098
value: 1, prob: 0.243902
class: 1
value: 0, prob: 0.229885
value: 1, prob: 0.770115
feature: 7, with gini loss: 0.269003, with 0/1 loss: 0.16727 (when used alone for prediction)
class: 0
value: 0, prob: 0.842767
value: 1, prob: 0.157233
class: 1
value: 0, prob: 0.173585
value: 1, prob: 0.826415
feature: 8, with gini loss: 0.292049, with 0/1 loss: 0.196018 (when used alone for prediction)
class: 0
value: 0, prob: 0.88024
value: 1, prob: 0.11976
class: 1
value: 0, prob: 0.244
value: 1, prob: 0.756
feature: 9, with gini loss: 0.47084, with 0/1 loss: 0.386207 (when used alone for prediction)
class: 0
value: 0, prob: 0.556886
value: 1, prob: 0.443114
class: 1
value: 0, prob: 0.471698
value: 1, prob: 0.528302
feature: 10, with gini loss: 0.407875, with 0/1 loss: 0.356088 (when used alone for prediction)
class: 0
value: 0, prob: 0.863354
value: 1, prob: 0.136646
class: 1
value: 0, prob: 0.494163
value: 1, prob: 0.505837
feature: 11, with gini loss: 0.236471, with 0/1 loss: 0.142138 (when used alone for prediction)
class: 0
value: 0, prob: 0.866242
value: 1, prob: 0.133758
class: 1
value: 0, prob: 0.14741
value: 1, prob: 0.85259
feature: 12, with gini loss: 0.330589, with 0/1 loss: 0.234339 (when used alone for prediction)
class: 0
value: 0, prob: 0.85625
value: 1, prob: 0.14375
class: 1
value: 0, prob: 0.291339
value: 1, prob: 0.708661
feature: 13, with gini loss: 0.292809, with 0/1 loss: 0.225135 (when used alone for prediction)
class: 0
value: 0, prob: 0.97546
value: 1, prob: 0.0245399
class: 1
value: 0, prob: 0.351351
value: 1, prob: 0.648649
feature: 14, with gini loss: 0.339472, with 0/1 loss: 0.259863 (when used alone for prediction)
class: 0
value: 0, prob: 0.905063
value: 1, prob: 0.0949367
class: 1
value: 0, prob: 0.363636
value: 1, prob: 0.636364
feature: 15, with gini loss: 0.4154, with 0/1 loss: 0.295792 (when used alone for prediction)
class: 0
value: 0, prob: 0.655405
value: 1, prob: 0.344595
class: 1
value: 0, prob: 0.930481
value: 1, prob: 0.0695187
Car data set (UCI)
Number of features = 6
Total number of instances = 1728
number of classes: 4
probability of class 0 in the whole set: 0.700231
probability of class 1 in the whole set: 0.222222
probability of class 2 in the whole set: 0.0376157
probability of class 3 in the whole set: 0.0399306
feature 0, with number of values = 4
feature 1, with number of values = 4
feature 2, with number of values = 4
feature 3, with number of values = 3
feature 4, with number of values = 3
feature 5, with number of values = 3
Naive Bayes trained on the whole data set:
0/1 loss if no feature was used (error of random):0.299769
feature: 0, with gini loss: 0.443979, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.297364
value: 1, prob: 0.26771
value: 2, prob: 0.221582
value: 3, prob: 0.213344
class: 1
value: 0, prob: 0.188144
value: 1, prob: 0.280928
value: 2, prob: 0.298969
value: 3, prob: 0.231959
class: 2
value: 0, prob: 0.0144928
value: 1, prob: 0.0144928
value: 2, prob: 0.391304
value: 3, prob: 0.57971
class: 3
value: 0, prob: 0.0136986
value: 1, prob: 0.0136986
value: 2, prob: 0.328767
value: 3, prob: 0.643836
feature: 1, with gini loss: 0.446268, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.297364
value: 1, prob: 0.259473
value: 2, prob: 0.221582
value: 3, prob: 0.221582
class: 1
value: 0, prob: 0.188144
value: 1, prob: 0.273196
value: 2, prob: 0.298969
value: 3, prob: 0.239691
class: 2
value: 0, prob: 0.0144928
value: 1, prob: 0.202899
value: 2, prob: 0.391304
value: 3, prob: 0.391304
class: 3
value: 0, prob: 0.0136986
value: 1, prob: 0.0136986
value: 2, prob: 0.328767
value: 3, prob: 0.643836
feature: 2, with gini loss: 0.455785, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.269357
value: 1, prob: 0.247941
value: 2, prob: 0.241351
value: 3, prob: 0.241351
class: 1
value: 0, prob: 0.21134
value: 1, prob: 0.257732
value: 2, prob: 0.265464
value: 3, prob: 0.265464
class: 2
value: 0, prob: 0.15942
value: 1, prob: 0.231884
value: 2, prob: 0.304348
value: 3, prob: 0.304348
class: 3
value: 0, prob: 0.219178
value: 1, prob: 0.260274
value: 2, prob: 0.260274
value: 3, prob: 0.260274
feature: 3, with gini loss: 0.387571, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.47568
value: 1, prob: 0.258038
value: 2, prob: 0.266282
class: 1
value: 0, prob: 0.00258398
value: 1, prob: 0.514212
value: 2, prob: 0.483204
class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.455882
value: 2, prob: 0.529412
class: 3
value: 0, prob: 0.0138889
value: 1, prob: 0.513889
value: 2, prob: 0.472222
feature: 4, with gini loss: 0.45225, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.371805
value: 1, prob: 0.32399
value: 2, prob: 0.304204
class: 1
value: 0, prob: 0.273902
value: 1, prob: 0.351421
value: 2, prob: 0.374677
class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.382353
value: 2, prob: 0.602941
class: 3
value: 0, prob: 0.305556
value: 1, prob: 0.347222
value: 2, prob: 0.347222
feature: 5, with gini loss: 0.382318, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.47568
value: 1, prob: 0.295136
value: 2, prob: 0.229184
class: 1
value: 0, prob: 0.00258398
value: 1, prob: 0.4677
value: 2, prob: 0.529716
class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.0147059
value: 2, prob: 0.970588
class: 3
value: 0, prob: 0.0138889
value: 1, prob: 0.555556
value: 2, prob: 0.430556
kr-vs-kp data set (UCI)
Number of features = 36
Total number of instances = 3196
Number of classes: 2
probability of class 0 in the whole set: 0.522215
probability of class 1 in the whole set: 0.477785
feature 0, with number of values = 2
feature 1, with number of values = 2
feature 2, with number of values = 2
feature 3, with number of values = 2
feature 4, with number of values = 2
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 2
feature 9, with number of values = 2
feature 10, with number of values = 2
feature 11, with number of values = 2
feature 12, with number of values = 2
feature 13, with number of values = 2
feature 14, with number of values = 3
feature 15, with number of values = 2
feature 16, with number of values = 2
feature 17, with number of values = 2
feature 18, with number of values = 2
feature 19, with number of values = 2
feature 20, with number of values = 2
feature 21, with number of values = 2
feature 22, with number of values = 2
feature 23, with number of values = 2
feature 24, with number of values = 2
feature 25, with number of values = 2
feature 26, with number of values = 2
feature 27, with number of values = 2
feature 28, with number of values = 2
feature 29, with number of values = 2
feature 30, with number of values = 2
feature 31, with number of values = 2
feature 32, with number of values = 2
feature 33, with number of values = 2
feature 34, with number of values = 2
feature 35, with number of values = 2
Naive Bayes trained on the whole data set:
0/1 loss if no feature was used (error of random):0.477785
feature: 0, with gini loss: 0.499012, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.887493
value: 1, prob: 0.112507
class: 1
value: 0, prob: 0.888162
value: 1, prob: 0.111838
feature: 1, with gini loss: 0.499007, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.928187
value: 1, prob: 0.0718133
class: 1
value: 0, prob: 0.93002
value: 1, prob: 0.0699804
feature: 2, with gini loss: 0.494924, with 0/1 loss: 0.462162 (when used alone for prediction)
class: 0
value: 0, prob: 0.978456
value: 1, prob: 0.021544
class: 1
value: 0, prob: 0.943754
value: 1, prob: 0.0562459
feature: 3, with gini loss: 0.498931, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.902454
value: 1, prob: 0.0975464
class: 1
value: 0, prob: 0.894702
value: 1, prob: 0.105298
feature: 4, with gini loss: 0.498263, with 0/1 loss: 0.474366 (when used alone for prediction)
class: 0
value: 0, prob: 0.683423
value: 1, prob: 0.316577
class: 1
value: 0, prob: 0.646828
value: 1, prob: 0.353172
feature: 5, with gini loss: 0.489285, with 0/1 loss: 0.43219 (when used alone for prediction)
class: 0
value: 0, prob: 0.472172
value: 1, prob: 0.527828
class: 1
value: 0, prob: 0.611511
value: 1, prob: 0.388489
feature: 6, with gini loss: 0.485653, with 0/1 loss: 0.415305 (when used alone for prediction)
class: 0
value: 0, prob: 0.709156
value: 1, prob: 0.290844
class: 1
value: 0, prob: 0.551341
value: 1, prob: 0.448659
feature: 7, with gini loss: 0.472034, with 0/1 loss: 0.391547 (when used alone for prediction)
class: 0
value: 0, prob: 0.873728
value: 1, prob: 0.126272
class: 1
value: 0, prob: 0.681491
value: 1, prob: 0.318509
feature: 8, with gini loss: 0.495401, with 0/1 loss: 0.453431 (when used alone for prediction)
class: 0
value: 0, prob: 0.658887
value: 1, prob: 0.341113
class: 1
value: 0, prob: 0.576194
value: 1, prob: 0.423806
feature: 9, with gini loss: 0.42712, with 0/1 loss: 0.316865 (when used alone for prediction)
class: 0
value: 0, prob: 0.862956
value: 1, prob: 0.137044
class: 1
value: 0, prob: 0.513407
value: 1, prob: 0.486593
feature: 10, with gini loss: 0.496703, with 0/1 loss: 0.469379 (when used alone for prediction)
class: 0
value: 0, prob: 0.536206
value: 1, prob: 0.463794
class: 1
value: 0, prob: 0.603663
value: 1, prob: 0.396337
feature: 11, with gini loss: 0.498897, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.889886
value: 1, prob: 0.110114
class: 1
value: 0, prob: 0.899281
value: 1, prob: 0.100719
feature: 12, with gini loss: 0.494079, with 0/1 loss: 0.445615 (when used alone for prediction)
class: 0
value: 0, prob: 0.733692
value: 1, prob: 0.266308
class: 1
value: 0, prob: 0.641596
value: 1, prob: 0.358404
feature: 13, with gini loss: 0.496719, with 0/1 loss: 0.473098 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444
class: 1
value: 0, prob: 0.989536
value: 1, prob: 0.0104644
feature: 14, with gini loss: 0.475094, with 0/1 loss: 0.444128 (when used alone for prediction)
class: 0
value: 0, prob: 0.743421
value: 1, prob: 0.208732
value: 2, prob: 0.0478469
class: 1
value: 0, prob: 0.839869
value: 1, prob: 0.0647059
value: 2, prob: 0.0954248
feature: 15, with gini loss: 0.48665, with 0/1 loss: 0.445913 (when used alone for prediction)
class: 0
value: 0, prob: 0.983244
value: 1, prob: 0.0167564
class: 1
value: 0, prob: 0.914977
value: 1, prob: 0.0850229
feature: 16, with gini loss: 0.498942, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.967086
value: 1, prob: 0.0329144
class: 1
value: 0, prob: 0.971223
value: 1, prob: 0.028777
feature: 17, with gini loss: 0.485548, with 0/1 loss: 0.432198 (when used alone for prediction)
class: 0
value: 0, prob: 0.614004
value: 1, prob: 0.385996
class: 1
value: 0, prob: 0.766514
value: 1, prob: 0.233486
feature: 18, with gini loss: 0.498581, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.98863
value: 1, prob: 0.0113704
class: 1
value: 0, prob: 0.994114
value: 1, prob: 0.0058862
feature: 19, with gini loss: 0.498985, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.8462
value: 1, prob: 0.1538
class: 1
value: 0, prob: 0.851537
value: 1, prob: 0.148463
feature: 20, with gini loss: 0.397386, with 0/1 loss: 0.339706 (when used alone for prediction)
class: 0
value: 0, prob: 0.64991
value: 1, prob: 0.35009
class: 1
value: 0, prob: 0.999346
value: 1, prob: 0.000654022
feature: 21, with gini loss: 0.493906, with 0/1 loss: 0.472829 (when used alone for prediction)
class: 0
value: 0, prob: 0.760622
value: 1, prob: 0.239378
class: 1
value: 0, prob: 0.841727
value: 1, prob: 0.158273
feature: 22, with gini loss: 0.495201, with 0/1 loss: 0.459975 (when used alone for prediction)
class: 0
value: 0, prob: 0.9617
value: 1, prob: 0.0383004
class: 1
value: 0, prob: 0.920863
value: 1, prob: 0.0791367
feature: 23, with gini loss: 0.497978, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.596649
value: 1, prob: 0.403351
class: 1
value: 0, prob: 0.640942
value: 1, prob: 0.359058
feature: 24, with gini loss: 0.49832, with 0/1 loss: 0.475597 (when used alone for prediction)
class: 0
value: 0, prob: 0.998205
value: 1, prob: 0.00179533
class: 1
value: 0, prob: 0.99346
value: 1, prob: 0.00654022
feature: 25, with gini loss: 0.498333, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.67684
value: 1, prob: 0.32316
class: 1
value: 0, prob: 0.710922
value: 1, prob: 0.289078
feature: 26, with gini loss: 0.490605, with 0/1 loss: 0.4506 (when used alone for prediction)
class: 0
value: 0, prob: 0.97307
value: 1, prob: 0.02693
class: 1
value: 0, prob: 0.913669
value: 1, prob: 0.0863309
feature: 27, with gini loss: 0.498946, with 0/1 loss: 0.477472 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444
class: 1
value: 0, prob: 0.998692
value: 1, prob: 0.00130804
feature: 28, with gini loss: 0.491182, with 0/1 loss: 0.463098 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444
class: 1
value: 0, prob: 0.968607
value: 1, prob: 0.0313931
feature: 29, with gini loss: 0.498221, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.949132
value: 1, prob: 0.0508677
class: 1
value: 0, prob: 0.965337
value: 1, prob: 0.0346632
feature: 30, with gini loss: 0.491087, with 0/1 loss: 0.466268 (when used alone for prediction)
class: 0
value: 0, prob: 0.77678
value: 1, prob: 0.22322
class: 1
value: 0, prob: 0.87312
value: 1, prob: 0.12688
feature: 31, with gini loss: 0.479943, with 0/1 loss: 0.4356 (when used alone for prediction)
class: 0
value: 0, prob: 0.987433
value: 1, prob: 0.0125673
class: 1
value: 0, prob: 0.897973
value: 1, prob: 0.102027
feature: 32, with gini loss: 0.432607, with 0/1 loss: 0.317806 (when used alone for prediction)
class: 0
value: 0, prob: 0.789946
value: 1, prob: 0.210054
class: 1
value: 0, prob: 0.435579
value: 1, prob: 0.564421
feature: 33, with gini loss: 0.498206, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.609216
value: 1, prob: 0.390784
class: 1
value: 0, prob: 0.648136
value: 1, prob: 0.351864
feature: 34, with gini loss: 0.488327, with 0/1 loss: 0.424987 (when used alone for prediction)
class: 0
value: 0, prob: 0.795332
value: 1, prob: 0.204668
class: 1
value: 0, prob: 0.665795
value: 1, prob: 0.334205
feature: 35, with gini loss: 0.499013, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.752843
value: 1, prob: 0.247157
class: 1
value: 0, prob: 0.75278
value: 1, prob: 0.24722
