top of page
Mushroom

Mushroom data set (UCI)

​

Number of features = 22

​

Total number of instances = 8124

​

Number of classes: 2

 

probability of class 0 in the whole set: 0.482029
probability of class 1 in the whole set: 0.517971

​

feature 0, with number of values = 6
feature 1, with number of values = 4
feature 2, with number of values = 10
feature 3, with number of values = 2
feature 4, with number of values = 9
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 12
feature 9, with number of values = 2
feature 10, with number of values = 4
feature 11, with number of values = 4
feature 12, with number of values = 4
feature 13, with number of values = 9
feature 14, with number of values = 9
feature 15, with number of values = 1
feature 16, with number of values = 4
feature 17, with number of values = 3
feature 18, with number of values = 5
feature 19, with number of values = 9
feature 20, with number of values = 6
feature 21, with number of values = 7


Conditional probability table for naive Bayes classifier trained on the whole data set:

​

0/1 loss if no feature was used (error of random):0.482029

​

feature: 0, with gini loss: 0.469583, with 0/1 loss: 0.43582 (when used alone for prediction)
class: 0
value: 0, prob: 0.435747
value: 1, prob: 0.0124936
value: 2, prob: 0.000254972
value: 3, prob: 0.396991
value: 4, prob: 0.153238
value: 5, prob: 0.00127486

class: 1
value: 0, prob: 0.462506
value: 1, prob: 0.0961082
value: 2, prob: 0.00783104
value: 3, prob: 0.378975
value: 4, prob: 0.0543427
value: 5, prob: 0.000237304


feature: 1, with gini loss: 0.480107, with 0/1 loss: 0.419585 (when used alone for prediction)
class: 0
value: 0, prob: 0.360459
value: 1, prob: 0.444133
value: 2, prob: 0.194133
value: 3, prob: 0.00127551

class: 1
value: 0, prob: 0.271842
value: 1, prob: 0.357312
value: 2, prob: 0.370608
value: 3, prob: 0.000237417


feature: 2, with gini loss: 0.475891, with 0/1 loss: 0.404948 (when used alone for prediction)
class: 0
value: 0, prob: 0.260061
value: 1, prob: 0.171421
value: 2, prob: 0.0817626
value: 3, prob: 0.206062
value: 4, prob: 0.223383
value: 5, prob: 0.0226694
value: 6, prob: 0.0308202
value: 7, prob: 0.000254712
value: 8, prob: 0.00331126
value: 9, prob: 0.000254712

class: 1
value: 0, prob: 0.299905
value: 1, prob: 0.0950688
value: 2, prob: 0.170934
value: 3, prob: 0.244903
value: 4, prob: 0.148174
value: 5, prob: 0.0135135
value: 6, prob: 0.0116169
value: 7, prob: 0.00403035
value: 8, prob: 0.00782361
value: 9, prob: 0.00403035


feature: 3, with gini loss: 0.37388, with 0/1 loss: 0.256153 (when used alone for prediction)
class: 0
value: 0, prob: 0.15952
value: 1, prob: 0.84048

class: 1
value: 0, prob: 0.653919
value: 1, prob: 0.346081


feature: 4, with gini loss: 0.0306557, with 0/1 loss: 0.0158426 (when used alone for prediction)
class: 0
value: 0, prob: 0.0654777
value: 1, prob: 0.000254777
value: 2, prob: 0.000254777
value: 3, prob: 0.030828
value: 4, prob: 0.550573
value: 5, prob: 0.049172
value: 6, prob: 0.147006
value: 7, prob: 0.147006
value: 8, prob: 0.00942675

class: 1
value: 0, prob: 0.000237135
value: 1, prob: 0.0950913
value: 2, prob: 0.0950913
value: 3, prob: 0.808395
value: 4, prob: 0.000237135
value: 5, prob: 0.000237135
value: 6, prob: 0.000237135
value: 7, prob: 0.000237135
value: 8, prob: 0.000237135


feature: 5, with gini loss: 0.491106, with 0/1 loss: 0.482029 (when used alone for prediction)
class: 0
value: 0, prob: 0.995151
value: 1, prob: 0.00484941

class: 1
value: 0, prob: 0.954157
value: 1, prob: 0.0458432


feature: 6, with gini loss: 0.438862, with 0/1 loss: 0.38411 (when used alone for prediction)
class: 0
value: 0, prob: 0.971159
value: 1, prob: 0.0288412

class: 1
value: 0, prob: 0.714727
value: 1, prob: 0.285273


feature: 7, with gini loss: 0.353892, with 0/1 loss: 0.243845 (when used alone for prediction)
class: 0
value: 0, prob: 0.567892
value: 1, prob: 0.432108

class: 1
value: 0, prob: 0.0686461
value: 1, prob: 0.931354


feature: 8, with gini loss: 0.269366, with 0/1 loss: 0.195867 (when used alone for prediction)
class: 0
value: 0, prob: 0.0165479
value: 1, prob: 0.0287678
value: 2, prob: 0.128564
value: 3, prob: 0.163187
value: 4, prob: 0.0628819
value: 5, prob: 0.134674
value: 6, prob: 0.0124745
value: 7, prob: 0.000254582
value: 8, prob: 0.440173
value: 9, prob: 0.00636456
value: 10, prob: 0.0058554
value: 11, prob: 0.000254582

class: 1
value: 0, prob: 0.0817536
value: 1, prob: 0.222038
value: 2, prob: 0.0590047
value: 3, prob: 0.202133
value: 4, prob: 0.226777
value: 5, prob: 0.0485782
value: 6, prob: 0.10545
value: 7, prob: 0.0229858
value: 8, prob: 0.000236967
value: 9, prob: 0.000236967
value: 10, prob: 0.0154028
value: 11, prob: 0.0154028


feature: 9, with gini loss: 0.494162, with 0/1 loss: 0.447095 (when used alone for prediction)
class: 0
value: 0, prob: 0.485197
value: 1, prob: 0.514803

class: 1
value: 0, prob: 0.384086
value: 1, prob: 0.615914


feature: 10, with gini loss: 0.43515, with 0/1 loss: 0.352562 (when used alone for prediction)
class: 0
value: 0, prob: 0.118981
value: 1, prob: 0.0208333
value: 2, prob: 0.859722
value: 3, prob: 0.000462963

class: 1
value: 0, prob: 0.247709
value: 1, prob: 0.146907
value: 2, prob: 0.550115
value: 3, prob: 0.0552692


feature: 11, with gini loss: 0.327061, with 0/1 loss: 0.225768 (when used alone for prediction)
class: 0
value: 0, prob: 0.392092
value: 1, prob: 0.0369898
value: 2, prob: 0.568622
value: 3, prob: 0.00229592

class: 1
value: 0, prob: 0.864435
value: 1, prob: 0.0971035
value: 2, prob: 0.0344255
value: 3, prob: 0.00403609


feature: 12, with gini loss: 0.334679, with 0/1 loss: 0.234129 (when used alone for prediction)
class: 0
value: 0, prob: 0.392092
value: 1, prob: 0.0369898
value: 2, prob: 0.0196429
value: 3, prob: 0.551276

class: 1
value: 0, prob: 0.807455
value: 1, prob: 0.1085
value: 2, prob: 0.0496201
value: 3, prob: 0.0344255


feature: 13, with gini loss: 0.362933, with 0/1 loss: 0.284071 (when used alone for prediction)
class: 0
value: 0, prob: 0.436433
value: 1, prob: 0.000254777
value: 2, prob: 0.330446
value: 3, prob: 0.110318
value: 4, prob: 0.110318
value: 5, prob: 0.000254777
value: 6, prob: 0.000254777
value: 7, prob: 0.00942675
value: 8, prob: 0.00229299

class: 1
value: 0, prob: 0.652834
value: 1, prob: 0.136827
value: 2, prob: 0.136827
value: 3, prob: 0.0040313
value: 4, prob: 0.000237135
value: 5, prob: 0.0230021
value: 6, prob: 0.0457671
value: 7, prob: 0.000237135
value: 8, prob: 0.000237135


feature: 14, with gini loss: 0.368156, with 0/1 loss: 0.286037 (when used alone for prediction)
class: 0
value: 0, prob: 0.42828
value: 1, prob: 0.330446
value: 2, prob: 0.000254777
value: 3, prob: 0.110318
value: 4, prob: 0.114395
value: 5, prob: 0.000254777
value: 6, prob: 0.00636943
value: 7, prob: 0.000254777
value: 8, prob: 0.00942675

class: 1
value: 0, prob: 0.641451
value: 1, prob: 0.136827
value: 2, prob: 0.136827
value: 3, prob: 0.000237135
value: 4, prob: 0.0154138
value: 5, prob: 0.0230021
value: 6, prob: 0.000237135
value: 7, prob: 0.0457671
value: 8, prob: 0.000237135


feature: 15, with gini loss: 0.499354, with 0/1 loss: 0.482029 (when used alone for prediction)
class: 0
value: 0, prob: 1

class: 1
value: 0, prob: 1


feature: 16, with gini loss: 0.487951, with 0/1 loss: 0.481045 (when used alone for prediction)
class: 0
value: 0, prob: 0.997194
value: 1, prob: 0.000255102
value: 2, prob: 0.000255102
value: 3, prob: 0.00229592

class: 1
value: 0, prob: 0.953704
value: 1, prob: 0.0230294
value: 2, prob: 0.0230294
value: 3, prob: 0.000237417


feature: 17, with gini loss: 0.476525, with 0/1 loss: 0.461881 (when used alone for prediction)
class: 0
value: 0, prob: 0.971932
value: 1, prob: 0.0186272
value: 2, prob: 0.00944118

class: 1
value: 0, prob: 0.874139
value: 1, prob: 0.125623
value: 2, prob: 0.000237473


feature: 18, with gini loss: 0.318251, with 0/1 loss: 0.224859 (when used alone for prediction)
class: 0
value: 0, prob: 0.208365
value: 1, prob: 0.45116
value: 2, prob: 0.330783
value: 3, prob: 0.000255037
value: 4, prob: 0.00943637

class: 1
value: 0, prob: 0.748398
value: 1, prob: 0.239497
value: 2, prob: 0.000237361
value: 3, prob: 0.0116307
value: 4, prob: 0.000237361


feature: 19, with gini loss: 0.217985, with 0/1 loss: 0.13277 (when used alone for prediction)
class: 0
value: 0, prob: 0.0573248
value: 1, prob: 0.0573248
value: 2, prob: 0.000254777
value: 3, prob: 0.403822
value: 4, prob: 0.461911
value: 5, prob: 0.0185987
value: 6, prob: 0.000254777
value: 7, prob: 0.000254777
value: 8, prob: 0.000254777

class: 1
value: 0, prob: 0.391036
value: 1, prob: 0.413801
value: 2, prob: 0.0116196
value: 3, prob: 0.0116196
value: 4, prob: 0.136827
value: 5, prob: 0.000237135
value: 6, prob: 0.0116196
value: 7, prob: 0.0116196
value: 8, prob: 0.0116196


feature: 20, with gini loss: 0.381268, with 0/1 loss: 0.278515 (when used alone for prediction)
class: 0
value: 0, prob: 0.0940847
value: 1, prob: 0.000254972
value: 2, prob: 0.000254972
value: 3, prob: 0.726415
value: 4, prob: 0.165477
value: 5, prob: 0.0135135

class: 1
value: 0, prob: 0.209065
value: 1, prob: 0.095159
value: 2, prob: 0.0913621
value: 3, prob: 0.283104
value: 4, prob: 0.252729
value: 5, prob: 0.0685809


feature: 21, with gini loss: 0.403113, with 0/1 loss: 0.310014 (when used alone for prediction)
class: 0
value: 0, prob: 0.0695896
value: 1, prob: 0.188886
value: 2, prob: 0.00943156
value: 3, prob: 0.323477
value: 4, prob: 0.257201
value: 5, prob: 0.000254907
value: 6, prob: 0.15116

class: 1
value: 0, prob: 0.023013
value: 1, prob: 0.334282
value: 2, prob: 0.0609727
value: 3, prob: 0.446263
value: 4, prob: 0.032503
value: 5, prob: 0.0457888
value: 6, prob: 0.0571767
 

Mushroom: look-ahead b=300

Average number of times each feature was queried using the single-feature

 

look-ahead algorithm (depth 50) under a budget of 300.  Feature 4 was

 

queried the most, and it is the most discriminative as well.

 

Feature query statistics:

 

0:      5.53333
1:      1.23333
2:      24.3667
3:      0.166667
4:      110.367
5:      0.133333
6:      0.3
7:      0.166667
8:      56.6333
9:      0.3
10:     1.36667
11:     1.06667
12:     1.53333
13:     19.7667
14:     20.1333
15:     0
16:     1.5
17:     0.933333
18:     2.83333
19:     39.4
20:     4.93333
21:     7.33333
 

Mushroom: aveage biased-robin b=300

Average number of times each feature was queried using the biased-robin

algorithm under a budget of 300.  Feature 4 was queried the most, and it is the most discriminative as well.

 

Feature query statistics:

 

0:      8.94
1:      8.84
2:      10.48
3:      12.5
4:      72.3
5:      7.54
6:      9.42
7:      12.06
8:      17.2
9:      7.56
10:     4.02
11:     15.74
12:     12.46
13:     11
14:     12.02
15:     2.64
16:     7.74
17:     7.9
18:     13.04
19:     21.72
20:     11.5
21:     11.5

Nursery

Nursery  data set (UCI)

Number of features = 8

Total number of instances = 12960

Number of classes: 5

probability of class 0 in the whole set: 0.000154321
probability of class 1 in the whole set: 0.329167
probability of class 2 in the whole set: 0.333333
probability of class 3 in the whole set: 0.0253086
probability of class 4 in the whole set: 0.312037

feature 0, with number of values = 3
feature 1, with number of values = 5
feature 2, with number of values = 4
feature 3, with number of values = 4
feature 4, with number of values = 3
feature 5, with number of values = 2
feature 6, with number of values = 3
feature 7, with number of values = 3


Naive Bayes trained on the whole data set:

0/1 loss if no feature was used (error of random):0.666667

feature: 0, with gini loss: 0.657509, with 0/1 loss: 0.581088 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2

class: 1
value: 0, prob: 0.450925
value: 1, prob: 0.347857
value: 2, prob: 0.201218

class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333

class: 3
value: 0, prob: 0.595166
value: 1, prob: 0.401813
value: 2, prob: 0.00302115

class: 4
value: 0, prob: 0.187546
value: 1, prob: 0.312577
value: 2, prob: 0.499876


feature: 1, with gini loss: 0.61129, with 0/1 loss: 0.508383 (when used alone for prediction)
class: 0
value: 0, prob: 0.428571
value: 1, prob: 0.142857
value: 2, prob: 0.142857
value: 3, prob: 0.142857
value: 4, prob: 0.142857

class: 1
value: 0, prob: 0.314915
value: 1, prob: 0.314915
value: 2, prob: 0.211894
value: 3, prob: 0.108874
value: 4, prob: 0.049403

class: 2
value: 0, prob: 0.2
value: 1, prob: 0.2
value: 2, prob: 0.2
value: 3, prob: 0.2
value: 4, prob: 0.2

class: 3
value: 0, prob: 0.393393
value: 1, prob: 0.399399
value: 2, prob: 0.201201
value: 3, prob: 0.003003
value: 4, prob: 0.003003

class: 4
value: 0, prob: 0.0624846
value: 1, prob: 0.0624846
value: 2, prob: 0.187454
value: 3, prob: 0.312423
value: 4, prob: 0.375154


feature: 2, with gini loss: 0.681264, with 0/1 loss: 0.655882 (when used alone for prediction)
class: 0
value: 0, prob: 0.5
value: 1, prob: 0.166667
value: 2, prob: 0.166667
value: 3, prob: 0.166667

class: 1
value: 0, prob: 0.270023
value: 1, prob: 0.255972
value: 2, prob: 0.243326
value: 3, prob: 0.230679

class: 2
value: 0, prob: 0.25
value: 1, prob: 0.25
value: 2, prob: 0.25
value: 3, prob: 0.25

class: 3
value: 0, prob: 0.358434
value: 1, prob: 0.304217
value: 2, prob: 0.213855
value: 3, prob: 0.123494

class: 4
value: 0, prob: 0.219615
value: 1, prob: 0.239377
value: 2, prob: 0.260128
value: 3, prob: 0.280879


feature: 3, with gini loss: 0.679735, with 0/1 loss: 0.647408 (when used alone for prediction)
class: 0
value: 0, prob: 0.5
value: 1, prob: 0.166667
value: 2, prob: 0.166667
value: 3, prob: 0.166667

class: 1
value: 0, prob: 0.28267
value: 1, prob: 0.255972
value: 2, prob: 0.230679
value: 3, prob: 0.230679

class: 2
value: 0, prob: 0.25
value: 1, prob: 0.25
value: 2, prob: 0.25
value: 3, prob: 0.25

class: 3
value: 0, prob: 0.448795
value: 1, prob: 0.304217
value: 2, prob: 0.123494
value: 3, prob: 0.123494

class: 4
value: 0, prob: 0.198864
value: 1, prob: 0.239377
value: 2, prob: 0.280879
value: 3, prob: 0.280879


feature: 4, with gini loss: 0.678216, with 0/1 loss: 0.639995 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2

class: 1
value: 0, prob: 0.379246
value: 1, prob: 0.327243
value: 2, prob: 0.293511

class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333

class: 3
value: 0, prob: 0.63142
value: 1, prob: 0.305136
value: 2, prob: 0.0634441

class: 4
value: 0, prob: 0.260193
value: 1, prob: 0.342229
value: 2, prob: 0.397578


feature: 5, with gini loss: 0.681514, with 0/1 loss: 0.658035 (when used alone for prediction)
class: 0
value: 0, prob: 0.75
value: 1, prob: 0.25

class: 1
value: 0, prob: 0.526007
value: 1, prob: 0.473993

class: 2
value: 0, prob: 0.5
value: 1, prob: 0.5

class: 3
value: 0, prob: 0.663636
value: 1, prob: 0.336364

class: 4
value: 0, prob: 0.458972
value: 1, prob: 0.541028


feature: 6, with gini loss: 0.678949, with 0/1 loss: 0.639379 (when used alone for prediction)
class: 0
value: 0, prob: 0.4
value: 1, prob: 0.4
value: 2, prob: 0.2

class: 1
value: 0, prob: 0.355118
value: 1, prob: 0.355118
value: 2, prob: 0.289763

class: 2
value: 0, prob: 0.333333
value: 1, prob: 0.333333
value: 2, prob: 0.333333

class: 3
value: 0, prob: 0.498489
value: 1, prob: 0.498489
value: 2, prob: 0.00302115

class: 4
value: 0, prob: 0.296763
value: 1, prob: 0.296763
value: 2, prob: 0.406474


feature: 7, with gini loss: 0.346904, with 0/1 loss: 0.29055 (when used alone for prediction)
class: 0
value: 0, prob: 0.6
value: 1, prob: 0.2
value: 2, prob: 0.2

class: 1
value: 0, prob: 0.565238
value: 1, prob: 0.434528
value: 2, prob: 0.000234247

class: 2
value: 0, prob: 0.000231321
value: 1, prob: 0.000231321
value: 2, prob: 0.999537

class: 3
value: 0, prob: 0.993958
value: 1, prob: 0.00302115
value: 2, prob: 0.00302115

class: 4
value: 0, prob: 0.390166
value: 1, prob: 0.609587
value: 2, prob: 0.000247097

Number of features = 16

​

Total number of instances = 435

​

number of classes: 2

​

probability of class 0 in the whole set: 0.386207
probability of class 1 in the whole set: 0.613793

​

feature 0, with number of values = 2
feature 1, with number of values = 2
feature 2, with number of values = 2
feature 3, with number of values = 2
feature 4, with number of values = 2
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 2
feature 9, with number of values = 2
feature 10, with number of values = 2
feature 11, with number of values = 2
feature 12, with number of values = 2
feature 13, with number of values = 2
feature 14, with number of values = 2
feature 15, with number of values = 2


Naive Bayes trained on the whole data set:

0/1 loss if no feature was used (error of random):0.386207

feature: 0, with gini loss: 0.396761, with 0/1 loss: 0.31716 (when used alone for prediction)
class: 0
value: 0, prob: 0.808383
value: 1, prob: 0.191617

class: 1
value: 0, prob: 0.396154
value: 1, prob: 0.603846


feature: 1, with gini loss: 0.474093, with 0/1 loss: 0.386207 (when used alone for prediction)
class: 0
value: 0, prob: 0.506667
value: 1, prob: 0.493333

class: 1
value: 0, prob: 0.502075
value: 1, prob: 0.497925


feature: 2, with gini loss: 0.213477, with 0/1 loss: 0.123792 (when used alone for prediction)
class: 0
value: 0, prob: 0.861446
value: 1, prob: 0.138554

class: 1
value: 0, prob: 0.114504
value: 1, prob: 0.885496


feature: 3, with gini loss: 0.0782587, with 0/1 loss: 0.0422133 (when used alone for prediction)
class: 0
value: 0, prob: 0.982036
value: 1, prob: 0.0179641

class: 1
value: 0, prob: 0.0574713
value: 1, prob: 0.942529


feature: 4, with gini loss: 0.235713, with 0/1 loss: 0.154558 (when used alone for prediction)
class: 0
value: 0, prob: 0.946108
value: 1, prob: 0.0538922

class: 1
value: 0, prob: 0.217899
value: 1, prob: 0.782101


feature: 5, with gini loss: 0.389962, with 0/1 loss: 0.334111 (when used alone for prediction)
class: 0
value: 0, prob: 0.892857
value: 1, prob: 0.107143

class: 1
value: 0, prob: 0.476923
value: 1, prob: 0.523077


feature: 6, with gini loss: 0.347355, with 0/1 loss: 0.235299 (when used alone for prediction)
class: 0
value: 0, prob: 0.756098
value: 1, prob: 0.243902

class: 1
value: 0, prob: 0.229885
value: 1, prob: 0.770115


feature: 7, with gini loss: 0.269003, with 0/1 loss: 0.16727 (when used alone for prediction)
class: 0
value: 0, prob: 0.842767
value: 1, prob: 0.157233

class: 1
value: 0, prob: 0.173585
value: 1, prob: 0.826415


feature: 8, with gini loss: 0.292049, with 0/1 loss: 0.196018 (when used alone for prediction)
class: 0
value: 0, prob: 0.88024
value: 1, prob: 0.11976

class: 1
value: 0, prob: 0.244
value: 1, prob: 0.756


feature: 9, with gini loss: 0.47084, with 0/1 loss: 0.386207 (when used alone for prediction)
class: 0
value: 0, prob: 0.556886
value: 1, prob: 0.443114

class: 1
value: 0, prob: 0.471698
value: 1, prob: 0.528302


feature: 10, with gini loss: 0.407875, with 0/1 loss: 0.356088 (when used alone for prediction)
class: 0
value: 0, prob: 0.863354
value: 1, prob: 0.136646

class: 1
value: 0, prob: 0.494163
value: 1, prob: 0.505837


feature: 11, with gini loss: 0.236471, with 0/1 loss: 0.142138 (when used alone for prediction)
class: 0
value: 0, prob: 0.866242
value: 1, prob: 0.133758

class: 1
value: 0, prob: 0.14741
value: 1, prob: 0.85259


feature: 12, with gini loss: 0.330589, with 0/1 loss: 0.234339 (when used alone for prediction)
class: 0
value: 0, prob: 0.85625
value: 1, prob: 0.14375

class: 1
value: 0, prob: 0.291339
value: 1, prob: 0.708661


feature: 13, with gini loss: 0.292809, with 0/1 loss: 0.225135 (when used alone for prediction)
class: 0
value: 0, prob: 0.97546
value: 1, prob: 0.0245399

class: 1
value: 0, prob: 0.351351
value: 1, prob: 0.648649


feature: 14, with gini loss: 0.339472, with 0/1 loss: 0.259863 (when used alone for prediction)
class: 0
value: 0, prob: 0.905063
value: 1, prob: 0.0949367

class: 1
value: 0, prob: 0.363636
value: 1, prob: 0.636364


feature: 15, with gini loss: 0.4154, with 0/1 loss: 0.295792 (when used alone for prediction)
class: 0
value: 0, prob: 0.655405
value: 1, prob: 0.344595

class: 1
value: 0, prob: 0.930481
value: 1, prob: 0.0695187

votes

Car data set (UCI)

​

Number of features = 6

​

Total number of instances = 1728

 

number of classes: 4

 

probability of class 0 in the whole set: 0.700231
probability of class 1 in the whole set: 0.222222
probability of class 2 in the whole set: 0.0376157
probability of class 3 in the whole set: 0.0399306

 

feature 0, with number of values = 4
feature 1, with number of values = 4
feature 2, with number of values = 4
feature 3, with number of values = 3
feature 4, with number of values = 3
feature 5, with number of values = 3


Naive Bayes trained on the whole data set:

0/1 loss if no feature was used (error of random):0.299769

feature: 0, with gini loss: 0.443979, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.297364
value: 1, prob: 0.26771
value: 2, prob: 0.221582
value: 3, prob: 0.213344

class: 1
value: 0, prob: 0.188144
value: 1, prob: 0.280928
value: 2, prob: 0.298969
value: 3, prob: 0.231959

class: 2
value: 0, prob: 0.0144928
value: 1, prob: 0.0144928
value: 2, prob: 0.391304
value: 3, prob: 0.57971

class: 3
value: 0, prob: 0.0136986
value: 1, prob: 0.0136986
value: 2, prob: 0.328767
value: 3, prob: 0.643836


feature: 1, with gini loss: 0.446268, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.297364
value: 1, prob: 0.259473
value: 2, prob: 0.221582
value: 3, prob: 0.221582

class: 1
value: 0, prob: 0.188144
value: 1, prob: 0.273196
value: 2, prob: 0.298969
value: 3, prob: 0.239691

class: 2
value: 0, prob: 0.0144928
value: 1, prob: 0.202899
value: 2, prob: 0.391304
value: 3, prob: 0.391304

class: 3
value: 0, prob: 0.0136986
value: 1, prob: 0.0136986
value: 2, prob: 0.328767
value: 3, prob: 0.643836


feature: 2, with gini loss: 0.455785, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.269357
value: 1, prob: 0.247941
value: 2, prob: 0.241351
value: 3, prob: 0.241351

class: 1
value: 0, prob: 0.21134
value: 1, prob: 0.257732
value: 2, prob: 0.265464
value: 3, prob: 0.265464

class: 2
value: 0, prob: 0.15942
value: 1, prob: 0.231884
value: 2, prob: 0.304348
value: 3, prob: 0.304348

class: 3
value: 0, prob: 0.219178
value: 1, prob: 0.260274
value: 2, prob: 0.260274
value: 3, prob: 0.260274


feature: 3, with gini loss: 0.387571, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.47568
value: 1, prob: 0.258038
value: 2, prob: 0.266282

class: 1
value: 0, prob: 0.00258398
value: 1, prob: 0.514212
value: 2, prob: 0.483204

class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.455882
value: 2, prob: 0.529412

class: 3
value: 0, prob: 0.0138889
value: 1, prob: 0.513889
value: 2, prob: 0.472222


feature: 4, with gini loss: 0.45225, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.371805
value: 1, prob: 0.32399
value: 2, prob: 0.304204

class: 1
value: 0, prob: 0.273902
value: 1, prob: 0.351421
value: 2, prob: 0.374677

class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.382353
value: 2, prob: 0.602941

class: 3
value: 0, prob: 0.305556
value: 1, prob: 0.347222
value: 2, prob: 0.347222


feature: 5, with gini loss: 0.382318, with 0/1 loss: 0.299769 (when used alone for prediction)
class: 0
value: 0, prob: 0.47568
value: 1, prob: 0.295136
value: 2, prob: 0.229184

class: 1
value: 0, prob: 0.00258398
value: 1, prob: 0.4677
value: 2, prob: 0.529716

class: 2
value: 0, prob: 0.0147059
value: 1, prob: 0.0147059
value: 2, prob: 0.970588

class: 3
value: 0, prob: 0.0138889
value: 1, prob: 0.555556
value: 2, prob: 0.430556

car

kr-vs-kp data set (UCI)

​

Number of features = 36

​

Total number of instances = 3196

 

Number of classes: 2

 

probability of class 0 in the whole set: 0.522215

probability of class 1 in the whole set: 0.477785

 

feature 0, with number of values = 2
feature 1, with number of values = 2
feature 2, with number of values = 2
feature 3, with number of values = 2
feature 4, with number of values = 2
feature 5, with number of values = 2
feature 6, with number of values = 2
feature 7, with number of values = 2
feature 8, with number of values = 2
feature 9, with number of values = 2
feature 10, with number of values = 2
feature 11, with number of values = 2
feature 12, with number of values = 2
feature 13, with number of values = 2
feature 14, with number of values = 3
feature 15, with number of values = 2
feature 16, with number of values = 2
feature 17, with number of values = 2
feature 18, with number of values = 2
feature 19, with number of values = 2
feature 20, with number of values = 2
feature 21, with number of values = 2
feature 22, with number of values = 2
feature 23, with number of values = 2
feature 24, with number of values = 2
feature 25, with number of values = 2
feature 26, with number of values = 2
feature 27, with number of values = 2
feature 28, with number of values = 2
feature 29, with number of values = 2
feature 30, with number of values = 2
feature 31, with number of values = 2
feature 32, with number of values = 2
feature 33, with number of values = 2
feature 34, with number of values = 2
feature 35, with number of values = 2


Naive Bayes trained on the whole data set:

0/1 loss if no feature was used (error of random):0.477785

feature: 0, with gini loss: 0.499012, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.887493
value: 1, prob: 0.112507

class: 1
value: 0, prob: 0.888162
value: 1, prob: 0.111838


feature: 1, with gini loss: 0.499007, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.928187
value: 1, prob: 0.0718133

class: 1
value: 0, prob: 0.93002
value: 1, prob: 0.0699804


feature: 2, with gini loss: 0.494924, with 0/1 loss: 0.462162 (when used alone for prediction)
class: 0
value: 0, prob: 0.978456
value: 1, prob: 0.021544

class: 1
value: 0, prob: 0.943754
value: 1, prob: 0.0562459


feature: 3, with gini loss: 0.498931, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.902454
value: 1, prob: 0.0975464

class: 1
value: 0, prob: 0.894702
value: 1, prob: 0.105298


feature: 4, with gini loss: 0.498263, with 0/1 loss: 0.474366 (when used alone for prediction)
class: 0
value: 0, prob: 0.683423
value: 1, prob: 0.316577

class: 1
value: 0, prob: 0.646828
value: 1, prob: 0.353172


feature: 5, with gini loss: 0.489285, with 0/1 loss: 0.43219 (when used alone for prediction)
class: 0
value: 0, prob: 0.472172
value: 1, prob: 0.527828

class: 1
value: 0, prob: 0.611511
value: 1, prob: 0.388489


feature: 6, with gini loss: 0.485653, with 0/1 loss: 0.415305 (when used alone for prediction)
class: 0
value: 0, prob: 0.709156
value: 1, prob: 0.290844

class: 1
value: 0, prob: 0.551341
value: 1, prob: 0.448659


feature: 7, with gini loss: 0.472034, with 0/1 loss: 0.391547 (when used alone for prediction)
class: 0
value: 0, prob: 0.873728
value: 1, prob: 0.126272

class: 1
value: 0, prob: 0.681491
value: 1, prob: 0.318509


feature: 8, with gini loss: 0.495401, with 0/1 loss: 0.453431 (when used alone for prediction)
class: 0
value: 0, prob: 0.658887
value: 1, prob: 0.341113

class: 1
value: 0, prob: 0.576194
value: 1, prob: 0.423806


feature: 9, with gini loss: 0.42712, with 0/1 loss: 0.316865 (when used alone for prediction)
class: 0
value: 0, prob: 0.862956
value: 1, prob: 0.137044

class: 1
value: 0, prob: 0.513407
value: 1, prob: 0.486593


feature: 10, with gini loss: 0.496703, with 0/1 loss: 0.469379 (when used alone for prediction)
class: 0
value: 0, prob: 0.536206
value: 1, prob: 0.463794

class: 1
value: 0, prob: 0.603663
value: 1, prob: 0.396337


feature: 11, with gini loss: 0.498897, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.889886
value: 1, prob: 0.110114

class: 1
value: 0, prob: 0.899281
value: 1, prob: 0.100719


feature: 12, with gini loss: 0.494079, with 0/1 loss: 0.445615 (when used alone for prediction)
class: 0
value: 0, prob: 0.733692
value: 1, prob: 0.266308

class: 1
value: 0, prob: 0.641596
value: 1, prob: 0.358404


feature: 13, with gini loss: 0.496719, with 0/1 loss: 0.473098 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444

class: 1
value: 0, prob: 0.989536
value: 1, prob: 0.0104644


feature: 14, with gini loss: 0.475094, with 0/1 loss: 0.444128 (when used alone for prediction)
class: 0
value: 0, prob: 0.743421
value: 1, prob: 0.208732
value: 2, prob: 0.0478469

class: 1
value: 0, prob: 0.839869
value: 1, prob: 0.0647059
value: 2, prob: 0.0954248


feature: 15, with gini loss: 0.48665, with 0/1 loss: 0.445913 (when used alone for prediction)
class: 0
value: 0, prob: 0.983244
value: 1, prob: 0.0167564

class: 1
value: 0, prob: 0.914977
value: 1, prob: 0.0850229


feature: 16, with gini loss: 0.498942, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.967086
value: 1, prob: 0.0329144

class: 1
value: 0, prob: 0.971223
value: 1, prob: 0.028777


feature: 17, with gini loss: 0.485548, with 0/1 loss: 0.432198 (when used alone for prediction)
class: 0
value: 0, prob: 0.614004
value: 1, prob: 0.385996

class: 1
value: 0, prob: 0.766514
value: 1, prob: 0.233486


feature: 18, with gini loss: 0.498581, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.98863
value: 1, prob: 0.0113704

class: 1
value: 0, prob: 0.994114
value: 1, prob: 0.0058862


feature: 19, with gini loss: 0.498985, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.8462
value: 1, prob: 0.1538

class: 1
value: 0, prob: 0.851537
value: 1, prob: 0.148463


feature: 20, with gini loss: 0.397386, with 0/1 loss: 0.339706 (when used alone for prediction)
class: 0
value: 0, prob: 0.64991
value: 1, prob: 0.35009

class: 1
value: 0, prob: 0.999346
value: 1, prob: 0.000654022


feature: 21, with gini loss: 0.493906, with 0/1 loss: 0.472829 (when used alone for prediction)
class: 0
value: 0, prob: 0.760622
value: 1, prob: 0.239378

class: 1
value: 0, prob: 0.841727
value: 1, prob: 0.158273


feature: 22, with gini loss: 0.495201, with 0/1 loss: 0.459975 (when used alone for prediction)
class: 0
value: 0, prob: 0.9617
value: 1, prob: 0.0383004

class: 1
value: 0, prob: 0.920863
value: 1, prob: 0.0791367


feature: 23, with gini loss: 0.497978, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.596649
value: 1, prob: 0.403351

class: 1
value: 0, prob: 0.640942
value: 1, prob: 0.359058


feature: 24, with gini loss: 0.49832, with 0/1 loss: 0.475597 (when used alone for prediction)
class: 0
value: 0, prob: 0.998205
value: 1, prob: 0.00179533

class: 1
value: 0, prob: 0.99346
value: 1, prob: 0.00654022


feature: 25, with gini loss: 0.498333, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.67684
value: 1, prob: 0.32316

class: 1
value: 0, prob: 0.710922
value: 1, prob: 0.289078


feature: 26, with gini loss: 0.490605, with 0/1 loss: 0.4506 (when used alone for prediction)
class: 0
value: 0, prob: 0.97307
value: 1, prob: 0.02693

class: 1
value: 0, prob: 0.913669
value: 1, prob: 0.0863309


feature: 27, with gini loss: 0.498946, with 0/1 loss: 0.477472 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444

class: 1
value: 0, prob: 0.998692
value: 1, prob: 0.00130804


feature: 28, with gini loss: 0.491182, with 0/1 loss: 0.463098 (when used alone for prediction)
class: 0
value: 0, prob: 0.999402
value: 1, prob: 0.000598444

class: 1
value: 0, prob: 0.968607
value: 1, prob: 0.0313931


feature: 29, with gini loss: 0.498221, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.949132
value: 1, prob: 0.0508677

class: 1
value: 0, prob: 0.965337
value: 1, prob: 0.0346632


feature: 30, with gini loss: 0.491087, with 0/1 loss: 0.466268 (when used alone for prediction)
class: 0
value: 0, prob: 0.77678
value: 1, prob: 0.22322

class: 1
value: 0, prob: 0.87312
value: 1, prob: 0.12688


feature: 31, with gini loss: 0.479943, with 0/1 loss: 0.4356 (when used alone for prediction)
class: 0
value: 0, prob: 0.987433
value: 1, prob: 0.0125673

class: 1
value: 0, prob: 0.897973
value: 1, prob: 0.102027


feature: 32, with gini loss: 0.432607, with 0/1 loss: 0.317806 (when used alone for prediction)
class: 0
value: 0, prob: 0.789946
value: 1, prob: 0.210054

class: 1
value: 0, prob: 0.435579
value: 1, prob: 0.564421


feature: 33, with gini loss: 0.498206, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.609216
value: 1, prob: 0.390784

class: 1
value: 0, prob: 0.648136
value: 1, prob: 0.351864


feature: 34, with gini loss: 0.488327, with 0/1 loss: 0.424987 (when used alone for prediction)
class: 0
value: 0, prob: 0.795332
value: 1, prob: 0.204668

class: 1
value: 0, prob: 0.665795
value: 1, prob: 0.334205


feature: 35, with gini loss: 0.499013, with 0/1 loss: 0.477785 (when used alone for prediction)
class: 0
value: 0, prob: 0.752843
value: 1, prob: 0.247157

class: 1
value: 0, prob: 0.75278
value: 1, prob: 0.24722

chess
bottom of page