///////////////////////////////////////////
// Running convGAN-majority-5 on folding_yeast4
///////////////////////////////////////////

Load 'data_input/folding_yeast4'
from pickle file
Data loaded.
-> Shuffling data
### Start exercise for synthetic point generator

====== Step 1/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 1/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.2183
 40/115 [=========>....................] - ETA: 0s - loss: 0.2737 
 78/115 [===================>..........] - ETA: 0s - loss: 0.2882
115/115 [==============================] - 0s 1ms/step - loss: 0.2959
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.4597
 38/115 [========>.....................] - ETA: 0s - loss: 0.2641
 77/115 [===================>..........] - ETA: 0s - loss: 0.2784
112/115 [============================>.] - ETA: 0s - loss: 0.2883
115/115 [==============================] - 0s 1ms/step - loss: 0.2940
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3421
 32/115 [=======>......................] - ETA: 0s - loss: 0.3161
 65/115 [===============>..............] - ETA: 0s - loss: 0.2867
 98/115 [========================>.....] - ETA: 0s - loss: 0.2933
115/115 [==============================] - 0s 2ms/step - loss: 0.2901
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3157
 39/115 [=========>....................] - ETA: 0s - loss: 0.3035
 77/115 [===================>..........] - ETA: 0s - loss: 0.2997
115/115 [==============================] - ETA: 0s - loss: 0.2873
115/115 [==============================] - 0s 1ms/step - loss: 0.2873
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.2285
 44/115 [==========>...................] - ETA: 0s - loss: 0.2809
 86/115 [=====================>........] - ETA: 0s - loss: 0.2803
115/115 [==============================] - 0s 1ms/step - loss: 0.2847
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2451
 40/115 [=========>....................] - ETA: 0s - loss: 0.2606
 76/115 [==================>...........] - ETA: 0s - loss: 0.2730
115/115 [==============================] - ETA: 0s - loss: 0.2829
115/115 [==============================] - 0s 1ms/step - loss: 0.2829
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3497
 39/115 [=========>....................] - ETA: 0s - loss: 0.2622
 77/115 [===================>..........] - ETA: 0s - loss: 0.2665
114/115 [============================>.] - ETA: 0s - loss: 0.2788
115/115 [==============================] - 0s 1ms/step - loss: 0.2789
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2643
 38/115 [========>.....................] - ETA: 0s - loss: 0.2795
 76/115 [==================>...........] - ETA: 0s - loss: 0.2770
114/115 [============================>.] - ETA: 0s - loss: 0.2756
115/115 [==============================] - 0s 1ms/step - loss: 0.2759
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.1405
 39/115 [=========>....................] - ETA: 0s - loss: 0.2703
 77/115 [===================>..........] - ETA: 0s - loss: 0.2654
113/115 [============================>.] - ETA: 0s - loss: 0.2720
115/115 [==============================] - 0s 1ms/step - loss: 0.2733
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3016
 40/115 [=========>....................] - ETA: 0s - loss: 0.2680
 79/115 [===================>..........] - ETA: 0s - loss: 0.2627
115/115 [==============================] - 0s 1ms/step - loss: 0.2677
-> test with GAN.predict
GAN tn, fp: 260, 27
GAN fn, tp: 2, 9
GAN f1 score: 0.383
GAN cohens kappa score: 0.346

-> test with 'LR'
LR tn, fp: 245, 42
LR fn, tp: 2, 9
LR f1 score: 0.290
LR cohens kappa score: 0.244
LR average precision score: 0.389

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 10, 1
RF f1 score: 0.154
RF cohens kappa score: 0.144

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 10, 1
GB f1 score: 0.154
GB cohens kappa score: 0.144

-> test with 'KNN'
KNN tn, fp: 259, 28
KNN fn, tp: 2, 9
KNN f1 score: 0.375
KNN cohens kappa score: 0.337


------ Step 1/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 19s - loss: 0.3954
 40/115 [=========>....................] - ETA: 0s - loss: 0.3362 
 79/115 [===================>..........] - ETA: 0s - loss: 0.3245
115/115 [==============================] - 0s 1ms/step - loss: 0.3349
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2593
 41/115 [=========>....................] - ETA: 0s - loss: 0.3266
 80/115 [===================>..........] - ETA: 0s - loss: 0.3219
115/115 [==============================] - 0s 1ms/step - loss: 0.3312
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.6266
 40/115 [=========>....................] - ETA: 0s - loss: 0.3430
 78/115 [===================>..........] - ETA: 0s - loss: 0.3292
115/115 [==============================] - 0s 1ms/step - loss: 0.3286
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2315
 38/115 [========>.....................] - ETA: 0s - loss: 0.3239
 72/115 [=================>............] - ETA: 0s - loss: 0.3123
110/115 [===========================>..] - ETA: 0s - loss: 0.3180
115/115 [==============================] - 0s 1ms/step - loss: 0.3223
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.2317
 38/115 [========>.....................] - ETA: 0s - loss: 0.3306
 76/115 [==================>...........] - ETA: 0s - loss: 0.3121
114/115 [============================>.] - ETA: 0s - loss: 0.3178
115/115 [==============================] - 0s 1ms/step - loss: 0.3176
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2973
 39/115 [=========>....................] - ETA: 0s - loss: 0.3339
 77/115 [===================>..........] - ETA: 0s - loss: 0.3156
115/115 [==============================] - ETA: 0s - loss: 0.3128
115/115 [==============================] - 0s 1ms/step - loss: 0.3128
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2231
 39/115 [=========>....................] - ETA: 0s - loss: 0.3037
 77/115 [===================>..........] - ETA: 0s - loss: 0.3059
115/115 [==============================] - 0s 1ms/step - loss: 0.3087
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1893
 40/115 [=========>....................] - ETA: 0s - loss: 0.3152
 80/115 [===================>..........] - ETA: 0s - loss: 0.3171
115/115 [==============================] - 0s 1ms/step - loss: 0.3062
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2723
 36/115 [========>.....................] - ETA: 0s - loss: 0.3044
 73/115 [==================>...........] - ETA: 0s - loss: 0.2971
107/115 [==========================>...] - ETA: 0s - loss: 0.2999
115/115 [==============================] - 0s 1ms/step - loss: 0.2993
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.4919
 32/115 [=======>......................] - ETA: 0s - loss: 0.2818
 66/115 [================>.............] - ETA: 0s - loss: 0.2910
105/115 [==========================>...] - ETA: 0s - loss: 0.2934
115/115 [==============================] - 0s 1ms/step - loss: 0.2949
-> test with GAN.predict
GAN tn, fp: 259, 28
GAN fn, tp: 2, 9
GAN f1 score: 0.375
GAN cohens kappa score: 0.337

-> test with 'LR'
LR tn, fp: 237, 50
LR fn, tp: 1, 10
LR f1 score: 0.282
LR cohens kappa score: 0.234
LR average precision score: 0.661

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 7, 4
RF f1 score: 0.500
RF cohens kappa score: 0.488

-> test with 'GB'
GB tn, fp: 284, 3
GB fn, tp: 6, 5
GB f1 score: 0.526
GB cohens kappa score: 0.511

-> test with 'KNN'
KNN tn, fp: 259, 28
KNN fn, tp: 0, 11
KNN f1 score: 0.440
KNN cohens kappa score: 0.406


------ Step 1/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.2694
 42/115 [=========>....................] - ETA: 0s - loss: 0.3220 
 81/115 [====================>.........] - ETA: 0s - loss: 0.3310
115/115 [==============================] - 0s 1ms/step - loss: 0.3297
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.1856
 40/115 [=========>....................] - ETA: 0s - loss: 0.3340
 81/115 [====================>.........] - ETA: 0s - loss: 0.3198
115/115 [==============================] - 0s 1ms/step - loss: 0.3271
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2188
 42/115 [=========>....................] - ETA: 0s - loss: 0.3090
 80/115 [===================>..........] - ETA: 0s - loss: 0.3216
115/115 [==============================] - 0s 1ms/step - loss: 0.3259
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2046
 41/115 [=========>....................] - ETA: 0s - loss: 0.3054
 81/115 [====================>.........] - ETA: 0s - loss: 0.3248
115/115 [==============================] - 0s 1ms/step - loss: 0.3228
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3414
 40/115 [=========>....................] - ETA: 0s - loss: 0.3111
 78/115 [===================>..........] - ETA: 0s - loss: 0.3042
115/115 [==============================] - 0s 1ms/step - loss: 0.3200
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2309
 40/115 [=========>....................] - ETA: 0s - loss: 0.2979
 76/115 [==================>...........] - ETA: 0s - loss: 0.3043
114/115 [============================>.] - ETA: 0s - loss: 0.3189
115/115 [==============================] - 0s 1ms/step - loss: 0.3179
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.4476
 41/115 [=========>....................] - ETA: 0s - loss: 0.3243
 81/115 [====================>.........] - ETA: 0s - loss: 0.3139
115/115 [==============================] - 0s 1ms/step - loss: 0.3141
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.4451
 39/115 [=========>....................] - ETA: 0s - loss: 0.2978
 78/115 [===================>..........] - ETA: 0s - loss: 0.3132
115/115 [==============================] - ETA: 0s - loss: 0.3125
115/115 [==============================] - 0s 1ms/step - loss: 0.3125
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3286
 37/115 [========>.....................] - ETA: 0s - loss: 0.2908
 78/115 [===================>..........] - ETA: 0s - loss: 0.3058
115/115 [==============================] - 0s 1ms/step - loss: 0.3104
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2532
 42/115 [=========>....................] - ETA: 0s - loss: 0.2855
 79/115 [===================>..........] - ETA: 0s - loss: 0.3021
115/115 [==============================] - 0s 1ms/step - loss: 0.3091
-> test with GAN.predict
GAN tn, fp: 257, 30
GAN fn, tp: 2, 9
GAN f1 score: 0.360
GAN cohens kappa score: 0.321

-> test with 'LR'
LR tn, fp: 232, 55
LR fn, tp: 1, 10
LR f1 score: 0.263
LR cohens kappa score: 0.213
LR average precision score: 0.251

-> test with 'RF'
RF tn, fp: 287, 0
RF fn, tp: 11, 0
RF f1 score: 0.000
RF cohens kappa score: 0.000

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 10, 1
GB f1 score: 0.154
GB cohens kappa score: 0.144

-> test with 'KNN'
KNN tn, fp: 252, 35
KNN fn, tp: 3, 8
KNN f1 score: 0.296
KNN cohens kappa score: 0.252


------ Step 1/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 20s - loss: 0.1738
 42/115 [=========>....................] - ETA: 0s - loss: 0.2470 
 83/115 [====================>.........] - ETA: 0s - loss: 0.2304
115/115 [==============================] - 0s 1ms/step - loss: 0.2240
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.4490
 40/115 [=========>....................] - ETA: 0s - loss: 0.2229
 79/115 [===================>..........] - ETA: 0s - loss: 0.2249
115/115 [==============================] - 0s 1ms/step - loss: 0.2214
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3827
 41/115 [=========>....................] - ETA: 0s - loss: 0.2176
 81/115 [====================>.........] - ETA: 0s - loss: 0.2183
115/115 [==============================] - 0s 1ms/step - loss: 0.2202
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3313
 44/115 [==========>...................] - ETA: 0s - loss: 0.2217
 86/115 [=====================>........] - ETA: 0s - loss: 0.2121
115/115 [==============================] - 0s 1ms/step - loss: 0.2173
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.0764
 40/115 [=========>....................] - ETA: 0s - loss: 0.2210
 80/115 [===================>..........] - ETA: 0s - loss: 0.2178
115/115 [==============================] - 0s 1ms/step - loss: 0.2189
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1983
 41/115 [=========>....................] - ETA: 0s - loss: 0.2171
 80/115 [===================>..........] - ETA: 0s - loss: 0.2222
115/115 [==============================] - 0s 1ms/step - loss: 0.2154
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.0875
 35/115 [========>.....................] - ETA: 0s - loss: 0.2174
 68/115 [================>.............] - ETA: 0s - loss: 0.2122
107/115 [==========================>...] - ETA: 0s - loss: 0.2123
115/115 [==============================] - 0s 1ms/step - loss: 0.2158
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2690
 39/115 [=========>....................] - ETA: 0s - loss: 0.2376
 77/115 [===================>..........] - ETA: 0s - loss: 0.2219
115/115 [==============================] - 0s 1ms/step - loss: 0.2136
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2096
 40/115 [=========>....................] - ETA: 0s - loss: 0.2080
 79/115 [===================>..........] - ETA: 0s - loss: 0.2034
115/115 [==============================] - 0s 1ms/step - loss: 0.2100
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2223
 41/115 [=========>....................] - ETA: 0s - loss: 0.1934
 79/115 [===================>..........] - ETA: 0s - loss: 0.2031
115/115 [==============================] - 0s 1ms/step - loss: 0.2110
-> test with GAN.predict
GAN tn, fp: 261, 26
GAN fn, tp: 6, 5
GAN f1 score: 0.238
GAN cohens kappa score: 0.194

-> test with 'LR'
LR tn, fp: 251, 36
LR fn, tp: 6, 5
LR f1 score: 0.192
LR cohens kappa score: 0.142
LR average precision score: 0.176

-> test with 'RF'
RF tn, fp: 283, 4
RF fn, tp: 8, 3
RF f1 score: 0.333
RF cohens kappa score: 0.314

-> test with 'GB'
GB tn, fp: 281, 6
GB fn, tp: 8, 3
GB f1 score: 0.300
GB cohens kappa score: 0.276

-> test with 'KNN'
KNN tn, fp: 251, 36
KNN fn, tp: 5, 6
KNN f1 score: 0.226
KNN cohens kappa score: 0.178


------ Step 1/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1104 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.3312
 42/115 [=========>....................] - ETA: 0s - loss: 0.3223 
 83/115 [====================>.........] - ETA: 0s - loss: 0.3105
115/115 [==============================] - 0s 1ms/step - loss: 0.3110
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2363
 42/115 [=========>....................] - ETA: 0s - loss: 0.3320
 83/115 [====================>.........] - ETA: 0s - loss: 0.3173
115/115 [==============================] - 0s 1ms/step - loss: 0.3063
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2359
 42/115 [=========>....................] - ETA: 0s - loss: 0.2859
 83/115 [====================>.........] - ETA: 0s - loss: 0.3058
115/115 [==============================] - 0s 1ms/step - loss: 0.3021
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2572
 42/115 [=========>....................] - ETA: 0s - loss: 0.3104
 82/115 [====================>.........] - ETA: 0s - loss: 0.3101
115/115 [==============================] - 0s 1ms/step - loss: 0.3024
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3790
 41/115 [=========>....................] - ETA: 0s - loss: 0.2911
 82/115 [====================>.........] - ETA: 0s - loss: 0.2881
115/115 [==============================] - 0s 1ms/step - loss: 0.2949
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2325
 34/115 [=======>......................] - ETA: 0s - loss: 0.3051
 68/115 [================>.............] - ETA: 0s - loss: 0.3020
105/115 [==========================>...] - ETA: 0s - loss: 0.2917
115/115 [==============================] - 0s 1ms/step - loss: 0.2906
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3587
 42/115 [=========>....................] - ETA: 0s - loss: 0.2785
 81/115 [====================>.........] - ETA: 0s - loss: 0.2747
115/115 [==============================] - 0s 1ms/step - loss: 0.2856
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2190
 42/115 [=========>....................] - ETA: 0s - loss: 0.2855
 83/115 [====================>.........] - ETA: 0s - loss: 0.2819
115/115 [==============================] - 0s 1ms/step - loss: 0.2834
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2639
 42/115 [=========>....................] - ETA: 0s - loss: 0.2537
 82/115 [====================>.........] - ETA: 0s - loss: 0.2676
115/115 [==============================] - 0s 1ms/step - loss: 0.2781
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.4015
 42/115 [=========>....................] - ETA: 0s - loss: 0.3017
 83/115 [====================>.........] - ETA: 0s - loss: 0.2793
115/115 [==============================] - 0s 1ms/step - loss: 0.2744
-> test with GAN.predict
GAN tn, fp: 253, 32
GAN fn, tp: 2, 5
GAN f1 score: 0.227
GAN cohens kappa score: 0.195

-> test with 'LR'
LR tn, fp: 241, 44
LR fn, tp: 1, 6
LR f1 score: 0.211
LR cohens kappa score: 0.176
LR average precision score: 0.410

-> test with 'RF'
RF tn, fp: 285, 0
RF fn, tp: 5, 2
RF f1 score: 0.444
RF cohens kappa score: 0.438

-> test with 'GB'
GB tn, fp: 283, 2
GB fn, tp: 6, 1
GB f1 score: 0.200
GB cohens kappa score: 0.188

-> test with 'KNN'
KNN tn, fp: 258, 27
KNN fn, tp: 1, 6
KNN f1 score: 0.300
KNN cohens kappa score: 0.271


====== Step 2/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 2/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.4580
 42/115 [=========>....................] - ETA: 0s - loss: 0.2949 
 80/115 [===================>..........] - ETA: 0s - loss: 0.2846
115/115 [==============================] - 0s 1ms/step - loss: 0.2864
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.6379
 29/115 [======>.......................] - ETA: 0s - loss: 0.3524
 58/115 [==============>...............] - ETA: 0s - loss: 0.3041
 92/115 [=======================>......] - ETA: 0s - loss: 0.2888
115/115 [==============================] - 0s 3ms/step - loss: 0.2852
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3285
 39/115 [=========>....................] - ETA: 0s - loss: 0.2925
 79/115 [===================>..........] - ETA: 0s - loss: 0.2812
115/115 [==============================] - 0s 1ms/step - loss: 0.2809
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3162
 38/115 [========>.....................] - ETA: 0s - loss: 0.2503
 79/115 [===================>..........] - ETA: 0s - loss: 0.2654
115/115 [==============================] - 0s 1ms/step - loss: 0.2781
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.4246
 41/115 [=========>....................] - ETA: 0s - loss: 0.2743
 80/115 [===================>..........] - ETA: 0s - loss: 0.2767
115/115 [==============================] - 0s 1ms/step - loss: 0.2743
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1382
 41/115 [=========>....................] - ETA: 0s - loss: 0.2849
 77/115 [===================>..........] - ETA: 0s - loss: 0.2661
115/115 [==============================] - 0s 1ms/step - loss: 0.2714
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3072
 41/115 [=========>....................] - ETA: 0s - loss: 0.2751
 76/115 [==================>...........] - ETA: 0s - loss: 0.2759
112/115 [============================>.] - ETA: 0s - loss: 0.2684
115/115 [==============================] - 0s 1ms/step - loss: 0.2683
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2537
 32/115 [=======>......................] - ETA: 0s - loss: 0.2371
 70/115 [=================>............] - ETA: 0s - loss: 0.2705
111/115 [===========================>..] - ETA: 0s - loss: 0.2687
115/115 [==============================] - 0s 1ms/step - loss: 0.2697
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.1999
 40/115 [=========>....................] - ETA: 0s - loss: 0.2394
 82/115 [====================>.........] - ETA: 0s - loss: 0.2629
115/115 [==============================] - 0s 1ms/step - loss: 0.2609
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1841
 40/115 [=========>....................] - ETA: 0s - loss: 0.2739
 81/115 [====================>.........] - ETA: 0s - loss: 0.2726
115/115 [==============================] - 0s 1ms/step - loss: 0.2612
-> test with GAN.predict
GAN tn, fp: 263, 24
GAN fn, tp: 2, 9
GAN f1 score: 0.409
GAN cohens kappa score: 0.374

-> test with 'LR'
LR tn, fp: 248, 39
LR fn, tp: 2, 9
LR f1 score: 0.305
LR cohens kappa score: 0.261
LR average precision score: 0.327

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 10, 1
RF f1 score: 0.154
RF cohens kappa score: 0.144

-> test with 'GB'
GB tn, fp: 284, 3
GB fn, tp: 10, 1
GB f1 score: 0.133
GB cohens kappa score: 0.116

-> test with 'KNN'
KNN tn, fp: 267, 20
KNN fn, tp: 3, 8
KNN f1 score: 0.410
KNN cohens kappa score: 0.377


------ Step 2/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.5738
 39/115 [=========>....................] - ETA: 0s - loss: 0.2987 
 74/115 [==================>...........] - ETA: 0s - loss: 0.2954
109/115 [===========================>..] - ETA: 0s - loss: 0.2957
115/115 [==============================] - 0s 1ms/step - loss: 0.2978
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3082
 36/115 [========>.....................] - ETA: 0s - loss: 0.2671
 69/115 [=================>............] - ETA: 0s - loss: 0.2933
103/115 [=========================>....] - ETA: 0s - loss: 0.2926
115/115 [==============================] - 0s 1ms/step - loss: 0.2939
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3994
 37/115 [========>.....................] - ETA: 0s - loss: 0.2778
 72/115 [=================>............] - ETA: 0s - loss: 0.2892
107/115 [==========================>...] - ETA: 0s - loss: 0.2898
115/115 [==============================] - 0s 1ms/step - loss: 0.2913
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2261
 35/115 [========>.....................] - ETA: 0s - loss: 0.2765
 66/115 [================>.............] - ETA: 0s - loss: 0.2921
 99/115 [========================>.....] - ETA: 0s - loss: 0.2906
115/115 [==============================] - 0s 2ms/step - loss: 0.2873
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3860
 35/115 [========>.....................] - ETA: 0s - loss: 0.3092
 69/115 [=================>............] - ETA: 0s - loss: 0.2921
104/115 [==========================>...] - ETA: 0s - loss: 0.2865
115/115 [==============================] - 0s 1ms/step - loss: 0.2843
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.4045
 35/115 [========>.....................] - ETA: 0s - loss: 0.2807
 67/115 [================>.............] - ETA: 0s - loss: 0.2814
103/115 [=========================>....] - ETA: 0s - loss: 0.2844
115/115 [==============================] - 0s 1ms/step - loss: 0.2827
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2110
 35/115 [========>.....................] - ETA: 0s - loss: 0.2710
 68/115 [================>.............] - ETA: 0s - loss: 0.2758
 97/115 [========================>.....] - ETA: 0s - loss: 0.2761
115/115 [==============================] - 0s 2ms/step - loss: 0.2785
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.4104
 35/115 [========>.....................] - ETA: 0s - loss: 0.3230
 70/115 [=================>............] - ETA: 0s - loss: 0.2945
107/115 [==========================>...] - ETA: 0s - loss: 0.2803
115/115 [==============================] - 0s 1ms/step - loss: 0.2773
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3067
 33/115 [=======>......................] - ETA: 0s - loss: 0.2652
 71/115 [=================>............] - ETA: 0s - loss: 0.2572
105/115 [==========================>...] - ETA: 0s - loss: 0.2718
115/115 [==============================] - 0s 1ms/step - loss: 0.2756
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3754
 34/115 [=======>......................] - ETA: 0s - loss: 0.2560
 65/115 [===============>..............] - ETA: 0s - loss: 0.2616
 97/115 [========================>.....] - ETA: 0s - loss: 0.2635
115/115 [==============================] - 0s 2ms/step - loss: 0.2687
-> test with GAN.predict
GAN tn, fp: 254, 33
GAN fn, tp: 3, 8
GAN f1 score: 0.308
GAN cohens kappa score: 0.265

-> test with 'LR'
LR tn, fp: 237, 50
LR fn, tp: 2, 9
LR f1 score: 0.257
LR cohens kappa score: 0.208
LR average precision score: 0.468

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 7, 4
RF f1 score: 0.500
RF cohens kappa score: 0.488

-> test with 'GB'
GB tn, fp: 285, 2
GB fn, tp: 6, 5
GB f1 score: 0.556
GB cohens kappa score: 0.542

-> test with 'KNN'
KNN tn, fp: 235, 52
KNN fn, tp: 3, 8
KNN f1 score: 0.225
KNN cohens kappa score: 0.174


------ Step 2/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.2238
 42/115 [=========>....................] - ETA: 0s - loss: 0.2610 
 83/115 [====================>.........] - ETA: 0s - loss: 0.2720
115/115 [==============================] - 0s 1ms/step - loss: 0.2690
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.1529
 42/115 [=========>....................] - ETA: 0s - loss: 0.2763
 78/115 [===================>..........] - ETA: 0s - loss: 0.2713
113/115 [============================>.] - ETA: 0s - loss: 0.2696
115/115 [==============================] - 0s 1ms/step - loss: 0.2674
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3820
 35/115 [========>.....................] - ETA: 0s - loss: 0.2919
 76/115 [==================>...........] - ETA: 0s - loss: 0.2679
115/115 [==============================] - 0s 1ms/step - loss: 0.2680
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1114
 43/115 [==========>...................] - ETA: 0s - loss: 0.2663
 84/115 [====================>.........] - ETA: 0s - loss: 0.2639
115/115 [==============================] - 0s 1ms/step - loss: 0.2644
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1773
 42/115 [=========>....................] - ETA: 0s - loss: 0.2755
 83/115 [====================>.........] - ETA: 0s - loss: 0.2616
115/115 [==============================] - 0s 1ms/step - loss: 0.2609
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1027
 41/115 [=========>....................] - ETA: 0s - loss: 0.2566
 81/115 [====================>.........] - ETA: 0s - loss: 0.2663
115/115 [==============================] - 0s 1ms/step - loss: 0.2596
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2012
 42/115 [=========>....................] - ETA: 0s - loss: 0.2444
 83/115 [====================>.........] - ETA: 0s - loss: 0.2514
115/115 [==============================] - 0s 1ms/step - loss: 0.2561
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1945
 39/115 [=========>....................] - ETA: 0s - loss: 0.2397
 80/115 [===================>..........] - ETA: 0s - loss: 0.2491
115/115 [==============================] - 0s 1ms/step - loss: 0.2535
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3286
 43/115 [==========>...................] - ETA: 0s - loss: 0.2428
 81/115 [====================>.........] - ETA: 0s - loss: 0.2474
115/115 [==============================] - 0s 1ms/step - loss: 0.2534
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2494
 42/115 [=========>....................] - ETA: 0s - loss: 0.2455
 82/115 [====================>.........] - ETA: 0s - loss: 0.2488
115/115 [==============================] - 0s 1ms/step - loss: 0.2497
-> test with GAN.predict
GAN tn, fp: 257, 30
GAN fn, tp: 4, 7
GAN f1 score: 0.292
GAN cohens kappa score: 0.249

-> test with 'LR'
LR tn, fp: 245, 42
LR fn, tp: 4, 7
LR f1 score: 0.233
LR cohens kappa score: 0.184
LR average precision score: 0.362

-> test with 'RF'
RF tn, fp: 285, 2
RF fn, tp: 9, 2
RF f1 score: 0.267
RF cohens kappa score: 0.252

-> test with 'GB'
GB tn, fp: 284, 3
GB fn, tp: 8, 3
GB f1 score: 0.353
GB cohens kappa score: 0.336

-> test with 'KNN'
KNN tn, fp: 251, 36
KNN fn, tp: 3, 8
KNN f1 score: 0.291
KNN cohens kappa score: 0.246


------ Step 2/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.1022
 39/115 [=========>....................] - ETA: 0s - loss: 0.2580 
 78/115 [===================>..........] - ETA: 0s - loss: 0.2814
115/115 [==============================] - 0s 1ms/step - loss: 0.2688
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3048
 38/115 [========>.....................] - ETA: 0s - loss: 0.2432
 77/115 [===================>..........] - ETA: 0s - loss: 0.2562
115/115 [==============================] - 0s 1ms/step - loss: 0.2661
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2406
 33/115 [=======>......................] - ETA: 0s - loss: 0.2608
 66/115 [================>.............] - ETA: 0s - loss: 0.2835
101/115 [=========================>....] - ETA: 0s - loss: 0.2689
115/115 [==============================] - 0s 1ms/step - loss: 0.2644
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2900
 40/115 [=========>....................] - ETA: 0s - loss: 0.2841
 80/115 [===================>..........] - ETA: 0s - loss: 0.2535
115/115 [==============================] - 0s 1ms/step - loss: 0.2627
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1226
 40/115 [=========>....................] - ETA: 0s - loss: 0.2872
 78/115 [===================>..........] - ETA: 0s - loss: 0.2708
115/115 [==============================] - 0s 1ms/step - loss: 0.2610
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2658
 40/115 [=========>....................] - ETA: 0s - loss: 0.2875
 78/115 [===================>..........] - ETA: 0s - loss: 0.2575
115/115 [==============================] - ETA: 0s - loss: 0.2591
115/115 [==============================] - 0s 1ms/step - loss: 0.2591
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.4785
 37/115 [========>.....................] - ETA: 0s - loss: 0.2586
 73/115 [==================>...........] - ETA: 0s - loss: 0.2612
110/115 [===========================>..] - ETA: 0s - loss: 0.2555
115/115 [==============================] - 0s 1ms/step - loss: 0.2566
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1571
 38/115 [========>.....................] - ETA: 0s - loss: 0.2730
 77/115 [===================>..........] - ETA: 0s - loss: 0.2590
115/115 [==============================] - 0s 1ms/step - loss: 0.2558
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2662
 41/115 [=========>....................] - ETA: 0s - loss: 0.2812
 81/115 [====================>.........] - ETA: 0s - loss: 0.2592
115/115 [==============================] - 0s 1ms/step - loss: 0.2526
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2186
 40/115 [=========>....................] - ETA: 0s - loss: 0.2373
 81/115 [====================>.........] - ETA: 0s - loss: 0.2572
115/115 [==============================] - 0s 1ms/step - loss: 0.2500
-> test with GAN.predict
GAN tn, fp: 259, 28
GAN fn, tp: 3, 8
GAN f1 score: 0.340
GAN cohens kappa score: 0.301

-> test with 'LR'
LR tn, fp: 247, 40
LR fn, tp: 2, 9
LR f1 score: 0.300
LR cohens kappa score: 0.255
LR average precision score: 0.295

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 9, 2
RF f1 score: 0.286
RF cohens kappa score: 0.274

-> test with 'GB'
GB tn, fp: 285, 2
GB fn, tp: 10, 1
GB f1 score: 0.143
GB cohens kappa score: 0.129

-> test with 'KNN'
KNN tn, fp: 262, 25
KNN fn, tp: 3, 8
KNN f1 score: 0.364
KNN cohens kappa score: 0.326


------ Step 2/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1104 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.2086
 41/115 [=========>....................] - ETA: 0s - loss: 0.2861 
 82/115 [====================>.........] - ETA: 0s - loss: 0.2992
115/115 [==============================] - 0s 1ms/step - loss: 0.3011
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3201
 41/115 [=========>....................] - ETA: 0s - loss: 0.3001
 81/115 [====================>.........] - ETA: 0s - loss: 0.2901
115/115 [==============================] - 0s 1ms/step - loss: 0.2940
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3669
 41/115 [=========>....................] - ETA: 0s - loss: 0.2858
 81/115 [====================>.........] - ETA: 0s - loss: 0.2881
115/115 [==============================] - 0s 1ms/step - loss: 0.2893
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1803
 40/115 [=========>....................] - ETA: 0s - loss: 0.2925
 80/115 [===================>..........] - ETA: 0s - loss: 0.2937
115/115 [==============================] - 0s 1ms/step - loss: 0.2869
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3339
 34/115 [=======>......................] - ETA: 0s - loss: 0.2710
 69/115 [=================>............] - ETA: 0s - loss: 0.2774
104/115 [==========================>...] - ETA: 0s - loss: 0.2808
115/115 [==============================] - 0s 1ms/step - loss: 0.2808
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.4335
 40/115 [=========>....................] - ETA: 0s - loss: 0.2593
 80/115 [===================>..........] - ETA: 0s - loss: 0.2749
115/115 [==============================] - 0s 1ms/step - loss: 0.2734
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.1366
 42/115 [=========>....................] - ETA: 0s - loss: 0.2548
 83/115 [====================>.........] - ETA: 0s - loss: 0.2612
115/115 [==============================] - 0s 1ms/step - loss: 0.2691
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.3582
 40/115 [=========>....................] - ETA: 0s - loss: 0.2605
 80/115 [===================>..........] - ETA: 0s - loss: 0.2622
115/115 [==============================] - 0s 1ms/step - loss: 0.2640
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2976
 42/115 [=========>....................] - ETA: 0s - loss: 0.2606
 83/115 [====================>.........] - ETA: 0s - loss: 0.2548
115/115 [==============================] - 0s 1ms/step - loss: 0.2589
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3732
 41/115 [=========>....................] - ETA: 0s - loss: 0.2484
 76/115 [==================>...........] - ETA: 0s - loss: 0.2439
108/115 [===========================>..] - ETA: 0s - loss: 0.2540
115/115 [==============================] - 0s 1ms/step - loss: 0.2527
-> test with GAN.predict
GAN tn, fp: 263, 22
GAN fn, tp: 2, 5
GAN f1 score: 0.294
GAN cohens kappa score: 0.266

-> test with 'LR'
LR tn, fp: 224, 61
LR fn, tp: 1, 6
LR f1 score: 0.162
LR cohens kappa score: 0.124
LR average precision score: 0.361

-> test with 'RF'
RF tn, fp: 284, 1
RF fn, tp: 7, 0
RF f1 score: 0.000
RF cohens kappa score: -0.006

-> test with 'GB'
GB tn, fp: 284, 1
GB fn, tp: 6, 1
GB f1 score: 0.222
GB cohens kappa score: 0.214

-> test with 'KNN'
KNN tn, fp: 267, 18
KNN fn, tp: 1, 6
KNN f1 score: 0.387
KNN cohens kappa score: 0.363


====== Step 3/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 3/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.2743
 42/115 [=========>....................] - ETA: 0s - loss: 0.3106 
 79/115 [===================>..........] - ETA: 0s - loss: 0.2988
115/115 [==============================] - 0s 1ms/step - loss: 0.3112
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2286
 40/115 [=========>....................] - ETA: 0s - loss: 0.3159
 79/115 [===================>..........] - ETA: 0s - loss: 0.3015
115/115 [==============================] - 0s 1ms/step - loss: 0.3089
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2875
 40/115 [=========>....................] - ETA: 0s - loss: 0.3126
 81/115 [====================>.........] - ETA: 0s - loss: 0.3207
115/115 [==============================] - 0s 1ms/step - loss: 0.3073
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1003
 41/115 [=========>....................] - ETA: 0s - loss: 0.2829
 81/115 [====================>.........] - ETA: 0s - loss: 0.3117
111/115 [===========================>..] - ETA: 0s - loss: 0.3022
115/115 [==============================] - 0s 1ms/step - loss: 0.3043
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3898
 31/115 [=======>......................] - ETA: 0s - loss: 0.3031
 61/115 [==============>...............] - ETA: 0s - loss: 0.3182
 97/115 [========================>.....] - ETA: 0s - loss: 0.3005
115/115 [==============================] - 0s 2ms/step - loss: 0.3022
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.3850
 39/115 [=========>....................] - ETA: 0s - loss: 0.2977
 78/115 [===================>..........] - ETA: 0s - loss: 0.3004
115/115 [==============================] - 0s 1ms/step - loss: 0.2974
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3284
 40/115 [=========>....................] - ETA: 0s - loss: 0.2852
 77/115 [===================>..........] - ETA: 0s - loss: 0.2885
115/115 [==============================] - 0s 1ms/step - loss: 0.2960
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1709
 39/115 [=========>....................] - ETA: 0s - loss: 0.2870
 78/115 [===================>..........] - ETA: 0s - loss: 0.2934
115/115 [==============================] - 0s 1ms/step - loss: 0.2910
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3758
 42/115 [=========>....................] - ETA: 0s - loss: 0.2996
 81/115 [====================>.........] - ETA: 0s - loss: 0.2770
115/115 [==============================] - 0s 1ms/step - loss: 0.2875
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2311
 40/115 [=========>....................] - ETA: 0s - loss: 0.2863
 80/115 [===================>..........] - ETA: 0s - loss: 0.2873
115/115 [==============================] - 0s 1ms/step - loss: 0.2851
-> test with GAN.predict
GAN tn, fp: 251, 36
GAN fn, tp: 3, 8
GAN f1 score: 0.291
GAN cohens kappa score: 0.246

-> test with 'LR'
LR tn, fp: 242, 45
LR fn, tp: 2, 9
LR f1 score: 0.277
LR cohens kappa score: 0.230
LR average precision score: 0.453

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 9, 2
RF f1 score: 0.286
RF cohens kappa score: 0.274

-> test with 'GB'
GB tn, fp: 284, 3
GB fn, tp: 10, 1
GB f1 score: 0.133
GB cohens kappa score: 0.116

-> test with 'KNN'
KNN tn, fp: 268, 19
KNN fn, tp: 3, 8
KNN f1 score: 0.421
KNN cohens kappa score: 0.389


------ Step 3/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 26s - loss: 0.2511
 33/115 [=======>......................] - ETA: 0s - loss: 0.2544 
 66/115 [================>.............] - ETA: 0s - loss: 0.2751
 97/115 [========================>.....] - ETA: 0s - loss: 0.2715
115/115 [==============================] - 0s 2ms/step - loss: 0.2764
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3098
 37/115 [========>.....................] - ETA: 0s - loss: 0.2847
 74/115 [==================>...........] - ETA: 0s - loss: 0.2763
107/115 [==========================>...] - ETA: 0s - loss: 0.2768
115/115 [==============================] - 0s 1ms/step - loss: 0.2748
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2773
 26/115 [=====>........................] - ETA: 0s - loss: 0.2610
 57/115 [=============>................] - ETA: 0s - loss: 0.2610
 91/115 [======================>.......] - ETA: 0s - loss: 0.2796
115/115 [==============================] - 0s 2ms/step - loss: 0.2721
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2879
 33/115 [=======>......................] - ETA: 0s - loss: 0.2624
 66/115 [================>.............] - ETA: 0s - loss: 0.2591
 99/115 [========================>.....] - ETA: 0s - loss: 0.2713
115/115 [==============================] - 0s 2ms/step - loss: 0.2699
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.5320
 36/115 [========>.....................] - ETA: 0s - loss: 0.2527
 70/115 [=================>............] - ETA: 0s - loss: 0.2648
101/115 [=========================>....] - ETA: 0s - loss: 0.2726
115/115 [==============================] - 0s 2ms/step - loss: 0.2698
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2119
 34/115 [=======>......................] - ETA: 0s - loss: 0.2557
 70/115 [=================>............] - ETA: 0s - loss: 0.2619
 99/115 [========================>.....] - ETA: 0s - loss: 0.2643
115/115 [==============================] - 0s 2ms/step - loss: 0.2633
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3141
 35/115 [========>.....................] - ETA: 0s - loss: 0.2684
 72/115 [=================>............] - ETA: 0s - loss: 0.2566
110/115 [===========================>..] - ETA: 0s - loss: 0.2636
115/115 [==============================] - 0s 1ms/step - loss: 0.2647
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2662
 41/115 [=========>....................] - ETA: 0s - loss: 0.2624
 79/115 [===================>..........] - ETA: 0s - loss: 0.2580
115/115 [==============================] - 0s 1ms/step - loss: 0.2586
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2785
 39/115 [=========>....................] - ETA: 0s - loss: 0.2683
 77/115 [===================>..........] - ETA: 0s - loss: 0.2544
114/115 [============================>.] - ETA: 0s - loss: 0.2545
115/115 [==============================] - 0s 1ms/step - loss: 0.2552
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.4804
 38/115 [========>.....................] - ETA: 0s - loss: 0.2776
 76/115 [==================>...........] - ETA: 0s - loss: 0.2585
112/115 [============================>.] - ETA: 0s - loss: 0.2535
115/115 [==============================] - 0s 1ms/step - loss: 0.2533
-> test with GAN.predict
GAN tn, fp: 263, 24
GAN fn, tp: 3, 8
GAN f1 score: 0.372
GAN cohens kappa score: 0.336

-> test with 'LR'
LR tn, fp: 254, 33
LR fn, tp: 2, 9
LR f1 score: 0.340
LR cohens kappa score: 0.299
LR average precision score: 0.404

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 9, 2
RF f1 score: 0.286
RF cohens kappa score: 0.274

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 10, 1
GB f1 score: 0.154
GB cohens kappa score: 0.144

-> test with 'KNN'
KNN tn, fp: 257, 30
KNN fn, tp: 2, 9
KNN f1 score: 0.360
KNN cohens kappa score: 0.321


------ Step 3/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.2719
 41/115 [=========>....................] - ETA: 0s - loss: 0.2470 
 82/115 [====================>.........] - ETA: 0s - loss: 0.2538
115/115 [==============================] - 0s 1ms/step - loss: 0.2543
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2793
 39/115 [=========>....................] - ETA: 0s - loss: 0.2398
 78/115 [===================>..........] - ETA: 0s - loss: 0.2296
115/115 [==============================] - 0s 1ms/step - loss: 0.2537
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2088
 39/115 [=========>....................] - ETA: 0s - loss: 0.2461
 79/115 [===================>..........] - ETA: 0s - loss: 0.2618
115/115 [==============================] - 0s 1ms/step - loss: 0.2507
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.5842
 37/115 [========>.....................] - ETA: 0s - loss: 0.2511
 75/115 [==================>...........] - ETA: 0s - loss: 0.2637
115/115 [==============================] - ETA: 0s - loss: 0.2494
115/115 [==============================] - 0s 1ms/step - loss: 0.2494
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.2594
 42/115 [=========>....................] - ETA: 0s - loss: 0.2570
 82/115 [====================>.........] - ETA: 0s - loss: 0.2458
115/115 [==============================] - 0s 1ms/step - loss: 0.2469
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.3539
 41/115 [=========>....................] - ETA: 0s - loss: 0.2247
 73/115 [==================>...........] - ETA: 0s - loss: 0.2366
105/115 [==========================>...] - ETA: 0s - loss: 0.2455
115/115 [==============================] - 0s 1ms/step - loss: 0.2465
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.1543
 37/115 [========>.....................] - ETA: 0s - loss: 0.2575
 76/115 [==================>...........] - ETA: 0s - loss: 0.2445
111/115 [===========================>..] - ETA: 0s - loss: 0.2471
115/115 [==============================] - 0s 1ms/step - loss: 0.2474
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2353
 38/115 [========>.....................] - ETA: 0s - loss: 0.2647
 77/115 [===================>..........] - ETA: 0s - loss: 0.2601
115/115 [==============================] - 0s 1ms/step - loss: 0.2442
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.4908
 39/115 [=========>....................] - ETA: 0s - loss: 0.2483
 80/115 [===================>..........] - ETA: 0s - loss: 0.2332
115/115 [==============================] - 0s 1ms/step - loss: 0.2454
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2333
 40/115 [=========>....................] - ETA: 0s - loss: 0.2278
 79/115 [===================>..........] - ETA: 0s - loss: 0.2185
115/115 [==============================] - 0s 1ms/step - loss: 0.2414
-> test with GAN.predict
GAN tn, fp: 241, 46
GAN fn, tp: 3, 8
GAN f1 score: 0.246
GAN cohens kappa score: 0.197

-> test with 'LR'
LR tn, fp: 246, 41
LR fn, tp: 3, 8
LR f1 score: 0.267
LR cohens kappa score: 0.220
LR average precision score: 0.224

-> test with 'RF'
RF tn, fp: 283, 4
RF fn, tp: 9, 2
RF f1 score: 0.235
RF cohens kappa score: 0.215

-> test with 'GB'
GB tn, fp: 283, 4
GB fn, tp: 10, 1
GB f1 score: 0.125
GB cohens kappa score: 0.104

-> test with 'KNN'
KNN tn, fp: 253, 34
KNN fn, tp: 2, 9
KNN f1 score: 0.333
KNN cohens kappa score: 0.292


------ Step 3/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 21s - loss: 0.1183
 41/115 [=========>....................] - ETA: 0s - loss: 0.3090 
 80/115 [===================>..........] - ETA: 0s - loss: 0.3203
115/115 [==============================] - 0s 1ms/step - loss: 0.3105
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3902
 40/115 [=========>....................] - ETA: 0s - loss: 0.3057
 80/115 [===================>..........] - ETA: 0s - loss: 0.3090
115/115 [==============================] - ETA: 0s - loss: 0.3101
115/115 [==============================] - 0s 1ms/step - loss: 0.3101
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.0938
 41/115 [=========>....................] - ETA: 0s - loss: 0.2874
 78/115 [===================>..........] - ETA: 0s - loss: 0.2981
113/115 [============================>.] - ETA: 0s - loss: 0.3034
115/115 [==============================] - 0s 1ms/step - loss: 0.3049
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2951
 34/115 [=======>......................] - ETA: 0s - loss: 0.3071
 70/115 [=================>............] - ETA: 0s - loss: 0.3114
109/115 [===========================>..] - ETA: 0s - loss: 0.3041
115/115 [==============================] - 0s 1ms/step - loss: 0.3019
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3012
 40/115 [=========>....................] - ETA: 0s - loss: 0.2706
 78/115 [===================>..........] - ETA: 0s - loss: 0.2830
110/115 [===========================>..] - ETA: 0s - loss: 0.2962
115/115 [==============================] - 0s 1ms/step - loss: 0.2987
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2113
 35/115 [========>.....................] - ETA: 0s - loss: 0.3107
 70/115 [=================>............] - ETA: 0s - loss: 0.2956
109/115 [===========================>..] - ETA: 0s - loss: 0.2987
115/115 [==============================] - 0s 1ms/step - loss: 0.2971
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3176
 41/115 [=========>....................] - ETA: 0s - loss: 0.3001
 80/115 [===================>..........] - ETA: 0s - loss: 0.2979
115/115 [==============================] - 0s 1ms/step - loss: 0.2922
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.5279
 41/115 [=========>....................] - ETA: 0s - loss: 0.2805
 81/115 [====================>.........] - ETA: 0s - loss: 0.2894
115/115 [==============================] - 0s 1ms/step - loss: 0.2906
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.5200
 41/115 [=========>....................] - ETA: 0s - loss: 0.2953
 81/115 [====================>.........] - ETA: 0s - loss: 0.2811
115/115 [==============================] - 0s 1ms/step - loss: 0.2863
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3019
 40/115 [=========>....................] - ETA: 0s - loss: 0.3018
 80/115 [===================>..........] - ETA: 0s - loss: 0.3048
115/115 [==============================] - 0s 1ms/step - loss: 0.2866
-> test with GAN.predict
GAN tn, fp: 258, 29
GAN fn, tp: 3, 8
GAN f1 score: 0.333
GAN cohens kappa score: 0.293

-> test with 'LR'
LR tn, fp: 237, 50
LR fn, tp: 1, 10
LR f1 score: 0.282
LR cohens kappa score: 0.234
LR average precision score: 0.525

-> test with 'RF'
RF tn, fp: 285, 2
RF fn, tp: 7, 4
RF f1 score: 0.471
RF cohens kappa score: 0.456

-> test with 'GB'
GB tn, fp: 283, 4
GB fn, tp: 9, 2
GB f1 score: 0.235
GB cohens kappa score: 0.215

-> test with 'KNN'
KNN tn, fp: 258, 29
KNN fn, tp: 4, 7
KNN f1 score: 0.298
KNN cohens kappa score: 0.256


------ Step 3/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1104 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 21s - loss: 0.2798
 39/115 [=========>....................] - ETA: 0s - loss: 0.2942 
 80/115 [===================>..........] - ETA: 0s - loss: 0.2709
115/115 [==============================] - 0s 1ms/step - loss: 0.2615
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2410
 40/115 [=========>....................] - ETA: 0s - loss: 0.2562
 80/115 [===================>..........] - ETA: 0s - loss: 0.2611
115/115 [==============================] - 0s 1ms/step - loss: 0.2597
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3375
 44/115 [==========>...................] - ETA: 0s - loss: 0.2258
 85/115 [=====================>........] - ETA: 0s - loss: 0.2545
115/115 [==============================] - 0s 1ms/step - loss: 0.2588
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2452
 41/115 [=========>....................] - ETA: 0s - loss: 0.2632
 79/115 [===================>..........] - ETA: 0s - loss: 0.2663
115/115 [==============================] - 0s 1ms/step - loss: 0.2568
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.4042
 41/115 [=========>....................] - ETA: 0s - loss: 0.2377
 81/115 [====================>.........] - ETA: 0s - loss: 0.2527
115/115 [==============================] - 0s 1ms/step - loss: 0.2543
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1549
 41/115 [=========>....................] - ETA: 0s - loss: 0.2453
 81/115 [====================>.........] - ETA: 0s - loss: 0.2411
115/115 [==============================] - 0s 1ms/step - loss: 0.2515
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3832
 41/115 [=========>....................] - ETA: 0s - loss: 0.2625
 80/115 [===================>..........] - ETA: 0s - loss: 0.2580
115/115 [==============================] - 0s 1ms/step - loss: 0.2531
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.2407
 41/115 [=========>....................] - ETA: 0s - loss: 0.2400
 81/115 [====================>.........] - ETA: 0s - loss: 0.2452
115/115 [==============================] - 0s 1ms/step - loss: 0.2468
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2462
 38/115 [========>.....................] - ETA: 0s - loss: 0.2523
 76/115 [==================>...........] - ETA: 0s - loss: 0.2530
110/115 [===========================>..] - ETA: 0s - loss: 0.2465
115/115 [==============================] - 0s 1ms/step - loss: 0.2473
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1399
 36/115 [========>.....................] - ETA: 0s - loss: 0.2390
 68/115 [================>.............] - ETA: 0s - loss: 0.2571
 99/115 [========================>.....] - ETA: 0s - loss: 0.2488
115/115 [==============================] - 0s 2ms/step - loss: 0.2459
-> test with GAN.predict
GAN tn, fp: 253, 32
GAN fn, tp: 3, 4
GAN f1 score: 0.186
GAN cohens kappa score: 0.152

-> test with 'LR'
LR tn, fp: 247, 38
LR fn, tp: 2, 5
LR f1 score: 0.200
LR cohens kappa score: 0.166
LR average precision score: 0.399

-> test with 'RF'
RF tn, fp: 285, 0
RF fn, tp: 6, 1
RF f1 score: 0.250
RF cohens kappa score: 0.245

-> test with 'GB'
GB tn, fp: 284, 1
GB fn, tp: 4, 3
GB f1 score: 0.545
GB cohens kappa score: 0.537

-> test with 'KNN'
KNN tn, fp: 257, 28
KNN fn, tp: 1, 6
KNN f1 score: 0.293
KNN cohens kappa score: 0.263


====== Step 4/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 4/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 18s - loss: 0.1757
 38/115 [========>.....................] - ETA: 0s - loss: 0.2646 
 71/115 [=================>............] - ETA: 0s - loss: 0.2845
106/115 [==========================>...] - ETA: 0s - loss: 0.2809
115/115 [==============================] - 0s 1ms/step - loss: 0.2780
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3074
 39/115 [=========>....................] - ETA: 0s - loss: 0.2746
 79/115 [===================>..........] - ETA: 0s - loss: 0.2682
115/115 [==============================] - 0s 1ms/step - loss: 0.2744
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.1048
 40/115 [=========>....................] - ETA: 0s - loss: 0.2521
 80/115 [===================>..........] - ETA: 0s - loss: 0.2668
115/115 [==============================] - 0s 1ms/step - loss: 0.2724
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2800
 38/115 [========>.....................] - ETA: 0s - loss: 0.2784
 77/115 [===================>..........] - ETA: 0s - loss: 0.2780
115/115 [==============================] - 0s 1ms/step - loss: 0.2689
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.4738
 40/115 [=========>....................] - ETA: 0s - loss: 0.2939
 79/115 [===================>..........] - ETA: 0s - loss: 0.2740
115/115 [==============================] - 0s 1ms/step - loss: 0.2668
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.3234
 40/115 [=========>....................] - ETA: 0s - loss: 0.2634
 77/115 [===================>..........] - ETA: 0s - loss: 0.2605
115/115 [==============================] - 0s 1ms/step - loss: 0.2627
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2250
 41/115 [=========>....................] - ETA: 0s - loss: 0.2549
 81/115 [====================>.........] - ETA: 0s - loss: 0.2702
115/115 [==============================] - 0s 1ms/step - loss: 0.2600
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.3894
 41/115 [=========>....................] - ETA: 0s - loss: 0.2491
 78/115 [===================>..........] - ETA: 0s - loss: 0.2437
113/115 [============================>.] - ETA: 0s - loss: 0.2567
115/115 [==============================] - 0s 1ms/step - loss: 0.2563
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3515
 41/115 [=========>....................] - ETA: 0s - loss: 0.2440
 80/115 [===================>..........] - ETA: 0s - loss: 0.2651
115/115 [==============================] - 0s 1ms/step - loss: 0.2520
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1602
 37/115 [========>.....................] - ETA: 0s - loss: 0.2592
 77/115 [===================>..........] - ETA: 0s - loss: 0.2483
115/115 [==============================] - 0s 1ms/step - loss: 0.2494
-> test with GAN.predict
GAN tn, fp: 269, 18
GAN fn, tp: 5, 6
GAN f1 score: 0.343
GAN cohens kappa score: 0.308

-> test with 'LR'
LR tn, fp: 252, 35
LR fn, tp: 4, 7
LR f1 score: 0.264
LR cohens kappa score: 0.218
LR average precision score: 0.469

-> test with 'RF'
RF tn, fp: 287, 0
RF fn, tp: 9, 2
RF f1 score: 0.308
RF cohens kappa score: 0.300

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 10, 1
GB f1 score: 0.154
GB cohens kappa score: 0.144

-> test with 'KNN'
KNN tn, fp: 267, 20
KNN fn, tp: 5, 6
KNN f1 score: 0.324
KNN cohens kappa score: 0.287


------ Step 4/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.3306
 41/115 [=========>....................] - ETA: 0s - loss: 0.2398 
 83/115 [====================>.........] - ETA: 0s - loss: 0.2291
115/115 [==============================] - 0s 1ms/step - loss: 0.2327
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2379
 42/115 [=========>....................] - ETA: 0s - loss: 0.2288
 83/115 [====================>.........] - ETA: 0s - loss: 0.2239
115/115 [==============================] - 0s 1ms/step - loss: 0.2277
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.0854
 42/115 [=========>....................] - ETA: 0s - loss: 0.2288
 80/115 [===================>..........] - ETA: 0s - loss: 0.2260
115/115 [==============================] - 0s 1ms/step - loss: 0.2252
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1874
 41/115 [=========>....................] - ETA: 0s - loss: 0.1904
 82/115 [====================>.........] - ETA: 0s - loss: 0.2025
115/115 [==============================] - 0s 1ms/step - loss: 0.2218
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1680
 42/115 [=========>....................] - ETA: 0s - loss: 0.1859
 83/115 [====================>.........] - ETA: 0s - loss: 0.2170
115/115 [==============================] - 0s 1ms/step - loss: 0.2198
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2344
 41/115 [=========>....................] - ETA: 0s - loss: 0.2359
 80/115 [===================>..........] - ETA: 0s - loss: 0.2246
115/115 [==============================] - 0s 1ms/step - loss: 0.2172
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.1097
 42/115 [=========>....................] - ETA: 0s - loss: 0.1943
 82/115 [====================>.........] - ETA: 0s - loss: 0.2102
115/115 [==============================] - 0s 1ms/step - loss: 0.2120
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.0725
 42/115 [=========>....................] - ETA: 0s - loss: 0.1933
 83/115 [====================>.........] - ETA: 0s - loss: 0.2081
115/115 [==============================] - 0s 1ms/step - loss: 0.2100
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.0757
 43/115 [==========>...................] - ETA: 0s - loss: 0.2112
 83/115 [====================>.........] - ETA: 0s - loss: 0.2112
115/115 [==============================] - 0s 1ms/step - loss: 0.2048
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.0757
 43/115 [==========>...................] - ETA: 0s - loss: 0.2074
 83/115 [====================>.........] - ETA: 0s - loss: 0.1986
115/115 [==============================] - 0s 1ms/step - loss: 0.2022
-> test with GAN.predict
GAN tn, fp: 268, 19
GAN fn, tp: 4, 7
GAN f1 score: 0.378
GAN cohens kappa score: 0.344

-> test with 'LR'
LR tn, fp: 258, 29
LR fn, tp: 2, 9
LR f1 score: 0.367
LR cohens kappa score: 0.329
LR average precision score: 0.419

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 10, 1
RF f1 score: 0.154
RF cohens kappa score: 0.144

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 8, 3
GB f1 score: 0.400
GB cohens kappa score: 0.388

-> test with 'KNN'
KNN tn, fp: 261, 26
KNN fn, tp: 4, 7
KNN f1 score: 0.318
KNN cohens kappa score: 0.278


------ Step 4/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 23s - loss: 0.2744
 33/115 [=======>......................] - ETA: 0s - loss: 0.2627 
 65/115 [===============>..............] - ETA: 0s - loss: 0.2460
105/115 [==========================>...] - ETA: 0s - loss: 0.2602
115/115 [==============================] - 0s 1ms/step - loss: 0.2663
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2412
 35/115 [========>.....................] - ETA: 0s - loss: 0.2348
 73/115 [==================>...........] - ETA: 0s - loss: 0.2556
111/115 [===========================>..] - ETA: 0s - loss: 0.2590
115/115 [==============================] - 0s 1ms/step - loss: 0.2620
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2098
 40/115 [=========>....................] - ETA: 0s - loss: 0.2480
 78/115 [===================>..........] - ETA: 0s - loss: 0.2557
115/115 [==============================] - 0s 1ms/step - loss: 0.2611
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1654
 38/115 [========>.....................] - ETA: 0s - loss: 0.2622
 78/115 [===================>..........] - ETA: 0s - loss: 0.2454
115/115 [==============================] - 0s 1ms/step - loss: 0.2576
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1179
 42/115 [=========>....................] - ETA: 0s - loss: 0.2524
 82/115 [====================>.........] - ETA: 0s - loss: 0.2569
115/115 [==============================] - 0s 1ms/step - loss: 0.2560
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2890
 42/115 [=========>....................] - ETA: 0s - loss: 0.2460
 81/115 [====================>.........] - ETA: 0s - loss: 0.2567
115/115 [==============================] - 0s 1ms/step - loss: 0.2532
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3820
 42/115 [=========>....................] - ETA: 0s - loss: 0.2455
 85/115 [=====================>........] - ETA: 0s - loss: 0.2353
115/115 [==============================] - 0s 1ms/step - loss: 0.2504
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.0858
 41/115 [=========>....................] - ETA: 0s - loss: 0.2417
 82/115 [====================>.........] - ETA: 0s - loss: 0.2410
115/115 [==============================] - 0s 1ms/step - loss: 0.2480
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3768
 41/115 [=========>....................] - ETA: 0s - loss: 0.2520
 82/115 [====================>.........] - ETA: 0s - loss: 0.2488
115/115 [==============================] - 0s 1ms/step - loss: 0.2439
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1173
 41/115 [=========>....................] - ETA: 0s - loss: 0.2372
 80/115 [===================>..........] - ETA: 0s - loss: 0.2379
115/115 [==============================] - 0s 1ms/step - loss: 0.2411
-> test with GAN.predict
GAN tn, fp: 259, 28
GAN fn, tp: 4, 7
GAN f1 score: 0.304
GAN cohens kappa score: 0.263

-> test with 'LR'
LR tn, fp: 237, 50
LR fn, tp: 2, 9
LR f1 score: 0.257
LR cohens kappa score: 0.208
LR average precision score: 0.303

-> test with 'RF'
RF tn, fp: 284, 3
RF fn, tp: 11, 0
RF f1 score: 0.000
RF cohens kappa score: -0.016

-> test with 'GB'
GB tn, fp: 282, 5
GB fn, tp: 10, 1
GB f1 score: 0.118
GB cohens kappa score: 0.094

-> test with 'KNN'
KNN tn, fp: 255, 32
KNN fn, tp: 1, 10
KNN f1 score: 0.377
KNN cohens kappa score: 0.339


------ Step 4/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 21s - loss: 0.2545
 31/115 [=======>......................] - ETA: 0s - loss: 0.2398 
 60/115 [==============>...............] - ETA: 0s - loss: 0.2447
 96/115 [========================>.....] - ETA: 0s - loss: 0.2498
115/115 [==============================] - 0s 2ms/step - loss: 0.2469
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.5911
 34/115 [=======>......................] - ETA: 0s - loss: 0.2922
 72/115 [=================>............] - ETA: 0s - loss: 0.2517
106/115 [==========================>...] - ETA: 0s - loss: 0.2429
115/115 [==============================] - 0s 1ms/step - loss: 0.2435
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2396
 36/115 [========>.....................] - ETA: 0s - loss: 0.2459
 70/115 [=================>............] - ETA: 0s - loss: 0.2416
105/115 [==========================>...] - ETA: 0s - loss: 0.2379
115/115 [==============================] - 0s 1ms/step - loss: 0.2391
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2249
 40/115 [=========>....................] - ETA: 0s - loss: 0.2200
 79/115 [===================>..........] - ETA: 0s - loss: 0.2273
115/115 [==============================] - 0s 1ms/step - loss: 0.2381
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3661
 37/115 [========>.....................] - ETA: 0s - loss: 0.2530
 72/115 [=================>............] - ETA: 0s - loss: 0.2351
106/115 [==========================>...] - ETA: 0s - loss: 0.2346
115/115 [==============================] - 0s 1ms/step - loss: 0.2354
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1563
 37/115 [========>.....................] - ETA: 0s - loss: 0.2238
 71/115 [=================>............] - ETA: 0s - loss: 0.2302
105/115 [==========================>...] - ETA: 0s - loss: 0.2330
115/115 [==============================] - 0s 1ms/step - loss: 0.2351
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.3268
 40/115 [=========>....................] - ETA: 0s - loss: 0.2378
 76/115 [==================>...........] - ETA: 0s - loss: 0.2509
108/115 [===========================>..] - ETA: 0s - loss: 0.2353
115/115 [==============================] - 0s 1ms/step - loss: 0.2312
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1234
 36/115 [========>.....................] - ETA: 0s - loss: 0.2136
 69/115 [=================>............] - ETA: 0s - loss: 0.2279
102/115 [=========================>....] - ETA: 0s - loss: 0.2277
115/115 [==============================] - 0s 2ms/step - loss: 0.2273
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2610
 35/115 [========>.....................] - ETA: 0s - loss: 0.2271
 68/115 [================>.............] - ETA: 0s - loss: 0.2244
103/115 [=========================>....] - ETA: 0s - loss: 0.2219
115/115 [==============================] - 0s 1ms/step - loss: 0.2268
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1487
 37/115 [========>.....................] - ETA: 0s - loss: 0.2153
 73/115 [==================>...........] - ETA: 0s - loss: 0.2102
109/115 [===========================>..] - ETA: 0s - loss: 0.2239
115/115 [==============================] - 0s 1ms/step - loss: 0.2222
-> test with GAN.predict
GAN tn, fp: 262, 25
GAN fn, tp: 4, 7
GAN f1 score: 0.326
GAN cohens kappa score: 0.286

-> test with 'LR'
LR tn, fp: 247, 40
LR fn, tp: 4, 7
LR f1 score: 0.241
LR cohens kappa score: 0.193
LR average precision score: 0.303

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 8, 3
RF f1 score: 0.400
RF cohens kappa score: 0.388

-> test with 'GB'
GB tn, fp: 283, 4
GB fn, tp: 10, 1
GB f1 score: 0.125
GB cohens kappa score: 0.104

-> test with 'KNN'
KNN tn, fp: 254, 33
KNN fn, tp: 4, 7
KNN f1 score: 0.275
KNN cohens kappa score: 0.230


------ Step 4/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1104 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.2122
 41/115 [=========>....................] - ETA: 0s - loss: 0.3062 
 80/115 [===================>..........] - ETA: 0s - loss: 0.2995
115/115 [==============================] - 0s 1ms/step - loss: 0.3053
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2551
 40/115 [=========>....................] - ETA: 0s - loss: 0.2850
 80/115 [===================>..........] - ETA: 0s - loss: 0.3077
115/115 [==============================] - 0s 1ms/step - loss: 0.3036
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.1977
 42/115 [=========>....................] - ETA: 0s - loss: 0.3064
 80/115 [===================>..........] - ETA: 0s - loss: 0.3021
115/115 [==============================] - 0s 1ms/step - loss: 0.3011
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.1090
 41/115 [=========>....................] - ETA: 0s - loss: 0.2861
 80/115 [===================>..........] - ETA: 0s - loss: 0.3021
115/115 [==============================] - 0s 1ms/step - loss: 0.2990
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1847
 36/115 [========>.....................] - ETA: 0s - loss: 0.2662
 75/115 [==================>...........] - ETA: 0s - loss: 0.2897
115/115 [==============================] - 0s 1ms/step - loss: 0.2984
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.3823
 42/115 [=========>....................] - ETA: 0s - loss: 0.3059
 83/115 [====================>.........] - ETA: 0s - loss: 0.2981
115/115 [==============================] - 0s 1ms/step - loss: 0.2916
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2933
 42/115 [=========>....................] - ETA: 0s - loss: 0.2949
 81/115 [====================>.........] - ETA: 0s - loss: 0.2913
115/115 [==============================] - 0s 1ms/step - loss: 0.2894
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1652
 41/115 [=========>....................] - ETA: 0s - loss: 0.2679
 82/115 [====================>.........] - ETA: 0s - loss: 0.2865
115/115 [==============================] - 0s 1ms/step - loss: 0.2878
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3369
 41/115 [=========>....................] - ETA: 0s - loss: 0.2652
 82/115 [====================>.........] - ETA: 0s - loss: 0.2878
115/115 [==============================] - 0s 1ms/step - loss: 0.2837
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3313
 41/115 [=========>....................] - ETA: 0s - loss: 0.2689
 82/115 [====================>.........] - ETA: 0s - loss: 0.2736
115/115 [==============================] - 0s 1ms/step - loss: 0.2796
-> test with GAN.predict
GAN tn, fp: 258, 27
GAN fn, tp: 2, 5
GAN f1 score: 0.256
GAN cohens kappa score: 0.226

-> test with 'LR'
LR tn, fp: 241, 44
LR fn, tp: 2, 5
LR f1 score: 0.179
LR cohens kappa score: 0.143
LR average precision score: 0.510

-> test with 'RF'
RF tn, fp: 285, 0
RF fn, tp: 4, 3
RF f1 score: 0.600
RF cohens kappa score: 0.594

-> test with 'GB'
GB tn, fp: 282, 3
GB fn, tp: 4, 3
GB f1 score: 0.462
GB cohens kappa score: 0.449

-> test with 'KNN'
KNN tn, fp: 257, 28
KNN fn, tp: 2, 5
KNN f1 score: 0.250
KNN cohens kappa score: 0.219


====== Step 5/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 5/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 23s - loss: 0.4455
 39/115 [=========>....................] - ETA: 0s - loss: 0.3091 
 78/115 [===================>..........] - ETA: 0s - loss: 0.3019
113/115 [============================>.] - ETA: 0s - loss: 0.2878
115/115 [==============================] - 0s 1ms/step - loss: 0.2859
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.1116
 36/115 [========>.....................] - ETA: 0s - loss: 0.2985
 68/115 [================>.............] - ETA: 0s - loss: 0.2936
103/115 [=========================>....] - ETA: 0s - loss: 0.2865
115/115 [==============================] - 0s 1ms/step - loss: 0.2832
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.3863
 41/115 [=========>....................] - ETA: 0s - loss: 0.2888
 81/115 [====================>.........] - ETA: 0s - loss: 0.2843
115/115 [==============================] - 0s 1ms/step - loss: 0.2802
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.2467
 39/115 [=========>....................] - ETA: 0s - loss: 0.2959
 79/115 [===================>..........] - ETA: 0s - loss: 0.2906
115/115 [==============================] - 0s 1ms/step - loss: 0.2783
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.1639
 41/115 [=========>....................] - ETA: 0s - loss: 0.2808
 81/115 [====================>.........] - ETA: 0s - loss: 0.2693
115/115 [==============================] - 0s 1ms/step - loss: 0.2754
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.1932
 41/115 [=========>....................] - ETA: 0s - loss: 0.2846
 79/115 [===================>..........] - ETA: 0s - loss: 0.2752
115/115 [==============================] - 0s 1ms/step - loss: 0.2764
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.0979
 40/115 [=========>....................] - ETA: 0s - loss: 0.2444
 80/115 [===================>..........] - ETA: 0s - loss: 0.2674
115/115 [==============================] - 0s 1ms/step - loss: 0.2726
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.4131
 40/115 [=========>....................] - ETA: 0s - loss: 0.2448
 78/115 [===================>..........] - ETA: 0s - loss: 0.2782
115/115 [==============================] - 0s 1ms/step - loss: 0.2723
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3125
 40/115 [=========>....................] - ETA: 0s - loss: 0.2922
 80/115 [===================>..........] - ETA: 0s - loss: 0.2768
115/115 [==============================] - 0s 1ms/step - loss: 0.2676
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.2023
 41/115 [=========>....................] - ETA: 0s - loss: 0.2666
 81/115 [====================>.........] - ETA: 0s - loss: 0.2559
115/115 [==============================] - 0s 1ms/step - loss: 0.2653
-> test with GAN.predict
GAN tn, fp: 260, 27
GAN fn, tp: 4, 7
GAN f1 score: 0.311
GAN cohens kappa score: 0.270

-> test with 'LR'
LR tn, fp: 247, 40
LR fn, tp: 3, 8
LR f1 score: 0.271
LR cohens kappa score: 0.225
LR average precision score: 0.231

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 11, 0
RF f1 score: 0.000
RF cohens kappa score: -0.006

-> test with 'GB'
GB tn, fp: 285, 2
GB fn, tp: 11, 0
GB f1 score: 0.000
GB cohens kappa score: -0.011

-> test with 'KNN'
KNN tn, fp: 265, 22
KNN fn, tp: 1, 10
KNN f1 score: 0.465
KNN cohens kappa score: 0.434


------ Step 5/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.3917
 34/115 [=======>......................] - ETA: 0s - loss: 0.3027 
 69/115 [=================>............] - ETA: 0s - loss: 0.2971
108/115 [===========================>..] - ETA: 0s - loss: 0.3014
115/115 [==============================] - 0s 1ms/step - loss: 0.3030
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3850
 42/115 [=========>....................] - ETA: 0s - loss: 0.2985
 82/115 [====================>.........] - ETA: 0s - loss: 0.3018
115/115 [==============================] - 0s 1ms/step - loss: 0.2947
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.1177
 41/115 [=========>....................] - ETA: 0s - loss: 0.2881
 82/115 [====================>.........] - ETA: 0s - loss: 0.2945
115/115 [==============================] - 0s 1ms/step - loss: 0.2909
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3138
 40/115 [=========>....................] - ETA: 0s - loss: 0.2764
 81/115 [====================>.........] - ETA: 0s - loss: 0.2914
115/115 [==============================] - 0s 1ms/step - loss: 0.2883
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.4893
 40/115 [=========>....................] - ETA: 0s - loss: 0.2872
 79/115 [===================>..........] - ETA: 0s - loss: 0.2970
115/115 [==============================] - 0s 1ms/step - loss: 0.2841
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2881
 39/115 [=========>....................] - ETA: 0s - loss: 0.3064
 79/115 [===================>..........] - ETA: 0s - loss: 0.2797
115/115 [==============================] - 0s 1ms/step - loss: 0.2804
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.5047
 38/115 [========>.....................] - ETA: 0s - loss: 0.2892
 79/115 [===================>..........] - ETA: 0s - loss: 0.2740
115/115 [==============================] - 0s 1ms/step - loss: 0.2768
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.3547
 37/115 [========>.....................] - ETA: 0s - loss: 0.2505
 70/115 [=================>............] - ETA: 0s - loss: 0.2684
103/115 [=========================>....] - ETA: 0s - loss: 0.2723
115/115 [==============================] - 0s 2ms/step - loss: 0.2729
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3061
 38/115 [========>.....................] - ETA: 0s - loss: 0.2640
 77/115 [===================>..........] - ETA: 0s - loss: 0.2649
115/115 [==============================] - 0s 1ms/step - loss: 0.2690
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.1421
 40/115 [=========>....................] - ETA: 0s - loss: 0.2708
 81/115 [====================>.........] - ETA: 0s - loss: 0.2749
115/115 [==============================] - 0s 1ms/step - loss: 0.2658
-> test with GAN.predict
GAN tn, fp: 239, 48
GAN fn, tp: 2, 9
GAN f1 score: 0.265
GAN cohens kappa score: 0.216

-> test with 'LR'
LR tn, fp: 227, 60
LR fn, tp: 2, 9
LR f1 score: 0.225
LR cohens kappa score: 0.172
LR average precision score: 0.541

-> test with 'RF'
RF tn, fp: 285, 2
RF fn, tp: 10, 1
RF f1 score: 0.143
RF cohens kappa score: 0.129

-> test with 'GB'
GB tn, fp: 286, 1
GB fn, tp: 9, 2
GB f1 score: 0.286
GB cohens kappa score: 0.274

-> test with 'KNN'
KNN tn, fp: 258, 29
KNN fn, tp: 1, 10
KNN f1 score: 0.400
KNN cohens kappa score: 0.363


------ Step 5/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 17s - loss: 0.2369
 40/115 [=========>....................] - ETA: 0s - loss: 0.2638 
 78/115 [===================>..........] - ETA: 0s - loss: 0.2778
115/115 [==============================] - 0s 1ms/step - loss: 0.2887
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.1870
 41/115 [=========>....................] - ETA: 0s - loss: 0.3085
 80/115 [===================>..........] - ETA: 0s - loss: 0.2836
115/115 [==============================] - 0s 1ms/step - loss: 0.2849
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.5019
 39/115 [=========>....................] - ETA: 0s - loss: 0.2779
 75/115 [==================>...........] - ETA: 0s - loss: 0.2851
114/115 [============================>.] - ETA: 0s - loss: 0.2810
115/115 [==============================] - 0s 1ms/step - loss: 0.2810
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3585
 41/115 [=========>....................] - ETA: 0s - loss: 0.2793
 80/115 [===================>..........] - ETA: 0s - loss: 0.2709
115/115 [==============================] - 0s 1ms/step - loss: 0.2772
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3424
 39/115 [=========>....................] - ETA: 0s - loss: 0.2779
 76/115 [==================>...........] - ETA: 0s - loss: 0.2618
115/115 [==============================] - 0s 1ms/step - loss: 0.2745
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2428
 39/115 [=========>....................] - ETA: 0s - loss: 0.2630
 79/115 [===================>..........] - ETA: 0s - loss: 0.2647
115/115 [==============================] - 0s 1ms/step - loss: 0.2693
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2974
 38/115 [========>.....................] - ETA: 0s - loss: 0.2489
 77/115 [===================>..........] - ETA: 0s - loss: 0.2715
115/115 [==============================] - 0s 1ms/step - loss: 0.2649
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.4004
 39/115 [=========>....................] - ETA: 0s - loss: 0.2749
 74/115 [==================>...........] - ETA: 0s - loss: 0.2605
108/115 [===========================>..] - ETA: 0s - loss: 0.2563
115/115 [==============================] - 0s 1ms/step - loss: 0.2611
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2219
 37/115 [========>.....................] - ETA: 0s - loss: 0.2615
 74/115 [==================>...........] - ETA: 0s - loss: 0.2674
113/115 [============================>.] - ETA: 0s - loss: 0.2577
115/115 [==============================] - 0s 1ms/step - loss: 0.2573
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.4025
 39/115 [=========>....................] - ETA: 0s - loss: 0.2488
 79/115 [===================>..........] - ETA: 0s - loss: 0.2536
115/115 [==============================] - 0s 1ms/step - loss: 0.2533
-> test with GAN.predict
GAN tn, fp: 262, 25
GAN fn, tp: 4, 7
GAN f1 score: 0.326
GAN cohens kappa score: 0.286

-> test with 'LR'
LR tn, fp: 244, 43
LR fn, tp: 3, 8
LR f1 score: 0.258
LR cohens kappa score: 0.210
LR average precision score: 0.561

-> test with 'RF'
RF tn, fp: 287, 0
RF fn, tp: 10, 1
RF f1 score: 0.167
RF cohens kappa score: 0.162

-> test with 'GB'
GB tn, fp: 287, 0
GB fn, tp: 8, 3
GB f1 score: 0.429
GB cohens kappa score: 0.419

-> test with 'KNN'
KNN tn, fp: 257, 30
KNN fn, tp: 5, 6
KNN f1 score: 0.255
KNN cohens kappa score: 0.211


------ Step 5/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1106 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 19s - loss: 0.2654
 40/115 [=========>....................] - ETA: 0s - loss: 0.3242 
 77/115 [===================>..........] - ETA: 0s - loss: 0.3204
112/115 [============================>.] - ETA: 0s - loss: 0.3123
115/115 [==============================] - 0s 1ms/step - loss: 0.3125
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.2923
 36/115 [========>.....................] - ETA: 0s - loss: 0.3004
 76/115 [==================>...........] - ETA: 0s - loss: 0.3016
115/115 [==============================] - 0s 1ms/step - loss: 0.3088
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2806
 41/115 [=========>....................] - ETA: 0s - loss: 0.3202
 82/115 [====================>.........] - ETA: 0s - loss: 0.3157
115/115 [==============================] - 0s 1ms/step - loss: 0.3052
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3156
 40/115 [=========>....................] - ETA: 0s - loss: 0.2918
 80/115 [===================>..........] - ETA: 0s - loss: 0.2977
115/115 [==============================] - 0s 1ms/step - loss: 0.3043
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3455
 41/115 [=========>....................] - ETA: 0s - loss: 0.2843
 82/115 [====================>.........] - ETA: 0s - loss: 0.3134
115/115 [==============================] - 0s 1ms/step - loss: 0.3021
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.3199
 40/115 [=========>....................] - ETA: 0s - loss: 0.3130
 80/115 [===================>..........] - ETA: 0s - loss: 0.3052
115/115 [==============================] - 0s 1ms/step - loss: 0.2972
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.2079
 39/115 [=========>....................] - ETA: 0s - loss: 0.3114
 77/115 [===================>..........] - ETA: 0s - loss: 0.3091
115/115 [==============================] - 0s 1ms/step - loss: 0.2972
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.3332
 42/115 [=========>....................] - ETA: 0s - loss: 0.2888
 81/115 [====================>.........] - ETA: 0s - loss: 0.2884
115/115 [==============================] - 0s 1ms/step - loss: 0.2921
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.3683
 40/115 [=========>....................] - ETA: 0s - loss: 0.2630
 79/115 [===================>..........] - ETA: 0s - loss: 0.2830
115/115 [==============================] - 0s 1ms/step - loss: 0.2901
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3831
 39/115 [=========>....................] - ETA: 0s - loss: 0.2963
 78/115 [===================>..........] - ETA: 0s - loss: 0.3005
115/115 [==============================] - 0s 1ms/step - loss: 0.2876
-> test with GAN.predict
GAN tn, fp: 262, 25
GAN fn, tp: 1, 10
GAN f1 score: 0.435
GAN cohens kappa score: 0.401

-> test with 'LR'
LR tn, fp: 239, 48
LR fn, tp: 1, 10
LR f1 score: 0.290
LR cohens kappa score: 0.243
LR average precision score: 0.501

-> test with 'RF'
RF tn, fp: 286, 1
RF fn, tp: 10, 1
RF f1 score: 0.154
RF cohens kappa score: 0.144

-> test with 'GB'
GB tn, fp: 281, 6
GB fn, tp: 9, 2
GB f1 score: 0.211
GB cohens kappa score: 0.185

-> test with 'KNN'
KNN tn, fp: 256, 31
KNN fn, tp: 3, 8
KNN f1 score: 0.320
KNN cohens kappa score: 0.278


------ Step 5/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples
-> create 1104 synthetic samples
-> retrain GAN for predict
Epoch 1/10

  1/115 [..............................] - ETA: 23s - loss: 0.1998
 41/115 [=========>....................] - ETA: 0s - loss: 0.3021 
 82/115 [====================>.........] - ETA: 0s - loss: 0.3112
115/115 [==============================] - 0s 1ms/step - loss: 0.3022
Epoch 2/10

  1/115 [..............................] - ETA: 0s - loss: 0.3872
 41/115 [=========>....................] - ETA: 0s - loss: 0.3169
 82/115 [====================>.........] - ETA: 0s - loss: 0.3045
115/115 [==============================] - 0s 1ms/step - loss: 0.3009
Epoch 3/10

  1/115 [..............................] - ETA: 0s - loss: 0.2518
 41/115 [=========>....................] - ETA: 0s - loss: 0.2766
 78/115 [===================>..........] - ETA: 0s - loss: 0.2829
115/115 [==============================] - 0s 1ms/step - loss: 0.2990
Epoch 4/10

  1/115 [..............................] - ETA: 0s - loss: 0.3721
 41/115 [=========>....................] - ETA: 0s - loss: 0.2843
 81/115 [====================>.........] - ETA: 0s - loss: 0.2765
115/115 [==============================] - 0s 1ms/step - loss: 0.2961
Epoch 5/10

  1/115 [..............................] - ETA: 0s - loss: 0.3180
 40/115 [=========>....................] - ETA: 0s - loss: 0.2872
 78/115 [===================>..........] - ETA: 0s - loss: 0.2911
115/115 [==============================] - 0s 1ms/step - loss: 0.2941
Epoch 6/10

  1/115 [..............................] - ETA: 0s - loss: 0.2064
 41/115 [=========>....................] - ETA: 0s - loss: 0.3155
 80/115 [===================>..........] - ETA: 0s - loss: 0.2867
115/115 [==============================] - 0s 1ms/step - loss: 0.2920
Epoch 7/10

  1/115 [..............................] - ETA: 0s - loss: 0.0984
 40/115 [=========>....................] - ETA: 0s - loss: 0.2876
 78/115 [===================>..........] - ETA: 0s - loss: 0.2837
115/115 [==============================] - 0s 1ms/step - loss: 0.2928
Epoch 8/10

  1/115 [..............................] - ETA: 0s - loss: 0.1463
 41/115 [=========>....................] - ETA: 0s - loss: 0.3132
 81/115 [====================>.........] - ETA: 0s - loss: 0.2974
115/115 [==============================] - 0s 1ms/step - loss: 0.2902
Epoch 9/10

  1/115 [..............................] - ETA: 0s - loss: 0.2462
 41/115 [=========>....................] - ETA: 0s - loss: 0.2682
 79/115 [===================>..........] - ETA: 0s - loss: 0.2842
115/115 [==============================] - 0s 1ms/step - loss: 0.2877
Epoch 10/10

  1/115 [..............................] - ETA: 0s - loss: 0.3722
 40/115 [=========>....................] - ETA: 0s - loss: 0.2663
 80/115 [===================>..........] - ETA: 0s - loss: 0.2712
115/115 [==============================] - 0s 1ms/step - loss: 0.2851
-> test with GAN.predict
GAN tn, fp: 256, 29
GAN fn, tp: 3, 4
GAN f1 score: 0.200
GAN cohens kappa score: 0.167

-> test with 'LR'
LR tn, fp: 234, 51
LR fn, tp: 3, 4
LR f1 score: 0.129
LR cohens kappa score: 0.090
LR average precision score: 0.122

-> test with 'RF'
RF tn, fp: 282, 3
RF fn, tp: 6, 1
RF f1 score: 0.182
RF cohens kappa score: 0.167

-> test with 'GB'
GB tn, fp: 281, 4
GB fn, tp: 5, 2
GB f1 score: 0.308
GB cohens kappa score: 0.292

-> test with 'KNN'
KNN tn, fp: 263, 22
KNN fn, tp: 1, 6
KNN f1 score: 0.343
KNN cohens kappa score: 0.317

### Exercise is done.

-----[ LR ]-----
maximum:
LR tn, fp: 258, 61
LR fn, tp: 6, 10
LR f1 score: 0.367
LR cohens kappa score: 0.329
LR average precision score: 0.661


average:
LR tn, fp: 242.36, 44.24
LR fn, tp: 2.32, 7.88
LR f1 score: 0.254
LR cohens kappa score: 0.209
LR average precision score: 0.387


minimum:
LR tn, fp: 224, 29
LR fn, tp: 1, 4
LR f1 score: 0.129
LR cohens kappa score: 0.090
LR average precision score: 0.122


-----[ RF ]-----
maximum:
RF tn, fp: 287, 4
RF fn, tp: 11, 4
RF f1 score: 0.600
RF cohens kappa score: 0.594


average:
RF tn, fp: 285.32, 1.28
RF fn, tp: 8.48, 1.72
RF f1 score: 0.251
RF cohens kappa score: 0.240


minimum:
RF tn, fp: 282, 0
RF fn, tp: 4, 0
RF f1 score: 0.000
RF cohens kappa score: -0.016


-----[ GB ]-----
maximum:
GB tn, fp: 287, 6
GB fn, tp: 11, 5
GB f1 score: 0.556
GB cohens kappa score: 0.542


average:
GB tn, fp: 284.04, 2.56
GB fn, tp: 8.28, 1.92
GB f1 score: 0.257
GB cohens kappa score: 0.242


minimum:
GB tn, fp: 281, 0
GB fn, tp: 4, 0
GB f1 score: 0.000
GB cohens kappa score: -0.011


-----[ KNN ]-----
maximum:
KNN tn, fp: 268, 52
KNN fn, tp: 5, 11
KNN f1 score: 0.465
KNN cohens kappa score: 0.434


average:
KNN tn, fp: 257.88, 28.72
KNN fn, tp: 2.52, 7.68
KNN f1 score: 0.334
KNN cohens kappa score: 0.296


minimum:
KNN tn, fp: 235, 18
KNN fn, tp: 0, 5
KNN f1 score: 0.225
KNN cohens kappa score: 0.174


-----[ GAN ]-----
maximum:
GAN tn, fp: 269, 48
GAN fn, tp: 6, 10
GAN f1 score: 0.435
GAN cohens kappa score: 0.401


average:
GAN tn, fp: 257.88, 28.72
GAN fn, tp: 3.04, 7.16
GAN f1 score: 0.312
GAN cohens kappa score: 0.274


minimum:
GAN tn, fp: 239, 18
GAN fn, tp: 1, 4
GAN f1 score: 0.186
GAN cohens kappa score: 0.152