/////////////////////////////////////////// // Running convGAN-proximary-full on folding_kr-vs-k-zero-one_vs_draw /////////////////////////////////////////// Load 'data_input/folding_kr-vs-k-zero-one_vs_draw' from pickle file Data loaded. -> Shuffling data ### Start exercise for synthetic point generator ====== Step 1/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 1/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 39s - loss: 2.2828e-12 43/224 [====>.........................] - ETA: 0s - loss: 0.0156  84/224 [==========>...................] - ETA: 0s - loss: 0.0229 124/224 [===============>..............] - ETA: 0s - loss: 0.0185 165/224 [=====================>........] - ETA: 0s - loss: 0.0142 205/224 [==========================>...] - ETA: 0s - loss: 0.0156 224/224 [==============================] - 0s 1ms/step - loss: 0.0170 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 4.3899e-04 39/224 [====>.........................] - ETA: 0s - loss: 0.0032  78/224 [=========>....................] - ETA: 0s - loss: 0.0065 119/224 [==============>...............] - ETA: 0s - loss: 0.0043 160/224 [====================>.........] - ETA: 0s - loss: 0.0062 202/224 [==========================>...] - ETA: 0s - loss: 0.0057 224/224 [==============================] - 0s 1ms/step - loss: 0.0054 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.6883e-07 42/224 [====>.........................] - ETA: 0s - loss: 3.6682e-04 84/224 [==========>...................] - ETA: 0s - loss: 0.0020  125/224 [===============>..............] - ETA: 0s - loss: 0.0015 166/224 [=====================>........] - ETA: 0s - loss: 0.0020 207/224 [==========================>...] - ETA: 0s - loss: 0.0027 224/224 [==============================] - 0s 1ms/step - loss: 0.0026 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 3.2778e-05 42/224 [====>.........................] - ETA: 0s - loss: 9.5430e-05 81/224 [=========>....................] - ETA: 0s - loss: 0.0020  120/224 [===============>..............] - ETA: 0s - loss: 0.0018 161/224 [====================>.........] - ETA: 0s - loss: 0.0015 202/224 [==========================>...] - ETA: 0s - loss: 0.0013 224/224 [==============================] - 0s 1ms/step - loss: 0.0024 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 1.9310e-06 40/224 [====>.........................] - ETA: 0s - loss: 0.0010  81/224 [=========>....................] - ETA: 0s - loss: 0.0020 121/224 [===============>..............] - ETA: 0s - loss: 0.0023 164/224 [====================>.........] - ETA: 0s - loss: 0.0020 205/224 [==========================>...] - ETA: 0s - loss: 0.0017 224/224 [==============================] - 0s 1ms/step - loss: 0.0019 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.2648e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0028  78/224 [=========>....................] - ETA: 0s - loss: 0.0029 118/224 [==============>...............] - ETA: 0s - loss: 0.0038 159/224 [====================>.........] - ETA: 0s - loss: 0.0030 201/224 [=========================>....] - ETA: 0s - loss: 0.0024 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 3.9143e-10 39/224 [====>.........................] - ETA: 0s - loss: 0.0055  78/224 [=========>....................] - ETA: 0s - loss: 0.0030 118/224 [==============>...............] - ETA: 0s - loss: 0.0020 160/224 [====================>.........] - ETA: 0s - loss: 0.0024 198/224 [=========================>....] - ETA: 0s - loss: 0.0020 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 4.8791e-07 37/224 [===>..........................] - ETA: 0s - loss: 5.5751e-05 75/224 [=========>....................] - ETA: 0s - loss: 0.0019  116/224 [==============>...............] - ETA: 0s - loss: 0.0019 156/224 [===================>..........] - ETA: 0s - loss: 0.0015 197/224 [=========================>....] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 0.0017 41/224 [====>.........................] - ETA: 0s - loss: 4.4568e-05 80/224 [=========>....................] - ETA: 0s - loss: 2.5087e-05 119/224 [==============>...............] - ETA: 0s - loss: 0.0021  159/224 [====================>.........] - ETA: 0s - loss: 0.0019 200/224 [=========================>....] - ETA: 0s - loss: 0.0021 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 4.7199e-12 41/224 [====>.........................] - ETA: 0s - loss: 2.5180e-04 81/224 [=========>....................] - ETA: 0s - loss: 0.0066  122/224 [===============>..............] - ETA: 0s - loss: 0.0083 162/224 [====================>.........] - ETA: 0s - loss: 0.0063 202/224 [==========================>...] - ETA: 0s - loss: 0.0051 224/224 [==============================] - 0s 1ms/step - loss: 0.0046 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 5, 16 GAN f1 score: 0.865 GAN cohens kappa score: 0.861 -> test with 'LR' LR tn, fp: 554, 6 LR fn, tp: 2, 19 LR f1 score: 0.826 LR cohens kappa score: 0.819 LR average precision score: 0.872 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 4, 17 RF f1 score: 0.895 RF cohens kappa score: 0.891 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 2, 19 GB f1 score: 0.950 GB cohens kappa score: 0.948 -> test with 'KNN' KNN tn, fp: 553, 7 KNN fn, tp: 2, 19 KNN f1 score: 0.809 KNN cohens kappa score: 0.801 ------ Step 1/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 34s - loss: 9.8375e-08 43/224 [====>.........................] - ETA: 0s - loss: 0.0902  86/224 [==========>...................] - ETA: 0s - loss: 0.0789 128/224 [================>.............] - ETA: 0s - loss: 0.0636 168/224 [=====================>........] - ETA: 0s - loss: 0.0635 209/224 [==========================>...] - ETA: 0s - loss: 0.0545 224/224 [==============================] - 0s 1ms/step - loss: 0.0517 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.1494e-06 43/224 [====>.........................] - ETA: 0s - loss: 0.0416  84/224 [==========>...................] - ETA: 0s - loss: 0.0312 125/224 [===============>..............] - ETA: 0s - loss: 0.0217 169/224 [=====================>........] - ETA: 0s - loss: 0.0203 210/224 [===========================>..] - ETA: 0s - loss: 0.0213 224/224 [==============================] - 0s 1ms/step - loss: 0.0205 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 0.0012 41/224 [====>.........................] - ETA: 0s - loss: 0.0125 80/224 [=========>....................] - ETA: 0s - loss: 0.0239 120/224 [===============>..............] - ETA: 0s - loss: 0.0199 160/224 [====================>.........] - ETA: 0s - loss: 0.0153 200/224 [=========================>....] - ETA: 0s - loss: 0.0154 224/224 [==============================] - 0s 1ms/step - loss: 0.0142 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 0.0231 43/224 [====>.........................] - ETA: 0s - loss: 0.0043 85/224 [==========>...................] - ETA: 0s - loss: 0.0108 127/224 [================>.............] - ETA: 0s - loss: 0.0078 169/224 [=====================>........] - ETA: 0s - loss: 0.0123 211/224 [===========================>..] - ETA: 0s - loss: 0.0118 224/224 [==============================] - 0s 1ms/step - loss: 0.0112 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 1.2103e-04 43/224 [====>.........................] - ETA: 0s - loss: 0.0081  84/224 [==========>...................] - ETA: 0s - loss: 0.0118 126/224 [===============>..............] - ETA: 0s - loss: 0.0086 167/224 [=====================>........] - ETA: 0s - loss: 0.0116 208/224 [==========================>...] - ETA: 0s - loss: 0.0097 224/224 [==============================] - 0s 1ms/step - loss: 0.0092 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 0.0013 34/224 [===>..........................] - ETA: 0s - loss: 0.0111 69/224 [========>.....................] - ETA: 0s - loss: 0.0064 102/224 [============>.................] - ETA: 0s - loss: 0.0049 143/224 [==================>...........] - ETA: 0s - loss: 0.0091 183/224 [=======================>......] - ETA: 0s - loss: 0.0079 224/224 [==============================] - ETA: 0s - loss: 0.0077 224/224 [==============================] - 0s 1ms/step - loss: 0.0077 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0012 42/224 [====>.........................] - ETA: 0s - loss: 0.0013 81/224 [=========>....................] - ETA: 0s - loss: 0.0085 123/224 [===============>..............] - ETA: 0s - loss: 0.0073 163/224 [====================>.........] - ETA: 0s - loss: 0.0069 203/224 [==========================>...] - ETA: 0s - loss: 0.0070 224/224 [==============================] - 0s 1ms/step - loss: 0.0065 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 9.7396e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0051  84/224 [==========>...................] - ETA: 0s - loss: 0.0082 125/224 [===============>..............] - ETA: 0s - loss: 0.0061 165/224 [=====================>........] - ETA: 0s - loss: 0.0049 204/224 [==========================>...] - ETA: 0s - loss: 0.0054 224/224 [==============================] - 0s 1ms/step - loss: 0.0058 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.4737e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0055  81/224 [=========>....................] - ETA: 0s - loss: 0.0034 123/224 [===============>..............] - ETA: 0s - loss: 0.0054 161/224 [====================>.........] - ETA: 0s - loss: 0.0058 197/224 [=========================>....] - ETA: 0s - loss: 0.0049 224/224 [==============================] - 0s 1ms/step - loss: 0.0049 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 3.5296e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0072  83/224 [==========>...................] - ETA: 0s - loss: 0.0084 124/224 [===============>..............] - ETA: 0s - loss: 0.0061 165/224 [=====================>........] - ETA: 0s - loss: 0.0049 204/224 [==========================>...] - ETA: 0s - loss: 0.0043 224/224 [==============================] - 0s 1ms/step - loss: 0.0042 -> test with GAN.predict GAN tn, fp: 559, 1 GAN fn, tp: 0, 21 GAN f1 score: 0.977 GAN cohens kappa score: 0.976 -> test with 'LR' LR tn, fp: 550, 10 LR fn, tp: 0, 21 LR f1 score: 0.808 LR cohens kappa score: 0.799 LR average precision score: 0.947 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 0, 21 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 557, 3 KNN fn, tp: 0, 21 KNN f1 score: 0.933 KNN cohens kappa score: 0.931 ------ Step 1/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 37s - loss: 2.0472e-07 36/224 [===>..........................] - ETA: 0s - loss: 0.1190  74/224 [========>.....................] - ETA: 0s - loss: 0.0607 111/224 [=============>................] - ETA: 0s - loss: 0.0435 131/224 [================>.............] - ETA: 0s - loss: 0.0411 163/224 [====================>.........] - ETA: 0s - loss: 0.0438 200/224 [=========================>....] - ETA: 0s - loss: 0.0378 224/224 [==============================] - 1s 2ms/step - loss: 0.0349 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 8.7978e-08 37/224 [===>..........................] - ETA: 0s - loss: 0.0033  72/224 [========>.....................] - ETA: 0s - loss: 0.0120 109/224 [=============>................] - ETA: 0s - loss: 0.0100 147/224 [==================>...........] - ETA: 0s - loss: 0.0078 185/224 [=======================>......] - ETA: 0s - loss: 0.0176 219/224 [============================>.] - ETA: 0s - loss: 0.0171 224/224 [==============================] - 0s 1ms/step - loss: 0.0169 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 2.5536e-06 39/224 [====>.........................] - ETA: 0s - loss: 0.0460  76/224 [=========>....................] - ETA: 0s - loss: 0.0267 112/224 [==============>...............] - ETA: 0s - loss: 0.0193 149/224 [==================>...........] - ETA: 0s - loss: 0.0147 188/224 [========================>.....] - ETA: 0s - loss: 0.0139 224/224 [==============================] - 0s 1ms/step - loss: 0.0119 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 7.8091e-08 38/224 [====>.........................] - ETA: 0s - loss: 8.4888e-04 73/224 [========>.....................] - ETA: 0s - loss: 0.0119  109/224 [=============>................] - ETA: 0s - loss: 0.0080 143/224 [==================>...........] - ETA: 0s - loss: 0.0069 178/224 [======================>.......] - ETA: 0s - loss: 0.0091 214/224 [===========================>..] - ETA: 0s - loss: 0.0077 224/224 [==============================] - 0s 1ms/step - loss: 0.0087 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 0.0017 37/224 [===>..........................] - ETA: 0s - loss: 9.7005e-04 70/224 [========>.....................] - ETA: 0s - loss: 7.0066e-04 107/224 [=============>................] - ETA: 0s - loss: 0.0059  142/224 [==================>...........] - ETA: 0s - loss: 0.0089 178/224 [======================>.......] - ETA: 0s - loss: 0.0092 210/224 [===========================>..] - ETA: 0s - loss: 0.0078 224/224 [==============================] - 0s 1ms/step - loss: 0.0074 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 2.5848e-05 38/224 [====>.........................] - ETA: 0s - loss: 0.0010  73/224 [========>.....................] - ETA: 0s - loss: 9.9002e-04 106/224 [=============>................] - ETA: 0s - loss: 8.7816e-04 141/224 [=================>............] - ETA: 0s - loss: 0.0089  178/224 [======================>.......] - ETA: 0s - loss: 0.0080 213/224 [===========================>..] - ETA: 0s - loss: 0.0070 224/224 [==============================] - 0s 1ms/step - loss: 0.0069 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 2.5176e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0014  77/224 [=========>....................] - ETA: 0s - loss: 0.0036 114/224 [==============>...............] - ETA: 0s - loss: 0.0027 150/224 [===================>..........] - ETA: 0s - loss: 0.0022 185/224 [=======================>......] - ETA: 0s - loss: 0.0018 218/224 [============================>.] - ETA: 0s - loss: 0.0048 224/224 [==============================] - 0s 1ms/step - loss: 0.0048 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 5.3173e-06 32/224 [===>..........................] - ETA: 0s - loss: 0.0078  66/224 [=======>......................] - ETA: 0s - loss: 0.0045 102/224 [============>.................] - ETA: 0s - loss: 0.0044 137/224 [=================>............] - ETA: 0s - loss: 0.0036 172/224 [======================>.......] - ETA: 0s - loss: 0.0044 210/224 [===========================>..] - ETA: 0s - loss: 0.0037 224/224 [==============================] - 0s 1ms/step - loss: 0.0036 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 0.0016 36/224 [===>..........................] - ETA: 0s - loss: 5.4891e-04 74/224 [========>.....................] - ETA: 0s - loss: 3.5814e-04 111/224 [=============>................] - ETA: 0s - loss: 0.0025  147/224 [==================>...........] - ETA: 0s - loss: 0.0020 183/224 [=======================>......] - ETA: 0s - loss: 0.0023 219/224 [============================>.] - ETA: 0s - loss: 0.0026 224/224 [==============================] - 0s 1ms/step - loss: 0.0026 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 3.6640e-04 38/224 [====>.........................] - ETA: 0s - loss: 9.3236e-04 73/224 [========>.....................] - ETA: 0s - loss: 7.3114e-04 109/224 [=============>................] - ETA: 0s - loss: 0.0023  146/224 [==================>...........] - ETA: 0s - loss: 0.0020 181/224 [=======================>......] - ETA: 0s - loss: 0.0024 215/224 [===========================>..] - ETA: 0s - loss: 0.0022 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 -> test with GAN.predict GAN tn, fp: 556, 4 GAN fn, tp: 2, 19 GAN f1 score: 0.864 GAN cohens kappa score: 0.858 -> test with 'LR' LR tn, fp: 543, 17 LR fn, tp: 0, 21 LR f1 score: 0.712 LR cohens kappa score: 0.698 LR average precision score: 0.903 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 2, 19 RF f1 score: 0.950 RF cohens kappa score: 0.948 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 551, 9 KNN fn, tp: 0, 21 KNN f1 score: 0.824 KNN cohens kappa score: 0.816 ------ Step 1/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 38s - loss: 1.5380e-10 41/224 [====>.........................] - ETA: 0s - loss: 0.0587  81/224 [=========>....................] - ETA: 0s - loss: 0.0424 122/224 [===============>..............] - ETA: 0s - loss: 0.0498 163/224 [====================>.........] - ETA: 0s - loss: 0.0495 202/224 [==========================>...] - ETA: 0s - loss: 0.0463 224/224 [==============================] - 0s 1ms/step - loss: 0.0432 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 5.4321e-06 37/224 [===>..........................] - ETA: 0s - loss: 0.0386  77/224 [=========>....................] - ETA: 0s - loss: 0.0206 117/224 [==============>...............] - ETA: 0s - loss: 0.0194 158/224 [====================>.........] - ETA: 0s - loss: 0.0201 200/224 [=========================>....] - ETA: 0s - loss: 0.0161 224/224 [==============================] - 0s 1ms/step - loss: 0.0194 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 0.0039 40/224 [====>.........................] - ETA: 0s - loss: 0.0035 81/224 [=========>....................] - ETA: 0s - loss: 0.0020 121/224 [===============>..............] - ETA: 0s - loss: 0.0073 163/224 [====================>.........] - ETA: 0s - loss: 0.0137 204/224 [==========================>...] - ETA: 0s - loss: 0.0115 224/224 [==============================] - 0s 1ms/step - loss: 0.0134 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 0.0010 42/224 [====>.........................] - ETA: 0s - loss: 0.0011 83/224 [==========>...................] - ETA: 0s - loss: 0.0067 123/224 [===============>..............] - ETA: 0s - loss: 0.0132 164/224 [====================>.........] - ETA: 0s - loss: 0.0102 198/224 [=========================>....] - ETA: 0s - loss: 0.0102 224/224 [==============================] - 0s 1ms/step - loss: 0.0093 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 5.8475e-04 34/224 [===>..........................] - ETA: 0s - loss: 0.0152  73/224 [========>.....................] - ETA: 0s - loss: 0.0098 110/224 [=============>................] - ETA: 0s - loss: 0.0068 149/224 [==================>...........] - ETA: 0s - loss: 0.0051 187/224 [========================>.....] - ETA: 0s - loss: 0.0058 224/224 [==============================] - 0s 1ms/step - loss: 0.0070 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 7.7976e-04 43/224 [====>.........................] - ETA: 0s - loss: 0.0017  84/224 [==========>...................] - ETA: 0s - loss: 0.0026 124/224 [===============>..............] - ETA: 0s - loss: 0.0039 165/224 [=====================>........] - ETA: 0s - loss: 0.0061 206/224 [==========================>...] - ETA: 0s - loss: 0.0059 224/224 [==============================] - 0s 1ms/step - loss: 0.0056 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0020 42/224 [====>.........................] - ETA: 0s - loss: 0.0047 83/224 [==========>...................] - ETA: 0s - loss: 0.0055 124/224 [===============>..............] - ETA: 0s - loss: 0.0047 165/224 [=====================>........] - ETA: 0s - loss: 0.0041 205/224 [==========================>...] - ETA: 0s - loss: 0.0039 224/224 [==============================] - 0s 1ms/step - loss: 0.0044 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 0.1196 41/224 [====>.........................] - ETA: 0s - loss: 0.0060 81/224 [=========>....................] - ETA: 0s - loss: 0.0054 119/224 [==============>...............] - ETA: 0s - loss: 0.0040 158/224 [====================>.........] - ETA: 0s - loss: 0.0046 199/224 [=========================>....] - ETA: 0s - loss: 0.0043 224/224 [==============================] - 0s 1ms/step - loss: 0.0051 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.7291e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0014  82/224 [=========>....................] - ETA: 0s - loss: 0.0019 122/224 [===============>..............] - ETA: 0s - loss: 0.0017 162/224 [====================>.........] - ETA: 0s - loss: 0.0020 202/224 [==========================>...] - ETA: 0s - loss: 0.0021 224/224 [==============================] - 0s 1ms/step - loss: 0.0022 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 0.0017 41/224 [====>.........................] - ETA: 0s - loss: 7.5010e-04 83/224 [==========>...................] - ETA: 0s - loss: 0.0010  124/224 [===============>..............] - ETA: 0s - loss: 8.4464e-04 163/224 [====================>.........] - ETA: 0s - loss: 0.0011  204/224 [==========================>...] - ETA: 0s - loss: 0.0013 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 544, 16 LR fn, tp: 2, 19 LR f1 score: 0.679 LR cohens kappa score: 0.663 LR average precision score: 0.896 -> test with 'RF' RF tn, fp: 555, 5 RF fn, tp: 1, 20 RF f1 score: 0.870 RF cohens kappa score: 0.864 -> test with 'GB' GB tn, fp: 555, 5 GB fn, tp: 0, 21 GB f1 score: 0.894 GB cohens kappa score: 0.889 -> test with 'KNN' KNN tn, fp: 552, 8 KNN fn, tp: 0, 21 KNN f1 score: 0.840 KNN cohens kappa score: 0.833 ------ Step 1/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2156 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 34s - loss: 4.7635e-08 45/224 [=====>........................] - ETA: 0s - loss: 0.0725  90/224 [===========>..................] - ETA: 0s - loss: 0.0679 133/224 [================>.............] - ETA: 0s - loss: 0.0529 177/224 [======================>.......] - ETA: 0s - loss: 0.0499 220/224 [============================>.] - ETA: 0s - loss: 0.0454 224/224 [==============================] - 0s 1ms/step - loss: 0.0446 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.2520e-05 45/224 [=====>........................] - ETA: 0s - loss: 0.0221  89/224 [==========>...................] - ETA: 0s - loss: 0.0285 131/224 [================>.............] - ETA: 0s - loss: 0.0292 173/224 [======================>.......] - ETA: 0s - loss: 0.0247 217/224 [============================>.] - ETA: 0s - loss: 0.0209 224/224 [==============================] - 0s 1ms/step - loss: 0.0203 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 6.0084e-09 42/224 [====>.........................] - ETA: 0s - loss: 0.0026  86/224 [==========>...................] - ETA: 0s - loss: 0.0021 131/224 [================>.............] - ETA: 0s - loss: 0.0105 175/224 [======================>.......] - ETA: 0s - loss: 0.0145 218/224 [============================>.] - ETA: 0s - loss: 0.0157 224/224 [==============================] - 0s 1ms/step - loss: 0.0153 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 3.9725e-05 43/224 [====>.........................] - ETA: 0s - loss: 0.0068  88/224 [==========>...................] - ETA: 0s - loss: 0.0043 128/224 [================>.............] - ETA: 0s - loss: 0.0070 167/224 [=====================>........] - ETA: 0s - loss: 0.0079 209/224 [==========================>...] - ETA: 0s - loss: 0.0092 224/224 [==============================] - 0s 1ms/step - loss: 0.0098 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 1.3988e-05 41/224 [====>.........................] - ETA: 0s - loss: 9.4262e-04 78/224 [=========>....................] - ETA: 0s - loss: 0.0040  116/224 [==============>...............] - ETA: 0s - loss: 0.0039 157/224 [====================>.........] - ETA: 0s - loss: 0.0044 201/224 [=========================>....] - ETA: 0s - loss: 0.0040 224/224 [==============================] - 0s 1ms/step - loss: 0.0058 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 0.0046 43/224 [====>.........................] - ETA: 0s - loss: 0.0036 86/224 [==========>...................] - ETA: 0s - loss: 0.0028 129/224 [================>.............] - ETA: 0s - loss: 0.0045 171/224 [=====================>........] - ETA: 0s - loss: 0.0055 214/224 [===========================>..] - ETA: 0s - loss: 0.0049 224/224 [==============================] - 0s 1ms/step - loss: 0.0048 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 7.5570e-04 43/224 [====>.........................] - ETA: 0s - loss: 0.0066  88/224 [==========>...................] - ETA: 0s - loss: 0.0050 132/224 [================>.............] - ETA: 0s - loss: 0.0042 176/224 [======================>.......] - ETA: 0s - loss: 0.0037 220/224 [============================>.] - ETA: 0s - loss: 0.0031 224/224 [==============================] - 0s 1ms/step - loss: 0.0030 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 8.4618e-04 44/224 [====>.........................] - ETA: 0s - loss: 0.0043  87/224 [==========>...................] - ETA: 0s - loss: 0.0040 132/224 [================>.............] - ETA: 0s - loss: 0.0037 176/224 [======================>.......] - ETA: 0s - loss: 0.0032 220/224 [============================>.] - ETA: 0s - loss: 0.0028 224/224 [==============================] - 0s 1ms/step - loss: 0.0027 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.3839e-05 45/224 [=====>........................] - ETA: 0s - loss: 0.0032  90/224 [===========>..................] - ETA: 0s - loss: 0.0024 132/224 [================>.............] - ETA: 0s - loss: 0.0021 175/224 [======================>.......] - ETA: 0s - loss: 0.0019 219/224 [============================>.] - ETA: 0s - loss: 0.0017 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 0.0012 44/224 [====>.........................] - ETA: 0s - loss: 0.0015 87/224 [==========>...................] - ETA: 0s - loss: 0.0018 130/224 [================>.............] - ETA: 0s - loss: 0.0019 173/224 [======================>.......] - ETA: 0s - loss: 0.0017 217/224 [============================>.] - ETA: 0s - loss: 0.0015 224/224 [==============================] - 0s 1ms/step - loss: 0.0014 -> test with GAN.predict GAN tn, fp: 556, 0 GAN fn, tp: 0, 21 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 544, 12 LR fn, tp: 0, 21 LR f1 score: 0.778 LR cohens kappa score: 0.767 LR average precision score: 0.989 -> test with 'RF' RF tn, fp: 554, 2 RF fn, tp: 0, 21 RF f1 score: 0.955 RF cohens kappa score: 0.953 -> test with 'GB' GB tn, fp: 556, 0 GB fn, tp: 0, 21 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 551, 5 KNN fn, tp: 0, 21 KNN f1 score: 0.894 KNN cohens kappa score: 0.889 ====== Step 2/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 2/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 44s - loss: 1.2001e-04 36/224 [===>..........................] - ETA: 0s - loss: 0.0599  74/224 [========>.....................] - ETA: 0s - loss: 0.0501 114/224 [==============>...............] - ETA: 0s - loss: 0.0473 147/224 [==================>...........] - ETA: 0s - loss: 0.0468 183/224 [=======================>......] - ETA: 0s - loss: 0.0416 219/224 [============================>.] - ETA: 0s - loss: 0.0427 224/224 [==============================] - 1s 1ms/step - loss: 0.0418 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.9510e-06 35/224 [===>..........................] - ETA: 0s - loss: 0.0394  72/224 [========>.....................] - ETA: 0s - loss: 0.0332 109/224 [=============>................] - ETA: 0s - loss: 0.0277 146/224 [==================>...........] - ETA: 0s - loss: 0.0267 183/224 [=======================>......] - ETA: 0s - loss: 0.0253 219/224 [============================>.] - ETA: 0s - loss: 0.0234 224/224 [==============================] - 0s 1ms/step - loss: 0.0229 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 3.3537e-04 37/224 [===>..........................] - ETA: 0s - loss: 0.0199  70/224 [========>.....................] - ETA: 0s - loss: 0.0139 100/224 [============>.................] - ETA: 0s - loss: 0.0136 132/224 [================>.............] - ETA: 0s - loss: 0.0127 169/224 [=====================>........] - ETA: 0s - loss: 0.0138 208/224 [==========================>...] - ETA: 0s - loss: 0.0143 224/224 [==============================] - 0s 1ms/step - loss: 0.0144 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 4.9978e-05 39/224 [====>.........................] - ETA: 0s - loss: 0.0213  77/224 [=========>....................] - ETA: 0s - loss: 0.0137 114/224 [==============>...............] - ETA: 0s - loss: 0.0102 151/224 [===================>..........] - ETA: 0s - loss: 0.0099 185/224 [=======================>......] - ETA: 0s - loss: 0.0108 224/224 [==============================] - 0s 1ms/step - loss: 0.0118 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 3.6746e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0083  77/224 [=========>....................] - ETA: 0s - loss: 0.0138 117/224 [==============>...............] - ETA: 0s - loss: 0.0121 157/224 [====================>.........] - ETA: 0s - loss: 0.0098 195/224 [=========================>....] - ETA: 0s - loss: 0.0101 224/224 [==============================] - 0s 1ms/step - loss: 0.0096 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 4.8761e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0105  80/224 [=========>....................] - ETA: 0s - loss: 0.0127 118/224 [==============>...............] - ETA: 0s - loss: 0.0108 158/224 [====================>.........] - ETA: 0s - loss: 0.0095 199/224 [=========================>....] - ETA: 0s - loss: 0.0088 224/224 [==============================] - 0s 1ms/step - loss: 0.0082 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 4.1483e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0068  80/224 [=========>....................] - ETA: 0s - loss: 0.0082 118/224 [==============>...............] - ETA: 0s - loss: 0.0072 157/224 [====================>.........] - ETA: 0s - loss: 0.0070 190/224 [========================>.....] - ETA: 0s - loss: 0.0065 224/224 [==============================] - 0s 1ms/step - loss: 0.0065 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 6.7228e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0088  80/224 [=========>....................] - ETA: 0s - loss: 0.0084 119/224 [==============>...............] - ETA: 0s - loss: 0.0064 159/224 [====================>.........] - ETA: 0s - loss: 0.0057 200/224 [=========================>....] - ETA: 0s - loss: 0.0050 224/224 [==============================] - 0s 1ms/step - loss: 0.0052 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 9.7625e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0023  82/224 [=========>....................] - ETA: 0s - loss: 0.0033 121/224 [===============>..............] - ETA: 0s - loss: 0.0033 160/224 [====================>.........] - ETA: 0s - loss: 0.0029 201/224 [=========================>....] - ETA: 0s - loss: 0.0038 224/224 [==============================] - 0s 1ms/step - loss: 0.0051 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 0.0018 41/224 [====>.........................] - ETA: 0s - loss: 0.0049 81/224 [=========>....................] - ETA: 0s - loss: 0.0054 121/224 [===============>..............] - ETA: 0s - loss: 0.0046 161/224 [====================>.........] - ETA: 0s - loss: 0.0038 195/224 [=========================>....] - ETA: 0s - loss: 0.0042 224/224 [==============================] - 0s 1ms/step - loss: 0.0042 -> test with GAN.predict GAN tn, fp: 559, 1 GAN fn, tp: 0, 21 GAN f1 score: 0.977 GAN cohens kappa score: 0.976 -> test with 'LR' LR tn, fp: 552, 8 LR fn, tp: 1, 20 LR f1 score: 0.816 LR cohens kappa score: 0.808 LR average precision score: 0.943 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 0, 21 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 554, 6 KNN fn, tp: 0, 21 KNN f1 score: 0.875 KNN cohens kappa score: 0.870 ------ Step 2/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 36s - loss: 1.8158e-10 40/224 [====>.........................] - ETA: 0s - loss: 0.0885  79/224 [=========>....................] - ETA: 0s - loss: 0.0699 117/224 [==============>...............] - ETA: 0s - loss: 0.0571 150/224 [===================>..........] - ETA: 0s - loss: 0.0509 185/224 [=======================>......] - ETA: 0s - loss: 0.0465 224/224 [==============================] - ETA: 0s - loss: 0.0478 224/224 [==============================] - 0s 1ms/step - loss: 0.0478 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.7303e-07 43/224 [====>.........................] - ETA: 0s - loss: 0.0163  85/224 [==========>...................] - ETA: 0s - loss: 0.0306 127/224 [================>.............] - ETA: 0s - loss: 0.0222 168/224 [=====================>........] - ETA: 0s - loss: 0.0250 210/224 [===========================>..] - ETA: 0s - loss: 0.0275 224/224 [==============================] - 0s 1ms/step - loss: 0.0258 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 0.5360 42/224 [====>.........................] - ETA: 0s - loss: 0.0291 83/224 [==========>...................] - ETA: 0s - loss: 0.0223 124/224 [===============>..............] - ETA: 0s - loss: 0.0208 165/224 [=====================>........] - ETA: 0s - loss: 0.0182 207/224 [==========================>...] - ETA: 0s - loss: 0.0173 224/224 [==============================] - 0s 1ms/step - loss: 0.0178 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 4.4015e-04 35/224 [===>..........................] - ETA: 0s - loss: 0.0112  75/224 [=========>....................] - ETA: 0s - loss: 0.0212 117/224 [==============>...............] - ETA: 0s - loss: 0.0157 157/224 [====================>.........] - ETA: 0s - loss: 0.0153 194/224 [========================>.....] - ETA: 0s - loss: 0.0131 224/224 [==============================] - 0s 1ms/step - loss: 0.0133 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 4.7364e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0018  83/224 [==========>...................] - ETA: 0s - loss: 0.0053 122/224 [===============>..............] - ETA: 0s - loss: 0.0103 163/224 [====================>.........] - ETA: 0s - loss: 0.0107 203/224 [==========================>...] - ETA: 0s - loss: 0.0108 224/224 [==============================] - 0s 1ms/step - loss: 0.0103 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 9.5936e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0043  83/224 [==========>...................] - ETA: 0s - loss: 0.0072 125/224 [===============>..............] - ETA: 0s - loss: 0.0073 166/224 [=====================>........] - ETA: 0s - loss: 0.0064 207/224 [==========================>...] - ETA: 0s - loss: 0.0075 224/224 [==============================] - 0s 1ms/step - loss: 0.0085 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0066 40/224 [====>.........................] - ETA: 0s - loss: 0.0031 77/224 [=========>....................] - ETA: 0s - loss: 0.0059 118/224 [==============>...............] - ETA: 0s - loss: 0.0056 159/224 [====================>.........] - ETA: 0s - loss: 0.0059 200/224 [=========================>....] - ETA: 0s - loss: 0.0051 224/224 [==============================] - 0s 1ms/step - loss: 0.0068 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 0.0014 43/224 [====>.........................] - ETA: 0s - loss: 0.0049 83/224 [==========>...................] - ETA: 0s - loss: 0.0051 124/224 [===============>..............] - ETA: 0s - loss: 0.0058 165/224 [=====================>........] - ETA: 0s - loss: 0.0068 206/224 [==========================>...] - ETA: 0s - loss: 0.0060 224/224 [==============================] - 0s 1ms/step - loss: 0.0056 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.1125e-04 35/224 [===>..........................] - ETA: 0s - loss: 0.0150  70/224 [========>.....................] - ETA: 0s - loss: 0.0112 106/224 [=============>................] - ETA: 0s - loss: 0.0077 145/224 [==================>...........] - ETA: 0s - loss: 0.0076 184/224 [=======================>......] - ETA: 0s - loss: 0.0066 223/224 [============================>.] - ETA: 0s - loss: 0.0058 224/224 [==============================] - 0s 1ms/step - loss: 0.0058 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 5.3971e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0019  83/224 [==========>...................] - ETA: 0s - loss: 0.0045 124/224 [===============>..............] - ETA: 0s - loss: 0.0047 165/224 [=====================>........] - ETA: 0s - loss: 0.0050 207/224 [==========================>...] - ETA: 0s - loss: 0.0045 224/224 [==============================] - 0s 1ms/step - loss: 0.0042 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 2, 19 GAN f1 score: 0.950 GAN cohens kappa score: 0.948 -> test with 'LR' LR tn, fp: 558, 2 LR fn, tp: 2, 19 LR f1 score: 0.905 LR cohens kappa score: 0.901 LR average precision score: 0.920 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 3, 18 RF f1 score: 0.923 RF cohens kappa score: 0.920 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 555, 5 KNN fn, tp: 2, 19 KNN f1 score: 0.844 KNN cohens kappa score: 0.838 ------ Step 2/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 44s - loss: 2.3255e-09 41/224 [====>.........................] - ETA: 0s - loss: 0.0539  82/224 [=========>....................] - ETA: 0s - loss: 0.0703 124/224 [===============>..............] - ETA: 0s - loss: 0.0510 166/224 [=====================>........] - ETA: 0s - loss: 0.0631 208/224 [==========================>...] - ETA: 0s - loss: 0.0567 224/224 [==============================] - 0s 1ms/step - loss: 0.0564 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 7.0010e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0263  83/224 [==========>...................] - ETA: 0s - loss: 0.0330 125/224 [===============>..............] - ETA: 0s - loss: 0.0225 167/224 [=====================>........] - ETA: 0s - loss: 0.0199 208/224 [==========================>...] - ETA: 0s - loss: 0.0248 224/224 [==============================] - 0s 1ms/step - loss: 0.0252 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 3.3712e-05 43/224 [====>.........................] - ETA: 0s - loss: 0.0248  82/224 [=========>....................] - ETA: 0s - loss: 0.0234 121/224 [===============>..............] - ETA: 0s - loss: 0.0232 157/224 [====================>.........] - ETA: 0s - loss: 0.0199 191/224 [========================>.....] - ETA: 0s - loss: 0.0190 224/224 [==============================] - 0s 1ms/step - loss: 0.0179 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 0.0029 38/224 [====>.........................] - ETA: 0s - loss: 0.0181 80/224 [=========>....................] - ETA: 0s - loss: 0.0192 121/224 [===============>..............] - ETA: 0s - loss: 0.0157 163/224 [====================>.........] - ETA: 0s - loss: 0.0136 204/224 [==========================>...] - ETA: 0s - loss: 0.0137 224/224 [==============================] - 0s 1ms/step - loss: 0.0141 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 5.6050e-04 39/224 [====>.........................] - ETA: 0s - loss: 0.0085  78/224 [=========>....................] - ETA: 0s - loss: 0.0103 114/224 [==============>...............] - ETA: 0s - loss: 0.0108 154/224 [===================>..........] - ETA: 0s - loss: 0.0088 196/224 [=========================>....] - ETA: 0s - loss: 0.0116 224/224 [==============================] - 0s 1ms/step - loss: 0.0119 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.1147e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0045  82/224 [=========>....................] - ETA: 0s - loss: 0.0052 123/224 [===============>..............] - ETA: 0s - loss: 0.0094 163/224 [====================>.........] - ETA: 0s - loss: 0.0105 204/224 [==========================>...] - ETA: 0s - loss: 0.0102 224/224 [==============================] - 0s 1ms/step - loss: 0.0098 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0065 43/224 [====>.........................] - ETA: 0s - loss: 0.0089 84/224 [==========>...................] - ETA: 0s - loss: 0.0064 125/224 [===============>..............] - ETA: 0s - loss: 0.0061 161/224 [====================>.........] - ETA: 0s - loss: 0.0068 194/224 [========================>.....] - ETA: 0s - loss: 0.0058 224/224 [==============================] - 0s 1ms/step - loss: 0.0082 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 0.0035 42/224 [====>.........................] - ETA: 0s - loss: 0.0124 84/224 [==========>...................] - ETA: 0s - loss: 0.0094 126/224 [===============>..............] - ETA: 0s - loss: 0.0093 167/224 [=====================>........] - ETA: 0s - loss: 0.0088 208/224 [==========================>...] - ETA: 0s - loss: 0.0082 224/224 [==============================] - 0s 1ms/step - loss: 0.0078 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 8.6197e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0111  83/224 [==========>...................] - ETA: 0s - loss: 0.0064 122/224 [===============>..............] - ETA: 0s - loss: 0.0063 163/224 [====================>.........] - ETA: 0s - loss: 0.0073 204/224 [==========================>...] - ETA: 0s - loss: 0.0066 224/224 [==============================] - 0s 1ms/step - loss: 0.0064 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 8.1323e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0062  82/224 [=========>....................] - ETA: 0s - loss: 0.0055 121/224 [===============>..............] - ETA: 0s - loss: 0.0063 163/224 [====================>.........] - ETA: 0s - loss: 0.0056 204/224 [==========================>...] - ETA: 0s - loss: 0.0059 224/224 [==============================] - 0s 1ms/step - loss: 0.0055 -> test with GAN.predict GAN tn, fp: 558, 2 GAN fn, tp: 1, 20 GAN f1 score: 0.930 GAN cohens kappa score: 0.928 -> test with 'LR' LR tn, fp: 549, 11 LR fn, tp: 0, 21 LR f1 score: 0.792 LR cohens kappa score: 0.783 LR average precision score: 0.934 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 1, 20 RF f1 score: 0.976 RF cohens kappa score: 0.975 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 558, 2 KNN fn, tp: 1, 20 KNN f1 score: 0.930 KNN cohens kappa score: 0.928 ------ Step 2/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 36s - loss: 1.3944e-07 42/224 [====>.........................] - ETA: 0s - loss: 0.0444  82/224 [=========>....................] - ETA: 0s - loss: 0.0416 123/224 [===============>..............] - ETA: 0s - loss: 0.0471 164/224 [====================>.........] - ETA: 0s - loss: 0.0472 205/224 [==========================>...] - ETA: 0s - loss: 0.0479 224/224 [==============================] - 0s 1ms/step - loss: 0.0465 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 7.4432e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0217  73/224 [========>.....................] - ETA: 0s - loss: 0.0169 108/224 [=============>................] - ETA: 0s - loss: 0.0171 143/224 [==================>...........] - ETA: 0s - loss: 0.0172 180/224 [=======================>......] - ETA: 0s - loss: 0.0195 220/224 [============================>.] - ETA: 0s - loss: 0.0201 224/224 [==============================] - 0s 1ms/step - loss: 0.0211 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 2.8702e-05 41/224 [====>.........................] - ETA: 0s - loss: 0.0193  82/224 [=========>....................] - ETA: 0s - loss: 0.0186 124/224 [===============>..............] - ETA: 0s - loss: 0.0193 163/224 [====================>.........] - ETA: 0s - loss: 0.0184 204/224 [==========================>...] - ETA: 0s - loss: 0.0159 224/224 [==============================] - 0s 1ms/step - loss: 0.0159 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 1.1858e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0040  78/224 [=========>....................] - ETA: 0s - loss: 0.0102 118/224 [==============>...............] - ETA: 0s - loss: 0.0144 156/224 [===================>..........] - ETA: 0s - loss: 0.0117 197/224 [=========================>....] - ETA: 0s - loss: 0.0142 224/224 [==============================] - 0s 1ms/step - loss: 0.0133 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 4.1040e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0255  83/224 [==========>...................] - ETA: 0s - loss: 0.0147 123/224 [===============>..............] - ETA: 0s - loss: 0.0121 160/224 [====================>.........] - ETA: 0s - loss: 0.0109 200/224 [=========================>....] - ETA: 0s - loss: 0.0095 224/224 [==============================] - 0s 1ms/step - loss: 0.0116 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 9.2190e-07 39/224 [====>.........................] - ETA: 0s - loss: 0.0060  79/224 [=========>....................] - ETA: 0s - loss: 0.0152 118/224 [==============>...............] - ETA: 0s - loss: 0.0127 158/224 [====================>.........] - ETA: 0s - loss: 0.0104 198/224 [=========================>....] - ETA: 0s - loss: 0.0105 224/224 [==============================] - 0s 1ms/step - loss: 0.0104 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 4.5444e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0022  83/224 [==========>...................] - ETA: 0s - loss: 0.0047 123/224 [===============>..............] - ETA: 0s - loss: 0.0061 163/224 [====================>.........] - ETA: 0s - loss: 0.0092 204/224 [==========================>...] - ETA: 0s - loss: 0.0096 224/224 [==============================] - 0s 1ms/step - loss: 0.0093 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 8.7604e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0066  83/224 [==========>...................] - ETA: 0s - loss: 0.0088 124/224 [===============>..............] - ETA: 0s - loss: 0.0065 164/224 [====================>.........] - ETA: 0s - loss: 0.0055 204/224 [==========================>...] - ETA: 0s - loss: 0.0070 224/224 [==============================] - 0s 1ms/step - loss: 0.0085 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.6502e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0172  81/224 [=========>....................] - ETA: 0s - loss: 0.0127 121/224 [===============>..............] - ETA: 0s - loss: 0.0106 156/224 [===================>..........] - ETA: 0s - loss: 0.0088 189/224 [========================>.....] - ETA: 0s - loss: 0.0081 224/224 [==============================] - 0s 1ms/step - loss: 0.0077 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 5.5745e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0014  81/224 [=========>....................] - ETA: 0s - loss: 0.0037 121/224 [===============>..............] - ETA: 0s - loss: 0.0044 161/224 [====================>.........] - ETA: 0s - loss: 0.0044 203/224 [==========================>...] - ETA: 0s - loss: 0.0047 224/224 [==============================] - 0s 1ms/step - loss: 0.0069 -> test with GAN.predict GAN tn, fp: 553, 7 GAN fn, tp: 1, 20 GAN f1 score: 0.833 GAN cohens kappa score: 0.826 -> test with 'LR' LR tn, fp: 543, 17 LR fn, tp: 0, 21 LR f1 score: 0.712 LR cohens kappa score: 0.698 LR average precision score: 0.894 -> test with 'RF' RF tn, fp: 559, 1 RF fn, tp: 2, 19 RF f1 score: 0.927 RF cohens kappa score: 0.924 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 2, 19 GB f1 score: 0.927 GB cohens kappa score: 0.924 -> test with 'KNN' KNN tn, fp: 550, 10 KNN fn, tp: 0, 21 KNN f1 score: 0.808 KNN cohens kappa score: 0.799 ------ Step 2/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2156 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 35s - loss: 6.9999e-15 45/224 [=====>........................] - ETA: 0s - loss: 0.0745  89/224 [==========>...................] - ETA: 0s - loss: 0.0907 134/224 [================>.............] - ETA: 0s - loss: 0.0645 177/224 [======================>.......] - ETA: 0s - loss: 0.0542 219/224 [============================>.] - ETA: 0s - loss: 0.0495 224/224 [==============================] - 0s 1ms/step - loss: 0.0500 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 0.0439 45/224 [=====>........................] - ETA: 0s - loss: 0.0203 84/224 [==========>...................] - ETA: 0s - loss: 0.0195 122/224 [===============>..............] - ETA: 0s - loss: 0.0199 160/224 [====================>.........] - ETA: 0s - loss: 0.0186 204/224 [==========================>...] - ETA: 0s - loss: 0.0177 224/224 [==============================] - 0s 1ms/step - loss: 0.0161 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.4331e-04 45/224 [=====>........................] - ETA: 0s - loss: 0.0039  85/224 [==========>...................] - ETA: 0s - loss: 0.0068 117/224 [==============>...............] - ETA: 0s - loss: 0.0068 150/224 [===================>..........] - ETA: 0s - loss: 0.0068 189/224 [========================>.....] - ETA: 0s - loss: 0.0076 224/224 [==============================] - 0s 1ms/step - loss: 0.0070 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 0.0038 45/224 [=====>........................] - ETA: 0s - loss: 0.0047 89/224 [==========>...................] - ETA: 0s - loss: 0.0075 129/224 [================>.............] - ETA: 0s - loss: 0.0068 173/224 [======================>.......] - ETA: 0s - loss: 0.0057 210/224 [===========================>..] - ETA: 0s - loss: 0.0050 224/224 [==============================] - 0s 1ms/step - loss: 0.0048 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 0.0013 45/224 [=====>........................] - ETA: 0s - loss: 0.0057 90/224 [===========>..................] - ETA: 0s - loss: 0.0059 132/224 [================>.............] - ETA: 0s - loss: 0.0043 176/224 [======================>.......] - ETA: 0s - loss: 0.0039 220/224 [============================>.] - ETA: 0s - loss: 0.0040 224/224 [==============================] - 0s 1ms/step - loss: 0.0039 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 4.7514e-08 44/224 [====>.........................] - ETA: 0s - loss: 0.0011  87/224 [==========>...................] - ETA: 0s - loss: 0.0010 131/224 [================>.............] - ETA: 0s - loss: 0.0024 174/224 [======================>.......] - ETA: 0s - loss: 0.0026 217/224 [============================>.] - ETA: 0s - loss: 0.0030 224/224 [==============================] - 0s 1ms/step - loss: 0.0029 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0013 43/224 [====>.........................] - ETA: 0s - loss: 0.0046 86/224 [==========>...................] - ETA: 0s - loss: 0.0048 130/224 [================>.............] - ETA: 0s - loss: 0.0037 174/224 [======================>.......] - ETA: 0s - loss: 0.0028 219/224 [============================>.] - ETA: 0s - loss: 0.0025 224/224 [==============================] - 0s 1ms/step - loss: 0.0025 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 9.2698e-04 45/224 [=====>........................] - ETA: 0s - loss: 0.0029  87/224 [==========>...................] - ETA: 0s - loss: 0.0022 131/224 [================>.............] - ETA: 0s - loss: 0.0017 175/224 [======================>.......] - ETA: 0s - loss: 0.0016 218/224 [============================>.] - ETA: 0s - loss: 0.0016 224/224 [==============================] - 0s 1ms/step - loss: 0.0017 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 5.2255e-05 43/224 [====>.........................] - ETA: 0s - loss: 0.0029  87/224 [==========>...................] - ETA: 0s - loss: 0.0020 124/224 [===============>..............] - ETA: 0s - loss: 0.0024 160/224 [====================>.........] - ETA: 0s - loss: 0.0020 201/224 [=========================>....] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0017 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 1.0570e-06 38/224 [====>.........................] - ETA: 0s - loss: 3.7160e-04 75/224 [=========>....................] - ETA: 0s - loss: 0.0014  114/224 [==============>...............] - ETA: 0s - loss: 0.0015 158/224 [====================>.........] - ETA: 0s - loss: 0.0019 201/224 [=========================>....] - ETA: 0s - loss: 0.0016 224/224 [==============================] - 0s 1ms/step - loss: 0.0016 -> test with GAN.predict GAN tn, fp: 556, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 540, 16 LR fn, tp: 1, 20 LR f1 score: 0.702 LR cohens kappa score: 0.687 LR average precision score: 0.932 -> test with 'RF' RF tn, fp: 556, 0 RF fn, tp: 2, 19 RF f1 score: 0.950 RF cohens kappa score: 0.948 -> test with 'GB' GB tn, fp: 556, 0 GB fn, tp: 0, 21 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 550, 6 KNN fn, tp: 1, 20 KNN f1 score: 0.851 KNN cohens kappa score: 0.845 ====== Step 3/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 3/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 43s - loss: 3.6578e-08 42/224 [====>.........................] - ETA: 0s - loss: 0.0027  82/224 [=========>....................] - ETA: 0s - loss: 0.0180 123/224 [===============>..............] - ETA: 0s - loss: 0.0248 164/224 [====================>.........] - ETA: 0s - loss: 0.0210 204/224 [==========================>...] - ETA: 0s - loss: 0.0177 224/224 [==============================] - 0s 1ms/step - loss: 0.0198 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 5.0968e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0020  83/224 [==========>...................] - ETA: 0s - loss: 0.0086 123/224 [===============>..............] - ETA: 0s - loss: 0.0061 163/224 [====================>.........] - ETA: 0s - loss: 0.0074 202/224 [==========================>...] - ETA: 0s - loss: 0.0060 224/224 [==============================] - 0s 1ms/step - loss: 0.0096 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.0756e-07 40/224 [====>.........................] - ETA: 0s - loss: 0.0077  82/224 [=========>....................] - ETA: 0s - loss: 0.0090 122/224 [===============>..............] - ETA: 0s - loss: 0.0062 162/224 [====================>.........] - ETA: 0s - loss: 0.0091 202/224 [==========================>...] - ETA: 0s - loss: 0.0074 224/224 [==============================] - 0s 1ms/step - loss: 0.0067 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 7.6599e-06 41/224 [====>.........................] - ETA: 0s - loss: 8.7311e-05 81/224 [=========>....................] - ETA: 0s - loss: 3.2370e-04 121/224 [===============>..............] - ETA: 0s - loss: 0.0023  161/224 [====================>.........] - ETA: 0s - loss: 0.0053 202/224 [==========================>...] - ETA: 0s - loss: 0.0044 224/224 [==============================] - 0s 1ms/step - loss: 0.0040 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 3.2283e-06 40/224 [====>.........................] - ETA: 0s - loss: 3.2633e-04 78/224 [=========>....................] - ETA: 0s - loss: 7.9709e-04 117/224 [==============>...............] - ETA: 0s - loss: 8.1259e-04 156/224 [===================>..........] - ETA: 0s - loss: 6.4812e-04 197/224 [=========================>....] - ETA: 0s - loss: 0.0027  224/224 [==============================] - 0s 1ms/step - loss: 0.0025 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.1095e-04 41/224 [====>.........................] - ETA: 0s - loss: 6.8994e-04 81/224 [=========>....................] - ETA: 0s - loss: 0.0060  120/224 [===============>..............] - ETA: 0s - loss: 0.0046 153/224 [===================>..........] - ETA: 0s - loss: 0.0039 189/224 [========================>.....] - ETA: 0s - loss: 0.0033 224/224 [==============================] - 0s 1ms/step - loss: 0.0028 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 7.2663e-06 42/224 [====>.........................] - ETA: 0s - loss: 3.8941e-04 82/224 [=========>....................] - ETA: 0s - loss: 2.8747e-04 121/224 [===============>..............] - ETA: 0s - loss: 2.1785e-04 161/224 [====================>.........] - ETA: 0s - loss: 2.8132e-04 200/224 [=========================>....] - ETA: 0s - loss: 2.6275e-04 224/224 [==============================] - 0s 1ms/step - loss: 0.0012 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 0.0039 42/224 [====>.........................] - ETA: 0s - loss: 3.1063e-04 81/224 [=========>....................] - ETA: 0s - loss: 4.4320e-04 122/224 [===============>..............] - ETA: 0s - loss: 4.2386e-04 160/224 [====================>.........] - ETA: 0s - loss: 3.9004e-04 199/224 [=========================>....] - ETA: 0s - loss: 7.7811e-04 224/224 [==============================] - 0s 1ms/step - loss: 7.0230e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 2.5945e-04 41/224 [====>.........................] - ETA: 0s - loss: 2.0343e-04 82/224 [=========>....................] - ETA: 0s - loss: 1.7875e-04 123/224 [===============>..............] - ETA: 0s - loss: 3.0799e-04 164/224 [====================>.........] - ETA: 0s - loss: 3.7916e-04 205/224 [==========================>...] - ETA: 0s - loss: 4.0522e-04 224/224 [==============================] - 0s 1ms/step - loss: 3.7981e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 7.3436e-04 41/224 [====>.........................] - ETA: 0s - loss: 2.4682e-04 82/224 [=========>....................] - ETA: 0s - loss: 3.3695e-04 120/224 [===============>..............] - ETA: 0s - loss: 3.8036e-04 157/224 [====================>.........] - ETA: 0s - loss: 3.6100e-04 196/224 [=========================>....] - ETA: 0s - loss: 3.0550e-04 224/224 [==============================] - 0s 1ms/step - loss: 2.8497e-04 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 551, 9 LR fn, tp: 1, 20 LR f1 score: 0.800 LR cohens kappa score: 0.791 LR average precision score: 0.950 -> test with 'RF' RF tn, fp: 559, 1 RF fn, tp: 1, 20 RF f1 score: 0.952 RF cohens kappa score: 0.951 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 0, 21 GB f1 score: 0.977 GB cohens kappa score: 0.976 -> test with 'KNN' KNN tn, fp: 550, 10 KNN fn, tp: 0, 21 KNN f1 score: 0.808 KNN cohens kappa score: 0.799 ------ Step 3/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 44s - loss: 2.5593e-09 42/224 [====>.........................] - ETA: 0s - loss: 0.0053  81/224 [=========>....................] - ETA: 0s - loss: 0.0096 121/224 [===============>..............] - ETA: 0s - loss: 0.0433 159/224 [====================>.........] - ETA: 0s - loss: 0.0329 200/224 [=========================>....] - ETA: 0s - loss: 0.0272 224/224 [==============================] - 0s 1ms/step - loss: 0.0267 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.1994e-04 34/224 [===>..........................] - ETA: 0s - loss: 0.0222  67/224 [=======>......................] - ETA: 0s - loss: 0.0115 102/224 [============>.................] - ETA: 0s - loss: 0.0120 141/224 [=================>............] - ETA: 0s - loss: 0.0088 181/224 [=======================>......] - ETA: 0s - loss: 0.0069 218/224 [============================>.] - ETA: 0s - loss: 0.0155 224/224 [==============================] - 0s 1ms/step - loss: 0.0152 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 9.9343e-08 42/224 [====>.........................] - ETA: 0s - loss: 7.0399e-04 84/224 [==========>...................] - ETA: 0s - loss: 4.7462e-04 125/224 [===============>..............] - ETA: 0s - loss: 0.0084  167/224 [=====================>........] - ETA: 0s - loss: 0.0104 208/224 [==========================>...] - ETA: 0s - loss: 0.0086 224/224 [==============================] - 0s 1ms/step - loss: 0.0111 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 9.9328e-04 36/224 [===>..........................] - ETA: 0s - loss: 0.0202  73/224 [========>.....................] - ETA: 0s - loss: 0.0112 112/224 [==============>...............] - ETA: 0s - loss: 0.0077 152/224 [===================>..........] - ETA: 0s - loss: 0.0069 192/224 [========================>.....] - ETA: 0s - loss: 0.0103 224/224 [==============================] - 0s 1ms/step - loss: 0.0090 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 5.6525e-08 42/224 [====>.........................] - ETA: 0s - loss: 0.0064  82/224 [=========>....................] - ETA: 0s - loss: 0.0036 121/224 [===============>..............] - ETA: 0s - loss: 0.0064 161/224 [====================>.........] - ETA: 0s - loss: 0.0050 202/224 [==========================>...] - ETA: 0s - loss: 0.0065 224/224 [==============================] - 0s 1ms/step - loss: 0.0061 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.3745e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0014  81/224 [=========>....................] - ETA: 0s - loss: 0.0064 119/224 [==============>...............] - ETA: 0s - loss: 0.0076 154/224 [===================>..........] - ETA: 0s - loss: 0.0062 192/224 [========================>.....] - ETA: 0s - loss: 0.0051 223/224 [============================>.] - ETA: 0s - loss: 0.0047 224/224 [==============================] - 0s 1ms/step - loss: 0.0047 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 1.6737e-07 38/224 [====>.........................] - ETA: 0s - loss: 0.0082  77/224 [=========>....................] - ETA: 0s - loss: 0.0044 115/224 [==============>...............] - ETA: 0s - loss: 0.0032 154/224 [===================>..........] - ETA: 0s - loss: 0.0025 194/224 [========================>.....] - ETA: 0s - loss: 0.0032 224/224 [==============================] - 0s 1ms/step - loss: 0.0029 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 6.3810e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0048  84/224 [==========>...................] - ETA: 0s - loss: 0.0028 125/224 [===============>..............] - ETA: 0s - loss: 0.0023 166/224 [=====================>........] - ETA: 0s - loss: 0.0022 205/224 [==========================>...] - ETA: 0s - loss: 0.0019 224/224 [==============================] - 0s 1ms/step - loss: 0.0019 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 4.5067e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0021  82/224 [=========>....................] - ETA: 0s - loss: 0.0016 119/224 [==============>...............] - ETA: 0s - loss: 0.0013 150/224 [===================>..........] - ETA: 0s - loss: 0.0012 184/224 [=======================>......] - ETA: 0s - loss: 0.0011 223/224 [============================>.] - ETA: 0s - loss: 0.0010 224/224 [==============================] - 0s 1ms/step - loss: 0.0010 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 1.8308e-04 42/224 [====>.........................] - ETA: 0s - loss: 5.4995e-04 81/224 [=========>....................] - ETA: 0s - loss: 5.9287e-04 121/224 [===============>..............] - ETA: 0s - loss: 4.8899e-04 162/224 [====================>.........] - ETA: 0s - loss: 4.1997e-04 203/224 [==========================>...] - ETA: 0s - loss: 4.5043e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.1934e-04 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 556, 4 LR fn, tp: 1, 20 LR f1 score: 0.889 LR cohens kappa score: 0.884 LR average precision score: 0.898 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 0, 21 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 1, 20 GB f1 score: 0.976 GB cohens kappa score: 0.975 -> test with 'KNN' KNN tn, fp: 554, 6 KNN fn, tp: 0, 21 KNN f1 score: 0.875 KNN cohens kappa score: 0.870 ------ Step 3/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 1:15 - loss: 2.4084e-08 10/224 [>.............................] - ETA: 1s - loss: 1.5195e-04  18/224 [=>............................] - ETA: 1s - loss: 0.0692  27/224 [==>...........................] - ETA: 1s - loss: 0.0887 40/224 [====>.........................] - ETA: 0s - loss: 0.0639 56/224 [======>.......................] - ETA: 0s - loss: 0.0541 72/224 [========>.....................] - ETA: 0s - loss: 0.0425 89/224 [==========>...................] - ETA: 0s - loss: 0.0426 111/224 [=============>................] - ETA: 0s - loss: 0.0384 137/224 [=================>............] - ETA: 0s - loss: 0.0479 162/224 [====================>.........] - ETA: 0s - loss: 0.0406 185/224 [=======================>......] - ETA: 0s - loss: 0.0402 211/224 [===========================>..] - ETA: 0s - loss: 0.0407 224/224 [==============================] - 1s 3ms/step - loss: 0.0384 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 2.1830e-04 27/224 [==>...........................] - ETA: 0s - loss: 0.0032  50/224 [=====>........................] - ETA: 0s - loss: 0.0026 76/224 [=========>....................] - ETA: 0s - loss: 0.0402 95/224 [===========>..................] - ETA: 0s - loss: 0.0366 117/224 [==============>...............] - ETA: 0s - loss: 0.0312 135/224 [=================>............] - ETA: 0s - loss: 0.0271 148/224 [==================>...........] - ETA: 0s - loss: 0.0247 166/224 [=====================>........] - ETA: 0s - loss: 0.0221 184/224 [=======================>......] - ETA: 0s - loss: 0.0200 209/224 [==========================>...] - ETA: 0s - loss: 0.0204 224/224 [==============================] - 1s 2ms/step - loss: 0.0191 Epoch 3/10 1/224 [..............................] - ETA: 1s - loss: 0.0024 18/224 [=>............................] - ETA: 0s - loss: 4.6182e-04 32/224 [===>..........................] - ETA: 0s - loss: 0.0431  48/224 [=====>........................] - ETA: 0s - loss: 0.0289 71/224 [========>.....................] - ETA: 0s - loss: 0.0199 92/224 [===========>..................] - ETA: 0s - loss: 0.0161 108/224 [=============>................] - ETA: 0s - loss: 0.0196 124/224 [===============>..............] - ETA: 0s - loss: 0.0209 139/224 [=================>............] - ETA: 0s - loss: 0.0187 162/224 [====================>.........] - ETA: 0s - loss: 0.0161 181/224 [=======================>......] - ETA: 0s - loss: 0.0173 199/224 [=========================>....] - ETA: 0s - loss: 0.0158 217/224 [============================>.] - ETA: 0s - loss: 0.0147 224/224 [==============================] - 1s 3ms/step - loss: 0.0142 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 0.0071 18/224 [=>............................] - ETA: 0s - loss: 0.0029 38/224 [====>.........................] - ETA: 0s - loss: 0.0015 66/224 [=======>......................] - ETA: 0s - loss: 9.7510e-04 91/224 [===========>..................] - ETA: 0s - loss: 8.8058e-04 118/224 [==============>...............] - ETA: 0s - loss: 7.3612e-04 147/224 [==================>...........] - ETA: 0s - loss: 6.9923e-04 179/224 [======================>.......] - ETA: 0s - loss: 0.0030  208/224 [==========================>...] - ETA: 0s - loss: 0.0071 224/224 [==============================] - 0s 2ms/step - loss: 0.0091 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 3.3457e-04 29/224 [==>...........................] - ETA: 0s - loss: 0.0045  58/224 [======>.......................] - ETA: 0s - loss: 0.0028 90/224 [===========>..................] - ETA: 0s - loss: 0.0056 126/224 [===============>..............] - ETA: 0s - loss: 0.0042 160/224 [====================>.........] - ETA: 0s - loss: 0.0046 195/224 [=========================>....] - ETA: 0s - loss: 0.0039 224/224 [==============================] - 0s 2ms/step - loss: 0.0063 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 0.0053 36/224 [===>..........................] - ETA: 0s - loss: 0.0075 72/224 [========>.....................] - ETA: 0s - loss: 0.0052 105/224 [=============>................] - ETA: 0s - loss: 0.0040 137/224 [=================>............] - ETA: 0s - loss: 0.0033 168/224 [=====================>........] - ETA: 0s - loss: 0.0028 205/224 [==========================>...] - ETA: 0s - loss: 0.0033 224/224 [==============================] - 0s 1ms/step - loss: 0.0035 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 2.4396e-04 34/224 [===>..........................] - ETA: 0s - loss: 0.0012  66/224 [=======>......................] - ETA: 0s - loss: 0.0024 94/224 [===========>..................] - ETA: 0s - loss: 0.0020 126/224 [===============>..............] - ETA: 0s - loss: 0.0024 161/224 [====================>.........] - ETA: 0s - loss: 0.0023 198/224 [=========================>....] - ETA: 0s - loss: 0.0026 224/224 [==============================] - 0s 2ms/step - loss: 0.0025 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 1.0340e-04 36/224 [===>..........................] - ETA: 0s - loss: 2.4056e-04 71/224 [========>.....................] - ETA: 0s - loss: 2.9628e-04 108/224 [=============>................] - ETA: 0s - loss: 3.6561e-04 142/224 [==================>...........] - ETA: 0s - loss: 0.0010  178/224 [======================>.......] - ETA: 0s - loss: 0.0014 212/224 [===========================>..] - ETA: 0s - loss: 0.0016 224/224 [==============================] - 0s 1ms/step - loss: 0.0016 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 2.1283e-04 37/224 [===>..........................] - ETA: 0s - loss: 0.0021  72/224 [========>.....................] - ETA: 0s - loss: 0.0015 105/224 [=============>................] - ETA: 0s - loss: 0.0017 139/224 [=================>............] - ETA: 0s - loss: 0.0014 173/224 [======================>.......] - ETA: 0s - loss: 0.0013 208/224 [==========================>...] - ETA: 0s - loss: 0.0011 224/224 [==============================] - 0s 1ms/step - loss: 0.0011 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 7.5997e-06 42/224 [====>.........................] - ETA: 0s - loss: 0.0021  78/224 [=========>....................] - ETA: 0s - loss: 0.0013 113/224 [==============>...............] - ETA: 0s - loss: 0.0011 147/224 [==================>...........] - ETA: 0s - loss: 9.8190e-04 183/224 [=======================>......] - ETA: 0s - loss: 0.0013  219/224 [============================>.] - ETA: 0s - loss: 0.0012 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 3, 18 GAN f1 score: 0.923 GAN cohens kappa score: 0.920 -> test with 'LR' LR tn, fp: 543, 17 LR fn, tp: 1, 20 LR f1 score: 0.690 LR cohens kappa score: 0.675 LR average precision score: 0.886 -> test with 'RF' RF tn, fp: 559, 1 RF fn, tp: 2, 19 RF f1 score: 0.927 RF cohens kappa score: 0.924 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 2, 19 GB f1 score: 0.950 GB cohens kappa score: 0.948 -> test with 'KNN' KNN tn, fp: 552, 8 KNN fn, tp: 0, 21 KNN f1 score: 0.840 KNN cohens kappa score: 0.833 ------ Step 3/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 46s - loss: 4.1370e-14 42/224 [====>.........................] - ETA: 0s - loss: 0.0190  84/224 [==========>...................] - ETA: 0s - loss: 0.0368 126/224 [===============>..............] - ETA: 0s - loss: 0.0452 165/224 [=====================>........] - ETA: 0s - loss: 0.0544 202/224 [==========================>...] - ETA: 0s - loss: 0.0451 224/224 [==============================] - 0s 1ms/step - loss: 0.0419 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 7.2083e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0303  80/224 [=========>....................] - ETA: 0s - loss: 0.0158 120/224 [===============>..............] - ETA: 0s - loss: 0.0296 161/224 [====================>.........] - ETA: 0s - loss: 0.0250 200/224 [=========================>....] - ETA: 0s - loss: 0.0210 224/224 [==============================] - 0s 1ms/step - loss: 0.0188 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.1913e-05 41/224 [====>.........................] - ETA: 0s - loss: 9.3796e-04 81/224 [=========>....................] - ETA: 0s - loss: 0.0079  122/224 [===============>..............] - ETA: 0s - loss: 0.0093 162/224 [====================>.........] - ETA: 0s - loss: 0.0077 203/224 [==========================>...] - ETA: 0s - loss: 0.0071 224/224 [==============================] - 0s 1ms/step - loss: 0.0065 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 3.6913e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0035  82/224 [=========>....................] - ETA: 0s - loss: 0.0028 119/224 [==============>...............] - ETA: 0s - loss: 0.0025 156/224 [===================>..........] - ETA: 0s - loss: 0.0025 191/224 [========================>.....] - ETA: 0s - loss: 0.0021 224/224 [==============================] - 0s 1ms/step - loss: 0.0020 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 3.1650e-07 41/224 [====>.........................] - ETA: 0s - loss: 0.0032  82/224 [=========>....................] - ETA: 0s - loss: 0.0025 124/224 [===============>..............] - ETA: 0s - loss: 0.0026 165/224 [=====================>........] - ETA: 0s - loss: 0.0022 206/224 [==========================>...] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.0469e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0032  82/224 [=========>....................] - ETA: 0s - loss: 0.0017 123/224 [===============>..............] - ETA: 0s - loss: 0.0020 164/224 [====================>.........] - ETA: 0s - loss: 0.0015 205/224 [==========================>...] - ETA: 0s - loss: 0.0012 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 1.8922e-04 42/224 [====>.........................] - ETA: 0s - loss: 5.1385e-04 83/224 [==========>...................] - ETA: 0s - loss: 8.1387e-04 123/224 [===============>..............] - ETA: 0s - loss: 6.3978e-04 163/224 [====================>.........] - ETA: 0s - loss: 8.7495e-04 204/224 [==========================>...] - ETA: 0s - loss: 7.3975e-04 224/224 [==============================] - 0s 1ms/step - loss: 6.8044e-04 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 3.2144e-08 42/224 [====>.........................] - ETA: 0s - loss: 3.3099e-04 83/224 [==========>...................] - ETA: 0s - loss: 3.6912e-04 124/224 [===============>..............] - ETA: 0s - loss: 7.2798e-04 166/224 [=====================>........] - ETA: 0s - loss: 7.3588e-04 205/224 [==========================>...] - ETA: 0s - loss: 6.2182e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.7711e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.0327e-04 42/224 [====>.........................] - ETA: 0s - loss: 4.0178e-04 83/224 [==========>...................] - ETA: 0s - loss: 3.5399e-04 123/224 [===============>..............] - ETA: 0s - loss: 5.5476e-04 162/224 [====================>.........] - ETA: 0s - loss: 4.9938e-04 203/224 [==========================>...] - ETA: 0s - loss: 6.9180e-04 224/224 [==============================] - 0s 1ms/step - loss: 7.1844e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 8.3345e-09 41/224 [====>.........................] - ETA: 0s - loss: 3.9003e-04 82/224 [=========>....................] - ETA: 0s - loss: 6.3359e-04 124/224 [===============>..............] - ETA: 0s - loss: 5.1418e-04 163/224 [====================>.........] - ETA: 0s - loss: 6.7991e-04 203/224 [==========================>...] - ETA: 0s - loss: 6.0880e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.9442e-04 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 546, 14 LR fn, tp: 1, 20 LR f1 score: 0.727 LR cohens kappa score: 0.715 LR average precision score: 0.946 -> test with 'RF' RF tn, fp: 559, 1 RF fn, tp: 1, 20 RF f1 score: 0.952 RF cohens kappa score: 0.951 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 1, 20 GB f1 score: 0.952 GB cohens kappa score: 0.951 -> test with 'KNN' KNN tn, fp: 556, 4 KNN fn, tp: 0, 21 KNN f1 score: 0.913 KNN cohens kappa score: 0.909 ------ Step 3/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2156 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 35s - loss: 2.5245e-11 42/224 [====>.........................] - ETA: 0s - loss: 0.0593  79/224 [=========>....................] - ETA: 0s - loss: 0.0595 118/224 [==============>...............] - ETA: 0s - loss: 0.0421 159/224 [====================>.........] - ETA: 0s - loss: 0.0354 198/224 [=========================>....] - ETA: 0s - loss: 0.0402 224/224 [==============================] - 0s 1ms/step - loss: 0.0390 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 7.2287e-05 39/224 [====>.........................] - ETA: 0s - loss: 0.0131  83/224 [==========>...................] - ETA: 0s - loss: 0.0135 126/224 [===============>..............] - ETA: 0s - loss: 0.0130 170/224 [=====================>........] - ETA: 0s - loss: 0.0108 212/224 [===========================>..] - ETA: 0s - loss: 0.0141 224/224 [==============================] - 0s 1ms/step - loss: 0.0137 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 0.0012 45/224 [=====>........................] - ETA: 0s - loss: 0.0015 88/224 [==========>...................] - ETA: 0s - loss: 0.0059 131/224 [================>.............] - ETA: 0s - loss: 0.0071 175/224 [======================>.......] - ETA: 0s - loss: 0.0060 219/224 [============================>.] - ETA: 0s - loss: 0.0077 224/224 [==============================] - 0s 1ms/step - loss: 0.0076 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 2.8173e-04 43/224 [====>.........................] - ETA: 0s - loss: 0.0037  86/224 [==========>...................] - ETA: 0s - loss: 0.0083 130/224 [================>.............] - ETA: 0s - loss: 0.0061 174/224 [======================>.......] - ETA: 0s - loss: 0.0060 218/224 [============================>.] - ETA: 0s - loss: 0.0057 224/224 [==============================] - 0s 1ms/step - loss: 0.0058 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 7.4270e-04 45/224 [=====>........................] - ETA: 0s - loss: 0.0024  87/224 [==========>...................] - ETA: 0s - loss: 0.0066 124/224 [===============>..............] - ETA: 0s - loss: 0.0057 167/224 [=====================>........] - ETA: 0s - loss: 0.0050 211/224 [===========================>..] - ETA: 0s - loss: 0.0044 224/224 [==============================] - 0s 1ms/step - loss: 0.0042 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 5.5732e-04 37/224 [===>..........................] - ETA: 0s - loss: 0.0046  76/224 [=========>....................] - ETA: 0s - loss: 0.0033 116/224 [==============>...............] - ETA: 0s - loss: 0.0052 157/224 [====================>.........] - ETA: 0s - loss: 0.0047 200/224 [=========================>....] - ETA: 0s - loss: 0.0040 224/224 [==============================] - 0s 1ms/step - loss: 0.0039 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0017 46/224 [=====>........................] - ETA: 0s - loss: 0.0069 90/224 [===========>..................] - ETA: 0s - loss: 0.0042 134/224 [================>.............] - ETA: 0s - loss: 0.0039 175/224 [======================>.......] - ETA: 0s - loss: 0.0035 219/224 [============================>.] - ETA: 0s - loss: 0.0029 224/224 [==============================] - 0s 1ms/step - loss: 0.0028 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 6.6300e-11 45/224 [=====>........................] - ETA: 0s - loss: 0.0016  89/224 [==========>...................] - ETA: 0s - loss: 0.0012 133/224 [================>.............] - ETA: 0s - loss: 0.0014 175/224 [======================>.......] - ETA: 0s - loss: 0.0031 219/224 [============================>.] - ETA: 0s - loss: 0.0029 224/224 [==============================] - 0s 1ms/step - loss: 0.0028 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.2688e-06 45/224 [=====>........................] - ETA: 0s - loss: 8.4632e-04 89/224 [==========>...................] - ETA: 0s - loss: 0.0011  133/224 [================>.............] - ETA: 0s - loss: 0.0013 176/224 [======================>.......] - ETA: 0s - loss: 0.0012 220/224 [============================>.] - ETA: 0s - loss: 0.0024 224/224 [==============================] - 0s 1ms/step - loss: 0.0023 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 1.3466e-04 44/224 [====>.........................] - ETA: 0s - loss: 0.0028  87/224 [==========>...................] - ETA: 0s - loss: 0.0016 131/224 [================>.............] - ETA: 0s - loss: 0.0036 174/224 [======================>.......] - ETA: 0s - loss: 0.0030 218/224 [============================>.] - ETA: 0s - loss: 0.0029 224/224 [==============================] - 0s 1ms/step - loss: 0.0028 -> test with GAN.predict GAN tn, fp: 553, 3 GAN fn, tp: 0, 21 GAN f1 score: 0.933 GAN cohens kappa score: 0.931 -> test with 'LR' LR tn, fp: 538, 18 LR fn, tp: 0, 21 LR f1 score: 0.700 LR cohens kappa score: 0.685 LR average precision score: 0.957 -> test with 'RF' RF tn, fp: 555, 1 RF fn, tp: 0, 21 RF f1 score: 0.977 RF cohens kappa score: 0.976 -> test with 'GB' GB tn, fp: 555, 1 GB fn, tp: 0, 21 GB f1 score: 0.977 GB cohens kappa score: 0.976 -> test with 'KNN' KNN tn, fp: 546, 10 KNN fn, tp: 0, 21 KNN f1 score: 0.808 KNN cohens kappa score: 0.799 ====== Step 4/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 4/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 45s - loss: 1.0530e-10 35/224 [===>..........................] - ETA: 0s - loss: 0.0788  71/224 [========>.....................] - ETA: 0s - loss: 0.0541 111/224 [=============>................] - ETA: 0s - loss: 0.0393 147/224 [==================>...........] - ETA: 0s - loss: 0.0403 186/224 [=======================>......] - ETA: 0s - loss: 0.0391 224/224 [==============================] - 1s 1ms/step - loss: 0.0393 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 0.0018 41/224 [====>.........................] - ETA: 0s - loss: 1.3577e-04 78/224 [=========>....................] - ETA: 0s - loss: 0.0224  117/224 [==============>...............] - ETA: 0s - loss: 0.0310 152/224 [===================>..........] - ETA: 0s - loss: 0.0240 186/224 [=======================>......] - ETA: 0s - loss: 0.0277 221/224 [============================>.] - ETA: 0s - loss: 0.0246 224/224 [==============================] - 0s 1ms/step - loss: 0.0243 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 6.5893e-09 36/224 [===>..........................] - ETA: 0s - loss: 0.0546  75/224 [=========>....................] - ETA: 0s - loss: 0.0468 114/224 [==============>...............] - ETA: 0s - loss: 0.0346 155/224 [===================>..........] - ETA: 0s - loss: 0.0275 191/224 [========================>.....] - ETA: 0s - loss: 0.0232 224/224 [==============================] - 0s 1ms/step - loss: 0.0198 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 1.1716e-04 42/224 [====>.........................] - ETA: 0s - loss: 0.0032  85/224 [==========>...................] - ETA: 0s - loss: 0.0017 125/224 [===============>..............] - ETA: 0s - loss: 0.0079 166/224 [=====================>........] - ETA: 0s - loss: 0.0139 206/224 [==========================>...] - ETA: 0s - loss: 0.0164 224/224 [==============================] - 0s 1ms/step - loss: 0.0151 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 8.7533e-08 40/224 [====>.........................] - ETA: 0s - loss: 2.5173e-04 78/224 [=========>....................] - ETA: 0s - loss: 0.0010  114/224 [==============>...............] - ETA: 0s - loss: 0.0074 149/224 [==================>...........] - ETA: 0s - loss: 0.0095 181/224 [=======================>......] - ETA: 0s - loss: 0.0133 220/224 [============================>.] - ETA: 0s - loss: 0.0120 224/224 [==============================] - 0s 1ms/step - loss: 0.0118 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.8781e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0134  82/224 [=========>....................] - ETA: 0s - loss: 0.0094 121/224 [===============>..............] - ETA: 0s - loss: 0.0095 162/224 [====================>.........] - ETA: 0s - loss: 0.0131 202/224 [==========================>...] - ETA: 0s - loss: 0.0108 224/224 [==============================] - 0s 1ms/step - loss: 0.0104 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 8.5527e-04 42/224 [====>.........................] - ETA: 0s - loss: 6.5404e-04 83/224 [==========>...................] - ETA: 0s - loss: 0.0109  124/224 [===============>..............] - ETA: 0s - loss: 0.0076 165/224 [=====================>........] - ETA: 0s - loss: 0.0095 204/224 [==========================>...] - ETA: 0s - loss: 0.0093 224/224 [==============================] - 0s 1ms/step - loss: 0.0086 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 8.0254e-04 41/224 [====>.........................] - ETA: 0s - loss: 5.6022e-04 81/224 [=========>....................] - ETA: 0s - loss: 0.0038  122/224 [===============>..............] - ETA: 0s - loss: 0.0051 162/224 [====================>.........] - ETA: 0s - loss: 0.0053 203/224 [==========================>...] - ETA: 0s - loss: 0.0060 224/224 [==============================] - 0s 1ms/step - loss: 0.0068 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 4.8820e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0081  81/224 [=========>....................] - ETA: 0s - loss: 0.0070 122/224 [===============>..............] - ETA: 0s - loss: 0.0076 160/224 [====================>.........] - ETA: 0s - loss: 0.0062 197/224 [=========================>....] - ETA: 0s - loss: 0.0062 224/224 [==============================] - 0s 1ms/step - loss: 0.0055 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 9.0390e-04 39/224 [====>.........................] - ETA: 0s - loss: 0.0092  79/224 [=========>....................] - ETA: 0s - loss: 0.0069 122/224 [===============>..............] - ETA: 0s - loss: 0.0058 164/224 [====================>.........] - ETA: 0s - loss: 0.0051 204/224 [==========================>...] - ETA: 0s - loss: 0.0060 224/224 [==============================] - 0s 1ms/step - loss: 0.0055 -> test with GAN.predict GAN tn, fp: 557, 3 GAN fn, tp: 0, 21 GAN f1 score: 0.933 GAN cohens kappa score: 0.931 -> test with 'LR' LR tn, fp: 548, 12 LR fn, tp: 1, 20 LR f1 score: 0.755 LR cohens kappa score: 0.744 LR average precision score: 0.934 -> test with 'RF' RF tn, fp: 558, 2 RF fn, tp: 0, 21 RF f1 score: 0.955 RF cohens kappa score: 0.953 -> test with 'GB' GB tn, fp: 558, 2 GB fn, tp: 1, 20 GB f1 score: 0.930 GB cohens kappa score: 0.928 -> test with 'KNN' KNN tn, fp: 551, 9 KNN fn, tp: 0, 21 KNN f1 score: 0.824 KNN cohens kappa score: 0.816 ------ Step 4/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 50s - loss: 8.9630e-15 39/224 [====>.........................] - ETA: 0s - loss: 0.0466  80/224 [=========>....................] - ETA: 0s - loss: 0.0599 119/224 [==============>...............] - ETA: 0s - loss: 0.0470 160/224 [====================>.........] - ETA: 0s - loss: 0.0516 200/224 [=========================>....] - ETA: 0s - loss: 0.0421 224/224 [==============================] - 1s 1ms/step - loss: 0.0381 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 2.3993e-07 42/224 [====>.........................] - ETA: 0s - loss: 0.0310  82/224 [=========>....................] - ETA: 0s - loss: 0.0292 123/224 [===============>..............] - ETA: 0s - loss: 0.0264 164/224 [====================>.........] - ETA: 0s - loss: 0.0200 204/224 [==========================>...] - ETA: 0s - loss: 0.0185 224/224 [==============================] - 0s 1ms/step - loss: 0.0169 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 0.0013 41/224 [====>.........................] - ETA: 0s - loss: 1.6480e-04 82/224 [=========>....................] - ETA: 0s - loss: 0.0096  122/224 [===============>..............] - ETA: 0s - loss: 0.0206 161/224 [====================>.........] - ETA: 0s - loss: 0.0157 201/224 [=========================>....] - ETA: 0s - loss: 0.0131 224/224 [==============================] - 0s 1ms/step - loss: 0.0119 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 1.9410e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0260  83/224 [==========>...................] - ETA: 0s - loss: 0.0168 124/224 [===============>..............] - ETA: 0s - loss: 0.0118 164/224 [====================>.........] - ETA: 0s - loss: 0.0090 204/224 [==========================>...] - ETA: 0s - loss: 0.0074 224/224 [==============================] - 0s 1ms/step - loss: 0.0070 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 2.2879e-07 41/224 [====>.........................] - ETA: 0s - loss: 9.0878e-04 83/224 [==========>...................] - ETA: 0s - loss: 0.0075  124/224 [===============>..............] - ETA: 0s - loss: 0.0060 160/224 [====================>.........] - ETA: 0s - loss: 0.0059 192/224 [========================>.....] - ETA: 0s - loss: 0.0051 223/224 [============================>.] - ETA: 0s - loss: 0.0044 224/224 [==============================] - 0s 1ms/step - loss: 0.0044 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 2.2050e-04 41/224 [====>.........................] - ETA: 0s - loss: 2.9053e-04 80/224 [=========>....................] - ETA: 0s - loss: 0.0015  121/224 [===============>..............] - ETA: 0s - loss: 0.0024 161/224 [====================>.........] - ETA: 0s - loss: 0.0022 200/224 [=========================>....] - ETA: 0s - loss: 0.0023 224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 6.1545e-05 42/224 [====>.........................] - ETA: 0s - loss: 0.0016  83/224 [==========>...................] - ETA: 0s - loss: 0.0011 124/224 [===============>..............] - ETA: 0s - loss: 0.0011 162/224 [====================>.........] - ETA: 0s - loss: 0.0015 199/224 [=========================>....] - ETA: 0s - loss: 0.0012 224/224 [==============================] - 0s 1ms/step - loss: 0.0012 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 6.2652e-05 38/224 [====>.........................] - ETA: 0s - loss: 6.1318e-04 76/224 [=========>....................] - ETA: 0s - loss: 8.5213e-04 116/224 [==============>...............] - ETA: 0s - loss: 7.3959e-04 157/224 [====================>.........] - ETA: 0s - loss: 8.8534e-04 197/224 [=========================>....] - ETA: 0s - loss: 7.6925e-04 224/224 [==============================] - 0s 1ms/step - loss: 7.6886e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 8.0312e-05 41/224 [====>.........................] - ETA: 0s - loss: 0.0010  82/224 [=========>....................] - ETA: 0s - loss: 7.2081e-04 120/224 [===============>..............] - ETA: 0s - loss: 7.1472e-04 161/224 [====================>.........] - ETA: 0s - loss: 6.1871e-04 197/224 [=========================>....] - ETA: 0s - loss: 5.3970e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.2807e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 1.7552e-08 42/224 [====>.........................] - ETA: 0s - loss: 2.1574e-04 82/224 [=========>....................] - ETA: 0s - loss: 2.0972e-04 123/224 [===============>..............] - ETA: 0s - loss: 1.9061e-04 164/224 [====================>.........] - ETA: 0s - loss: 2.0756e-04 205/224 [==========================>...] - ETA: 0s - loss: 2.1984e-04 224/224 [==============================] - 0s 1ms/step - loss: 3.5830e-04 -> test with GAN.predict GAN tn, fp: 559, 1 GAN fn, tp: 1, 20 GAN f1 score: 0.952 GAN cohens kappa score: 0.951 -> test with 'LR' LR tn, fp: 543, 17 LR fn, tp: 0, 21 LR f1 score: 0.712 LR cohens kappa score: 0.698 LR average precision score: 0.973 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 0, 21 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 0, 21 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 551, 9 KNN fn, tp: 0, 21 KNN f1 score: 0.824 KNN cohens kappa score: 0.816 ------ Step 4/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 41s - loss: 1.9106e-10 35/224 [===>..........................] - ETA: 0s - loss: 0.0063  70/224 [========>.....................] - ETA: 0s - loss: 0.0219 104/224 [============>.................] - ETA: 0s - loss: 0.0295 143/224 [==================>...........] - ETA: 0s - loss: 0.0275 184/224 [=======================>......] - ETA: 0s - loss: 0.0215 223/224 [============================>.] - ETA: 0s - loss: 0.0177 224/224 [==============================] - 0s 1ms/step - loss: 0.0177 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 5.6291e-11 37/224 [===>..........................] - ETA: 0s - loss: 5.5039e-04 70/224 [========>.....................] - ETA: 0s - loss: 3.7497e-04 105/224 [=============>................] - ETA: 0s - loss: 0.0073  147/224 [==================>...........] - ETA: 0s - loss: 0.0053 188/224 [========================>.....] - ETA: 0s - loss: 0.0041 224/224 [==============================] - 0s 1ms/step - loss: 0.0062 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.9407e-06 42/224 [====>.........................] - ETA: 0s - loss: 7.4270e-04 82/224 [=========>....................] - ETA: 0s - loss: 3.9515e-04 121/224 [===============>..............] - ETA: 0s - loss: 6.7528e-04 156/224 [===================>..........] - ETA: 0s - loss: 0.0016  196/224 [=========================>....] - ETA: 0s - loss: 0.0013 224/224 [==============================] - 0s 1ms/step - loss: 0.0011 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 1.6063e-04 42/224 [====>.........................] - ETA: 0s - loss: 1.3680e-05 82/224 [=========>....................] - ETA: 0s - loss: 1.1006e-05 123/224 [===============>..............] - ETA: 0s - loss: 4.7995e-05 164/224 [====================>.........] - ETA: 0s - loss: 1.6765e-04 206/224 [==========================>...] - ETA: 0s - loss: 2.3512e-04 224/224 [==============================] - 0s 1ms/step - loss: 2.1996e-04 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 6.7789e-15 41/224 [====>.........................] - ETA: 0s - loss: 9.1729e-06 83/224 [==========>...................] - ETA: 0s - loss: 1.6985e-05 122/224 [===============>..............] - ETA: 0s - loss: 1.2746e-05 161/224 [====================>.........] - ETA: 0s - loss: 9.9915e-05 203/224 [==========================>...] - ETA: 0s - loss: 1.0833e-04 224/224 [==============================] - 0s 1ms/step - loss: 1.0006e-04 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 1.8326e-07 43/224 [====>.........................] - ETA: 0s - loss: 3.2785e-05 83/224 [==========>...................] - ETA: 0s - loss: 3.7022e-05 125/224 [===============>..............] - ETA: 0s - loss: 3.7952e-05 166/224 [=====================>........] - ETA: 0s - loss: 4.0952e-05 206/224 [==========================>...] - ETA: 0s - loss: 5.0158e-05 224/224 [==============================] - 0s 1ms/step - loss: 4.9630e-05 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 5.4607e-10 41/224 [====>.........................] - ETA: 0s - loss: 5.6637e-05 82/224 [=========>....................] - ETA: 0s - loss: 4.6443e-05 122/224 [===============>..............] - ETA: 0s - loss: 3.5633e-05 163/224 [====================>.........] - ETA: 0s - loss: 3.2731e-05 204/224 [==========================>...] - ETA: 0s - loss: 4.7301e-05 224/224 [==============================] - 0s 1ms/step - loss: 4.4028e-05 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 3.7400e-05 41/224 [====>.........................] - ETA: 0s - loss: 4.5030e-05 80/224 [=========>....................] - ETA: 0s - loss: 4.5729e-05 121/224 [===============>..............] - ETA: 0s - loss: 4.3593e-05 157/224 [====================>.........] - ETA: 0s - loss: 3.7417e-05 190/224 [========================>.....] - ETA: 0s - loss: 3.7068e-05 224/224 [==============================] - 0s 1ms/step - loss: 4.0017e-05 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.5524e-08 40/224 [====>.........................] - ETA: 0s - loss: 2.8078e-05 77/224 [=========>....................] - ETA: 0s - loss: 3.3415e-05 117/224 [==============>...............] - ETA: 0s - loss: 2.7406e-05 158/224 [====================>.........] - ETA: 0s - loss: 2.7830e-05 199/224 [=========================>....] - ETA: 0s - loss: 3.7210e-05 224/224 [==============================] - 0s 1ms/step - loss: 3.6449e-05 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 2.8370e-11 41/224 [====>.........................] - ETA: 0s - loss: 6.4753e-05 82/224 [=========>....................] - ETA: 0s - loss: 4.9259e-05 124/224 [===============>..............] - ETA: 0s - loss: 4.0065e-05 164/224 [====================>.........] - ETA: 0s - loss: 4.2141e-05 203/224 [==========================>...] - ETA: 0s - loss: 3.4770e-05 224/224 [==============================] - 0s 1ms/step - loss: 3.3280e-05 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 6, 15 GAN f1 score: 0.833 GAN cohens kappa score: 0.828 -> test with 'LR' LR tn, fp: 548, 12 LR fn, tp: 4, 17 LR f1 score: 0.680 LR cohens kappa score: 0.666 LR average precision score: 0.830 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 4, 17 RF f1 score: 0.895 RF cohens kappa score: 0.891 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 3, 18 GB f1 score: 0.923 GB cohens kappa score: 0.920 -> test with 'KNN' KNN tn, fp: 552, 8 KNN fn, tp: 1, 20 KNN f1 score: 0.816 KNN cohens kappa score: 0.808 ------ Step 4/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 48s - loss: 5.1064e-11 35/224 [===>..........................] - ETA: 0s - loss: 0.0809  74/224 [========>.....................] - ETA: 0s - loss: 0.0850 112/224 [==============>...............] - ETA: 0s - loss: 0.0597 153/224 [===================>..........] - ETA: 0s - loss: 0.0461 194/224 [========================>.....] - ETA: 0s - loss: 0.0482 224/224 [==============================] - 1s 1ms/step - loss: 0.0422 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 9.7940e-07 41/224 [====>.........................] - ETA: 0s - loss: 0.0127  82/224 [=========>....................] - ETA: 0s - loss: 0.0185 123/224 [===============>..............] - ETA: 0s - loss: 0.0195 164/224 [====================>.........] - ETA: 0s - loss: 0.0148 205/224 [==========================>...] - ETA: 0s - loss: 0.0120 224/224 [==============================] - 0s 1ms/step - loss: 0.0111 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.2234e-07 40/224 [====>.........................] - ETA: 0s - loss: 0.0137  79/224 [=========>....................] - ETA: 0s - loss: 0.0128 118/224 [==============>...............] - ETA: 0s - loss: 0.0088 159/224 [====================>.........] - ETA: 0s - loss: 0.0067 199/224 [=========================>....] - ETA: 0s - loss: 0.0056 224/224 [==============================] - 0s 1ms/step - loss: 0.0050 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 4.5406e-06 41/224 [====>.........................] - ETA: 0s - loss: 0.0029  79/224 [=========>....................] - ETA: 0s - loss: 0.0032 116/224 [==============>...............] - ETA: 0s - loss: 0.0041 153/224 [===================>..........] - ETA: 0s - loss: 0.0037 192/224 [========================>.....] - ETA: 0s - loss: 0.0047 224/224 [==============================] - 0s 1ms/step - loss: 0.0042 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 2.3252e-11 42/224 [====>.........................] - ETA: 0s - loss: 2.3006e-04 82/224 [=========>....................] - ETA: 0s - loss: 5.5247e-04 122/224 [===============>..............] - ETA: 0s - loss: 6.0715e-04 160/224 [====================>.........] - ETA: 0s - loss: 8.5231e-04 201/224 [=========================>....] - ETA: 0s - loss: 0.0012  224/224 [==============================] - 0s 1ms/step - loss: 0.0026 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 5.6127e-04 41/224 [====>.........................] - ETA: 0s - loss: 2.2473e-04 81/224 [=========>....................] - ETA: 0s - loss: 6.6365e-04 121/224 [===============>..............] - ETA: 0s - loss: 8.5650e-04 161/224 [====================>.........] - ETA: 0s - loss: 0.0012  202/224 [==========================>...] - ETA: 0s - loss: 0.0014 224/224 [==============================] - 0s 1ms/step - loss: 0.0022 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0070 42/224 [====>.........................] - ETA: 0s - loss: 0.0071 84/224 [==========>...................] - ETA: 0s - loss: 0.0044 127/224 [================>.............] - ETA: 0s - loss: 0.0029 170/224 [=====================>........] - ETA: 0s - loss: 0.0027 210/224 [===========================>..] - ETA: 0s - loss: 0.0024 224/224 [==============================] - 0s 1ms/step - loss: 0.0023 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 2.1749e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0017  74/224 [========>.....................] - ETA: 0s - loss: 0.0011 107/224 [=============>................] - ETA: 0s - loss: 8.8471e-04 142/224 [==================>...........] - ETA: 0s - loss: 8.8432e-04 183/224 [=======================>......] - ETA: 0s - loss: 0.0018  224/224 [==============================] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.5082e-05 40/224 [====>.........................] - ETA: 0s - loss: 0.0011  74/224 [========>.....................] - ETA: 0s - loss: 6.6751e-04 115/224 [==============>...............] - ETA: 0s - loss: 9.7059e-04 155/224 [===================>..........] - ETA: 0s - loss: 9.7898e-04 195/224 [=========================>....] - ETA: 0s - loss: 8.1106e-04 224/224 [==============================] - 0s 1ms/step - loss: 0.0015 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 0.0245 42/224 [====>.........................] - ETA: 0s - loss: 0.0030 83/224 [==========>...................] - ETA: 0s - loss: 0.0016 124/224 [===============>..............] - ETA: 0s - loss: 0.0012 165/224 [=====================>........] - ETA: 0s - loss: 0.0011 204/224 [==========================>...] - ETA: 0s - loss: 0.0012 224/224 [==============================] - 0s 1ms/step - loss: 0.0011 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 545, 15 LR fn, tp: 0, 21 LR f1 score: 0.737 LR cohens kappa score: 0.724 LR average precision score: 0.952 -> test with 'RF' RF tn, fp: 559, 1 RF fn, tp: 1, 20 RF f1 score: 0.952 RF cohens kappa score: 0.951 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 1, 20 GB f1 score: 0.952 GB cohens kappa score: 0.951 -> test with 'KNN' KNN tn, fp: 555, 5 KNN fn, tp: 1, 20 KNN f1 score: 0.870 KNN cohens kappa score: 0.864 ------ Step 4/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2156 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 38s - loss: 0.3814 43/224 [====>.........................] - ETA: 0s - loss: 0.0564  85/224 [==========>...................] - ETA: 0s - loss: 0.0481 125/224 [===============>..............] - ETA: 0s - loss: 0.0330 165/224 [=====================>........] - ETA: 0s - loss: 0.0282 203/224 [==========================>...] - ETA: 0s - loss: 0.0248 224/224 [==============================] - 0s 1ms/step - loss: 0.0246 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.6598e-04 39/224 [====>.........................] - ETA: 0s - loss: 0.0036  81/224 [=========>....................] - ETA: 0s - loss: 0.0064 123/224 [===============>..............] - ETA: 0s - loss: 0.0059 165/224 [=====================>........] - ETA: 0s - loss: 0.0062 206/224 [==========================>...] - ETA: 0s - loss: 0.0051 224/224 [==============================] - 0s 1ms/step - loss: 0.0068 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 4.2412e-06 41/224 [====>.........................] - ETA: 0s - loss: 0.0019  77/224 [=========>....................] - ETA: 0s - loss: 0.0042 111/224 [=============>................] - ETA: 0s - loss: 0.0039 149/224 [==================>...........] - ETA: 0s - loss: 0.0054 191/224 [========================>.....] - ETA: 0s - loss: 0.0044 224/224 [==============================] - 0s 1ms/step - loss: 0.0038 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 5.7375e-10 44/224 [====>.........................] - ETA: 0s - loss: 7.1987e-04 84/224 [==========>...................] - ETA: 0s - loss: 6.5316e-04 125/224 [===============>..............] - ETA: 0s - loss: 0.0014  166/224 [=====================>........] - ETA: 0s - loss: 0.0011 207/224 [==========================>...] - ETA: 0s - loss: 9.4823e-04 224/224 [==============================] - 0s 1ms/step - loss: 8.9172e-04 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 4.7698e-06 42/224 [====>.........................] - ETA: 0s - loss: 0.0020  83/224 [==========>...................] - ETA: 0s - loss: 0.0014 124/224 [===============>..............] - ETA: 0s - loss: 0.0011 165/224 [=====================>........] - ETA: 0s - loss: 0.0012 207/224 [==========================>...] - ETA: 0s - loss: 0.0010 224/224 [==============================] - 0s 1ms/step - loss: 9.4750e-04 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 7.5998e-07 42/224 [====>.........................] - ETA: 0s - loss: 0.0012  82/224 [=========>....................] - ETA: 0s - loss: 9.7051e-04 123/224 [===============>..............] - ETA: 0s - loss: 6.8443e-04 164/224 [====================>.........] - ETA: 0s - loss: 5.4953e-04 204/224 [==========================>...] - ETA: 0s - loss: 4.7181e-04 224/224 [==============================] - 0s 1ms/step - loss: 4.9066e-04 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 6.7185e-04 43/224 [====>.........................] - ETA: 0s - loss: 2.4726e-04 84/224 [==========>...................] - ETA: 0s - loss: 4.9543e-04 125/224 [===============>..............] - ETA: 0s - loss: 7.6842e-04 166/224 [=====================>........] - ETA: 0s - loss: 6.9163e-04 206/224 [==========================>...] - ETA: 0s - loss: 6.0602e-04 224/224 [==============================] - 0s 1ms/step - loss: 6.0541e-04 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 3.7532e-08 43/224 [====>.........................] - ETA: 0s - loss: 1.1504e-04 85/224 [==========>...................] - ETA: 0s - loss: 8.8516e-05 125/224 [===============>..............] - ETA: 0s - loss: 8.9095e-04 165/224 [=====================>........] - ETA: 0s - loss: 7.3884e-04 203/224 [==========================>...] - ETA: 0s - loss: 7.0988e-04 224/224 [==============================] - 0s 1ms/step - loss: 6.4972e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.2102e-05 43/224 [====>.........................] - ETA: 0s - loss: 1.8960e-04 81/224 [=========>....................] - ETA: 0s - loss: 9.0607e-04 123/224 [===============>..............] - ETA: 0s - loss: 6.3719e-04 165/224 [=====================>........] - ETA: 0s - loss: 5.1576e-04 205/224 [==========================>...] - ETA: 0s - loss: 4.3802e-04 224/224 [==============================] - 0s 1ms/step - loss: 4.0584e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 6.0944e-09 42/224 [====>.........................] - ETA: 0s - loss: 1.4635e-04 83/224 [==========>...................] - ETA: 0s - loss: 1.4144e-04 124/224 [===============>..............] - ETA: 0s - loss: 1.0296e-04 164/224 [====================>.........] - ETA: 0s - loss: 2.8865e-04 201/224 [=========================>....] - ETA: 0s - loss: 2.5046e-04 224/224 [==============================] - 0s 1ms/step - loss: 2.3648e-04 -> test with GAN.predict GAN tn, fp: 556, 0 GAN fn, tp: 1, 20 GAN f1 score: 0.976 GAN cohens kappa score: 0.975 -> test with 'LR' LR tn, fp: 551, 5 LR fn, tp: 1, 20 LR f1 score: 0.870 LR cohens kappa score: 0.864 LR average precision score: 0.945 -> test with 'RF' RF tn, fp: 556, 0 RF fn, tp: 1, 20 RF f1 score: 0.976 RF cohens kappa score: 0.975 -> test with 'GB' GB tn, fp: 556, 0 GB fn, tp: 2, 19 GB f1 score: 0.950 GB cohens kappa score: 0.948 -> test with 'KNN' KNN tn, fp: 552, 4 KNN fn, tp: 0, 21 KNN f1 score: 0.913 KNN cohens kappa score: 0.909 ====== Step 5/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 5/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 49s - loss: 8.1962e-08 40/224 [====>.........................] - ETA: 0s - loss: 0.0537  79/224 [=========>....................] - ETA: 0s - loss: 0.0371 118/224 [==============>...............] - ETA: 0s - loss: 0.0279 156/224 [===================>..........] - ETA: 0s - loss: 0.0232 194/224 [========================>.....] - ETA: 0s - loss: 0.0190 224/224 [==============================] - 1s 1ms/step - loss: 0.0194 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 2.0847e-04 40/224 [====>.........................] - ETA: 0s - loss: 3.3156e-04 79/224 [=========>....................] - ETA: 0s - loss: 0.0035  118/224 [==============>...............] - ETA: 0s - loss: 0.0025 157/224 [====================>.........] - ETA: 0s - loss: 0.0065 195/224 [=========================>....] - ETA: 0s - loss: 0.0069 224/224 [==============================] - 0s 1ms/step - loss: 0.0060 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.5993e-04 39/224 [====>.........................] - ETA: 0s - loss: 8.7824e-04 78/224 [=========>....................] - ETA: 0s - loss: 0.0066  117/224 [==============>...............] - ETA: 0s - loss: 0.0045 156/224 [===================>..........] - ETA: 0s - loss: 0.0035 194/224 [========================>.....] - ETA: 0s - loss: 0.0028 224/224 [==============================] - 0s 1ms/step - loss: 0.0031 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 4.9413e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0105  78/224 [=========>....................] - ETA: 0s - loss: 0.0056 117/224 [==============>...............] - ETA: 0s - loss: 0.0044 152/224 [===================>..........] - ETA: 0s - loss: 0.0037 189/224 [========================>.....] - ETA: 0s - loss: 0.0030 224/224 [==============================] - ETA: 0s - loss: 0.0026 224/224 [==============================] - 0s 1ms/step - loss: 0.0026 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 2.5210e-09 39/224 [====>.........................] - ETA: 0s - loss: 6.8577e-05 77/224 [=========>....................] - ETA: 0s - loss: 2.3511e-04 117/224 [==============>...............] - ETA: 0s - loss: 7.9320e-04 156/224 [===================>..........] - ETA: 0s - loss: 6.8620e-04 195/224 [=========================>....] - ETA: 0s - loss: 0.0024  224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 3.0732e-10 39/224 [====>.........................] - ETA: 0s - loss: 0.0101  77/224 [=========>....................] - ETA: 0s - loss: 0.0052 111/224 [=============>................] - ETA: 0s - loss: 0.0039 145/224 [==================>...........] - ETA: 0s - loss: 0.0030 179/224 [======================>.......] - ETA: 0s - loss: 0.0025 214/224 [===========================>..] - ETA: 0s - loss: 0.0021 224/224 [==============================] - 0s 1ms/step - loss: 0.0020 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 4.3688e-07 38/224 [====>.........................] - ETA: 0s - loss: 6.8762e-04 76/224 [=========>....................] - ETA: 0s - loss: 4.4792e-04 115/224 [==============>...............] - ETA: 0s - loss: 3.2178e-04 154/224 [===================>..........] - ETA: 0s - loss: 2.7655e-04 192/224 [========================>.....] - ETA: 0s - loss: 0.0015  224/224 [==============================] - 0s 1ms/step - loss: 0.0021 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 1.1856e-04 39/224 [====>.........................] - ETA: 0s - loss: 7.3898e-04 77/224 [=========>....................] - ETA: 0s - loss: 4.0415e-04 114/224 [==============>...............] - ETA: 0s - loss: 0.0033  153/224 [===================>..........] - ETA: 0s - loss: 0.0025 191/224 [========================>.....] - ETA: 0s - loss: 0.0020 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.5573e-04 39/224 [====>.........................] - ETA: 0s - loss: 1.0241e-04 77/224 [=========>....................] - ETA: 0s - loss: 1.3652e-04 115/224 [==============>...............] - ETA: 0s - loss: 2.0805e-04 153/224 [===================>..........] - ETA: 0s - loss: 1.8437e-04 191/224 [========================>.....] - ETA: 0s - loss: 8.3484e-04 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 6.4855e-05 39/224 [====>.........................] - ETA: 0s - loss: 0.0043  77/224 [=========>....................] - ETA: 0s - loss: 0.0025 114/224 [==============>...............] - ETA: 0s - loss: 0.0030 151/224 [===================>..........] - ETA: 0s - loss: 0.0037 190/224 [========================>.....] - ETA: 0s - loss: 0.0030 224/224 [==============================] - 0s 1ms/step - loss: 0.0026 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 2, 19 GAN f1 score: 0.950 GAN cohens kappa score: 0.948 -> test with 'LR' LR tn, fp: 544, 16 LR fn, tp: 0, 21 LR f1 score: 0.724 LR cohens kappa score: 0.711 LR average precision score: 0.979 -> test with 'RF' RF tn, fp: 558, 2 RF fn, tp: 1, 20 RF f1 score: 0.930 RF cohens kappa score: 0.928 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 0, 21 GB f1 score: 0.977 GB cohens kappa score: 0.976 -> test with 'KNN' KNN tn, fp: 552, 8 KNN fn, tp: 1, 20 KNN f1 score: 0.816 KNN cohens kappa score: 0.808 ------ Step 5/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 53s - loss: 3.9335e-09 36/224 [===>..........................] - ETA: 0s - loss: 0.0329  74/224 [========>.....................] - ETA: 0s - loss: 0.0302 109/224 [=============>................] - ETA: 0s - loss: 0.0240 142/224 [==================>...........] - ETA: 0s - loss: 0.0225 173/224 [======================>.......] - ETA: 0s - loss: 0.0185 205/224 [==========================>...] - ETA: 0s - loss: 0.0172 224/224 [==============================] - 1s 1ms/step - loss: 0.0165 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 6.4027e-04 29/224 [==>...........................] - ETA: 0s - loss: 0.0153  61/224 [=======>......................] - ETA: 0s - loss: 0.0075 94/224 [===========>..................] - ETA: 0s - loss: 0.0057 126/224 [===============>..............] - ETA: 0s - loss: 0.0057 155/224 [===================>..........] - ETA: 0s - loss: 0.0053 188/224 [========================>.....] - ETA: 0s - loss: 0.0049 222/224 [============================>.] - ETA: 0s - loss: 0.0044 224/224 [==============================] - 0s 2ms/step - loss: 0.0043 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 4.7933e-06 32/224 [===>..........................] - ETA: 0s - loss: 0.0046  58/224 [======>.......................] - ETA: 0s - loss: 0.0030 90/224 [===========>..................] - ETA: 0s - loss: 0.0037 119/224 [==============>...............] - ETA: 0s - loss: 0.0037 142/224 [==================>...........] - ETA: 0s - loss: 0.0034 172/224 [======================>.......] - ETA: 0s - loss: 0.0030 203/224 [==========================>...] - ETA: 0s - loss: 0.0028 224/224 [==============================] - 0s 2ms/step - loss: 0.0026 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 3.3156e-07 32/224 [===>..........................] - ETA: 0s - loss: 0.0023  67/224 [=======>......................] - ETA: 0s - loss: 0.0019 101/224 [============>.................] - ETA: 0s - loss: 0.0017 135/224 [=================>............] - ETA: 0s - loss: 0.0014 170/224 [=====================>........] - ETA: 0s - loss: 0.0018 203/224 [==========================>...] - ETA: 0s - loss: 0.0020 224/224 [==============================] - 0s 2ms/step - loss: 0.0019 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 8.8280e-06 36/224 [===>..........................] - ETA: 0s - loss: 0.0012  71/224 [========>.....................] - ETA: 0s - loss: 6.9464e-04 103/224 [============>.................] - ETA: 0s - loss: 8.0194e-04 136/224 [=================>............] - ETA: 0s - loss: 7.9696e-04 162/224 [====================>.........] - ETA: 0s - loss: 7.0594e-04 194/224 [========================>.....] - ETA: 0s - loss: 8.6536e-04 224/224 [==============================] - 0s 2ms/step - loss: 0.0014 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 2.1639e-07 35/224 [===>..........................] - ETA: 0s - loss: 7.3483e-04 70/224 [========>.....................] - ETA: 0s - loss: 0.0014  104/224 [============>.................] - ETA: 0s - loss: 0.0013 133/224 [================>.............] - ETA: 0s - loss: 0.0011 168/224 [=====================>........] - ETA: 0s - loss: 9.4731e-04 205/224 [==========================>...] - ETA: 0s - loss: 9.0297e-04 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 4.9580e-04 37/224 [===>..........................] - ETA: 0s - loss: 8.0688e-04 72/224 [========>.....................] - ETA: 0s - loss: 5.2370e-04 108/224 [=============>................] - ETA: 0s - loss: 5.4143e-04 145/224 [==================>...........] - ETA: 0s - loss: 5.0065e-04 181/224 [=======================>......] - ETA: 0s - loss: 9.8617e-04 217/224 [============================>.] - ETA: 0s - loss: 9.1368e-04 224/224 [==============================] - 0s 1ms/step - loss: 8.9296e-04 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 3.4575e-04 38/224 [====>.........................] - ETA: 0s - loss: 0.0020  71/224 [========>.....................] - ETA: 0s - loss: 0.0014 101/224 [============>.................] - ETA: 0s - loss: 0.0010 130/224 [================>.............] - ETA: 0s - loss: 9.5284e-04 162/224 [====================>.........] - ETA: 0s - loss: 8.7669e-04 195/224 [=========================>....] - ETA: 0s - loss: 7.6675e-04 224/224 [==============================] - 0s 2ms/step - loss: 8.2629e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.2017e-06 36/224 [===>..........................] - ETA: 0s - loss: 2.1537e-04 71/224 [========>.....................] - ETA: 0s - loss: 4.2742e-04 107/224 [=============>................] - ETA: 0s - loss: 3.9316e-04 143/224 [==================>...........] - ETA: 0s - loss: 4.1121e-04 179/224 [======================>.......] - ETA: 0s - loss: 5.6796e-04 211/224 [===========================>..] - ETA: 0s - loss: 5.5358e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.8048e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 5.8351e-07 36/224 [===>..........................] - ETA: 0s - loss: 8.4770e-05 74/224 [========>.....................] - ETA: 0s - loss: 2.1589e-04 111/224 [=============>................] - ETA: 0s - loss: 2.9774e-04 148/224 [==================>...........] - ETA: 0s - loss: 5.8832e-04 185/224 [=======================>......] - ETA: 0s - loss: 5.8523e-04 223/224 [============================>.] - ETA: 0s - loss: 5.1172e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.1035e-04 -> test with GAN.predict GAN tn, fp: 558, 2 GAN fn, tp: 2, 19 GAN f1 score: 0.905 GAN cohens kappa score: 0.901 -> test with 'LR' LR tn, fp: 550, 10 LR fn, tp: 1, 20 LR f1 score: 0.784 LR cohens kappa score: 0.775 LR average precision score: 0.936 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 3, 18 RF f1 score: 0.923 RF cohens kappa score: 0.920 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 4, 17 GB f1 score: 0.895 GB cohens kappa score: 0.891 -> test with 'KNN' KNN tn, fp: 555, 5 KNN fn, tp: 1, 20 KNN f1 score: 0.870 KNN cohens kappa score: 0.864 ------ Step 5/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 42s - loss: 0.1334 40/224 [====>.........................] - ETA: 0s - loss: 0.0388  78/224 [=========>....................] - ETA: 0s - loss: 0.0273 118/224 [==============>...............] - ETA: 0s - loss: 0.0188 156/224 [===================>..........] - ETA: 0s - loss: 0.0198 192/224 [========================>.....] - ETA: 0s - loss: 0.0161 224/224 [==============================] - 0s 1ms/step - loss: 0.0151 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 1.1167e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0017  80/224 [=========>....................] - ETA: 0s - loss: 9.9085e-04 119/224 [==============>...............] - ETA: 0s - loss: 8.9338e-04 159/224 [====================>.........] - ETA: 0s - loss: 7.4505e-04 198/224 [=========================>....] - ETA: 0s - loss: 0.0024  224/224 [==============================] - 0s 1ms/step - loss: 0.0022 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 1.0875e-04 40/224 [====>.........................] - ETA: 0s - loss: 2.2011e-04 80/224 [=========>....................] - ETA: 0s - loss: 2.1433e-04 120/224 [===============>..............] - ETA: 0s - loss: 0.0019  162/224 [====================>.........] - ETA: 0s - loss: 0.0022 203/224 [==========================>...] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 6.3002e-06 41/224 [====>.........................] - ETA: 0s - loss: 8.7254e-04 81/224 [=========>....................] - ETA: 0s - loss: 5.8850e-04 120/224 [===============>..............] - ETA: 0s - loss: 5.6940e-04 157/224 [====================>.........] - ETA: 0s - loss: 4.8613e-04 198/224 [=========================>....] - ETA: 0s - loss: 0.0013  224/224 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 6.6373e-04 40/224 [====>.........................] - ETA: 0s - loss: 2.4604e-04 78/224 [=========>....................] - ETA: 0s - loss: 1.9231e-04 118/224 [==============>...............] - ETA: 0s - loss: 2.5225e-04 159/224 [====================>.........] - ETA: 0s - loss: 2.2487e-04 199/224 [=========================>....] - ETA: 0s - loss: 0.0016  224/224 [==============================] - 0s 1ms/step - loss: 0.0014 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 4.7419e-05 41/224 [====>.........................] - ETA: 0s - loss: 7.0713e-05 80/224 [=========>....................] - ETA: 0s - loss: 7.9458e-05 120/224 [===============>..............] - ETA: 0s - loss: 0.0012  157/224 [====================>.........] - ETA: 0s - loss: 0.0012 195/224 [=========================>....] - ETA: 0s - loss: 0.0015 224/224 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 7.5757e-04 41/224 [====>.........................] - ETA: 0s - loss: 0.0016  81/224 [=========>....................] - ETA: 0s - loss: 0.0011 114/224 [==============>...............] - ETA: 0s - loss: 9.0710e-04 148/224 [==================>...........] - ETA: 0s - loss: 7.7738e-04 183/224 [=======================>......] - ETA: 0s - loss: 6.5256e-04 224/224 [==============================] - ETA: 0s - loss: 5.6571e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.6571e-04 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 7.2363e-06 39/224 [====>.........................] - ETA: 0s - loss: 5.5879e-05 78/224 [=========>....................] - ETA: 0s - loss: 0.0019  116/224 [==============>...............] - ETA: 0s - loss: 0.0014 154/224 [===================>..........] - ETA: 0s - loss: 0.0011 196/224 [=========================>....] - ETA: 0s - loss: 8.8925e-04 224/224 [==============================] - 0s 1ms/step - loss: 8.6310e-04 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 8.7253e-04 40/224 [====>.........................] - ETA: 0s - loss: 1.5114e-04 80/224 [=========>....................] - ETA: 0s - loss: 1.1340e-04 121/224 [===============>..............] - ETA: 0s - loss: 9.5526e-05 160/224 [====================>.........] - ETA: 0s - loss: 1.1536e-04 200/224 [=========================>....] - ETA: 0s - loss: 4.7571e-04 224/224 [==============================] - 0s 1ms/step - loss: 5.2006e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 3.0179e-04 42/224 [====>.........................] - ETA: 0s - loss: 1.9012e-04 81/224 [=========>....................] - ETA: 0s - loss: 4.2430e-04 121/224 [===============>..............] - ETA: 0s - loss: 4.1128e-04 160/224 [====================>.........] - ETA: 0s - loss: 3.1437e-04 200/224 [=========================>....] - ETA: 0s - loss: 3.2632e-04 224/224 [==============================] - 0s 1ms/step - loss: 2.9713e-04 -> test with GAN.predict GAN tn, fp: 560, 0 GAN fn, tp: 2, 19 GAN f1 score: 0.950 GAN cohens kappa score: 0.948 -> test with 'LR' LR tn, fp: 550, 10 LR fn, tp: 1, 20 LR f1 score: 0.784 LR cohens kappa score: 0.775 LR average precision score: 0.892 -> test with 'RF' RF tn, fp: 560, 0 RF fn, tp: 1, 20 RF f1 score: 0.976 RF cohens kappa score: 0.975 -> test with 'GB' GB tn, fp: 560, 0 GB fn, tp: 0, 21 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 551, 9 KNN fn, tp: 0, 21 KNN f1 score: 0.824 KNN cohens kappa score: 0.816 ------ Step 5/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2152 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 46s - loss: 2.4943e-09 42/224 [====>.........................] - ETA: 0s - loss: 0.0533  83/224 [==========>...................] - ETA: 0s - loss: 0.0284 124/224 [===============>..............] - ETA: 0s - loss: 0.0242 162/224 [====================>.........] - ETA: 0s - loss: 0.0230 197/224 [=========================>....] - ETA: 0s - loss: 0.0205 224/224 [==============================] - 1s 1ms/step - loss: 0.0188 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 2.6199e-09 38/224 [====>.........................] - ETA: 0s - loss: 0.0091  79/224 [=========>....................] - ETA: 0s - loss: 0.0046 120/224 [===============>..............] - ETA: 0s - loss: 0.0064 158/224 [====================>.........] - ETA: 0s - loss: 0.0077 199/224 [=========================>....] - ETA: 0s - loss: 0.0066 224/224 [==============================] - 0s 1ms/step - loss: 0.0065 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 5.5901e-08 42/224 [====>.........................] - ETA: 0s - loss: 0.0046  83/224 [==========>...................] - ETA: 0s - loss: 0.0025 120/224 [===============>..............] - ETA: 0s - loss: 0.0018 159/224 [====================>.........] - ETA: 0s - loss: 0.0015 199/224 [=========================>....] - ETA: 0s - loss: 0.0033 224/224 [==============================] - 0s 1ms/step - loss: 0.0030 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 4.0912e-05 39/224 [====>.........................] - ETA: 0s - loss: 8.3982e-05 78/224 [=========>....................] - ETA: 0s - loss: 3.5809e-04 118/224 [==============>...............] - ETA: 0s - loss: 0.0032  157/224 [====================>.........] - ETA: 0s - loss: 0.0025 198/224 [=========================>....] - ETA: 0s - loss: 0.0024 224/224 [==============================] - 0s 1ms/step - loss: 0.0022 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 3.6757e-07 42/224 [====>.........................] - ETA: 0s - loss: 2.4913e-04 83/224 [==========>...................] - ETA: 0s - loss: 0.0035  124/224 [===============>..............] - ETA: 0s - loss: 0.0027 165/224 [=====================>........] - ETA: 0s - loss: 0.0022 206/224 [==========================>...] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 5.4334e-06 41/224 [====>.........................] - ETA: 0s - loss: 0.0085  81/224 [=========>....................] - ETA: 0s - loss: 0.0050 123/224 [===============>..............] - ETA: 0s - loss: 0.0035 164/224 [====================>.........] - ETA: 0s - loss: 0.0028 205/224 [==========================>...] - ETA: 0s - loss: 0.0024 224/224 [==============================] - 0s 1ms/step - loss: 0.0022 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 6.8744e-13 41/224 [====>.........................] - ETA: 0s - loss: 9.0351e-05 82/224 [=========>....................] - ETA: 0s - loss: 1.8255e-04 122/224 [===============>..............] - ETA: 0s - loss: 0.0022  163/224 [====================>.........] - ETA: 0s - loss: 0.0017 205/224 [==========================>...] - ETA: 0s - loss: 0.0018 224/224 [==============================] - 0s 1ms/step - loss: 0.0016 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 1.7189e-10 41/224 [====>.........................] - ETA: 0s - loss: 3.7872e-04 83/224 [==========>...................] - ETA: 0s - loss: 2.7405e-04 124/224 [===============>..............] - ETA: 0s - loss: 2.8961e-04 163/224 [====================>.........] - ETA: 0s - loss: 4.1946e-04 202/224 [==========================>...] - ETA: 0s - loss: 9.2587e-04 224/224 [==============================] - 0s 1ms/step - loss: 0.0011 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 1.2808e-08 41/224 [====>.........................] - ETA: 0s - loss: 3.5436e-04 77/224 [=========>....................] - ETA: 0s - loss: 0.0012  111/224 [=============>................] - ETA: 0s - loss: 9.6709e-04 147/224 [==================>...........] - ETA: 0s - loss: 8.6513e-04 185/224 [=======================>......] - ETA: 0s - loss: 7.9909e-04 224/224 [==============================] - ETA: 0s - loss: 7.0074e-04 224/224 [==============================] - 0s 1ms/step - loss: 7.0074e-04 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 4.1836e-06 40/224 [====>.........................] - ETA: 0s - loss: 0.0018  79/224 [=========>....................] - ETA: 0s - loss: 9.7876e-04 118/224 [==============>...............] - ETA: 0s - loss: 7.7792e-04 158/224 [====================>.........] - ETA: 0s - loss: 0.0012  198/224 [=========================>....] - ETA: 0s - loss: 0.0020 224/224 [==============================] - 0s 1ms/step - loss: 0.0018 -> test with GAN.predict GAN tn, fp: 559, 1 GAN fn, tp: 1, 20 GAN f1 score: 0.952 GAN cohens kappa score: 0.951 -> test with 'LR' LR tn, fp: 546, 14 LR fn, tp: 1, 20 LR f1 score: 0.727 LR cohens kappa score: 0.715 LR average precision score: 0.919 -> test with 'RF' RF tn, fp: 557, 3 RF fn, tp: 1, 20 RF f1 score: 0.909 RF cohens kappa score: 0.906 -> test with 'GB' GB tn, fp: 559, 1 GB fn, tp: 1, 20 GB f1 score: 0.952 GB cohens kappa score: 0.951 -> test with 'KNN' KNN tn, fp: 552, 8 KNN fn, tp: 0, 21 KNN f1 score: 0.840 KNN cohens kappa score: 0.833 ------ Step 5/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2156 synthetic samples -> retrain GAN for predict Epoch 1/10 1/224 [..............................] - ETA: 43s - loss: 1.9891e-09 37/224 [===>..........................] - ETA: 0s - loss: 0.0450  73/224 [========>.....................] - ETA: 0s - loss: 0.0385 104/224 [============>.................] - ETA: 0s - loss: 0.0597 137/224 [=================>............] - ETA: 0s - loss: 0.0599 177/224 [======================>.......] - ETA: 0s - loss: 0.0582 209/224 [==========================>...] - ETA: 0s - loss: 0.0526 224/224 [==============================] - 1s 1ms/step - loss: 0.0500 Epoch 2/10 1/224 [..............................] - ETA: 0s - loss: 0.0013 40/224 [====>.........................] - ETA: 0s - loss: 0.0297 78/224 [=========>....................] - ETA: 0s - loss: 0.0271 116/224 [==============>...............] - ETA: 0s - loss: 0.0269 155/224 [===================>..........] - ETA: 0s - loss: 0.0339 193/224 [========================>.....] - ETA: 0s - loss: 0.0289 224/224 [==============================] - 0s 1ms/step - loss: 0.0257 Epoch 3/10 1/224 [..............................] - ETA: 0s - loss: 7.8259e-06 41/224 [====>.........................] - ETA: 0s - loss: 0.0615  84/224 [==========>...................] - ETA: 0s - loss: 0.0321 121/224 [===============>..............] - ETA: 0s - loss: 0.0286 162/224 [====================>.........] - ETA: 0s - loss: 0.0223 195/224 [=========================>....] - ETA: 0s - loss: 0.0225 224/224 [==============================] - 0s 1ms/step - loss: 0.0207 Epoch 4/10 1/224 [..............................] - ETA: 0s - loss: 5.3190e-05 43/224 [====>.........................] - ETA: 0s - loss: 0.0252  84/224 [==========>...................] - ETA: 0s - loss: 0.0141 125/224 [===============>..............] - ETA: 0s - loss: 0.0249 167/224 [=====================>........] - ETA: 0s - loss: 0.0197 201/224 [=========================>....] - ETA: 0s - loss: 0.0190 224/224 [==============================] - 0s 1ms/step - loss: 0.0172 Epoch 5/10 1/224 [..............................] - ETA: 0s - loss: 4.0715e-05 41/224 [====>.........................] - ETA: 0s - loss: 0.0014  77/224 [=========>....................] - ETA: 0s - loss: 0.0075 114/224 [==============>...............] - ETA: 0s - loss: 0.0140 157/224 [====================>.........] - ETA: 0s - loss: 0.0124 198/224 [=========================>....] - ETA: 0s - loss: 0.0107 224/224 [==============================] - 0s 1ms/step - loss: 0.0141 Epoch 6/10 1/224 [..............................] - ETA: 0s - loss: 0.0063 35/224 [===>..........................] - ETA: 0s - loss: 0.0048 71/224 [========>.....................] - ETA: 0s - loss: 0.0028 111/224 [=============>................] - ETA: 0s - loss: 0.0047 152/224 [===================>..........] - ETA: 0s - loss: 0.0064 190/224 [========================>.....] - ETA: 0s - loss: 0.0076 224/224 [==============================] - 0s 1ms/step - loss: 0.0111 Epoch 7/10 1/224 [..............................] - ETA: 0s - loss: 0.0026 41/224 [====>.........................] - ETA: 0s - loss: 0.0030 83/224 [==========>...................] - ETA: 0s - loss: 0.0085 125/224 [===============>..............] - ETA: 0s - loss: 0.0112 163/224 [====================>.........] - ETA: 0s - loss: 0.0127 200/224 [=========================>....] - ETA: 0s - loss: 0.0115 224/224 [==============================] - 0s 1ms/step - loss: 0.0103 Epoch 8/10 1/224 [..............................] - ETA: 0s - loss: 2.3051e-04 38/224 [====>.........................] - ETA: 0s - loss: 0.0142  73/224 [========>.....................] - ETA: 0s - loss: 0.0090 109/224 [=============>................] - ETA: 0s - loss: 0.0142 144/224 [==================>...........] - ETA: 0s - loss: 0.0118 183/224 [=======================>......] - ETA: 0s - loss: 0.0096 220/224 [============================>.] - ETA: 0s - loss: 0.0090 224/224 [==============================] - 0s 1ms/step - loss: 0.0089 Epoch 9/10 1/224 [..............................] - ETA: 0s - loss: 0.0016 36/224 [===>..........................] - ETA: 0s - loss: 0.0122 70/224 [========>.....................] - ETA: 0s - loss: 0.0098 105/224 [=============>................] - ETA: 0s - loss: 0.0084 140/224 [=================>............] - ETA: 0s - loss: 0.0069 178/224 [======================>.......] - ETA: 0s - loss: 0.0072 217/224 [============================>.] - ETA: 0s - loss: 0.0080 224/224 [==============================] - 0s 1ms/step - loss: 0.0078 Epoch 10/10 1/224 [..............................] - ETA: 0s - loss: 3.7715e-04 40/224 [====>.........................] - ETA: 0s - loss: 0.0031  77/224 [=========>....................] - ETA: 0s - loss: 0.0045 115/224 [==============>...............] - ETA: 0s - loss: 0.0051 155/224 [===================>..........] - ETA: 0s - loss: 0.0072 193/224 [========================>.....] - ETA: 0s - loss: 0.0072 224/224 [==============================] - 0s 1ms/step - loss: 0.0068 -> test with GAN.predict GAN tn, fp: 555, 1 GAN fn, tp: 0, 21 GAN f1 score: 0.977 GAN cohens kappa score: 0.976 -> test with 'LR' LR tn, fp: 542, 14 LR fn, tp: 1, 20 LR f1 score: 0.727 LR cohens kappa score: 0.714 LR average precision score: 0.913 -> test with 'RF' RF tn, fp: 554, 2 RF fn, tp: 0, 21 RF f1 score: 0.955 RF cohens kappa score: 0.953 -> test with 'GB' GB tn, fp: 555, 1 GB fn, tp: 0, 21 GB f1 score: 0.977 GB cohens kappa score: 0.976 -> test with 'KNN' KNN tn, fp: 550, 6 KNN fn, tp: 0, 21 KNN f1 score: 0.875 KNN cohens kappa score: 0.870 ### Exercise is done. -----[ LR ]----- maximum: LR tn, fp: 558, 18 LR fn, tp: 4, 21 LR f1 score: 0.905 LR cohens kappa score: 0.901 LR average precision score: 0.989 average: LR tn, fp: 547.12, 12.08 LR fn, tp: 0.88, 20.12 LR f1 score: 0.761 LR cohens kappa score: 0.750 LR average precision score: 0.926 minimum: LR tn, fp: 538, 2 LR fn, tp: 0, 17 LR f1 score: 0.679 LR cohens kappa score: 0.663 LR average precision score: 0.830 -----[ RF ]----- maximum: RF tn, fp: 560, 5 RF fn, tp: 4, 21 RF f1 score: 1.000 RF cohens kappa score: 1.000 average: RF tn, fp: 558.32, 0.88 RF fn, tp: 1.24, 19.76 RF f1 score: 0.949 RF cohens kappa score: 0.947 minimum: RF tn, fp: 554, 0 RF fn, tp: 0, 17 RF f1 score: 0.870 RF cohens kappa score: 0.864 -----[ GB ]----- maximum: GB tn, fp: 560, 5 GB fn, tp: 4, 21 GB f1 score: 1.000 GB cohens kappa score: 1.000 average: GB tn, fp: 558.6, 0.6 GB fn, tp: 1.0, 20.0 GB f1 score: 0.961 GB cohens kappa score: 0.960 minimum: GB tn, fp: 555, 0 GB fn, tp: 0, 17 GB f1 score: 0.894 GB cohens kappa score: 0.889 -----[ KNN ]----- maximum: KNN tn, fp: 558, 10 KNN fn, tp: 2, 21 KNN f1 score: 0.933 KNN cohens kappa score: 0.931 average: KNN tn, fp: 552.4, 6.8 KNN fn, tp: 0.4, 20.6 KNN f1 score: 0.853 KNN cohens kappa score: 0.847 minimum: KNN tn, fp: 546, 2 KNN fn, tp: 0, 19 KNN f1 score: 0.808 KNN cohens kappa score: 0.799 -----[ GAN ]----- maximum: GAN tn, fp: 560, 7 GAN fn, tp: 6, 21 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 average: GAN tn, fp: 558.16, 1.04 GAN fn, tp: 1.4, 19.6 GAN f1 score: 0.941 GAN cohens kappa score: 0.939 minimum: GAN tn, fp: 553, 0 GAN fn, tp: 0, 15 GAN f1 score: 0.833 GAN cohens kappa score: 0.826