/////////////////////////////////////////// // Running convGAN-proximary-5 on folding_kr-vs-k-three_vs_eleven /////////////////////////////////////////// Load 'data_input/folding_kr-vs-k-three_vs_eleven' from pickle file Data loaded. -> Shuffling data ### Start exercise for synthetic point generator ====== Step 1/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 1/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 36s - loss: 0.0013 41/229 [====>.........................] - ETA: 0s - loss: 5.5429e-04 83/229 [=========>....................] - ETA: 0s - loss: 6.5271e-04 124/229 [===============>..............] - ETA: 0s - loss: 5.1230e-04 164/229 [====================>.........] - ETA: 0s - loss: 4.2332e-04 205/229 [=========================>....] - ETA: 0s - loss: 3.6677e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.4903e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 2.3044e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.2829e-04 80/229 [=========>....................] - ETA: 0s - loss: 1.5021e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.1925e-04 162/229 [====================>.........] - ETA: 0s - loss: 1.3966e-04 201/229 [=========================>....] - ETA: 0s - loss: 1.6451e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.6443e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.3694e-06 41/229 [====>.........................] - ETA: 0s - loss: 1.8411e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.4831e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.3425e-04 165/229 [====================>.........] - ETA: 0s - loss: 1.2157e-04 201/229 [=========================>....] - ETA: 0s - loss: 1.1687e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1512e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.6752e-06 37/229 [===>..........................] - ETA: 0s - loss: 6.2654e-05 78/229 [=========>....................] - ETA: 0s - loss: 7.1672e-05 117/229 [==============>...............] - ETA: 0s - loss: 8.6237e-05 158/229 [===================>..........] - ETA: 0s - loss: 8.6242e-05 198/229 [========================>.....] - ETA: 0s - loss: 8.2917e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.0463e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 6.5117e-06 37/229 [===>..........................] - ETA: 0s - loss: 1.0018e-04 73/229 [========>.....................] - ETA: 0s - loss: 9.1930e-05 108/229 [=============>................] - ETA: 0s - loss: 7.9411e-05 145/229 [=================>............] - ETA: 0s - loss: 6.8606e-05 185/229 [=======================>......] - ETA: 0s - loss: 7.0632e-05 224/229 [============================>.] - ETA: 0s - loss: 8.0335e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.9282e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 3.0765e-06 42/229 [====>.........................] - ETA: 0s - loss: 5.3605e-05 82/229 [=========>....................] - ETA: 0s - loss: 6.2259e-05 123/229 [===============>..............] - ETA: 0s - loss: 6.8165e-05 161/229 [====================>.........] - ETA: 0s - loss: 7.1572e-05 203/229 [=========================>....] - ETA: 0s - loss: 6.9899e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.5598e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.2023e-05 40/229 [====>.........................] - ETA: 0s - loss: 3.1344e-05 79/229 [=========>....................] - ETA: 0s - loss: 4.2636e-05 118/229 [==============>...............] - ETA: 0s - loss: 4.3689e-05 160/229 [===================>..........] - ETA: 0s - loss: 4.6559e-05 199/229 [=========================>....] - ETA: 0s - loss: 4.5288e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5977e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 6.9744e-05 41/229 [====>.........................] - ETA: 0s - loss: 4.0907e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.9999e-05 121/229 [==============>...............] - ETA: 0s - loss: 4.2325e-05 161/229 [====================>.........] - ETA: 0s - loss: 4.2517e-05 201/229 [=========================>....] - ETA: 0s - loss: 4.5194e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.7198e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 4.5744e-05 39/229 [====>.........................] - ETA: 0s - loss: 7.5178e-05 79/229 [=========>....................] - ETA: 0s - loss: 4.9939e-05 119/229 [==============>...............] - ETA: 0s - loss: 4.5162e-05 160/229 [===================>..........] - ETA: 0s - loss: 4.3287e-05 197/229 [========================>.....] - ETA: 0s - loss: 3.9022e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.6469e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 1.0317e-05 42/229 [====>.........................] - ETA: 0s - loss: 4.0618e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.3488e-05 122/229 [==============>...............] - ETA: 0s - loss: 3.8877e-05 162/229 [====================>.........] - ETA: 0s - loss: 3.5520e-05 202/229 [=========================>....] - ETA: 0s - loss: 3.5644e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.3742e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 1 LR fn, tp: 0, 17 LR f1 score: 0.971 LR cohens kappa score: 0.971 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 4 KNN fn, tp: 0, 17 KNN f1 score: 0.895 KNN cohens kappa score: 0.891 ------ Step 1/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 35s - loss: 3.1833e-04 39/229 [====>.........................] - ETA: 0s - loss: 3.8820e-04  80/229 [=========>....................] - ETA: 0s - loss: 6.3716e-04 120/229 [==============>...............] - ETA: 0s - loss: 5.8201e-04 159/229 [===================>..........] - ETA: 0s - loss: 4.6041e-04 199/229 [=========================>....] - ETA: 0s - loss: 0.0012  229/229 [==============================] - 0s 1ms/step - loss: 0.0013 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 5.7000e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.5432e-04 82/229 [=========>....................] - ETA: 0s - loss: 1.3503e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.8531e-04 161/229 [====================>.........] - ETA: 0s - loss: 2.4165e-04 202/229 [=========================>....] - ETA: 0s - loss: 2.3738e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.2182e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.1077e-04 41/229 [====>.........................] - ETA: 0s - loss: 2.7402e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.0585e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.8568e-04 163/229 [====================>.........] - ETA: 0s - loss: 1.8424e-04 203/229 [=========================>....] - ETA: 0s - loss: 1.6458e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5563e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 5.1080e-05 35/229 [===>..........................] - ETA: 0s - loss: 7.5069e-05 69/229 [========>.....................] - ETA: 0s - loss: 9.4947e-05 105/229 [============>.................] - ETA: 0s - loss: 9.1615e-05 147/229 [==================>...........] - ETA: 0s - loss: 1.3504e-04 187/229 [=======================>......] - ETA: 0s - loss: 1.3441e-04 226/229 [============================>.] - ETA: 0s - loss: 1.3184e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3118e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.8682e-05 43/229 [====>.........................] - ETA: 0s - loss: 1.8784e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.3932e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.2082e-04 162/229 [====================>.........] - ETA: 0s - loss: 1.0953e-04 200/229 [=========================>....] - ETA: 0s - loss: 1.1023e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0339e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.2414e-05 40/229 [====>.........................] - ETA: 0s - loss: 1.0201e-04 80/229 [=========>....................] - ETA: 0s - loss: 8.6762e-05 121/229 [==============>...............] - ETA: 0s - loss: 7.8576e-05 160/229 [===================>..........] - ETA: 0s - loss: 8.4618e-05 199/229 [=========================>....] - ETA: 0s - loss: 9.8907e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.3956e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.3893e-04 42/229 [====>.........................] - ETA: 0s - loss: 5.3019e-05 83/229 [=========>....................] - ETA: 0s - loss: 5.3463e-05 121/229 [==============>...............] - ETA: 0s - loss: 7.0813e-05 162/229 [====================>.........] - ETA: 0s - loss: 6.6442e-05 202/229 [=========================>....] - ETA: 0s - loss: 7.6542e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.1638e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 4.2091e-05 40/229 [====>.........................] - ETA: 0s - loss: 5.8572e-05 81/229 [=========>....................] - ETA: 0s - loss: 6.3204e-05 122/229 [==============>...............] - ETA: 0s - loss: 6.1082e-05 163/229 [====================>.........] - ETA: 0s - loss: 7.5113e-05 204/229 [=========================>....] - ETA: 0s - loss: 7.3038e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.9201e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 7.5939e-05 42/229 [====>.........................] - ETA: 0s - loss: 5.6502e-05 80/229 [=========>....................] - ETA: 0s - loss: 5.3990e-05 121/229 [==============>...............] - ETA: 0s - loss: 6.2866e-05 163/229 [====================>.........] - ETA: 0s - loss: 6.7142e-05 204/229 [=========================>....] - ETA: 0s - loss: 6.4845e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.2539e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 4.1550e-06 41/229 [====>.........................] - ETA: 0s - loss: 5.5633e-05 82/229 [=========>....................] - ETA: 0s - loss: 6.0145e-05 121/229 [==============>...............] - ETA: 0s - loss: 5.8339e-05 157/229 [===================>..........] - ETA: 0s - loss: 6.2523e-05 197/229 [========================>.....] - ETA: 0s - loss: 5.8043e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5620e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 1, 16 LR f1 score: 0.970 LR cohens kappa score: 0.969 LR average precision score: 0.994 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 1, 16 RF f1 score: 0.970 RF cohens kappa score: 0.969 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 568, 3 KNN fn, tp: 0, 17 KNN f1 score: 0.919 KNN cohens kappa score: 0.916 ------ Step 1/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 35s - loss: 2.1194e-05 42/229 [====>.........................] - ETA: 0s - loss: 0.0023  78/229 [=========>....................] - ETA: 0s - loss: 0.0014 115/229 [==============>...............] - ETA: 0s - loss: 0.0010 146/229 [==================>...........] - ETA: 0s - loss: 8.1731e-04 185/229 [=======================>......] - ETA: 0s - loss: 6.8643e-04 225/229 [============================>.] - ETA: 0s - loss: 5.8602e-04 229/229 [==============================] - 0s 1ms/step - loss: 5.7866e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 2.6320e-05 41/229 [====>.........................] - ETA: 0s - loss: 1.3760e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.5045e-04 124/229 [===============>..............] - ETA: 0s - loss: 2.1040e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.8539e-04 200/229 [=========================>....] - ETA: 0s - loss: 1.7356e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.6300e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 8.7495e-08 42/229 [====>.........................] - ETA: 0s - loss: 8.4730e-05 84/229 [==========>...................] - ETA: 0s - loss: 8.2960e-05 125/229 [===============>..............] - ETA: 0s - loss: 7.9891e-05 166/229 [====================>.........] - ETA: 0s - loss: 1.2004e-04 207/229 [==========================>...] - ETA: 0s - loss: 1.1148e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0454e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 5.2700e-05 42/229 [====>.........................] - ETA: 0s - loss: 4.5940e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.5427e-05 123/229 [===============>..............] - ETA: 0s - loss: 5.4525e-05 163/229 [====================>.........] - ETA: 0s - loss: 5.7606e-05 203/229 [=========================>....] - ETA: 0s - loss: 8.1687e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.2431e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 6.3775e-06 43/229 [====>.........................] - ETA: 0s - loss: 5.3172e-05 84/229 [==========>...................] - ETA: 0s - loss: 5.7694e-05 125/229 [===============>..............] - ETA: 0s - loss: 5.8636e-05 165/229 [====================>.........] - ETA: 0s - loss: 5.7162e-05 206/229 [=========================>....] - ETA: 0s - loss: 7.8981e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.5918e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 1.7880e-05 41/229 [====>.........................] - ETA: 0s - loss: 5.8266e-05 81/229 [=========>....................] - ETA: 0s - loss: 5.0847e-05 121/229 [==============>...............] - ETA: 0s - loss: 7.8594e-05 162/229 [====================>.........] - ETA: 0s - loss: 7.2075e-05 203/229 [=========================>....] - ETA: 0s - loss: 6.4554e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.1045e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 7.0595e-05 39/229 [====>.........................] - ETA: 0s - loss: 4.3028e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.7745e-05 120/229 [==============>...............] - ETA: 0s - loss: 3.7223e-05 160/229 [===================>..........] - ETA: 0s - loss: 4.0794e-05 201/229 [=========================>....] - ETA: 0s - loss: 5.3064e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.0007e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.4422e-05 42/229 [====>.........................] - ETA: 0s - loss: 7.9332e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.7457e-05 122/229 [==============>...............] - ETA: 0s - loss: 5.4354e-05 158/229 [===================>..........] - ETA: 0s - loss: 4.7847e-05 191/229 [========================>.....] - ETA: 0s - loss: 4.3069e-05 225/229 [============================>.] - ETA: 0s - loss: 4.2499e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.2153e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 2.7178e-05 43/229 [====>.........................] - ETA: 0s - loss: 6.7222e-05 84/229 [==========>...................] - ETA: 0s - loss: 4.9569e-05 120/229 [==============>...............] - ETA: 0s - loss: 4.2910e-05 156/229 [===================>..........] - ETA: 0s - loss: 3.7118e-05 196/229 [========================>.....] - ETA: 0s - loss: 3.7932e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.7616e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 5.3920e-05 43/229 [====>.........................] - ETA: 0s - loss: 4.9478e-05 85/229 [==========>...................] - ETA: 0s - loss: 4.2559e-05 126/229 [===============>..............] - ETA: 0s - loss: 3.7664e-05 167/229 [====================>.........] - ETA: 0s - loss: 3.8519e-05 208/229 [==========================>...] - ETA: 0s - loss: 3.3037e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.1207e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 2 LR fn, tp: 0, 17 LR f1 score: 0.944 LR cohens kappa score: 0.943 LR average precision score: 0.994 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 569, 2 KNN fn, tp: 0, 17 KNN f1 score: 0.944 KNN cohens kappa score: 0.943 ------ Step 1/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 37s - loss: 2.7364e-04 44/229 [====>.........................] - ETA: 0s - loss: 5.8895e-04  79/229 [=========>....................] - ETA: 0s - loss: 4.0859e-04 121/229 [==============>...............] - ETA: 0s - loss: 5.3636e-04 162/229 [====================>.........] - ETA: 0s - loss: 4.9371e-04 201/229 [=========================>....] - ETA: 0s - loss: 4.2893e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.3784e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 1.5583e-04 42/229 [====>.........................] - ETA: 0s - loss: 1.9412e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.7355e-04 123/229 [===============>..............] - ETA: 0s - loss: 2.3754e-04 163/229 [====================>.........] - ETA: 0s - loss: 2.3658e-04 204/229 [=========================>....] - ETA: 0s - loss: 2.2890e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.2313e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 4.1187e-05 44/229 [====>.........................] - ETA: 0s - loss: 1.4353e-04 85/229 [==========>...................] - ETA: 0s - loss: 1.2862e-04 127/229 [===============>..............] - ETA: 0s - loss: 1.1023e-04 169/229 [=====================>........] - ETA: 0s - loss: 9.8901e-05 210/229 [==========================>...] - ETA: 0s - loss: 1.5531e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.7134e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 7.1193e-05 43/229 [====>.........................] - ETA: 0s - loss: 1.3819e-04 84/229 [==========>...................] - ETA: 0s - loss: 1.2579e-04 125/229 [===============>..............] - ETA: 0s - loss: 1.0990e-04 166/229 [====================>.........] - ETA: 0s - loss: 1.2907e-04 205/229 [=========================>....] - ETA: 0s - loss: 1.3961e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3484e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.1462e-04 42/229 [====>.........................] - ETA: 0s - loss: 7.9834e-05 83/229 [=========>....................] - ETA: 0s - loss: 6.7133e-05 123/229 [===============>..............] - ETA: 0s - loss: 1.0482e-04 165/229 [====================>.........] - ETA: 0s - loss: 1.0083e-04 207/229 [==========================>...] - ETA: 0s - loss: 1.0236e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0932e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 1.3246e-04 41/229 [====>.........................] - ETA: 0s - loss: 1.2363e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.0990e-04 125/229 [===============>..............] - ETA: 0s - loss: 9.5789e-05 167/229 [====================>.........] - ETA: 0s - loss: 9.8528e-05 208/229 [==========================>...] - ETA: 0s - loss: 9.6039e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.2618e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 4.7878e-05 40/229 [====>.........................] - ETA: 0s - loss: 6.3828e-05 78/229 [=========>....................] - ETA: 0s - loss: 6.3549e-05 119/229 [==============>...............] - ETA: 0s - loss: 5.6180e-05 155/229 [===================>..........] - ETA: 0s - loss: 8.2648e-05 190/229 [=======================>......] - ETA: 0s - loss: 8.3557e-05 229/229 [==============================] - ETA: 0s - loss: 8.2532e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.2532e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 4.1510e-05 42/229 [====>.........................] - ETA: 0s - loss: 6.2896e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.1620e-05 122/229 [==============>...............] - ETA: 0s - loss: 6.2754e-05 159/229 [===================>..........] - ETA: 0s - loss: 5.8732e-05 200/229 [=========================>....] - ETA: 0s - loss: 6.6652e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.6138e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 2.9993e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.3216e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.0805e-05 122/229 [==============>...............] - ETA: 0s - loss: 3.3825e-05 161/229 [====================>.........] - ETA: 0s - loss: 3.6840e-05 199/229 [=========================>....] - ETA: 0s - loss: 4.0338e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5749e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 2.2408e-05 43/229 [====>.........................] - ETA: 0s - loss: 5.0799e-05 85/229 [==========>...................] - ETA: 0s - loss: 5.5949e-05 126/229 [===============>..............] - ETA: 0s - loss: 5.1465e-05 161/229 [====================>.........] - ETA: 0s - loss: 5.6382e-05 197/229 [========================>.....] - ETA: 0s - loss: 5.0601e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.7286e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 0, 17 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 563, 8 KNN fn, tp: 0, 17 KNN f1 score: 0.810 KNN cohens kappa score: 0.803 ------ Step 1/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2216 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 35s - loss: 1.5198e-05 31/229 [===>..........................] - ETA: 0s - loss: 1.8323e-04  67/229 [=======>......................] - ETA: 0s - loss: 2.4630e-04 106/229 [============>.................] - ETA: 0s - loss: 2.6646e-04 145/229 [=================>............] - ETA: 0s - loss: 2.6144e-04 185/229 [=======================>......] - ETA: 0s - loss: 2.2209e-04 225/229 [============================>.] - ETA: 0s - loss: 2.5568e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.5228e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 4.7038e-05 41/229 [====>.........................] - ETA: 0s - loss: 9.4247e-05 78/229 [=========>....................] - ETA: 0s - loss: 7.3295e-05 117/229 [==============>...............] - ETA: 0s - loss: 2.1117e-04 159/229 [===================>..........] - ETA: 0s - loss: 1.9007e-04 199/229 [=========================>....] - ETA: 0s - loss: 1.6753e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.7293e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.8344e-05 42/229 [====>.........................] - ETA: 0s - loss: 5.8830e-05 82/229 [=========>....................] - ETA: 0s - loss: 1.8802e-04 122/229 [==============>...............] - ETA: 0s - loss: 1.3827e-04 162/229 [====================>.........] - ETA: 0s - loss: 1.6445e-04 199/229 [=========================>....] - ETA: 0s - loss: 1.6096e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4389e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 3.8158e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.1204e-04 84/229 [==========>...................] - ETA: 0s - loss: 1.5081e-04 124/229 [===============>..............] - ETA: 0s - loss: 1.8047e-04 164/229 [====================>.........] - ETA: 0s - loss: 1.4275e-04 203/229 [=========================>....] - ETA: 0s - loss: 1.3035e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.2076e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 4.9434e-05 42/229 [====>.........................] - ETA: 0s - loss: 2.4871e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.0596e-04 119/229 [==============>...............] - ETA: 0s - loss: 1.7158e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.3302e-04 202/229 [=========================>....] - ETA: 0s - loss: 1.0920e-04 229/229 [==============================] - 0s 1ms/step - loss: 9.9671e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 3.0038e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.8475e-05 83/229 [=========>....................] - ETA: 0s - loss: 4.6353e-05 123/229 [===============>..............] - ETA: 0s - loss: 7.4191e-05 164/229 [====================>.........] - ETA: 0s - loss: 1.0016e-04 205/229 [=========================>....] - ETA: 0s - loss: 8.6766e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.9002e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.0703e-07 41/229 [====>.........................] - ETA: 0s - loss: 8.8768e-05 80/229 [=========>....................] - ETA: 0s - loss: 8.0100e-05 118/229 [==============>...............] - ETA: 0s - loss: 7.6385e-05 155/229 [===================>..........] - ETA: 0s - loss: 7.6982e-05 195/229 [========================>.....] - ETA: 0s - loss: 6.4971e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.4550e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 4.7722e-07 42/229 [====>.........................] - ETA: 0s - loss: 5.0883e-05 81/229 [=========>....................] - ETA: 0s - loss: 5.5792e-05 115/229 [==============>...............] - ETA: 0s - loss: 4.5020e-05 148/229 [==================>...........] - ETA: 0s - loss: 5.4064e-05 186/229 [=======================>......] - ETA: 0s - loss: 6.8374e-05 227/229 [============================>.] - ETA: 0s - loss: 6.5388e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.4991e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 8.4574e-06 41/229 [====>.........................] - ETA: 0s - loss: 9.5481e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.2456e-05 122/229 [==============>...............] - ETA: 0s - loss: 5.8750e-05 162/229 [====================>.........] - ETA: 0s - loss: 6.5094e-05 203/229 [=========================>....] - ETA: 0s - loss: 6.1204e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.6457e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 9.0242e-07 41/229 [====>.........................] - ETA: 0s - loss: 9.1076e-05 80/229 [=========>....................] - ETA: 0s - loss: 8.6044e-05 122/229 [==============>...............] - ETA: 0s - loss: 7.1630e-05 161/229 [====================>.........] - ETA: 0s - loss: 5.6737e-05 201/229 [=========================>....] - ETA: 0s - loss: 5.3514e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.8567e-05 -> test with GAN.predict GAN tn, fp: 568, 2 GAN fn, tp: 0, 13 GAN f1 score: 0.929 GAN cohens kappa score: 0.927 -> test with 'LR' LR tn, fp: 565, 5 LR fn, tp: 1, 12 LR f1 score: 0.800 LR cohens kappa score: 0.795 LR average precision score: 0.847 -> test with 'RF' RF tn, fp: 570, 0 RF fn, tp: 0, 13 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 568, 2 GB fn, tp: 0, 13 GB f1 score: 0.929 GB cohens kappa score: 0.927 -> test with 'KNN' KNN tn, fp: 567, 3 KNN fn, tp: 0, 13 KNN f1 score: 0.897 KNN cohens kappa score: 0.894 ====== Step 2/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 2/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 39s - loss: 4.3340e-05 44/229 [====>.........................] - ETA: 0s - loss: 3.0535e-04  86/229 [==========>...................] - ETA: 0s - loss: 0.0011  126/229 [===============>..............] - ETA: 0s - loss: 9.4730e-04 166/229 [====================>.........] - ETA: 0s - loss: 9.3041e-04 208/229 [==========================>...] - ETA: 0s - loss: 0.0011  229/229 [==============================] - 0s 1ms/step - loss: 0.0012 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 8.8232e-04 42/229 [====>.........................] - ETA: 0s - loss: 3.9959e-04 84/229 [==========>...................] - ETA: 0s - loss: 2.6738e-04 126/229 [===============>..............] - ETA: 0s - loss: 2.1285e-04 166/229 [====================>.........] - ETA: 0s - loss: 2.2389e-04 207/229 [==========================>...] - ETA: 0s - loss: 2.8152e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.7852e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.9492e-04 42/229 [====>.........................] - ETA: 0s - loss: 2.8720e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.0656e-04 123/229 [===============>..............] - ETA: 0s - loss: 2.1218e-04 162/229 [====================>.........] - ETA: 0s - loss: 2.6185e-04 203/229 [=========================>....] - ETA: 0s - loss: 2.3792e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.2094e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 5.5594e-05 42/229 [====>.........................] - ETA: 0s - loss: 5.8507e-05 83/229 [=========>....................] - ETA: 0s - loss: 1.0292e-04 125/229 [===============>..............] - ETA: 0s - loss: 8.7554e-05 166/229 [====================>.........] - ETA: 0s - loss: 1.0934e-04 207/229 [==========================>...] - ETA: 0s - loss: 1.5956e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.6085e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.9541e-04 42/229 [====>.........................] - ETA: 0s - loss: 1.4175e-04 79/229 [=========>....................] - ETA: 0s - loss: 2.5008e-04 113/229 [=============>................] - ETA: 0s - loss: 2.1818e-04 148/229 [==================>...........] - ETA: 0s - loss: 1.9418e-04 187/229 [=======================>......] - ETA: 0s - loss: 1.7085e-04 228/229 [============================>.] - ETA: 0s - loss: 1.5037e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5033e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 3.2249e-06 43/229 [====>.........................] - ETA: 0s - loss: 7.4760e-05 87/229 [==========>...................] - ETA: 0s - loss: 1.3854e-04 129/229 [===============>..............] - ETA: 0s - loss: 1.7860e-04 171/229 [=====================>........] - ETA: 0s - loss: 1.5393e-04 209/229 [==========================>...] - ETA: 0s - loss: 1.3514e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3196e-04 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 6.1666e-05 35/229 [===>..........................] - ETA: 0s - loss: 4.1883e-05 74/229 [========>.....................] - ETA: 0s - loss: 6.4634e-05 114/229 [=============>................] - ETA: 0s - loss: 7.8358e-05 154/229 [===================>..........] - ETA: 0s - loss: 7.3176e-05 194/229 [========================>.....] - ETA: 0s - loss: 1.0225e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1864e-04 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 4.7538e-05 43/229 [====>.........................] - ETA: 0s - loss: 8.6434e-05 85/229 [==========>...................] - ETA: 0s - loss: 1.0819e-04 123/229 [===============>..............] - ETA: 0s - loss: 9.3930e-05 165/229 [====================>.........] - ETA: 0s - loss: 8.2084e-05 205/229 [=========================>....] - ETA: 0s - loss: 1.0006e-04 229/229 [==============================] - 0s 1ms/step - loss: 9.8017e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 6.7271e-05 41/229 [====>.........................] - ETA: 0s - loss: 6.7568e-05 79/229 [=========>....................] - ETA: 0s - loss: 1.1240e-04 120/229 [==============>...............] - ETA: 0s - loss: 1.1429e-04 162/229 [====================>.........] - ETA: 0s - loss: 9.3375e-05 204/229 [=========================>....] - ETA: 0s - loss: 9.3825e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.7850e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 2.9010e-05 43/229 [====>.........................] - ETA: 0s - loss: 8.0911e-05 83/229 [=========>....................] - ETA: 0s - loss: 6.2273e-05 123/229 [===============>..............] - ETA: 0s - loss: 7.2972e-05 163/229 [====================>.........] - ETA: 0s - loss: 8.6243e-05 205/229 [=========================>....] - ETA: 0s - loss: 7.7697e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.2943e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 0, 17 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 570, 1 KNN fn, tp: 0, 17 KNN f1 score: 0.971 KNN cohens kappa score: 0.971 ------ Step 2/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 35s - loss: 2.2456e-04 43/229 [====>.........................] - ETA: 0s - loss: 0.0024  82/229 [=========>....................] - ETA: 0s - loss: 0.0014 121/229 [==============>...............] - ETA: 0s - loss: 0.0010 160/229 [===================>..........] - ETA: 0s - loss: 8.3282e-04 197/229 [========================>.....] - ETA: 0s - loss: 7.0021e-04 229/229 [==============================] - 0s 1ms/step - loss: 6.2681e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 8.2061e-05 40/229 [====>.........................] - ETA: 0s - loss: 5.2585e-04 82/229 [=========>....................] - ETA: 0s - loss: 3.5117e-04 121/229 [==============>...............] - ETA: 0s - loss: 2.8644e-04 162/229 [====================>.........] - ETA: 0s - loss: 2.7078e-04 204/229 [=========================>....] - ETA: 0s - loss: 2.4911e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.5185e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.5483e-04 40/229 [====>.........................] - ETA: 0s - loss: 3.2357e-04 76/229 [========>.....................] - ETA: 0s - loss: 2.6917e-04 116/229 [==============>...............] - ETA: 0s - loss: 2.1524e-04 157/229 [===================>..........] - ETA: 0s - loss: 1.8706e-04 195/229 [========================>.....] - ETA: 0s - loss: 1.9494e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.8628e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.8266e-04 38/229 [===>..........................] - ETA: 0s - loss: 1.2531e-04 72/229 [========>.....................] - ETA: 0s - loss: 1.0735e-04 106/229 [============>.................] - ETA: 0s - loss: 9.6169e-05 141/229 [=================>............] - ETA: 0s - loss: 1.2972e-04 179/229 [======================>.......] - ETA: 0s - loss: 1.1716e-04 218/229 [===========================>..] - ETA: 0s - loss: 1.5587e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5558e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 2.9375e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.8936e-04 82/229 [=========>....................] - ETA: 0s - loss: 1.6376e-04 119/229 [==============>...............] - ETA: 0s - loss: 1.5398e-04 158/229 [===================>..........] - ETA: 0s - loss: 1.3686e-04 196/229 [========================>.....] - ETA: 0s - loss: 1.3780e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.2850e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 3.1950e-05 40/229 [====>.........................] - ETA: 0s - loss: 6.8636e-05 81/229 [=========>....................] - ETA: 0s - loss: 7.8911e-05 120/229 [==============>...............] - ETA: 0s - loss: 1.2126e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.1687e-04 198/229 [========================>.....] - ETA: 0s - loss: 1.1223e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1503e-04 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 3.2330e-05 42/229 [====>.........................] - ETA: 0s - loss: 2.0616e-04 82/229 [=========>....................] - ETA: 0s - loss: 1.4027e-04 119/229 [==============>...............] - ETA: 0s - loss: 1.1210e-04 158/229 [===================>..........] - ETA: 0s - loss: 1.0220e-04 198/229 [========================>.....] - ETA: 0s - loss: 9.0939e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.3504e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.3406e-05 41/229 [====>.........................] - ETA: 0s - loss: 6.1238e-05 81/229 [=========>....................] - ETA: 0s - loss: 6.2440e-05 118/229 [==============>...............] - ETA: 0s - loss: 1.0017e-04 159/229 [===================>..........] - ETA: 0s - loss: 9.4000e-05 200/229 [=========================>....] - ETA: 0s - loss: 8.9487e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.6032e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.9366e-04 42/229 [====>.........................] - ETA: 0s - loss: 1.5260e-04 80/229 [=========>....................] - ETA: 0s - loss: 1.0809e-04 121/229 [==============>...............] - ETA: 0s - loss: 8.8717e-05 161/229 [====================>.........] - ETA: 0s - loss: 7.5205e-05 200/229 [=========================>....] - ETA: 0s - loss: 8.4420e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.1431e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 3.3599e-05 39/229 [====>.........................] - ETA: 0s - loss: 1.0179e-04 80/229 [=========>....................] - ETA: 0s - loss: 7.3855e-05 122/229 [==============>...............] - ETA: 0s - loss: 6.3428e-05 160/229 [===================>..........] - ETA: 0s - loss: 7.1737e-05 200/229 [=========================>....] - ETA: 0s - loss: 6.8574e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.4042e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 0, 17 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 570, 1 KNN fn, tp: 0, 17 KNN f1 score: 0.971 KNN cohens kappa score: 0.971 ------ Step 2/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 36s - loss: 1.7982e-04 42/229 [====>.........................] - ETA: 0s - loss: 1.2782e-04  83/229 [=========>....................] - ETA: 0s - loss: 2.7909e-04 125/229 [===============>..............] - ETA: 0s - loss: 2.6136e-04 165/229 [====================>.........] - ETA: 0s - loss: 2.1721e-04 206/229 [=========================>....] - ETA: 0s - loss: 2.3706e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.3163e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 8.7115e-05 41/229 [====>.........................] - ETA: 0s - loss: 2.0886e-04 80/229 [=========>....................] - ETA: 0s - loss: 1.6011e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.3552e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.1778e-04 201/229 [=========================>....] - ETA: 0s - loss: 1.2026e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1350e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.7718e-04 43/229 [====>.........................] - ETA: 0s - loss: 1.1631e-04 84/229 [==========>...................] - ETA: 0s - loss: 1.2130e-04 125/229 [===============>..............] - ETA: 0s - loss: 1.0674e-04 166/229 [====================>.........] - ETA: 0s - loss: 9.7417e-05 207/229 [==========================>...] - ETA: 0s - loss: 9.2728e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.1725e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.8011e-04 41/229 [====>.........................] - ETA: 0s - loss: 8.3443e-05 80/229 [=========>....................] - ETA: 0s - loss: 7.2157e-05 119/229 [==============>...............] - ETA: 0s - loss: 7.0267e-05 158/229 [===================>..........] - ETA: 0s - loss: 6.5105e-05 199/229 [=========================>....] - ETA: 0s - loss: 7.6686e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.5370e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 9.0012e-05 38/229 [===>..........................] - ETA: 0s - loss: 7.5907e-05 79/229 [=========>....................] - ETA: 0s - loss: 6.0862e-05 120/229 [==============>...............] - ETA: 0s - loss: 6.1624e-05 161/229 [====================>.........] - ETA: 0s - loss: 6.5955e-05 197/229 [========================>.....] - ETA: 0s - loss: 6.2250e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.1530e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 7.1067e-05 33/229 [===>..........................] - ETA: 0s - loss: 4.8564e-05 73/229 [========>.....................] - ETA: 0s - loss: 4.2094e-05 114/229 [=============>................] - ETA: 0s - loss: 5.5223e-05 154/229 [===================>..........] - ETA: 0s - loss: 5.3708e-05 194/229 [========================>.....] - ETA: 0s - loss: 5.3902e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.2725e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 2.9338e-05 40/229 [====>.........................] - ETA: 0s - loss: 4.8969e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.6591e-05 120/229 [==============>...............] - ETA: 0s - loss: 4.4933e-05 161/229 [====================>.........] - ETA: 0s - loss: 4.7964e-05 202/229 [=========================>....] - ETA: 0s - loss: 4.5096e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.4866e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 2.7061e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.2592e-05 80/229 [=========>....................] - ETA: 0s - loss: 3.9462e-05 119/229 [==============>...............] - ETA: 0s - loss: 4.1440e-05 158/229 [===================>..........] - ETA: 0s - loss: 3.9455e-05 199/229 [=========================>....] - ETA: 0s - loss: 3.8381e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.9967e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 3.6079e-05 40/229 [====>.........................] - ETA: 0s - loss: 3.4081e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.4843e-05 121/229 [==============>...............] - ETA: 0s - loss: 3.9044e-05 162/229 [====================>.........] - ETA: 0s - loss: 3.5039e-05 201/229 [=========================>....] - ETA: 0s - loss: 3.6423e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.4813e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 8.1636e-06 40/229 [====>.........................] - ETA: 0s - loss: 5.5092e-05 74/229 [========>.....................] - ETA: 0s - loss: 4.6067e-05 113/229 [=============>................] - ETA: 0s - loss: 3.9566e-05 152/229 [==================>...........] - ETA: 0s - loss: 3.4162e-05 193/229 [========================>.....] - ETA: 0s - loss: 3.1961e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.0702e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 2 LR fn, tp: 2, 15 LR f1 score: 0.882 LR cohens kappa score: 0.879 LR average precision score: 0.927 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 2, 15 RF f1 score: 0.938 RF cohens kappa score: 0.936 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 2, 15 GB f1 score: 0.938 GB cohens kappa score: 0.936 -> test with 'KNN' KNN tn, fp: 565, 6 KNN fn, tp: 0, 17 KNN f1 score: 0.850 KNN cohens kappa score: 0.845 ------ Step 2/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 36s - loss: 4.1404e-05 38/229 [===>..........................] - ETA: 0s - loss: 0.0012  79/229 [=========>....................] - ETA: 0s - loss: 8.6009e-04 117/229 [==============>...............] - ETA: 0s - loss: 7.8811e-04 151/229 [==================>...........] - ETA: 0s - loss: 7.4113e-04 187/229 [=======================>......] - ETA: 0s - loss: 7.0690e-04 226/229 [============================>.] - ETA: 0s - loss: 7.0108e-04 229/229 [==============================] - 0s 1ms/step - loss: 6.9467e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 3.9536e-06 38/229 [===>..........................] - ETA: 0s - loss: 6.4317e-04 78/229 [=========>....................] - ETA: 0s - loss: 5.3682e-04 117/229 [==============>...............] - ETA: 0s - loss: 4.9480e-04 156/229 [===================>..........] - ETA: 0s - loss: 5.2667e-04 195/229 [========================>.....] - ETA: 0s - loss: 4.9916e-04 229/229 [==============================] - 0s 1ms/step - loss: 5.1058e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 6.3717e-05 39/229 [====>.........................] - ETA: 0s - loss: 4.6142e-04 75/229 [========>.....................] - ETA: 0s - loss: 3.6602e-04 114/229 [=============>................] - ETA: 0s - loss: 4.4020e-04 154/229 [===================>..........] - ETA: 0s - loss: 4.5508e-04 193/229 [========================>.....] - ETA: 0s - loss: 4.0583e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.8843e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.3643e-06 43/229 [====>.........................] - ETA: 0s - loss: 4.9332e-04 83/229 [=========>....................] - ETA: 0s - loss: 3.3828e-04 124/229 [===============>..............] - ETA: 0s - loss: 2.8402e-04 164/229 [====================>.........] - ETA: 0s - loss: 3.4857e-04 202/229 [=========================>....] - ETA: 0s - loss: 3.3820e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.0324e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 3.2991e-06 43/229 [====>.........................] - ETA: 0s - loss: 2.6075e-04 81/229 [=========>....................] - ETA: 0s - loss: 2.6515e-04 121/229 [==============>...............] - ETA: 0s - loss: 2.6005e-04 162/229 [====================>.........] - ETA: 0s - loss: 2.5231e-04 202/229 [=========================>....] - ETA: 0s - loss: 2.2784e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.3970e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 4.4151e-07 35/229 [===>..........................] - ETA: 0s - loss: 1.9116e-04 69/229 [========>.....................] - ETA: 0s - loss: 1.6215e-04 106/229 [============>.................] - ETA: 0s - loss: 1.7201e-04 147/229 [==================>...........] - ETA: 0s - loss: 2.1172e-04 187/229 [=======================>......] - ETA: 0s - loss: 2.0212e-04 228/229 [============================>.] - ETA: 0s - loss: 1.9027e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.9007e-04 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 8.5426e-05 42/229 [====>.........................] - ETA: 0s - loss: 2.7873e-04 81/229 [=========>....................] - ETA: 0s - loss: 1.9696e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.8086e-04 163/229 [====================>.........] - ETA: 0s - loss: 1.6368e-04 204/229 [=========================>....] - ETA: 0s - loss: 1.4888e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5210e-04 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 6.5218e-06 41/229 [====>.........................] - ETA: 0s - loss: 2.0102e-04 79/229 [=========>....................] - ETA: 0s - loss: 1.5374e-04 120/229 [==============>...............] - ETA: 0s - loss: 1.1485e-04 160/229 [===================>..........] - ETA: 0s - loss: 1.1445e-04 197/229 [========================>.....] - ETA: 0s - loss: 1.2444e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.2307e-04 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.4716e-05 37/229 [===>..........................] - ETA: 0s - loss: 4.6605e-05 77/229 [=========>....................] - ETA: 0s - loss: 4.8656e-05 117/229 [==============>...............] - ETA: 0s - loss: 7.5222e-05 158/229 [===================>..........] - ETA: 0s - loss: 8.3356e-05 199/229 [=========================>....] - ETA: 0s - loss: 9.5674e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.9794e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 7.5330e-06 38/229 [===>..........................] - ETA: 0s - loss: 7.4553e-05 78/229 [=========>....................] - ETA: 0s - loss: 6.7941e-05 118/229 [==============>...............] - ETA: 0s - loss: 7.5230e-05 160/229 [===================>..........] - ETA: 0s - loss: 6.2394e-05 199/229 [=========================>....] - ETA: 0s - loss: 7.8390e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.1632e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 2 LR fn, tp: 0, 17 LR f1 score: 0.944 LR cohens kappa score: 0.943 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 565, 6 KNN fn, tp: 0, 17 KNN f1 score: 0.850 KNN cohens kappa score: 0.845 ------ Step 2/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2216 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 36s - loss: 5.2152e-05 36/229 [===>..........................] - ETA: 0s - loss: 5.8634e-04  72/229 [========>.....................] - ETA: 0s - loss: 6.8315e-04 110/229 [=============>................] - ETA: 0s - loss: 6.8875e-04 147/229 [==================>...........] - ETA: 0s - loss: 6.2235e-04 181/229 [======================>.......] - ETA: 0s - loss: 5.4293e-04 217/229 [===========================>..] - ETA: 0s - loss: 5.0557e-04 229/229 [==============================] - 0s 1ms/step - loss: 5.0189e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 0.0043 35/229 [===>..........................] - ETA: 0s - loss: 3.0665e-04 71/229 [========>.....................] - ETA: 0s - loss: 3.4193e-04 103/229 [============>.................] - ETA: 0s - loss: 3.6122e-04 138/229 [=================>............] - ETA: 0s - loss: 3.3604e-04 173/229 [=====================>........] - ETA: 0s - loss: 3.1526e-04 211/229 [==========================>...] - ETA: 0s - loss: 2.9804e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.9535e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.2970e-04 36/229 [===>..........................] - ETA: 0s - loss: 3.3978e-04 74/229 [========>.....................] - ETA: 0s - loss: 2.4005e-04 114/229 [=============>................] - ETA: 0s - loss: 2.0018e-04 148/229 [==================>...........] - ETA: 0s - loss: 1.8998e-04 179/229 [======================>.......] - ETA: 0s - loss: 1.9136e-04 215/229 [===========================>..] - ETA: 0s - loss: 2.0044e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.9672e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.1232e-07 36/229 [===>..........................] - ETA: 0s - loss: 1.7079e-04 68/229 [=======>......................] - ETA: 0s - loss: 1.3733e-04 103/229 [============>.................] - ETA: 0s - loss: 1.5269e-04 138/229 [=================>............] - ETA: 0s - loss: 1.6518e-04 172/229 [=====================>........] - ETA: 0s - loss: 1.5539e-04 207/229 [==========================>...] - ETA: 0s - loss: 1.4754e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4385e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 4.6458e-06 30/229 [==>...........................] - ETA: 0s - loss: 1.0057e-04 67/229 [=======>......................] - ETA: 0s - loss: 1.4417e-04 101/229 [============>.................] - ETA: 0s - loss: 1.3717e-04 138/229 [=================>............] - ETA: 0s - loss: 1.3615e-04 179/229 [======================>.......] - ETA: 0s - loss: 1.1942e-04 214/229 [===========================>..] - ETA: 0s - loss: 1.1805e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1189e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 4.4423e-05 35/229 [===>..........................] - ETA: 0s - loss: 5.7827e-05 69/229 [========>.....................] - ETA: 0s - loss: 1.0077e-04 106/229 [============>.................] - ETA: 0s - loss: 8.6455e-05 141/229 [=================>............] - ETA: 0s - loss: 8.6684e-05 179/229 [======================>.......] - ETA: 0s - loss: 8.6683e-05 214/229 [===========================>..] - ETA: 0s - loss: 8.5972e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.6553e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 5.3456e-06 36/229 [===>..........................] - ETA: 0s - loss: 4.0749e-05 71/229 [========>.....................] - ETA: 0s - loss: 5.8778e-05 109/229 [=============>................] - ETA: 0s - loss: 7.0952e-05 145/229 [=================>............] - ETA: 0s - loss: 6.9543e-05 180/229 [======================>.......] - ETA: 0s - loss: 7.2530e-05 217/229 [===========================>..] - ETA: 0s - loss: 6.8445e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.8977e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 3.8247e-06 35/229 [===>..........................] - ETA: 0s - loss: 4.4271e-05 69/229 [========>.....................] - ETA: 0s - loss: 5.1720e-05 107/229 [=============>................] - ETA: 0s - loss: 4.7829e-05 142/229 [=================>............] - ETA: 0s - loss: 5.6089e-05 176/229 [======================>.......] - ETA: 0s - loss: 5.4853e-05 213/229 [==========================>...] - ETA: 0s - loss: 5.6494e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5732e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 3.5006e-06 35/229 [===>..........................] - ETA: 0s - loss: 4.3583e-05 70/229 [========>.....................] - ETA: 0s - loss: 4.6205e-05 104/229 [============>.................] - ETA: 0s - loss: 4.5967e-05 139/229 [=================>............] - ETA: 0s - loss: 5.0003e-05 170/229 [=====================>........] - ETA: 0s - loss: 4.6546e-05 204/229 [=========================>....] - ETA: 0s - loss: 4.7002e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.5168e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 4.5547e-06 32/229 [===>..........................] - ETA: 0s - loss: 5.3874e-05 63/229 [=======>......................] - ETA: 0s - loss: 4.8109e-05 94/229 [===========>..................] - ETA: 0s - loss: 4.1979e-05 128/229 [===============>..............] - ETA: 0s - loss: 4.1454e-05 165/229 [====================>.........] - ETA: 0s - loss: 4.0773e-05 201/229 [=========================>....] - ETA: 0s - loss: 3.7067e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.9720e-05 -> test with GAN.predict GAN tn, fp: 570, 0 GAN fn, tp: 0, 13 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 1 LR fn, tp: 0, 13 LR f1 score: 0.963 LR cohens kappa score: 0.962 LR average precision score: 0.995 -> test with 'RF' RF tn, fp: 570, 0 RF fn, tp: 0, 13 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 570, 0 GB fn, tp: 0, 13 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 563, 7 KNN fn, tp: 0, 13 KNN f1 score: 0.788 KNN cohens kappa score: 0.782 ====== Step 3/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 3/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 41s - loss: 7.6524e-06 36/229 [===>..........................] - ETA: 0s - loss: 0.0062  72/229 [========>.....................] - ETA: 0s - loss: 0.0032 106/229 [============>.................] - ETA: 0s - loss: 0.0022 142/229 [=================>............] - ETA: 0s - loss: 0.0016 177/229 [======================>.......] - ETA: 0s - loss: 0.0017 211/229 [==========================>...] - ETA: 0s - loss: 0.0015 229/229 [==============================] - 1s 1ms/step - loss: 0.0014 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 6.7949e-04 36/229 [===>..........................] - ETA: 0s - loss: 5.1215e-04 70/229 [========>.....................] - ETA: 0s - loss: 3.3667e-04 105/229 [============>.................] - ETA: 0s - loss: 2.5576e-04 141/229 [=================>............] - ETA: 0s - loss: 2.8732e-04 175/229 [=====================>........] - ETA: 0s - loss: 2.7635e-04 208/229 [==========================>...] - ETA: 0s - loss: 2.6582e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.5511e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.4514e-04 30/229 [==>...........................] - ETA: 0s - loss: 1.3765e-04 60/229 [======>.......................] - ETA: 0s - loss: 1.1171e-04 94/229 [===========>..................] - ETA: 0s - loss: 1.3215e-04 130/229 [================>.............] - ETA: 0s - loss: 2.1175e-04 164/229 [====================>.........] - ETA: 0s - loss: 1.9321e-04 197/229 [========================>.....] - ETA: 0s - loss: 1.8001e-04 229/229 [==============================] - 0s 2ms/step - loss: 1.6724e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.0328e-05 36/229 [===>..........................] - ETA: 0s - loss: 6.0957e-05 70/229 [========>.....................] - ETA: 0s - loss: 6.0212e-05 102/229 [============>.................] - ETA: 0s - loss: 1.6392e-04 137/229 [================>.............] - ETA: 0s - loss: 1.6432e-04 173/229 [=====================>........] - ETA: 0s - loss: 1.6076e-04 208/229 [==========================>...] - ETA: 0s - loss: 1.5271e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4348e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 5.5708e-05 36/229 [===>..........................] - ETA: 0s - loss: 6.6767e-05 71/229 [========>.....................] - ETA: 0s - loss: 1.5028e-04 105/229 [============>.................] - ETA: 0s - loss: 1.2853e-04 137/229 [================>.............] - ETA: 0s - loss: 1.2404e-04 171/229 [=====================>........] - ETA: 0s - loss: 1.1548e-04 204/229 [=========================>....] - ETA: 0s - loss: 1.2906e-04 229/229 [==============================] - 0s 2ms/step - loss: 1.2363e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.5114e-05 30/229 [==>...........................] - ETA: 0s - loss: 8.1969e-05 64/229 [=======>......................] - ETA: 0s - loss: 7.3982e-05 101/229 [============>.................] - ETA: 0s - loss: 7.9995e-05 137/229 [================>.............] - ETA: 0s - loss: 1.0667e-04 174/229 [=====================>........] - ETA: 0s - loss: 1.0281e-04 214/229 [===========================>..] - ETA: 0s - loss: 9.8971e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.8519e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.7943e-05 36/229 [===>..........................] - ETA: 0s - loss: 6.4112e-05 72/229 [========>.....................] - ETA: 0s - loss: 8.3266e-05 107/229 [=============>................] - ETA: 0s - loss: 8.0926e-05 144/229 [=================>............] - ETA: 0s - loss: 7.2200e-05 180/229 [======================>.......] - ETA: 0s - loss: 6.5515e-05 216/229 [===========================>..] - ETA: 0s - loss: 7.3970e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.1554e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 9.3984e-05 35/229 [===>..........................] - ETA: 0s - loss: 7.6093e-05 71/229 [========>.....................] - ETA: 0s - loss: 6.7228e-05 108/229 [=============>................] - ETA: 0s - loss: 5.8674e-05 147/229 [==================>...........] - ETA: 0s - loss: 8.1101e-05 182/229 [======================>.......] - ETA: 0s - loss: 7.7794e-05 217/229 [===========================>..] - ETA: 0s - loss: 7.5811e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.2157e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.5859e-05 35/229 [===>..........................] - ETA: 0s - loss: 5.8736e-05 71/229 [========>.....................] - ETA: 0s - loss: 8.1194e-05 108/229 [=============>................] - ETA: 0s - loss: 6.6543e-05 144/229 [=================>............] - ETA: 0s - loss: 8.8777e-05 180/229 [======================>.......] - ETA: 0s - loss: 7.8587e-05 214/229 [===========================>..] - ETA: 0s - loss: 7.4982e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.1955e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 6.8614e-05 39/229 [====>.........................] - ETA: 0s - loss: 5.5994e-05 75/229 [========>.....................] - ETA: 0s - loss: 5.5476e-05 114/229 [=============>................] - ETA: 0s - loss: 4.8165e-05 155/229 [===================>..........] - ETA: 0s - loss: 5.3078e-05 186/229 [=======================>......] - ETA: 0s - loss: 6.4177e-05 222/229 [============================>.] - ETA: 0s - loss: 6.0527e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.4015e-05 -> test with GAN.predict GAN tn, fp: 570, 1 GAN fn, tp: 0, 17 GAN f1 score: 0.971 GAN cohens kappa score: 0.971 -> test with 'LR' LR tn, fp: 570, 1 LR fn, tp: 0, 17 LR f1 score: 0.971 LR cohens kappa score: 0.971 LR average precision score: 0.997 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 568, 3 KNN fn, tp: 0, 17 KNN f1 score: 0.919 KNN cohens kappa score: 0.916 ------ Step 3/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 35s - loss: 8.8099e-05 43/229 [====>.........................] - ETA: 0s - loss: 5.7631e-04  84/229 [==========>...................] - ETA: 0s - loss: 4.1368e-04 126/229 [===============>..............] - ETA: 0s - loss: 6.7643e-04 167/229 [====================>.........] - ETA: 0s - loss: 6.7557e-04 208/229 [==========================>...] - ETA: 0s - loss: 5.9754e-04 229/229 [==============================] - 0s 1ms/step - loss: 5.8648e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 1.2696e-06 41/229 [====>.........................] - ETA: 0s - loss: 4.3210e-04 81/229 [=========>....................] - ETA: 0s - loss: 3.3651e-04 123/229 [===============>..............] - ETA: 0s - loss: 2.6837e-04 163/229 [====================>.........] - ETA: 0s - loss: 2.3840e-04 201/229 [=========================>....] - ETA: 0s - loss: 2.3937e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.3848e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.1826e-05 37/229 [===>..........................] - ETA: 0s - loss: 2.3444e-04 73/229 [========>.....................] - ETA: 0s - loss: 1.9551e-04 113/229 [=============>................] - ETA: 0s - loss: 1.9587e-04 153/229 [===================>..........] - ETA: 0s - loss: 1.9731e-04 193/229 [========================>.....] - ETA: 0s - loss: 1.9988e-04 225/229 [============================>.] - ETA: 0s - loss: 1.8551e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.8334e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 5.2828e-04 36/229 [===>..........................] - ETA: 0s - loss: 1.3948e-04 77/229 [=========>....................] - ETA: 0s - loss: 1.4932e-04 115/229 [==============>...............] - ETA: 0s - loss: 1.4665e-04 151/229 [==================>...........] - ETA: 0s - loss: 1.3431e-04 187/229 [=======================>......] - ETA: 0s - loss: 1.3171e-04 225/229 [============================>.] - ETA: 0s - loss: 1.3445e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3497e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.2334e-05 38/229 [===>..........................] - ETA: 0s - loss: 8.0531e-05 75/229 [========>.....................] - ETA: 0s - loss: 1.1119e-04 112/229 [=============>................] - ETA: 0s - loss: 1.1506e-04 145/229 [=================>............] - ETA: 0s - loss: 1.1631e-04 181/229 [======================>.......] - ETA: 0s - loss: 1.0806e-04 218/229 [===========================>..] - ETA: 0s - loss: 1.0360e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0296e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.4166e-05 38/229 [===>..........................] - ETA: 0s - loss: 9.0618e-05 73/229 [========>.....................] - ETA: 0s - loss: 7.5819e-05 111/229 [=============>................] - ETA: 0s - loss: 7.6758e-05 146/229 [==================>...........] - ETA: 0s - loss: 8.6567e-05 179/229 [======================>.......] - ETA: 0s - loss: 8.3853e-05 212/229 [==========================>...] - ETA: 0s - loss: 8.1995e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.5009e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 2.4975e-05 34/229 [===>..........................] - ETA: 0s - loss: 1.0946e-04 69/229 [========>.....................] - ETA: 0s - loss: 9.3377e-05 104/229 [============>.................] - ETA: 0s - loss: 8.2132e-05 139/229 [=================>............] - ETA: 0s - loss: 7.4949e-05 173/229 [=====================>........] - ETA: 0s - loss: 7.9184e-05 209/229 [==========================>...] - ETA: 0s - loss: 7.5625e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.1949e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 3.7386e-06 37/229 [===>..........................] - ETA: 0s - loss: 7.0724e-05 74/229 [========>.....................] - ETA: 0s - loss: 7.0516e-05 107/229 [=============>................] - ETA: 0s - loss: 6.2647e-05 138/229 [=================>............] - ETA: 0s - loss: 5.5783e-05 172/229 [=====================>........] - ETA: 0s - loss: 5.2113e-05 204/229 [=========================>....] - ETA: 0s - loss: 5.4797e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.9604e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 5.4039e-06 35/229 [===>..........................] - ETA: 0s - loss: 5.8336e-05 70/229 [========>.....................] - ETA: 0s - loss: 5.5501e-05 102/229 [============>.................] - ETA: 0s - loss: 5.5403e-05 132/229 [================>.............] - ETA: 0s - loss: 5.5297e-05 161/229 [====================>.........] - ETA: 0s - loss: 5.7806e-05 194/229 [========================>.....] - ETA: 0s - loss: 5.4329e-05 226/229 [============================>.] - ETA: 0s - loss: 5.1254e-05 229/229 [==============================] - 0s 2ms/step - loss: 5.0755e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 5.1915e-07 33/229 [===>..........................] - ETA: 0s - loss: 2.6881e-05 66/229 [=======>......................] - ETA: 0s - loss: 2.5286e-05 100/229 [============>.................] - ETA: 0s - loss: 4.2584e-05 135/229 [================>.............] - ETA: 0s - loss: 4.1937e-05 169/229 [=====================>........] - ETA: 0s - loss: 4.1122e-05 204/229 [=========================>....] - ETA: 0s - loss: 4.4082e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.4378e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 2 LR fn, tp: 0, 17 LR f1 score: 0.944 LR cohens kappa score: 0.943 LR average precision score: 0.994 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 1, 16 RF f1 score: 0.970 RF cohens kappa score: 0.969 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 565, 6 KNN fn, tp: 0, 17 KNN f1 score: 0.850 KNN cohens kappa score: 0.845 ------ Step 3/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 42s - loss: 1.6120e-04 40/229 [====>.........................] - ETA: 0s - loss: 6.3364e-04  79/229 [=========>....................] - ETA: 0s - loss: 5.3791e-04 119/229 [==============>...............] - ETA: 0s - loss: 4.9082e-04 159/229 [===================>..........] - ETA: 0s - loss: 4.3304e-04 199/229 [=========================>....] - ETA: 0s - loss: 3.8333e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.4979e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 8.7576e-06 41/229 [====>.........................] - ETA: 0s - loss: 1.5361e-04 77/229 [=========>....................] - ETA: 0s - loss: 1.9596e-04 112/229 [=============>................] - ETA: 0s - loss: 1.8907e-04 142/229 [=================>............] - ETA: 0s - loss: 1.7598e-04 178/229 [======================>.......] - ETA: 0s - loss: 1.6242e-04 211/229 [==========================>...] - ETA: 0s - loss: 1.4601e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3871e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.9898e-04 40/229 [====>.........................] - ETA: 0s - loss: 8.1620e-05 79/229 [=========>....................] - ETA: 0s - loss: 7.1818e-05 116/229 [==============>...............] - ETA: 0s - loss: 9.2471e-05 154/229 [===================>..........] - ETA: 0s - loss: 9.6049e-05 193/229 [========================>.....] - ETA: 0s - loss: 1.0847e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0773e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.9166e-05 39/229 [====>.........................] - ETA: 0s - loss: 8.0821e-05 73/229 [========>.....................] - ETA: 0s - loss: 6.2354e-05 107/229 [=============>................] - ETA: 0s - loss: 5.9587e-05 141/229 [=================>............] - ETA: 0s - loss: 6.4593e-05 175/229 [=====================>........] - ETA: 0s - loss: 8.5302e-05 209/229 [==========================>...] - ETA: 0s - loss: 8.3618e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.9238e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.8888e-06 37/229 [===>..........................] - ETA: 0s - loss: 7.4323e-05 71/229 [========>.....................] - ETA: 0s - loss: 7.4851e-05 109/229 [=============>................] - ETA: 0s - loss: 6.4511e-05 145/229 [=================>............] - ETA: 0s - loss: 6.4964e-05 181/229 [======================>.......] - ETA: 0s - loss: 6.0294e-05 215/229 [===========================>..] - ETA: 0s - loss: 6.0975e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.8646e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 4.8878e-05 36/229 [===>..........................] - ETA: 0s - loss: 3.7714e-05 72/229 [========>.....................] - ETA: 0s - loss: 4.5375e-05 112/229 [=============>................] - ETA: 0s - loss: 3.8384e-05 147/229 [==================>...........] - ETA: 0s - loss: 6.3704e-05 183/229 [======================>.......] - ETA: 0s - loss: 5.6865e-05 222/229 [============================>.] - ETA: 0s - loss: 5.5552e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.4884e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.6985e-05 39/229 [====>.........................] - ETA: 0s - loss: 6.6629e-05 75/229 [========>.....................] - ETA: 0s - loss: 5.6347e-05 107/229 [=============>................] - ETA: 0s - loss: 4.8081e-05 137/229 [================>.............] - ETA: 0s - loss: 5.2573e-05 170/229 [=====================>........] - ETA: 0s - loss: 4.9677e-05 208/229 [==========================>...] - ETA: 0s - loss: 4.4253e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.3362e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 2.9068e-08 40/229 [====>.........................] - ETA: 0s - loss: 3.6817e-05 73/229 [========>.....................] - ETA: 0s - loss: 3.2626e-05 113/229 [=============>................] - ETA: 0s - loss: 4.7940e-05 151/229 [==================>...........] - ETA: 0s - loss: 4.2385e-05 188/229 [=======================>......] - ETA: 0s - loss: 4.0220e-05 227/229 [============================>.] - ETA: 0s - loss: 3.7147e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.6985e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.1554e-05 38/229 [===>..........................] - ETA: 0s - loss: 2.3940e-05 69/229 [========>.....................] - ETA: 0s - loss: 2.7997e-05 100/229 [============>.................] - ETA: 0s - loss: 3.0702e-05 136/229 [================>.............] - ETA: 0s - loss: 2.6841e-05 177/229 [======================>.......] - ETA: 0s - loss: 3.5380e-05 219/229 [===========================>..] - ETA: 0s - loss: 3.5492e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.4404e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 6.8229e-05 41/229 [====>.........................] - ETA: 0s - loss: 5.2375e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.4504e-05 119/229 [==============>...............] - ETA: 0s - loss: 3.8957e-05 158/229 [===================>..........] - ETA: 0s - loss: 3.3268e-05 190/229 [=======================>......] - ETA: 0s - loss: 3.0027e-05 227/229 [============================>.] - ETA: 0s - loss: 2.7360e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.7298e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 2 LR fn, tp: 0, 17 LR f1 score: 0.944 LR cohens kappa score: 0.943 LR average precision score: 0.997 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 4 KNN fn, tp: 0, 17 KNN f1 score: 0.895 KNN cohens kappa score: 0.891 ------ Step 3/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 36s - loss: 1.8220e-04 42/229 [====>.........................] - ETA: 0s - loss: 0.0018  83/229 [=========>....................] - ETA: 0s - loss: 0.0010 124/229 [===============>..............] - ETA: 0s - loss: 7.2787e-04 165/229 [====================>.........] - ETA: 0s - loss: 5.9196e-04 205/229 [=========================>....] - ETA: 0s - loss: 4.9287e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.5117e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 5.0208e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.0428e-04 83/229 [=========>....................] - ETA: 0s - loss: 8.9199e-05 123/229 [===============>..............] - ETA: 0s - loss: 1.0805e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.1456e-04 201/229 [=========================>....] - ETA: 0s - loss: 1.1004e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0430e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.4642e-05 42/229 [====>.........................] - ETA: 0s - loss: 7.7944e-05 83/229 [=========>....................] - ETA: 0s - loss: 8.3449e-05 121/229 [==============>...............] - ETA: 0s - loss: 9.5049e-05 153/229 [===================>..........] - ETA: 0s - loss: 9.8430e-05 186/229 [=======================>......] - ETA: 0s - loss: 9.4637e-05 224/229 [============================>.] - ETA: 0s - loss: 8.8356e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.7088e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 4.2629e-05 38/229 [===>..........................] - ETA: 0s - loss: 6.9599e-05 77/229 [=========>....................] - ETA: 0s - loss: 5.6590e-05 115/229 [==============>...............] - ETA: 0s - loss: 6.6477e-05 153/229 [===================>..........] - ETA: 0s - loss: 7.1838e-05 194/229 [========================>.....] - ETA: 0s - loss: 7.0987e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.4478e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 3.7311e-05 41/229 [====>.........................] - ETA: 0s - loss: 4.8164e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.6095e-05 123/229 [===============>..............] - ETA: 0s - loss: 6.1198e-05 163/229 [====================>.........] - ETA: 0s - loss: 6.9046e-05 203/229 [=========================>....] - ETA: 0s - loss: 6.6394e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.5178e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.3564e-05 42/229 [====>.........................] - ETA: 0s - loss: 4.2767e-05 83/229 [=========>....................] - ETA: 0s - loss: 4.1801e-05 124/229 [===============>..............] - ETA: 0s - loss: 4.7653e-05 160/229 [===================>..........] - ETA: 0s - loss: 4.4950e-05 201/229 [=========================>....] - ETA: 0s - loss: 4.9682e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5903e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 4.3965e-05 41/229 [====>.........................] - ETA: 0s - loss: 4.6419e-05 78/229 [=========>....................] - ETA: 0s - loss: 5.4824e-05 119/229 [==============>...............] - ETA: 0s - loss: 4.7573e-05 160/229 [===================>..........] - ETA: 0s - loss: 5.1231e-05 200/229 [=========================>....] - ETA: 0s - loss: 4.9717e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.9898e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 6.0711e-05 42/229 [====>.........................] - ETA: 0s - loss: 4.6843e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.2035e-05 123/229 [===============>..............] - ETA: 0s - loss: 4.7599e-05 162/229 [====================>.........] - ETA: 0s - loss: 4.5069e-05 203/229 [=========================>....] - ETA: 0s - loss: 4.6028e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.3676e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 4.0457e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.8310e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.0721e-05 122/229 [==============>...............] - ETA: 0s - loss: 3.4055e-05 161/229 [====================>.........] - ETA: 0s - loss: 3.6300e-05 202/229 [=========================>....] - ETA: 0s - loss: 3.8790e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.8876e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 3.6097e-05 40/229 [====>.........................] - ETA: 0s - loss: 6.0235e-05 79/229 [=========>....................] - ETA: 0s - loss: 4.8816e-05 120/229 [==============>...............] - ETA: 0s - loss: 4.0245e-05 163/229 [====================>.........] - ETA: 0s - loss: 3.5608e-05 198/229 [========================>.....] - ETA: 0s - loss: 3.5970e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.4691e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 1 LR fn, tp: 0, 17 LR f1 score: 0.971 LR cohens kappa score: 0.971 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 4 KNN fn, tp: 0, 17 KNN f1 score: 0.895 KNN cohens kappa score: 0.891 ------ Step 3/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2216 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 43s - loss: 1.5492e-05 43/229 [====>.........................] - ETA: 0s - loss: 1.1253e-04  85/229 [==========>...................] - ETA: 0s - loss: 9.1834e-05 126/229 [===============>..............] - ETA: 0s - loss: 7.8323e-05 166/229 [====================>.........] - ETA: 0s - loss: 7.2151e-05 207/229 [==========================>...] - ETA: 0s - loss: 6.6356e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.3035e-05 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 2.6371e-05 42/229 [====>.........................] - ETA: 0s - loss: 3.5237e-05 82/229 [=========>....................] - ETA: 0s - loss: 4.6631e-05 123/229 [===============>..............] - ETA: 0s - loss: 4.6254e-05 165/229 [====================>.........] - ETA: 0s - loss: 6.2573e-05 206/229 [=========================>....] - ETA: 0s - loss: 5.6998e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.5216e-05 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.1895e-04 41/229 [====>.........................] - ETA: 0s - loss: 3.4495e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.6055e-05 123/229 [===============>..............] - ETA: 0s - loss: 3.2685e-05 162/229 [====================>.........] - ETA: 0s - loss: 3.5752e-05 203/229 [=========================>....] - ETA: 0s - loss: 3.8938e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.5990e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.0878e-05 41/229 [====>.........................] - ETA: 0s - loss: 5.0400e-05 82/229 [=========>....................] - ETA: 0s - loss: 4.5571e-05 121/229 [==============>...............] - ETA: 0s - loss: 4.3840e-05 161/229 [====================>.........] - ETA: 0s - loss: 3.8412e-05 202/229 [=========================>....] - ETA: 0s - loss: 4.2979e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.9905e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.5276e-05 42/229 [====>.........................] - ETA: 0s - loss: 3.7364e-05 79/229 [=========>....................] - ETA: 0s - loss: 4.2526e-05 113/229 [=============>................] - ETA: 0s - loss: 4.0570e-05 146/229 [==================>...........] - ETA: 0s - loss: 3.5038e-05 185/229 [=======================>......] - ETA: 0s - loss: 3.6019e-05 226/229 [============================>.] - ETA: 0s - loss: 3.3746e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.3502e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 1.1901e-05 41/229 [====>.........................] - ETA: 0s - loss: 2.2431e-05 81/229 [=========>....................] - ETA: 0s - loss: 2.3992e-05 117/229 [==============>...............] - ETA: 0s - loss: 2.2439e-05 158/229 [===================>..........] - ETA: 0s - loss: 2.3547e-05 198/229 [========================>.....] - ETA: 0s - loss: 2.7379e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.8951e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.4161e-05 40/229 [====>.........................] - ETA: 0s - loss: 1.2623e-05 76/229 [========>.....................] - ETA: 0s - loss: 1.6099e-05 116/229 [==============>...............] - ETA: 0s - loss: 2.2107e-05 156/229 [===================>..........] - ETA: 0s - loss: 2.8436e-05 196/229 [========================>.....] - ETA: 0s - loss: 2.6584e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.8244e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.5972e-05 41/229 [====>.........................] - ETA: 0s - loss: 2.3851e-05 83/229 [=========>....................] - ETA: 0s - loss: 2.9834e-05 125/229 [===============>..............] - ETA: 0s - loss: 2.5745e-05 166/229 [====================>.........] - ETA: 0s - loss: 2.2882e-05 207/229 [==========================>...] - ETA: 0s - loss: 2.5741e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.4619e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 3.7100e-06 40/229 [====>.........................] - ETA: 0s - loss: 2.1183e-05 81/229 [=========>....................] - ETA: 0s - loss: 2.0451e-05 122/229 [==============>...............] - ETA: 0s - loss: 2.4806e-05 163/229 [====================>.........] - ETA: 0s - loss: 2.2025e-05 203/229 [=========================>....] - ETA: 0s - loss: 1.9503e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.0473e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 8.7066e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.0295e-05 83/229 [=========>....................] - ETA: 0s - loss: 1.8651e-05 123/229 [===============>..............] - ETA: 0s - loss: 2.2014e-05 164/229 [====================>.........] - ETA: 0s - loss: 1.8386e-05 206/229 [=========================>....] - ETA: 0s - loss: 2.0914e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.0496e-05 -> test with GAN.predict GAN tn, fp: 570, 0 GAN fn, tp: 0, 13 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 569, 1 LR fn, tp: 1, 12 LR f1 score: 0.923 LR cohens kappa score: 0.921 LR average precision score: 0.990 -> test with 'RF' RF tn, fp: 570, 0 RF fn, tp: 0, 13 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 570, 0 GB fn, tp: 0, 13 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 568, 2 KNN fn, tp: 0, 13 KNN f1 score: 0.929 KNN cohens kappa score: 0.927 ====== Step 4/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 4/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 37s - loss: 5.5847e-05 41/229 [====>.........................] - ETA: 0s - loss: 9.7692e-04  82/229 [=========>....................] - ETA: 0s - loss: 5.4068e-04 122/229 [==============>...............] - ETA: 0s - loss: 5.2303e-04 161/229 [====================>.........] - ETA: 0s - loss: 6.6669e-04 196/229 [========================>.....] - ETA: 0s - loss: 6.6686e-04 229/229 [==============================] - 0s 1ms/step - loss: 5.8508e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 2.9534e-05 38/229 [===>..........................] - ETA: 0s - loss: 1.6644e-04 77/229 [=========>....................] - ETA: 0s - loss: 4.2595e-04 117/229 [==============>...............] - ETA: 0s - loss: 5.3307e-04 155/229 [===================>..........] - ETA: 0s - loss: 4.3268e-04 195/229 [========================>.....] - ETA: 0s - loss: 4.5961e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.3897e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.3708e-06 41/229 [====>.........................] - ETA: 0s - loss: 2.6069e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.0832e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.5509e-04 163/229 [====================>.........] - ETA: 0s - loss: 3.2318e-04 203/229 [=========================>....] - ETA: 0s - loss: 3.3948e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.8319e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.7843e-05 41/229 [====>.........................] - ETA: 0s - loss: 4.2398e-04 82/229 [=========>....................] - ETA: 0s - loss: 4.8861e-04 124/229 [===============>..............] - ETA: 0s - loss: 3.4410e-04 163/229 [====================>.........] - ETA: 0s - loss: 3.7661e-04 204/229 [=========================>....] - ETA: 0s - loss: 3.1610e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.1760e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.2528e-04 38/229 [===>..........................] - ETA: 0s - loss: 4.8807e-05 79/229 [=========>....................] - ETA: 0s - loss: 2.4097e-04 120/229 [==============>...............] - ETA: 0s - loss: 2.3005e-04 161/229 [====================>.........] - ETA: 0s - loss: 2.8035e-04 201/229 [=========================>....] - ETA: 0s - loss: 2.9637e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.6680e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 0.0058 41/229 [====>.........................] - ETA: 0s - loss: 4.7051e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.5060e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.7202e-04 160/229 [===================>..........] - ETA: 0s - loss: 1.9767e-04 199/229 [=========================>....] - ETA: 0s - loss: 2.2374e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.2348e-04 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 8.6983e-06 42/229 [====>.........................] - ETA: 0s - loss: 2.9540e-04 82/229 [=========>....................] - ETA: 0s - loss: 2.9263e-04 122/229 [==============>...............] - ETA: 0s - loss: 2.4690e-04 163/229 [====================>.........] - ETA: 0s - loss: 2.5117e-04 204/229 [=========================>....] - ETA: 0s - loss: 2.0787e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.8711e-04 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 2.0705e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.3976e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.8582e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.3727e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.1025e-04 200/229 [=========================>....] - ETA: 0s - loss: 1.2879e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5977e-04 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 6.7586e-05 35/229 [===>..........................] - ETA: 0s - loss: 2.2985e-05 69/229 [========>.....................] - ETA: 0s - loss: 2.1707e-05 107/229 [=============>................] - ETA: 0s - loss: 1.3265e-04 149/229 [==================>...........] - ETA: 0s - loss: 1.2616e-04 189/229 [=======================>......] - ETA: 0s - loss: 1.3667e-04 228/229 [============================>.] - ETA: 0s - loss: 1.3273e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.3256e-04 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 5.7917e-05 40/229 [====>.........................] - ETA: 0s - loss: 9.7237e-05 81/229 [=========>....................] - ETA: 0s - loss: 9.6403e-05 122/229 [==============>...............] - ETA: 0s - loss: 6.9291e-05 161/229 [====================>.........] - ETA: 0s - loss: 8.8999e-05 202/229 [=========================>....] - ETA: 0s - loss: 1.0882e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1148e-04 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 568, 3 LR fn, tp: 0, 17 LR f1 score: 0.919 LR cohens kappa score: 0.916 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 563, 8 KNN fn, tp: 0, 17 KNN f1 score: 0.810 KNN cohens kappa score: 0.803 ------ Step 4/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 39s - loss: 1.8220e-04 42/229 [====>.........................] - ETA: 0s - loss: 6.8493e-04  83/229 [=========>....................] - ETA: 0s - loss: 5.5017e-04 124/229 [===============>..............] - ETA: 0s - loss: 4.2448e-04 164/229 [====================>.........] - ETA: 0s - loss: 3.4648e-04 205/229 [=========================>....] - ETA: 0s - loss: 3.1797e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.9229e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 6.0001e-05 36/229 [===>..........................] - ETA: 0s - loss: 1.1427e-04 68/229 [=======>......................] - ETA: 0s - loss: 8.4980e-05 103/229 [============>.................] - ETA: 0s - loss: 6.8676e-05 141/229 [=================>............] - ETA: 0s - loss: 9.6765e-05 180/229 [======================>.......] - ETA: 0s - loss: 1.1102e-04 220/229 [===========================>..] - ETA: 0s - loss: 1.1966e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1814e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.3419e-05 40/229 [====>.........................] - ETA: 0s - loss: 6.2076e-05 81/229 [=========>....................] - ETA: 0s - loss: 7.3808e-05 119/229 [==============>...............] - ETA: 0s - loss: 7.2604e-05 160/229 [===================>..........] - ETA: 0s - loss: 7.6135e-05 199/229 [=========================>....] - ETA: 0s - loss: 9.1228e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.7308e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 3.1455e-05 40/229 [====>.........................] - ETA: 0s - loss: 8.0744e-05 81/229 [=========>....................] - ETA: 0s - loss: 6.3472e-05 121/229 [==============>...............] - ETA: 0s - loss: 7.9629e-05 160/229 [===================>..........] - ETA: 0s - loss: 7.7656e-05 200/229 [=========================>....] - ETA: 0s - loss: 8.1429e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.3061e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.0697e-05 41/229 [====>.........................] - ETA: 0s - loss: 7.1603e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.4512e-05 123/229 [===============>..............] - ETA: 0s - loss: 7.3250e-05 164/229 [====================>.........] - ETA: 0s - loss: 8.0077e-05 203/229 [=========================>....] - ETA: 0s - loss: 7.5732e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.2792e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 4.7907e-06 41/229 [====>.........................] - ETA: 0s - loss: 8.5234e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.2869e-05 122/229 [==============>...............] - ETA: 0s - loss: 5.7561e-05 162/229 [====================>.........] - ETA: 0s - loss: 5.3125e-05 202/229 [=========================>....] - ETA: 0s - loss: 5.9759e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.1650e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.5257e-05 42/229 [====>.........................] - ETA: 0s - loss: 6.7311e-05 82/229 [=========>....................] - ETA: 0s - loss: 5.6510e-05 122/229 [==============>...............] - ETA: 0s - loss: 7.1484e-05 161/229 [====================>.........] - ETA: 0s - loss: 6.6278e-05 202/229 [=========================>....] - ETA: 0s - loss: 5.7775e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.4363e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.1978e-04 42/229 [====>.........................] - ETA: 0s - loss: 3.3261e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.4979e-05 120/229 [==============>...............] - ETA: 0s - loss: 5.2425e-05 162/229 [====================>.........] - ETA: 0s - loss: 5.3592e-05 202/229 [=========================>....] - ETA: 0s - loss: 4.8426e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.8542e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 4.4477e-05 41/229 [====>.........................] - ETA: 0s - loss: 8.4908e-05 77/229 [=========>....................] - ETA: 0s - loss: 6.2808e-05 108/229 [=============>................] - ETA: 0s - loss: 5.9460e-05 140/229 [=================>............] - ETA: 0s - loss: 5.2125e-05 178/229 [======================>.......] - ETA: 0s - loss: 4.6223e-05 216/229 [===========================>..] - ETA: 0s - loss: 4.2333e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.3136e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 3.7973e-05 42/229 [====>.........................] - ETA: 0s - loss: 2.5353e-05 80/229 [=========>....................] - ETA: 0s - loss: 2.9569e-05 122/229 [==============>...............] - ETA: 0s - loss: 3.5325e-05 163/229 [====================>.........] - ETA: 0s - loss: 4.3618e-05 204/229 [=========================>....] - ETA: 0s - loss: 3.9109e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.7940e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 0, 17 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 570, 1 KNN fn, tp: 1, 16 KNN f1 score: 0.941 KNN cohens kappa score: 0.939 ------ Step 4/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 39s - loss: 2.8334e-06 42/229 [====>.........................] - ETA: 0s - loss: 0.0021  84/229 [==========>...................] - ETA: 0s - loss: 0.0013 126/229 [===============>..............] - ETA: 0s - loss: 9.7688e-04 167/229 [====================>.........] - ETA: 0s - loss: 8.1676e-04 210/229 [==========================>...] - ETA: 0s - loss: 6.9847e-04 229/229 [==============================] - 0s 1ms/step - loss: 6.5944e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 0.0014 42/229 [====>.........................] - ETA: 0s - loss: 2.3975e-04 83/229 [=========>....................] - ETA: 0s - loss: 2.2358e-04 125/229 [===============>..............] - ETA: 0s - loss: 2.2530e-04 166/229 [====================>.........] - ETA: 0s - loss: 2.0922e-04 208/229 [==========================>...] - ETA: 0s - loss: 2.7750e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.6621e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 8.8351e-06 42/229 [====>.........................] - ETA: 0s - loss: 2.3330e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.9740e-04 123/229 [===============>..............] - ETA: 0s - loss: 2.1584e-04 165/229 [====================>.........] - ETA: 0s - loss: 2.0840e-04 207/229 [==========================>...] - ETA: 0s - loss: 1.8858e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.8429e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.5493e-05 42/229 [====>.........................] - ETA: 0s - loss: 6.8161e-05 81/229 [=========>....................] - ETA: 0s - loss: 1.4539e-04 118/229 [==============>...............] - ETA: 0s - loss: 1.3148e-04 151/229 [==================>...........] - ETA: 0s - loss: 1.6678e-04 191/229 [========================>.....] - ETA: 0s - loss: 1.5332e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4321e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 8.2755e-06 42/229 [====>.........................] - ETA: 0s - loss: 6.0429e-05 78/229 [=========>....................] - ETA: 0s - loss: 7.0688e-05 118/229 [==============>...............] - ETA: 0s - loss: 8.8713e-05 158/229 [===================>..........] - ETA: 0s - loss: 1.0145e-04 200/229 [=========================>....] - ETA: 0s - loss: 9.4095e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.0687e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 3.8378e-06 37/229 [===>..........................] - ETA: 0s - loss: 8.7326e-05 68/229 [=======>......................] - ETA: 0s - loss: 8.5961e-05 104/229 [============>.................] - ETA: 0s - loss: 1.0132e-04 144/229 [=================>............] - ETA: 0s - loss: 8.7648e-05 185/229 [=======================>......] - ETA: 0s - loss: 9.0850e-05 225/229 [============================>.] - ETA: 0s - loss: 8.4037e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.3527e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 6.1587e-07 43/229 [====>.........................] - ETA: 0s - loss: 4.7791e-05 85/229 [==========>...................] - ETA: 0s - loss: 4.4684e-05 126/229 [===============>..............] - ETA: 0s - loss: 4.6430e-05 168/229 [=====================>........] - ETA: 0s - loss: 5.9121e-05 209/229 [==========================>...] - ETA: 0s - loss: 6.5706e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.8766e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 2.0133e-04 40/229 [====>.........................] - ETA: 0s - loss: 4.8835e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.5240e-05 121/229 [==============>...............] - ETA: 0s - loss: 4.4339e-05 162/229 [====================>.........] - ETA: 0s - loss: 5.9230e-05 203/229 [=========================>....] - ETA: 0s - loss: 5.7033e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.6889e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 3.7173e-06 41/229 [====>.........................] - ETA: 0s - loss: 4.1646e-05 82/229 [=========>....................] - ETA: 0s - loss: 3.3190e-05 123/229 [===============>..............] - ETA: 0s - loss: 3.2450e-05 166/229 [====================>.........] - ETA: 0s - loss: 3.5330e-05 208/229 [==========================>...] - ETA: 0s - loss: 3.9279e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.6481e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 4.5344e-06 42/229 [====>.........................] - ETA: 0s - loss: 3.6752e-05 84/229 [==========>...................] - ETA: 0s - loss: 3.1477e-05 126/229 [===============>..............] - ETA: 0s - loss: 3.6975e-05 167/229 [====================>.........] - ETA: 0s - loss: 3.6765e-05 208/229 [==========================>...] - ETA: 0s - loss: 3.9795e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.0139e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 1 LR fn, tp: 0, 17 LR f1 score: 0.971 LR cohens kappa score: 0.971 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 566, 5 KNN fn, tp: 0, 17 KNN f1 score: 0.872 KNN cohens kappa score: 0.867 ------ Step 4/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 42s - loss: 3.7912e-04 42/229 [====>.........................] - ETA: 0s - loss: 9.8732e-05  84/229 [==========>...................] - ETA: 0s - loss: 1.2112e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.1817e-04 164/229 [====================>.........] - ETA: 0s - loss: 1.0838e-04 205/229 [=========================>....] - ETA: 0s - loss: 9.9202e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.6411e-05 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 1.2165e-04 43/229 [====>.........................] - ETA: 0s - loss: 6.8911e-05 84/229 [==========>...................] - ETA: 0s - loss: 6.7805e-05 125/229 [===============>..............] - ETA: 0s - loss: 5.7162e-05 166/229 [====================>.........] - ETA: 0s - loss: 6.0836e-05 208/229 [==========================>...] - ETA: 0s - loss: 5.7529e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.5525e-05 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 2.7135e-07 41/229 [====>.........................] - ETA: 0s - loss: 4.2394e-05 78/229 [=========>....................] - ETA: 0s - loss: 4.3044e-05 119/229 [==============>...............] - ETA: 0s - loss: 3.7695e-05 160/229 [===================>..........] - ETA: 0s - loss: 3.7599e-05 199/229 [=========================>....] - ETA: 0s - loss: 3.9287e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.7931e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.8068e-07 42/229 [====>.........................] - ETA: 0s - loss: 2.7062e-05 82/229 [=========>....................] - ETA: 0s - loss: 2.7893e-05 123/229 [===============>..............] - ETA: 0s - loss: 2.9734e-05 164/229 [====================>.........] - ETA: 0s - loss: 2.7489e-05 205/229 [=========================>....] - ETA: 0s - loss: 2.8696e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.0561e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 2.4369e-04 41/229 [====>.........................] - ETA: 0s - loss: 2.7520e-05 82/229 [=========>....................] - ETA: 0s - loss: 3.3363e-05 123/229 [===============>..............] - ETA: 0s - loss: 2.7969e-05 162/229 [====================>.........] - ETA: 0s - loss: 2.8138e-05 203/229 [=========================>....] - ETA: 0s - loss: 2.6663e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.6774e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 5.0268e-05 43/229 [====>.........................] - ETA: 0s - loss: 1.5996e-05 84/229 [==========>...................] - ETA: 0s - loss: 2.5057e-05 123/229 [===============>..............] - ETA: 0s - loss: 2.4597e-05 163/229 [====================>.........] - ETA: 0s - loss: 2.6162e-05 203/229 [=========================>....] - ETA: 0s - loss: 2.4953e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.3898e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.6724e-05 40/229 [====>.........................] - ETA: 0s - loss: 1.8138e-05 81/229 [=========>....................] - ETA: 0s - loss: 2.5403e-05 119/229 [==============>...............] - ETA: 0s - loss: 2.5659e-05 153/229 [===================>..........] - ETA: 0s - loss: 2.3632e-05 187/229 [=======================>......] - ETA: 0s - loss: 2.2457e-05 225/229 [============================>.] - ETA: 0s - loss: 2.1166e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.0970e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 7.8166e-06 41/229 [====>.........................] - ETA: 0s - loss: 2.9582e-05 82/229 [=========>....................] - ETA: 0s - loss: 2.5013e-05 121/229 [==============>...............] - ETA: 0s - loss: 2.1297e-05 156/229 [===================>..........] - ETA: 0s - loss: 1.9924e-05 198/229 [========================>.....] - ETA: 0s - loss: 1.8988e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.9447e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.9942e-06 42/229 [====>.........................] - ETA: 0s - loss: 2.4550e-05 83/229 [=========>....................] - ETA: 0s - loss: 2.1167e-05 125/229 [===============>..............] - ETA: 0s - loss: 1.9854e-05 166/229 [====================>.........] - ETA: 0s - loss: 1.9005e-05 206/229 [=========================>....] - ETA: 0s - loss: 1.7835e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.7495e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 1.3714e-05 41/229 [====>.........................] - ETA: 0s - loss: 1.6449e-05 80/229 [=========>....................] - ETA: 0s - loss: 1.5794e-05 121/229 [==============>...............] - ETA: 0s - loss: 1.6273e-05 162/229 [====================>.........] - ETA: 0s - loss: 1.7010e-05 203/229 [=========================>....] - ETA: 0s - loss: 1.6763e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.5700e-05 -> test with GAN.predict GAN tn, fp: 569, 2 GAN fn, tp: 0, 17 GAN f1 score: 0.944 GAN cohens kappa score: 0.943 -> test with 'LR' LR tn, fp: 568, 3 LR fn, tp: 0, 17 LR f1 score: 0.919 LR cohens kappa score: 0.916 LR average precision score: 0.889 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 569, 2 GB fn, tp: 0, 17 GB f1 score: 0.944 GB cohens kappa score: 0.943 -> test with 'KNN' KNN tn, fp: 569, 2 KNN fn, tp: 0, 17 KNN f1 score: 0.944 KNN cohens kappa score: 0.943 ------ Step 4/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2216 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 39s - loss: 1.9339e-04 40/229 [====>.........................] - ETA: 0s - loss: 1.7086e-04  78/229 [=========>....................] - ETA: 0s - loss: 1.4361e-04 120/229 [==============>...............] - ETA: 0s - loss: 1.2572e-04 158/229 [===================>..........] - ETA: 0s - loss: 1.4692e-04 200/229 [=========================>....] - ETA: 0s - loss: 1.4459e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4963e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 5.5273e-05 39/229 [====>.........................] - ETA: 0s - loss: 8.2440e-05 74/229 [========>.....................] - ETA: 0s - loss: 7.7104e-05 107/229 [=============>................] - ETA: 0s - loss: 7.2865e-05 140/229 [=================>............] - ETA: 0s - loss: 1.0093e-04 178/229 [======================>.......] - ETA: 0s - loss: 1.0663e-04 216/229 [===========================>..] - ETA: 0s - loss: 1.0128e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0124e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 5.5694e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.2019e-04 82/229 [=========>....................] - ETA: 0s - loss: 9.9099e-05 123/229 [===============>..............] - ETA: 0s - loss: 9.5053e-05 164/229 [====================>.........] - ETA: 0s - loss: 8.1743e-05 206/229 [=========================>....] - ETA: 0s - loss: 8.0985e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.9255e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 1.4140e-04 41/229 [====>.........................] - ETA: 0s - loss: 8.9137e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.8064e-05 120/229 [==============>...............] - ETA: 0s - loss: 7.9233e-05 159/229 [===================>..........] - ETA: 0s - loss: 7.0827e-05 195/229 [========================>.....] - ETA: 0s - loss: 7.5544e-05 227/229 [============================>.] - ETA: 0s - loss: 7.2533e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.2209e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 5.2599e-05 38/229 [===>..........................] - ETA: 0s - loss: 5.7509e-05 74/229 [========>.....................] - ETA: 0s - loss: 5.6071e-05 114/229 [=============>................] - ETA: 0s - loss: 6.0993e-05 152/229 [==================>...........] - ETA: 0s - loss: 6.1070e-05 190/229 [=======================>......] - ETA: 0s - loss: 5.9823e-05 229/229 [==============================] - ETA: 0s - loss: 6.2121e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.2121e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 6.3231e-05 39/229 [====>.........................] - ETA: 0s - loss: 6.1817e-05 80/229 [=========>....................] - ETA: 0s - loss: 6.0946e-05 120/229 [==============>...............] - ETA: 0s - loss: 5.6948e-05 159/229 [===================>..........] - ETA: 0s - loss: 6.0706e-05 199/229 [=========================>....] - ETA: 0s - loss: 5.9556e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.6082e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 4.9144e-05 43/229 [====>.........................] - ETA: 0s - loss: 5.5932e-05 82/229 [=========>....................] - ETA: 0s - loss: 6.1183e-05 124/229 [===============>..............] - ETA: 0s - loss: 5.4115e-05 165/229 [====================>.........] - ETA: 0s - loss: 5.1426e-05 201/229 [=========================>....] - ETA: 0s - loss: 5.3554e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.0453e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.5478e-05 40/229 [====>.........................] - ETA: 0s - loss: 3.0314e-05 74/229 [========>.....................] - ETA: 0s - loss: 4.2412e-05 112/229 [=============>................] - ETA: 0s - loss: 4.9137e-05 148/229 [==================>...........] - ETA: 0s - loss: 4.5864e-05 188/229 [=======================>......] - ETA: 0s - loss: 4.5372e-05 227/229 [============================>.] - ETA: 0s - loss: 4.2656e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.5262e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.7073e-05 42/229 [====>.........................] - ETA: 0s - loss: 3.5294e-05 83/229 [=========>....................] - ETA: 0s - loss: 3.5990e-05 122/229 [==============>...............] - ETA: 0s - loss: 4.3739e-05 162/229 [====================>.........] - ETA: 0s - loss: 4.1002e-05 202/229 [=========================>....] - ETA: 0s - loss: 4.2867e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.0064e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 2.6238e-05 42/229 [====>.........................] - ETA: 0s - loss: 3.1628e-05 82/229 [=========>....................] - ETA: 0s - loss: 3.9570e-05 123/229 [===============>..............] - ETA: 0s - loss: 3.6737e-05 161/229 [====================>.........] - ETA: 0s - loss: 3.6544e-05 202/229 [=========================>....] - ETA: 0s - loss: 3.3714e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.6198e-05 -> test with GAN.predict GAN tn, fp: 570, 0 GAN fn, tp: 0, 13 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 0 LR fn, tp: 1, 12 LR f1 score: 0.960 LR cohens kappa score: 0.959 LR average precision score: 0.979 -> test with 'RF' RF tn, fp: 570, 0 RF fn, tp: 1, 12 RF f1 score: 0.960 RF cohens kappa score: 0.959 -> test with 'GB' GB tn, fp: 570, 0 GB fn, tp: 0, 13 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 3 KNN fn, tp: 0, 13 KNN f1 score: 0.897 KNN cohens kappa score: 0.894 ====== Step 5/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 5/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 45s - loss: 1.1442e-04 42/229 [====>.........................] - ETA: 0s - loss: 2.8246e-04  84/229 [==========>...................] - ETA: 0s - loss: 2.4571e-04 125/229 [===============>..............] - ETA: 0s - loss: 2.4604e-04 163/229 [====================>.........] - ETA: 0s - loss: 4.3391e-04 205/229 [=========================>....] - ETA: 0s - loss: 5.0727e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.8156e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 1.9962e-07 42/229 [====>.........................] - ETA: 0s - loss: 1.3886e-04 74/229 [========>.....................] - ETA: 0s - loss: 1.4791e-04 109/229 [=============>................] - ETA: 0s - loss: 1.5354e-04 143/229 [=================>............] - ETA: 0s - loss: 5.2607e-04 185/229 [=======================>......] - ETA: 0s - loss: 4.7821e-04 227/229 [============================>.] - ETA: 0s - loss: 4.2108e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.1880e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.0605e-04 43/229 [====>.........................] - ETA: 0s - loss: 1.3090e-04 84/229 [==========>...................] - ETA: 0s - loss: 1.2883e-04 125/229 [===============>..............] - ETA: 0s - loss: 1.6097e-04 164/229 [====================>.........] - ETA: 0s - loss: 1.5236e-04 200/229 [=========================>....] - ETA: 0s - loss: 1.4756e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.4296e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.5692e-05 42/229 [====>.........................] - ETA: 0s - loss: 1.0156e-04 81/229 [=========>....................] - ETA: 0s - loss: 1.1744e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.3033e-04 163/229 [====================>.........] - ETA: 0s - loss: 1.2394e-04 205/229 [=========================>....] - ETA: 0s - loss: 1.1577e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.1261e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 8.1539e-08 41/229 [====>.........................] - ETA: 0s - loss: 1.0030e-04 80/229 [=========>....................] - ETA: 0s - loss: 1.0662e-04 120/229 [==============>...............] - ETA: 0s - loss: 9.9696e-05 162/229 [====================>.........] - ETA: 0s - loss: 9.5694e-05 203/229 [=========================>....] - ETA: 0s - loss: 9.0536e-05 229/229 [==============================] - 0s 1ms/step - loss: 9.2601e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 1.4156e-05 41/229 [====>.........................] - ETA: 0s - loss: 9.2668e-05 81/229 [=========>....................] - ETA: 0s - loss: 8.5764e-05 121/229 [==============>...............] - ETA: 0s - loss: 7.5521e-05 159/229 [===================>..........] - ETA: 0s - loss: 8.0916e-05 201/229 [=========================>....] - ETA: 0s - loss: 8.1157e-05 229/229 [==============================] - 0s 1ms/step - loss: 7.7424e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 9.6608e-07 42/229 [====>.........................] - ETA: 0s - loss: 7.1461e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.8858e-05 123/229 [===============>..............] - ETA: 0s - loss: 6.8308e-05 164/229 [====================>.........] - ETA: 0s - loss: 6.8030e-05 205/229 [=========================>....] - ETA: 0s - loss: 6.4748e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.5945e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 1.7079e-04 41/229 [====>.........................] - ETA: 0s - loss: 4.8592e-05 80/229 [=========>....................] - ETA: 0s - loss: 4.7059e-05 121/229 [==============>...............] - ETA: 0s - loss: 4.5103e-05 162/229 [====================>.........] - ETA: 0s - loss: 5.6752e-05 199/229 [=========================>....] - ETA: 0s - loss: 5.7013e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.6153e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 9.1218e-06 42/229 [====>.........................] - ETA: 0s - loss: 5.1970e-05 84/229 [==========>...................] - ETA: 0s - loss: 4.9126e-05 124/229 [===============>..............] - ETA: 0s - loss: 4.6383e-05 160/229 [===================>..........] - ETA: 0s - loss: 4.8313e-05 193/229 [========================>.....] - ETA: 0s - loss: 5.0694e-05 225/229 [============================>.] - ETA: 0s - loss: 4.8559e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.8392e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 2.2023e-05 42/229 [====>.........................] - ETA: 0s - loss: 4.8736e-05 83/229 [=========>....................] - ETA: 0s - loss: 4.5875e-05 124/229 [===============>..............] - ETA: 0s - loss: 4.3059e-05 165/229 [====================>.........] - ETA: 0s - loss: 4.0582e-05 205/229 [=========================>....] - ETA: 0s - loss: 3.7642e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.1463e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 566, 5 LR fn, tp: 0, 17 LR f1 score: 0.872 LR cohens kappa score: 0.867 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 564, 7 KNN fn, tp: 0, 17 KNN f1 score: 0.829 KNN cohens kappa score: 0.823 ------ Step 5/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 38s - loss: 6.4946e-05 42/229 [====>.........................] - ETA: 0s - loss: 6.2414e-04  84/229 [==========>...................] - ETA: 0s - loss: 0.0018  125/229 [===============>..............] - ETA: 0s - loss: 0.0016 165/229 [====================>.........] - ETA: 0s - loss: 0.0015 200/229 [=========================>....] - ETA: 0s - loss: 0.0015 229/229 [==============================] - 0s 1ms/step - loss: 0.0015 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 3.4269e-05 37/229 [===>..........................] - ETA: 0s - loss: 0.0013  77/229 [=========>....................] - ETA: 0s - loss: 9.3282e-04 116/229 [==============>...............] - ETA: 0s - loss: 7.9102e-04 155/229 [===================>..........] - ETA: 0s - loss: 6.9663e-04 195/229 [========================>.....] - ETA: 0s - loss: 7.8361e-04 229/229 [==============================] - 0s 1ms/step - loss: 9.6875e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.5564e-05 42/229 [====>.........................] - ETA: 0s - loss: 9.2911e-04 82/229 [=========>....................] - ETA: 0s - loss: 6.4762e-04 122/229 [==============>...............] - ETA: 0s - loss: 5.7866e-04 164/229 [====================>.........] - ETA: 0s - loss: 7.2901e-04 205/229 [=========================>....] - ETA: 0s - loss: 7.0353e-04 229/229 [==============================] - 0s 1ms/step - loss: 7.7530e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 2.3520e-05 42/229 [====>.........................] - ETA: 0s - loss: 6.9761e-05 82/229 [=========>....................] - ETA: 0s - loss: 7.7384e-04 123/229 [===============>..............] - ETA: 0s - loss: 6.0349e-04 164/229 [====================>.........] - ETA: 0s - loss: 5.2903e-04 204/229 [=========================>....] - ETA: 0s - loss: 6.0480e-04 229/229 [==============================] - 0s 1ms/step - loss: 6.1677e-04 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.9144e-06 41/229 [====>.........................] - ETA: 0s - loss: 4.8816e-05 83/229 [=========>....................] - ETA: 0s - loss: 3.4197e-04 123/229 [===============>..............] - ETA: 0s - loss: 3.6035e-04 164/229 [====================>.........] - ETA: 0s - loss: 4.1044e-04 201/229 [=========================>....] - ETA: 0s - loss: 5.1967e-04 229/229 [==============================] - 0s 1ms/step - loss: 4.9020e-04 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 1.1217e-05 43/229 [====>.........................] - ETA: 0s - loss: 3.2393e-04 84/229 [==========>...................] - ETA: 0s - loss: 2.5620e-04 125/229 [===============>..............] - ETA: 0s - loss: 2.3209e-04 165/229 [====================>.........] - ETA: 0s - loss: 3.2737e-04 205/229 [=========================>....] - ETA: 0s - loss: 3.7707e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.8863e-04 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 1.3959e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.5756e-04 84/229 [==========>...................] - ETA: 0s - loss: 1.5764e-04 124/229 [===============>..............] - ETA: 0s - loss: 3.0502e-04 164/229 [====================>.........] - ETA: 0s - loss: 3.1865e-04 205/229 [=========================>....] - ETA: 0s - loss: 2.8128e-04 229/229 [==============================] - 0s 1ms/step - loss: 3.0695e-04 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 7.0032e-06 42/229 [====>.........................] - ETA: 0s - loss: 2.9530e-04 83/229 [=========>....................] - ETA: 0s - loss: 2.4219e-04 124/229 [===============>..............] - ETA: 0s - loss: 1.7399e-04 165/229 [====================>.........] - ETA: 0s - loss: 2.2162e-04 205/229 [=========================>....] - ETA: 0s - loss: 2.5272e-04 229/229 [==============================] - 0s 1ms/step - loss: 2.4208e-04 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.3115e-05 37/229 [===>..........................] - ETA: 0s - loss: 1.0932e-04 70/229 [========>.....................] - ETA: 0s - loss: 1.5793e-04 105/229 [============>.................] - ETA: 0s - loss: 1.6812e-04 144/229 [=================>............] - ETA: 0s - loss: 1.6596e-04 184/229 [=======================>......] - ETA: 0s - loss: 2.0468e-04 226/229 [============================>.] - ETA: 0s - loss: 1.9505e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.9317e-04 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 5.6517e-06 43/229 [====>.........................] - ETA: 0s - loss: 2.3889e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.5644e-04 120/229 [==============>...............] - ETA: 0s - loss: 1.5043e-04 160/229 [===================>..........] - ETA: 0s - loss: 1.5722e-04 201/229 [=========================>....] - ETA: 0s - loss: 1.5065e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.5334e-04 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 567, 4 LR fn, tp: 0, 17 LR f1 score: 0.895 LR cohens kappa score: 0.891 LR average precision score: 0.990 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 571, 0 KNN fn, tp: 0, 17 KNN f1 score: 1.000 KNN cohens kappa score: 1.000 ------ Step 5/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 45s - loss: 5.6890e-05 41/229 [====>.........................] - ETA: 0s - loss: 1.5488e-04  82/229 [=========>....................] - ETA: 0s - loss: 1.3253e-04 121/229 [==============>...............] - ETA: 0s - loss: 1.5801e-04 161/229 [====================>.........] - ETA: 0s - loss: 1.5393e-04 197/229 [========================>.....] - ETA: 0s - loss: 1.3606e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.2561e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 2.0026e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.9972e-05 82/229 [=========>....................] - ETA: 0s - loss: 3.6697e-05 121/229 [==============>...............] - ETA: 0s - loss: 6.4945e-05 160/229 [===================>..........] - ETA: 0s - loss: 5.8975e-05 201/229 [=========================>....] - ETA: 0s - loss: 5.6511e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.4931e-05 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 6.5729e-07 38/229 [===>..........................] - ETA: 0s - loss: 2.9103e-05 69/229 [========>.....................] - ETA: 0s - loss: 3.5781e-05 104/229 [============>.................] - ETA: 0s - loss: 4.7025e-05 136/229 [================>.............] - ETA: 0s - loss: 4.3689e-05 174/229 [=====================>........] - ETA: 0s - loss: 4.1871e-05 215/229 [===========================>..] - ETA: 0s - loss: 3.8213e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.7479e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 6.4920e-05 41/229 [====>.........................] - ETA: 0s - loss: 3.7931e-05 81/229 [=========>....................] - ETA: 0s - loss: 2.9127e-05 115/229 [==============>...............] - ETA: 0s - loss: 2.8769e-05 149/229 [==================>...........] - ETA: 0s - loss: 2.6308e-05 182/229 [======================>.......] - ETA: 0s - loss: 2.5328e-05 217/229 [===========================>..] - ETA: 0s - loss: 3.0030e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.9762e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 2.4003e-05 38/229 [===>..........................] - ETA: 0s - loss: 2.2608e-05 77/229 [=========>....................] - ETA: 0s - loss: 2.5454e-05 117/229 [==============>...............] - ETA: 0s - loss: 2.5025e-05 158/229 [===================>..........] - ETA: 0s - loss: 2.4785e-05 199/229 [=========================>....] - ETA: 0s - loss: 2.6754e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.5723e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 5.4030e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.7208e-05 83/229 [=========>....................] - ETA: 0s - loss: 1.5587e-05 124/229 [===============>..............] - ETA: 0s - loss: 1.4188e-05 162/229 [====================>.........] - ETA: 0s - loss: 1.4004e-05 202/229 [=========================>....] - ETA: 0s - loss: 2.3526e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.3210e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 6.4563e-06 40/229 [====>.........................] - ETA: 0s - loss: 1.8138e-05 81/229 [=========>....................] - ETA: 0s - loss: 1.8085e-05 113/229 [=============>................] - ETA: 0s - loss: 1.7461e-05 152/229 [==================>...........] - ETA: 0s - loss: 1.8578e-05 193/229 [========================>.....] - ETA: 0s - loss: 2.1844e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.1151e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 3.3019e-04 39/229 [====>.........................] - ETA: 0s - loss: 2.4942e-05 80/229 [=========>....................] - ETA: 0s - loss: 2.1206e-05 122/229 [==============>...............] - ETA: 0s - loss: 2.1163e-05 162/229 [====================>.........] - ETA: 0s - loss: 1.9940e-05 202/229 [=========================>....] - ETA: 0s - loss: 1.9231e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.8796e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 2.9701e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.9366e-05 81/229 [=========>....................] - ETA: 0s - loss: 2.1116e-05 121/229 [==============>...............] - ETA: 0s - loss: 2.0044e-05 162/229 [====================>.........] - ETA: 0s - loss: 1.9341e-05 200/229 [=========================>....] - ETA: 0s - loss: 1.8528e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.7760e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 1.5523e-05 36/229 [===>..........................] - ETA: 0s - loss: 2.2467e-05 73/229 [========>.....................] - ETA: 0s - loss: 2.4039e-05 113/229 [=============>................] - ETA: 0s - loss: 2.1470e-05 153/229 [===================>..........] - ETA: 0s - loss: 2.0037e-05 194/229 [========================>.....] - ETA: 0s - loss: 1.7881e-05 229/229 [==============================] - 0s 1ms/step - loss: 1.6585e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 571, 0 LR fn, tp: 1, 16 LR f1 score: 0.970 LR cohens kappa score: 0.969 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 4 KNN fn, tp: 0, 17 KNN f1 score: 0.895 KNN cohens kappa score: 0.891 ------ Step 5/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2219 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 40s - loss: 6.3698e-06 41/229 [====>.........................] - ETA: 0s - loss: 0.0041  76/229 [========>.....................] - ETA: 0s - loss: 0.0023 110/229 [=============>................] - ETA: 0s - loss: 0.0017 142/229 [=================>............] - ETA: 0s - loss: 0.0014 183/229 [======================>.......] - ETA: 0s - loss: 0.0011 223/229 [============================>.] - ETA: 0s - loss: 9.6493e-04 229/229 [==============================] - 0s 1ms/step - loss: 9.4552e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 9.3522e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.1778e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.4991e-04 126/229 [===============>..............] - ETA: 0s - loss: 1.5286e-04 165/229 [====================>.........] - ETA: 0s - loss: 1.3906e-04 203/229 [=========================>....] - ETA: 0s - loss: 1.3233e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.2886e-04 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 1.5129e-04 42/229 [====>.........................] - ETA: 0s - loss: 1.3627e-04 83/229 [=========>....................] - ETA: 0s - loss: 1.3897e-04 123/229 [===============>..............] - ETA: 0s - loss: 1.2230e-04 162/229 [====================>.........] - ETA: 0s - loss: 1.1228e-04 202/229 [=========================>....] - ETA: 0s - loss: 1.0620e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.0477e-04 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 3.9860e-05 41/229 [====>.........................] - ETA: 0s - loss: 1.0567e-04 77/229 [=========>....................] - ETA: 0s - loss: 9.5839e-05 115/229 [==============>...............] - ETA: 0s - loss: 8.6483e-05 156/229 [===================>..........] - ETA: 0s - loss: 8.5617e-05 195/229 [========================>.....] - ETA: 0s - loss: 7.8064e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.2345e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 1.4530e-06 41/229 [====>.........................] - ETA: 0s - loss: 7.2729e-05 81/229 [=========>....................] - ETA: 0s - loss: 6.7272e-05 123/229 [===============>..............] - ETA: 0s - loss: 7.1100e-05 163/229 [====================>.........] - ETA: 0s - loss: 6.6664e-05 203/229 [=========================>....] - ETA: 0s - loss: 6.5423e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.6766e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.2365e-05 33/229 [===>..........................] - ETA: 0s - loss: 4.8275e-05 65/229 [=======>......................] - ETA: 0s - loss: 4.1504e-05 100/229 [============>.................] - ETA: 0s - loss: 6.4947e-05 141/229 [=================>............] - ETA: 0s - loss: 6.3357e-05 182/229 [======================>.......] - ETA: 0s - loss: 5.6851e-05 223/229 [============================>.] - ETA: 0s - loss: 5.3198e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.7100e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 2.5148e-05 42/229 [====>.........................] - ETA: 0s - loss: 7.9328e-05 83/229 [=========>....................] - ETA: 0s - loss: 6.6517e-05 124/229 [===============>..............] - ETA: 0s - loss: 5.9974e-05 166/229 [====================>.........] - ETA: 0s - loss: 5.3356e-05 207/229 [==========================>...] - ETA: 0s - loss: 5.0791e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.7262e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 7.0475e-06 41/229 [====>.........................] - ETA: 0s - loss: 2.7988e-05 82/229 [=========>....................] - ETA: 0s - loss: 2.9786e-05 121/229 [==============>...............] - ETA: 0s - loss: 2.9710e-05 152/229 [==================>...........] - ETA: 0s - loss: 3.6516e-05 185/229 [=======================>......] - ETA: 0s - loss: 4.1910e-05 220/229 [===========================>..] - ETA: 0s - loss: 3.9132e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.0851e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 8.7940e-06 42/229 [====>.........................] - ETA: 0s - loss: 3.1813e-05 83/229 [=========>....................] - ETA: 0s - loss: 3.3606e-05 124/229 [===============>..............] - ETA: 0s - loss: 3.3257e-05 163/229 [====================>.........] - ETA: 0s - loss: 3.3291e-05 202/229 [=========================>....] - ETA: 0s - loss: 3.6956e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.5127e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 9.5599e-06 40/229 [====>.........................] - ETA: 0s - loss: 4.1843e-05 79/229 [=========>....................] - ETA: 0s - loss: 4.0911e-05 118/229 [==============>...............] - ETA: 0s - loss: 3.3584e-05 158/229 [===================>..........] - ETA: 0s - loss: 3.3006e-05 198/229 [========================>.....] - ETA: 0s - loss: 3.0411e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.1602e-05 -> test with GAN.predict GAN tn, fp: 571, 0 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 1 LR fn, tp: 0, 17 LR f1 score: 0.971 LR cohens kappa score: 0.971 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 571, 0 RF fn, tp: 0, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 571, 0 GB fn, tp: 0, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 566, 5 KNN fn, tp: 0, 17 KNN f1 score: 0.872 KNN cohens kappa score: 0.867 ------ Step 5/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 2216 synthetic samples -> retrain GAN for predict Epoch 1/10 1/229 [..............................] - ETA: 45s - loss: 4.9859e-05 42/229 [====>.........................] - ETA: 0s - loss: 3.3147e-04  81/229 [=========>....................] - ETA: 0s - loss: 3.0695e-04 122/229 [==============>...............] - ETA: 0s - loss: 2.2811e-04 163/229 [====================>.........] - ETA: 0s - loss: 1.9114e-04 203/229 [=========================>....] - ETA: 0s - loss: 1.7765e-04 229/229 [==============================] - 0s 1ms/step - loss: 1.6807e-04 Epoch 2/10 1/229 [..............................] - ETA: 0s - loss: 1.7866e-05 39/229 [====>.........................] - ETA: 0s - loss: 7.4386e-05 80/229 [=========>....................] - ETA: 0s - loss: 1.2008e-04 122/229 [==============>...............] - ETA: 0s - loss: 1.0806e-04 163/229 [====================>.........] - ETA: 0s - loss: 1.0487e-04 204/229 [=========================>....] - ETA: 0s - loss: 9.1868e-05 229/229 [==============================] - 0s 1ms/step - loss: 8.7534e-05 Epoch 3/10 1/229 [..............................] - ETA: 0s - loss: 3.5310e-05 42/229 [====>.........................] - ETA: 0s - loss: 9.9683e-05 83/229 [=========>....................] - ETA: 0s - loss: 8.2451e-05 124/229 [===============>..............] - ETA: 0s - loss: 7.1888e-05 165/229 [====================>.........] - ETA: 0s - loss: 7.3876e-05 205/229 [=========================>....] - ETA: 0s - loss: 6.8846e-05 229/229 [==============================] - 0s 1ms/step - loss: 6.7626e-05 Epoch 4/10 1/229 [..............................] - ETA: 0s - loss: 4.4984e-05 40/229 [====>.........................] - ETA: 0s - loss: 1.0602e-04 81/229 [=========>....................] - ETA: 0s - loss: 7.6127e-05 122/229 [==============>...............] - ETA: 0s - loss: 6.8669e-05 162/229 [====================>.........] - ETA: 0s - loss: 6.8309e-05 200/229 [=========================>....] - ETA: 0s - loss: 6.0892e-05 229/229 [==============================] - 0s 1ms/step - loss: 5.6741e-05 Epoch 5/10 1/229 [..............................] - ETA: 0s - loss: 2.9322e-05 43/229 [====>.........................] - ETA: 0s - loss: 3.6613e-05 84/229 [==========>...................] - ETA: 0s - loss: 4.9927e-05 125/229 [===============>..............] - ETA: 0s - loss: 5.1319e-05 164/229 [====================>.........] - ETA: 0s - loss: 5.1523e-05 205/229 [=========================>....] - ETA: 0s - loss: 4.7848e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.6988e-05 Epoch 6/10 1/229 [..............................] - ETA: 0s - loss: 2.2407e-05 38/229 [===>..........................] - ETA: 0s - loss: 2.4149e-05 79/229 [=========>....................] - ETA: 0s - loss: 3.2652e-05 118/229 [==============>...............] - ETA: 0s - loss: 4.4629e-05 159/229 [===================>..........] - ETA: 0s - loss: 4.2214e-05 199/229 [=========================>....] - ETA: 0s - loss: 3.9198e-05 229/229 [==============================] - 0s 1ms/step - loss: 4.1498e-05 Epoch 7/10 1/229 [..............................] - ETA: 0s - loss: 2.5521e-05 42/229 [====>.........................] - ETA: 0s - loss: 5.0126e-05 77/229 [=========>....................] - ETA: 0s - loss: 4.4494e-05 118/229 [==============>...............] - ETA: 0s - loss: 4.2928e-05 155/229 [===================>..........] - ETA: 0s - loss: 3.9662e-05 190/229 [=======================>......] - ETA: 0s - loss: 3.7448e-05 224/229 [============================>.] - ETA: 0s - loss: 3.5484e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.5438e-05 Epoch 8/10 1/229 [..............................] - ETA: 0s - loss: 3.6313e-06 40/229 [====>.........................] - ETA: 0s - loss: 2.8450e-05 81/229 [=========>....................] - ETA: 0s - loss: 3.2864e-05 119/229 [==============>...............] - ETA: 0s - loss: 3.1391e-05 161/229 [====================>.........] - ETA: 0s - loss: 2.9026e-05 200/229 [=========================>....] - ETA: 0s - loss: 3.1911e-05 229/229 [==============================] - 0s 1ms/step - loss: 3.1752e-05 Epoch 9/10 1/229 [..............................] - ETA: 0s - loss: 1.5883e-05 41/229 [====>.........................] - ETA: 0s - loss: 2.6798e-05 82/229 [=========>....................] - ETA: 0s - loss: 2.4927e-05 122/229 [==============>...............] - ETA: 0s - loss: 2.6770e-05 161/229 [====================>.........] - ETA: 0s - loss: 2.7350e-05 202/229 [=========================>....] - ETA: 0s - loss: 2.7535e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.7919e-05 Epoch 10/10 1/229 [..............................] - ETA: 0s - loss: 6.0395e-06 42/229 [====>.........................] - ETA: 0s - loss: 1.4802e-05 81/229 [=========>....................] - ETA: 0s - loss: 1.6356e-05 122/229 [==============>...............] - ETA: 0s - loss: 2.2243e-05 159/229 [===================>..........] - ETA: 0s - loss: 2.4818e-05 196/229 [========================>.....] - ETA: 0s - loss: 2.3186e-05 229/229 [==============================] - 0s 1ms/step - loss: 2.4792e-05 -> test with GAN.predict GAN tn, fp: 570, 0 GAN fn, tp: 0, 13 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 -> test with 'LR' LR tn, fp: 570, 0 LR fn, tp: 0, 13 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 -> test with 'RF' RF tn, fp: 570, 0 RF fn, tp: 0, 13 RF f1 score: 1.000 RF cohens kappa score: 1.000 -> test with 'GB' GB tn, fp: 570, 0 GB fn, tp: 0, 13 GB f1 score: 1.000 GB cohens kappa score: 1.000 -> test with 'KNN' KNN tn, fp: 567, 3 KNN fn, tp: 0, 13 KNN f1 score: 0.897 KNN cohens kappa score: 0.894 ### Exercise is done. -----[ LR ]----- maximum: LR tn, fp: 571, 5 LR fn, tp: 2, 17 LR f1 score: 1.000 LR cohens kappa score: 1.000 LR average precision score: 1.000 average: LR tn, fp: 569.32, 1.48 LR fn, tp: 0.28, 15.92 LR f1 score: 0.948 LR cohens kappa score: 0.947 LR average precision score: 0.984 minimum: LR tn, fp: 565, 0 LR fn, tp: 0, 12 LR f1 score: 0.800 LR cohens kappa score: 0.795 LR average precision score: 0.847 -----[ RF ]----- maximum: RF tn, fp: 571, 0 RF fn, tp: 2, 17 RF f1 score: 1.000 RF cohens kappa score: 1.000 average: RF tn, fp: 570.8, 0.0 RF fn, tp: 0.2, 16.0 RF f1 score: 0.993 RF cohens kappa score: 0.993 minimum: RF tn, fp: 570, 0 RF fn, tp: 0, 12 RF f1 score: 0.938 RF cohens kappa score: 0.936 -----[ GB ]----- maximum: GB tn, fp: 571, 2 GB fn, tp: 2, 17 GB f1 score: 1.000 GB cohens kappa score: 1.000 average: GB tn, fp: 570.64, 0.16 GB fn, tp: 0.08, 16.12 GB f1 score: 0.992 GB cohens kappa score: 0.992 minimum: GB tn, fp: 568, 0 GB fn, tp: 0, 13 GB f1 score: 0.929 GB cohens kappa score: 0.927 -----[ KNN ]----- maximum: KNN tn, fp: 571, 8 KNN fn, tp: 1, 17 KNN f1 score: 1.000 KNN cohens kappa score: 1.000 average: KNN tn, fp: 566.88, 3.92 KNN fn, tp: 0.04, 16.16 KNN f1 score: 0.894 KNN cohens kappa score: 0.890 minimum: KNN tn, fp: 563, 0 KNN fn, tp: 0, 13 KNN f1 score: 0.788 KNN cohens kappa score: 0.782 -----[ GAN ]----- maximum: GAN tn, fp: 571, 2 GAN fn, tp: 0, 17 GAN f1 score: 1.000 GAN cohens kappa score: 1.000 average: GAN tn, fp: 570.6, 0.2 GAN fn, tp: 0.0, 16.2 GAN f1 score: 0.994 GAN cohens kappa score: 0.994 minimum: GAN tn, fp: 568, 0 GAN fn, tp: 0, 13 GAN f1 score: 0.929 GAN cohens kappa score: 0.927