/////////////////////////////////////////// // Running convGAN-majority-full on folding_winequality-red-4 /////////////////////////////////////////// Load 'data_input/folding_winequality-red-4' from pickle file Data loaded. -> Shuffling data ### Start exercise for synthetic point generator ====== Step 1/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 1/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 31s - loss: 0.1600 22/124 [====>.........................] - ETA: 0s - loss: 0.3457  44/124 [=========>....................] - ETA: 0s - loss: 0.4072 66/124 [==============>...............] - ETA: 0s - loss: 0.3904 89/124 [====================>.........] - ETA: 0s - loss: 0.3746 109/124 [=========================>....] - ETA: 0s - loss: 0.3706 124/124 [==============================] - 1s 2ms/step - loss: 0.3705 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.3884 22/124 [====>.........................] - ETA: 0s - loss: 0.3602 37/124 [=======>......................] - ETA: 0s - loss: 0.3629 53/124 [===========>..................] - ETA: 0s - loss: 0.3676 68/124 [===============>..............] - ETA: 0s - loss: 0.3643 86/124 [===================>..........] - ETA: 0s - loss: 0.3644 101/124 [=======================>......] - ETA: 0s - loss: 0.3666 118/124 [===========================>..] - ETA: 0s - loss: 0.3655 124/124 [==============================] - 0s 3ms/step - loss: 0.3635 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2215 20/124 [===>..........................] - ETA: 0s - loss: 0.3355 37/124 [=======>......................] - ETA: 0s - loss: 0.3557 60/124 [=============>................] - ETA: 0s - loss: 0.3578 82/124 [==================>...........] - ETA: 0s - loss: 0.3464 102/124 [=======================>......] - ETA: 0s - loss: 0.3475 119/124 [===========================>..] - ETA: 0s - loss: 0.3521 124/124 [==============================] - 0s 3ms/step - loss: 0.3526 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.6699 20/124 [===>..........................] - ETA: 0s - loss: 0.3635 38/124 [========>.....................] - ETA: 0s - loss: 0.3568 58/124 [=============>................] - ETA: 0s - loss: 0.3422 76/124 [=================>............] - ETA: 0s - loss: 0.3541 97/124 [======================>.......] - ETA: 0s - loss: 0.3494 116/124 [===========================>..] - ETA: 0s - loss: 0.3513 124/124 [==============================] - 0s 3ms/step - loss: 0.3564 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3010 19/124 [===>..........................] - ETA: 0s - loss: 0.3692 36/124 [=======>......................] - ETA: 0s - loss: 0.3654 54/124 [============>.................] - ETA: 0s - loss: 0.3696 72/124 [================>.............] - ETA: 0s - loss: 0.3598 89/124 [====================>.........] - ETA: 0s - loss: 0.3529 109/124 [=========================>....] - ETA: 0s - loss: 0.3491 124/124 [==============================] - 0s 3ms/step - loss: 0.3418 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2421 19/124 [===>..........................] - ETA: 0s - loss: 0.3316 36/124 [=======>......................] - ETA: 0s - loss: 0.3178 54/124 [============>.................] - ETA: 0s - loss: 0.3391 72/124 [================>.............] - ETA: 0s - loss: 0.3409 88/124 [====================>.........] - ETA: 0s - loss: 0.3494 109/124 [=========================>....] - ETA: 0s - loss: 0.3478 124/124 [==============================] - 0s 3ms/step - loss: 0.3461 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.1459 19/124 [===>..........................] - ETA: 0s - loss: 0.3451 37/124 [=======>......................] - ETA: 0s - loss: 0.3590 58/124 [=============>................] - ETA: 0s - loss: 0.3553 77/124 [=================>............] - ETA: 0s - loss: 0.3508 96/124 [======================>.......] - ETA: 0s - loss: 0.3470 116/124 [===========================>..] - ETA: 0s - loss: 0.3437 124/124 [==============================] - 0s 3ms/step - loss: 0.3443 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.7815 20/124 [===>..........................] - ETA: 0s - loss: 0.3364 41/124 [========>.....................] - ETA: 0s - loss: 0.3316 60/124 [=============>................] - ETA: 0s - loss: 0.3238 79/124 [==================>...........] - ETA: 0s - loss: 0.3391 96/124 [======================>.......] - ETA: 0s - loss: 0.3432 112/124 [==========================>...] - ETA: 0s - loss: 0.3451 124/124 [==============================] - 0s 3ms/step - loss: 0.3401 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3284 17/124 [===>..........................] - ETA: 0s - loss: 0.4107 35/124 [=======>......................] - ETA: 0s - loss: 0.3781 52/124 [===========>..................] - ETA: 0s - loss: 0.3563 71/124 [================>.............] - ETA: 0s - loss: 0.3478 89/124 [====================>.........] - ETA: 0s - loss: 0.3464 106/124 [========================>.....] - ETA: 0s - loss: 0.3450 121/124 [============================>.] - ETA: 0s - loss: 0.3471 124/124 [==============================] - 0s 3ms/step - loss: 0.3480 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.4549 21/124 [====>.........................] - ETA: 0s - loss: 0.3493 41/124 [========>.....................] - ETA: 0s - loss: 0.3355 60/124 [=============>................] - ETA: 0s - loss: 0.3320 78/124 [=================>............] - ETA: 0s - loss: 0.3423 98/124 [======================>.......] - ETA: 0s - loss: 0.3446 117/124 [===========================>..] - ETA: 0s - loss: 0.3465 124/124 [==============================] - 0s 3ms/step - loss: 0.3433 -> test with GAN.predict GAN tn, fp: 270, 40 GAN fn, tp: 9, 2 GAN f1 score: 0.075 GAN cohens kappa score: 0.022 -> test with 'LR' LR tn, fp: 214, 96 LR fn, tp: 3, 8 LR f1 score: 0.139 LR cohens kappa score: 0.082 LR average precision score: 0.134 -> test with 'RF' RF tn, fp: 302, 8 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.030 -> test with 'GB' GB tn, fp: 292, 18 GB fn, tp: 11, 0 GB f1 score: 0.000 GB cohens kappa score: -0.044 -> test with 'KNN' KNN tn, fp: 212, 98 KNN fn, tp: 8, 3 KNN f1 score: 0.054 KNN cohens kappa score: -0.009 ------ Step 1/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 22s - loss: 0.3037 39/124 [========>.....................] - ETA: 0s - loss: 0.3209  78/124 [=================>............] - ETA: 0s - loss: 0.3181 116/124 [===========================>..] - ETA: 0s - loss: 0.3234 124/124 [==============================] - 0s 1ms/step - loss: 0.3234 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2650 39/124 [========>.....................] - ETA: 0s - loss: 0.3114 76/124 [=================>............] - ETA: 0s - loss: 0.3090 114/124 [==========================>...] - ETA: 0s - loss: 0.3118 124/124 [==============================] - 0s 1ms/step - loss: 0.3211 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.5664 37/124 [=======>......................] - ETA: 0s - loss: 0.3351 75/124 [=================>............] - ETA: 0s - loss: 0.3191 113/124 [==========================>...] - ETA: 0s - loss: 0.3216 124/124 [==============================] - 0s 1ms/step - loss: 0.3243 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.5853 37/124 [=======>......................] - ETA: 0s - loss: 0.2964 75/124 [=================>............] - ETA: 0s - loss: 0.2977 110/124 [=========================>....] - ETA: 0s - loss: 0.3163 124/124 [==============================] - 0s 1ms/step - loss: 0.3124 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.4958 39/124 [========>.....................] - ETA: 0s - loss: 0.3104 76/124 [=================>............] - ETA: 0s - loss: 0.3138 114/124 [==========================>...] - ETA: 0s - loss: 0.3147 124/124 [==============================] - 0s 1ms/step - loss: 0.3137 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4765 33/124 [======>.......................] - ETA: 0s - loss: 0.3199 71/124 [================>.............] - ETA: 0s - loss: 0.3060 108/124 [=========================>....] - ETA: 0s - loss: 0.3093 124/124 [==============================] - 0s 1ms/step - loss: 0.3127 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.1715 38/124 [========>.....................] - ETA: 0s - loss: 0.2769 76/124 [=================>............] - ETA: 0s - loss: 0.3035 114/124 [==========================>...] - ETA: 0s - loss: 0.3118 124/124 [==============================] - 0s 1ms/step - loss: 0.3130 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3740 39/124 [========>.....................] - ETA: 0s - loss: 0.3206 76/124 [=================>............] - ETA: 0s - loss: 0.3243 112/124 [==========================>...] - ETA: 0s - loss: 0.3169 124/124 [==============================] - 0s 1ms/step - loss: 0.3101 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3613 35/124 [=======>......................] - ETA: 0s - loss: 0.3198 68/124 [===============>..............] - ETA: 0s - loss: 0.3171 102/124 [=======================>......] - ETA: 0s - loss: 0.3191 124/124 [==============================] - 0s 2ms/step - loss: 0.3120 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3275 40/124 [========>.....................] - ETA: 0s - loss: 0.2876 75/124 [=================>............] - ETA: 0s - loss: 0.2962 113/124 [==========================>...] - ETA: 0s - loss: 0.3048 124/124 [==============================] - 0s 1ms/step - loss: 0.3056 -> test with GAN.predict GAN tn, fp: 288, 22 GAN fn, tp: 8, 3 GAN f1 score: 0.167 GAN cohens kappa score: 0.125 -> test with 'LR' LR tn, fp: 222, 88 LR fn, tp: 3, 8 LR f1 score: 0.150 LR cohens kappa score: 0.094 LR average precision score: 0.120 -> test with 'RF' RF tn, fp: 301, 9 RF fn, tp: 10, 1 RF f1 score: 0.095 RF cohens kappa score: 0.065 -> test with 'GB' GB tn, fp: 292, 18 GB fn, tp: 9, 2 GB f1 score: 0.129 GB cohens kappa score: 0.089 -> test with 'KNN' KNN tn, fp: 235, 75 KNN fn, tp: 9, 2 KNN f1 score: 0.045 KNN cohens kappa score: -0.015 ------ Step 1/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 19s - loss: 0.7063 43/124 [=========>....................] - ETA: 0s - loss: 0.4070  84/124 [===================>..........] - ETA: 0s - loss: 0.4052 124/124 [==============================] - 0s 1ms/step - loss: 0.3972 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.7346 41/124 [========>.....................] - ETA: 0s - loss: 0.3663 81/124 [==================>...........] - ETA: 0s - loss: 0.3801 121/124 [============================>.] - ETA: 0s - loss: 0.3847 124/124 [==============================] - 0s 1ms/step - loss: 0.3845 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2769 40/124 [========>.....................] - ETA: 0s - loss: 0.4071 78/124 [=================>............] - ETA: 0s - loss: 0.3893 116/124 [===========================>..] - ETA: 0s - loss: 0.3849 124/124 [==============================] - 0s 1ms/step - loss: 0.3847 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3391 37/124 [=======>......................] - ETA: 0s - loss: 0.3740 70/124 [===============>..............] - ETA: 0s - loss: 0.3783 105/124 [========================>.....] - ETA: 0s - loss: 0.3802 124/124 [==============================] - 0s 1ms/step - loss: 0.3797 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2531 42/124 [=========>....................] - ETA: 0s - loss: 0.3658 81/124 [==================>...........] - ETA: 0s - loss: 0.3620 122/124 [============================>.] - ETA: 0s - loss: 0.3752 124/124 [==============================] - 0s 1ms/step - loss: 0.3749 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4843 42/124 [=========>....................] - ETA: 0s - loss: 0.3889 82/124 [==================>...........] - ETA: 0s - loss: 0.3795 118/124 [===========================>..] - ETA: 0s - loss: 0.3672 124/124 [==============================] - 0s 1ms/step - loss: 0.3708 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.4366 35/124 [=======>......................] - ETA: 0s - loss: 0.3654 69/124 [===============>..............] - ETA: 0s - loss: 0.3789 106/124 [========================>.....] - ETA: 0s - loss: 0.3901 124/124 [==============================] - 0s 1ms/step - loss: 0.3876 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.4829 41/124 [========>.....................] - ETA: 0s - loss: 0.3692 78/124 [=================>............] - ETA: 0s - loss: 0.3782 119/124 [===========================>..] - ETA: 0s - loss: 0.3719 124/124 [==============================] - 0s 1ms/step - loss: 0.3719 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.5222 41/124 [========>.....................] - ETA: 0s - loss: 0.3845 82/124 [==================>...........] - ETA: 0s - loss: 0.3762 120/124 [============================>.] - ETA: 0s - loss: 0.3649 124/124 [==============================] - 0s 1ms/step - loss: 0.3659 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.6467 33/124 [======>.......................] - ETA: 0s - loss: 0.3530 68/124 [===============>..............] - ETA: 0s - loss: 0.3617 104/124 [========================>.....] - ETA: 0s - loss: 0.3644 124/124 [==============================] - 0s 1ms/step - loss: 0.3596 -> test with GAN.predict GAN tn, fp: 253, 57 GAN fn, tp: 5, 6 GAN f1 score: 0.162 GAN cohens kappa score: 0.110 -> test with 'LR' LR tn, fp: 199, 111 LR fn, tp: 2, 9 LR f1 score: 0.137 LR cohens kappa score: 0.080 LR average precision score: 0.224 -> test with 'RF' RF tn, fp: 298, 12 RF fn, tp: 8, 3 RF f1 score: 0.231 RF cohens kappa score: 0.199 -> test with 'GB' GB tn, fp: 290, 20 GB fn, tp: 7, 4 GB f1 score: 0.229 GB cohens kappa score: 0.191 -> test with 'KNN' KNN tn, fp: 218, 92 KNN fn, tp: 8, 3 KNN f1 score: 0.057 KNN cohens kappa score: -0.005 ------ Step 1/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 30s - loss: 0.1539 18/124 [===>..........................] - ETA: 0s - loss: 0.1982  35/124 [=======>......................] - ETA: 0s - loss: 0.1857 50/124 [===========>..................] - ETA: 0s - loss: 0.2283 65/124 [==============>...............] - ETA: 0s - loss: 0.2414 80/124 [==================>...........] - ETA: 0s - loss: 0.2478 96/124 [======================>.......] - ETA: 0s - loss: 0.2517 112/124 [==========================>...] - ETA: 0s - loss: 0.2400 124/124 [==============================] - 1s 3ms/step - loss: 0.2355 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.0757 26/124 [=====>........................] - ETA: 0s - loss: 0.2635 51/124 [===========>..................] - ETA: 0s - loss: 0.2383 76/124 [=================>............] - ETA: 0s - loss: 0.2294 99/124 [======================>.......] - ETA: 0s - loss: 0.2338 118/124 [===========================>..] - ETA: 0s - loss: 0.2257 124/124 [==============================] - 0s 2ms/step - loss: 0.2232 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.1708 16/124 [==>...........................] - ETA: 0s - loss: 0.1942 37/124 [=======>......................] - ETA: 0s - loss: 0.1952 59/124 [=============>................] - ETA: 0s - loss: 0.2100 81/124 [==================>...........] - ETA: 0s - loss: 0.2087 103/124 [=======================>......] - ETA: 0s - loss: 0.2117 124/124 [==============================] - 0s 2ms/step - loss: 0.2168 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.2170 27/124 [=====>........................] - ETA: 0s - loss: 0.2323 57/124 [============>.................] - ETA: 0s - loss: 0.2223 86/124 [===================>..........] - ETA: 0s - loss: 0.2262 111/124 [=========================>....] - ETA: 0s - loss: 0.2184 124/124 [==============================] - 0s 2ms/step - loss: 0.2209 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3528 25/124 [=====>........................] - ETA: 0s - loss: 0.2250 50/124 [===========>..................] - ETA: 0s - loss: 0.2253 73/124 [================>.............] - ETA: 0s - loss: 0.2094 98/124 [======================>.......] - ETA: 0s - loss: 0.2112 124/124 [==============================] - 0s 2ms/step - loss: 0.2134 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2547 25/124 [=====>........................] - ETA: 0s - loss: 0.2141 57/124 [============>.................] - ETA: 0s - loss: 0.2041 84/124 [===================>..........] - ETA: 0s - loss: 0.2069 114/124 [==========================>...] - ETA: 0s - loss: 0.2082 124/124 [==============================] - 0s 2ms/step - loss: 0.2092 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.1718 29/124 [======>.......................] - ETA: 0s - loss: 0.2240 59/124 [=============>................] - ETA: 0s - loss: 0.2251 89/124 [====================>.........] - ETA: 0s - loss: 0.2118 114/124 [==========================>...] - ETA: 0s - loss: 0.2088 124/124 [==============================] - 0s 2ms/step - loss: 0.2113 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.0981 26/124 [=====>........................] - ETA: 0s - loss: 0.1848 51/124 [===========>..................] - ETA: 0s - loss: 0.1791 74/124 [================>.............] - ETA: 0s - loss: 0.1911 103/124 [=======================>......] - ETA: 0s - loss: 0.2017 124/124 [==============================] - 0s 2ms/step - loss: 0.2121 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.0791 27/124 [=====>........................] - ETA: 0s - loss: 0.1555 54/124 [============>.................] - ETA: 0s - loss: 0.1871 83/124 [===================>..........] - ETA: 0s - loss: 0.2023 113/124 [==========================>...] - ETA: 0s - loss: 0.2115 124/124 [==============================] - 0s 2ms/step - loss: 0.2106 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.1709 25/124 [=====>........................] - ETA: 0s - loss: 0.2100 41/124 [========>.....................] - ETA: 0s - loss: 0.1978 62/124 [==============>...............] - ETA: 0s - loss: 0.2256 78/124 [=================>............] - ETA: 0s - loss: 0.2218 89/124 [====================>.........] - ETA: 0s - loss: 0.2132 105/124 [========================>.....] - ETA: 0s - loss: 0.2065 124/124 [==============================] - 0s 3ms/step - loss: 0.2036 -> test with GAN.predict GAN tn, fp: 282, 28 GAN fn, tp: 10, 1 GAN f1 score: 0.050 GAN cohens kappa score: 0.000 -> test with 'LR' LR tn, fp: 243, 67 LR fn, tp: 6, 5 LR f1 score: 0.120 LR cohens kappa score: 0.065 LR average precision score: 0.101 -> test with 'RF' RF tn, fp: 305, 5 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.022 -> test with 'GB' GB tn, fp: 288, 22 GB fn, tp: 11, 0 GB f1 score: 0.000 GB cohens kappa score: -0.048 -> test with 'KNN' KNN tn, fp: 251, 59 KNN fn, tp: 10, 1 KNN f1 score: 0.028 KNN cohens kappa score: -0.032 ------ Step 1/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1196 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 17s - loss: 0.3682 43/124 [=========>....................] - ETA: 0s - loss: 0.3447  86/124 [===================>..........] - ETA: 0s - loss: 0.3348 124/124 [==============================] - 0s 1ms/step - loss: 0.3332 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.1715 44/124 [=========>....................] - ETA: 0s - loss: 0.3198 87/124 [====================>.........] - ETA: 0s - loss: 0.3280 124/124 [==============================] - 0s 1ms/step - loss: 0.3320 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.5309 43/124 [=========>....................] - ETA: 0s - loss: 0.3458 86/124 [===================>..........] - ETA: 0s - loss: 0.3297 124/124 [==============================] - 0s 1ms/step - loss: 0.3306 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3308 43/124 [=========>....................] - ETA: 0s - loss: 0.3306 86/124 [===================>..........] - ETA: 0s - loss: 0.3261 124/124 [==============================] - 0s 1ms/step - loss: 0.3285 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2180 40/124 [========>.....................] - ETA: 0s - loss: 0.3117 80/124 [==================>...........] - ETA: 0s - loss: 0.3246 122/124 [============================>.] - ETA: 0s - loss: 0.3205 124/124 [==============================] - 0s 1ms/step - loss: 0.3209 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.3798 43/124 [=========>....................] - ETA: 0s - loss: 0.3167 82/124 [==================>...........] - ETA: 0s - loss: 0.3101 123/124 [============================>.] - ETA: 0s - loss: 0.3208 124/124 [==============================] - 0s 1ms/step - loss: 0.3222 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.1899 41/124 [========>.....................] - ETA: 0s - loss: 0.3361 84/124 [===================>..........] - ETA: 0s - loss: 0.3217 124/124 [==============================] - 0s 1ms/step - loss: 0.3302 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2645 44/124 [=========>....................] - ETA: 0s - loss: 0.2955 87/124 [====================>.........] - ETA: 0s - loss: 0.3156 124/124 [==============================] - 0s 1ms/step - loss: 0.3183 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3022 44/124 [=========>....................] - ETA: 0s - loss: 0.3259 86/124 [===================>..........] - ETA: 0s - loss: 0.3128 124/124 [==============================] - 0s 1ms/step - loss: 0.3172 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.1928 36/124 [=======>......................] - ETA: 0s - loss: 0.3242 70/124 [===============>..............] - ETA: 0s - loss: 0.3159 109/124 [=========================>....] - ETA: 0s - loss: 0.3174 124/124 [==============================] - 0s 1ms/step - loss: 0.3219 -> test with GAN.predict GAN tn, fp: 278, 28 GAN fn, tp: 6, 3 GAN f1 score: 0.150 GAN cohens kappa score: 0.111 -> test with 'LR' LR tn, fp: 226, 80 LR fn, tp: 4, 5 LR f1 score: 0.106 LR cohens kappa score: 0.058 LR average precision score: 0.222 -> test with 'RF' RF tn, fp: 298, 8 RF fn, tp: 9, 0 RF f1 score: 0.000 RF cohens kappa score: -0.028 -> test with 'GB' GB tn, fp: 286, 20 GB fn, tp: 7, 2 GB f1 score: 0.129 GB cohens kappa score: 0.092 -> test with 'KNN' KNN tn, fp: 232, 74 KNN fn, tp: 5, 4 KNN f1 score: 0.092 KNN cohens kappa score: 0.043 ====== Step 2/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 2/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 22s - loss: 0.5020 41/124 [========>.....................] - ETA: 0s - loss: 0.3791  82/124 [==================>...........] - ETA: 0s - loss: 0.3689 123/124 [============================>.] - ETA: 0s - loss: 0.3692 124/124 [==============================] - 0s 1ms/step - loss: 0.3688 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2036 40/124 [========>.....................] - ETA: 0s - loss: 0.3547 80/124 [==================>...........] - ETA: 0s - loss: 0.3653 120/124 [============================>.] - ETA: 0s - loss: 0.3651 124/124 [==============================] - 0s 1ms/step - loss: 0.3649 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.1951 41/124 [========>.....................] - ETA: 0s - loss: 0.3365 80/124 [==================>...........] - ETA: 0s - loss: 0.3598 120/124 [============================>.] - ETA: 0s - loss: 0.3653 124/124 [==============================] - 0s 1ms/step - loss: 0.3630 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.2910 42/124 [=========>....................] - ETA: 0s - loss: 0.3394 82/124 [==================>...........] - ETA: 0s - loss: 0.3506 123/124 [============================>.] - ETA: 0s - loss: 0.3594 124/124 [==============================] - 0s 1ms/step - loss: 0.3608 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3492 44/124 [=========>....................] - ETA: 0s - loss: 0.3504 84/124 [===================>..........] - ETA: 0s - loss: 0.3557 123/124 [============================>.] - ETA: 0s - loss: 0.3595 124/124 [==============================] - 0s 1ms/step - loss: 0.3605 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2745 42/124 [=========>....................] - ETA: 0s - loss: 0.3379 81/124 [==================>...........] - ETA: 0s - loss: 0.3516 119/124 [===========================>..] - ETA: 0s - loss: 0.3547 124/124 [==============================] - 0s 1ms/step - loss: 0.3535 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2594 40/124 [========>.....................] - ETA: 0s - loss: 0.3576 80/124 [==================>...........] - ETA: 0s - loss: 0.3515 114/124 [==========================>...] - ETA: 0s - loss: 0.3494 124/124 [==============================] - 0s 1ms/step - loss: 0.3533 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.1250 39/124 [========>.....................] - ETA: 0s - loss: 0.3499 79/124 [==================>...........] - ETA: 0s - loss: 0.3494 120/124 [============================>.] - ETA: 0s - loss: 0.3555 124/124 [==============================] - 0s 1ms/step - loss: 0.3532 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2614 41/124 [========>.....................] - ETA: 0s - loss: 0.4014 79/124 [==================>...........] - ETA: 0s - loss: 0.3692 117/124 [===========================>..] - ETA: 0s - loss: 0.3601 124/124 [==============================] - 0s 1ms/step - loss: 0.3627 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.2162 40/124 [========>.....................] - ETA: 0s - loss: 0.3610 79/124 [==================>...........] - ETA: 0s - loss: 0.3503 118/124 [===========================>..] - ETA: 0s - loss: 0.3532 124/124 [==============================] - 0s 1ms/step - loss: 0.3519 -> test with GAN.predict GAN tn, fp: 242, 68 GAN fn, tp: 5, 6 GAN f1 score: 0.141 GAN cohens kappa score: 0.087 -> test with 'LR' LR tn, fp: 206, 104 LR fn, tp: 2, 9 LR f1 score: 0.145 LR cohens kappa score: 0.088 LR average precision score: 0.141 -> test with 'RF' RF tn, fp: 291, 19 RF fn, tp: 10, 1 RF f1 score: 0.065 RF cohens kappa score: 0.021 -> test with 'GB' GB tn, fp: 282, 28 GB fn, tp: 7, 4 GB f1 score: 0.186 GB cohens kappa score: 0.142 -> test with 'KNN' KNN tn, fp: 212, 98 KNN fn, tp: 8, 3 KNN f1 score: 0.054 KNN cohens kappa score: -0.009 ------ Step 2/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 21s - loss: 0.4434 43/124 [=========>....................] - ETA: 0s - loss: 0.4047  86/124 [===================>..........] - ETA: 0s - loss: 0.3800 124/124 [==============================] - 0s 1ms/step - loss: 0.3721 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.3074 43/124 [=========>....................] - ETA: 0s - loss: 0.3397 84/124 [===================>..........] - ETA: 0s - loss: 0.3571 124/124 [==============================] - 0s 1ms/step - loss: 0.3595 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2679 42/124 [=========>....................] - ETA: 0s - loss: 0.3519 83/124 [===================>..........] - ETA: 0s - loss: 0.3540 122/124 [============================>.] - ETA: 0s - loss: 0.3593 124/124 [==============================] - 0s 1ms/step - loss: 0.3585 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.5467 41/124 [========>.....................] - ETA: 0s - loss: 0.3434 81/124 [==================>...........] - ETA: 0s - loss: 0.3459 122/124 [============================>.] - ETA: 0s - loss: 0.3598 124/124 [==============================] - 0s 1ms/step - loss: 0.3591 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2121 43/124 [=========>....................] - ETA: 0s - loss: 0.3396 84/124 [===================>..........] - ETA: 0s - loss: 0.3499 124/124 [==============================] - 0s 1ms/step - loss: 0.3513 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.3172 42/124 [=========>....................] - ETA: 0s - loss: 0.3402 84/124 [===================>..........] - ETA: 0s - loss: 0.3474 124/124 [==============================] - 0s 1ms/step - loss: 0.3490 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2835 39/124 [========>.....................] - ETA: 0s - loss: 0.3228 75/124 [=================>............] - ETA: 0s - loss: 0.3484 110/124 [=========================>....] - ETA: 0s - loss: 0.3486 124/124 [==============================] - 0s 1ms/step - loss: 0.3475 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2456 43/124 [=========>....................] - ETA: 0s - loss: 0.3620 84/124 [===================>..........] - ETA: 0s - loss: 0.3535 124/124 [==============================] - 0s 1ms/step - loss: 0.3448 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.7754 42/124 [=========>....................] - ETA: 0s - loss: 0.3635 79/124 [==================>...........] - ETA: 0s - loss: 0.3478 119/124 [===========================>..] - ETA: 0s - loss: 0.3483 124/124 [==============================] - 0s 1ms/step - loss: 0.3480 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.5791 42/124 [=========>....................] - ETA: 0s - loss: 0.3574 84/124 [===================>..........] - ETA: 0s - loss: 0.3729 123/124 [============================>.] - ETA: 0s - loss: 0.3587 124/124 [==============================] - 0s 1ms/step - loss: 0.3577 -> test with GAN.predict GAN tn, fp: 247, 63 GAN fn, tp: 5, 6 GAN f1 score: 0.150 GAN cohens kappa score: 0.097 -> test with 'LR' LR tn, fp: 212, 98 LR fn, tp: 4, 7 LR f1 score: 0.121 LR cohens kappa score: 0.063 LR average precision score: 0.183 -> test with 'RF' RF tn, fp: 299, 11 RF fn, tp: 10, 1 RF f1 score: 0.087 RF cohens kappa score: 0.053 -> test with 'GB' GB tn, fp: 288, 22 GB fn, tp: 11, 0 GB f1 score: 0.000 GB cohens kappa score: -0.048 -> test with 'KNN' KNN tn, fp: 227, 83 KNN fn, tp: 10, 1 KNN f1 score: 0.021 KNN cohens kappa score: -0.042 ------ Step 2/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 20s - loss: 0.4159 40/124 [========>.....................] - ETA: 0s - loss: 0.3408  82/124 [==================>...........] - ETA: 0s - loss: 0.3377 122/124 [============================>.] - ETA: 0s - loss: 0.3441 124/124 [==============================] - 0s 1ms/step - loss: 0.3428 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2828 38/124 [========>.....................] - ETA: 0s - loss: 0.3474 74/124 [================>.............] - ETA: 0s - loss: 0.3589 110/124 [=========================>....] - ETA: 0s - loss: 0.3462 124/124 [==============================] - 0s 1ms/step - loss: 0.3416 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3811 44/124 [=========>....................] - ETA: 0s - loss: 0.3432 86/124 [===================>..........] - ETA: 0s - loss: 0.3333 124/124 [==============================] - 0s 1ms/step - loss: 0.3370 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.4776 43/124 [=========>....................] - ETA: 0s - loss: 0.3642 82/124 [==================>...........] - ETA: 0s - loss: 0.3580 124/124 [==============================] - 0s 1ms/step - loss: 0.3474 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.1821 46/124 [==========>...................] - ETA: 0s - loss: 0.3202 85/124 [===================>..........] - ETA: 0s - loss: 0.3292 124/124 [==============================] - 0s 1ms/step - loss: 0.3354 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.5575 43/124 [=========>....................] - ETA: 0s - loss: 0.3108 85/124 [===================>..........] - ETA: 0s - loss: 0.3339 124/124 [==============================] - 0s 1ms/step - loss: 0.3308 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.3574 43/124 [=========>....................] - ETA: 0s - loss: 0.3133 85/124 [===================>..........] - ETA: 0s - loss: 0.3319 124/124 [==============================] - 0s 1ms/step - loss: 0.3353 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.4238 43/124 [=========>....................] - ETA: 0s - loss: 0.3352 83/124 [===================>..........] - ETA: 0s - loss: 0.3343 124/124 [==============================] - ETA: 0s - loss: 0.3323 124/124 [==============================] - 0s 1ms/step - loss: 0.3323 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3185 43/124 [=========>....................] - ETA: 0s - loss: 0.3895 85/124 [===================>..........] - ETA: 0s - loss: 0.3487 124/124 [==============================] - 0s 1ms/step - loss: 0.3387 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.1870 41/124 [========>.....................] - ETA: 0s - loss: 0.3090 82/124 [==================>...........] - ETA: 0s - loss: 0.3408 121/124 [============================>.] - ETA: 0s - loss: 0.3345 124/124 [==============================] - 0s 1ms/step - loss: 0.3329 -> test with GAN.predict GAN tn, fp: 278, 32 GAN fn, tp: 7, 4 GAN f1 score: 0.170 GAN cohens kappa score: 0.124 -> test with 'LR' LR tn, fp: 217, 93 LR fn, tp: 3, 8 LR f1 score: 0.143 LR cohens kappa score: 0.086 LR average precision score: 0.185 -> test with 'RF' RF tn, fp: 295, 15 RF fn, tp: 10, 1 RF f1 score: 0.074 RF cohens kappa score: 0.035 -> test with 'GB' GB tn, fp: 287, 23 GB fn, tp: 10, 1 GB f1 score: 0.057 GB cohens kappa score: 0.011 -> test with 'KNN' KNN tn, fp: 244, 66 KNN fn, tp: 9, 2 KNN f1 score: 0.051 KNN cohens kappa score: -0.009 ------ Step 2/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 23s - loss: 0.2137 37/124 [=======>......................] - ETA: 0s - loss: 0.3122  74/124 [================>.............] - ETA: 0s - loss: 0.2983 104/124 [========================>.....] - ETA: 0s - loss: 0.2800 124/124 [==============================] - 0s 1ms/step - loss: 0.2804 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.1398 35/124 [=======>......................] - ETA: 0s - loss: 0.2618 71/124 [================>.............] - ETA: 0s - loss: 0.2743 107/124 [========================>.....] - ETA: 0s - loss: 0.2827 124/124 [==============================] - 0s 1ms/step - loss: 0.2846 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.7680 37/124 [=======>......................] - ETA: 0s - loss: 0.2878 73/124 [================>.............] - ETA: 0s - loss: 0.2825 108/124 [=========================>....] - ETA: 0s - loss: 0.2762 124/124 [==============================] - 0s 1ms/step - loss: 0.2700 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.2108 35/124 [=======>......................] - ETA: 0s - loss: 0.2864 71/124 [================>.............] - ETA: 0s - loss: 0.2601 108/124 [=========================>....] - ETA: 0s - loss: 0.2772 124/124 [==============================] - 0s 1ms/step - loss: 0.2767 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3272 39/124 [========>.....................] - ETA: 0s - loss: 0.2643 76/124 [=================>............] - ETA: 0s - loss: 0.2604 110/124 [=========================>....] - ETA: 0s - loss: 0.2684 124/124 [==============================] - 0s 1ms/step - loss: 0.2671 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2067 38/124 [========>.....................] - ETA: 0s - loss: 0.2559 74/124 [================>.............] - ETA: 0s - loss: 0.2715 111/124 [=========================>....] - ETA: 0s - loss: 0.2717 124/124 [==============================] - 0s 1ms/step - loss: 0.2687 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2088 37/124 [=======>......................] - ETA: 0s - loss: 0.2493 72/124 [================>.............] - ETA: 0s - loss: 0.2618 113/124 [==========================>...] - ETA: 0s - loss: 0.2672 124/124 [==============================] - 0s 1ms/step - loss: 0.2723 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.1972 37/124 [=======>......................] - ETA: 0s - loss: 0.2712 70/124 [===============>..............] - ETA: 0s - loss: 0.2780 104/124 [========================>.....] - ETA: 0s - loss: 0.2724 124/124 [==============================] - 0s 1ms/step - loss: 0.2701 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.1553 37/124 [=======>......................] - ETA: 0s - loss: 0.2507 75/124 [=================>............] - ETA: 0s - loss: 0.2718 109/124 [=========================>....] - ETA: 0s - loss: 0.2638 124/124 [==============================] - 0s 1ms/step - loss: 0.2661 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.4166 42/124 [=========>....................] - ETA: 0s - loss: 0.2551 80/124 [==================>...........] - ETA: 0s - loss: 0.2583 114/124 [==========================>...] - ETA: 0s - loss: 0.2662 124/124 [==============================] - 0s 1ms/step - loss: 0.2644 -> test with GAN.predict GAN tn, fp: 269, 41 GAN fn, tp: 9, 2 GAN f1 score: 0.074 GAN cohens kappa score: 0.021 -> test with 'LR' LR tn, fp: 226, 84 LR fn, tp: 4, 7 LR f1 score: 0.137 LR cohens kappa score: 0.081 LR average precision score: 0.301 -> test with 'RF' RF tn, fp: 305, 5 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.022 -> test with 'GB' GB tn, fp: 301, 9 GB fn, tp: 11, 0 GB f1 score: 0.000 GB cohens kappa score: -0.032 -> test with 'KNN' KNN tn, fp: 241, 69 KNN fn, tp: 10, 1 KNN f1 score: 0.025 KNN cohens kappa score: -0.037 ------ Step 2/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1196 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 17s - loss: 0.3448 44/124 [=========>....................] - ETA: 0s - loss: 0.3291  86/124 [===================>..........] - ETA: 0s - loss: 0.3310 124/124 [==============================] - 0s 1ms/step - loss: 0.3366 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.4049 46/124 [==========>...................] - ETA: 0s - loss: 0.3107 91/124 [=====================>........] - ETA: 0s - loss: 0.3263 124/124 [==============================] - 0s 1ms/step - loss: 0.3344 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2338 46/124 [==========>...................] - ETA: 0s - loss: 0.3383 91/124 [=====================>........] - ETA: 0s - loss: 0.3326 124/124 [==============================] - 0s 1ms/step - loss: 0.3294 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.5449 36/124 [=======>......................] - ETA: 0s - loss: 0.3542 73/124 [================>.............] - ETA: 0s - loss: 0.3173 111/124 [=========================>....] - ETA: 0s - loss: 0.3242 124/124 [==============================] - 0s 1ms/step - loss: 0.3215 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3530 45/124 [=========>....................] - ETA: 0s - loss: 0.3361 88/124 [====================>.........] - ETA: 0s - loss: 0.3289 124/124 [==============================] - 0s 1ms/step - loss: 0.3258 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2088 44/124 [=========>....................] - ETA: 0s - loss: 0.3399 89/124 [====================>.........] - ETA: 0s - loss: 0.3230 124/124 [==============================] - 0s 1ms/step - loss: 0.3213 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2385 46/124 [==========>...................] - ETA: 0s - loss: 0.3511 89/124 [====================>.........] - ETA: 0s - loss: 0.3398 124/124 [==============================] - 0s 1ms/step - loss: 0.3310 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3585 44/124 [=========>....................] - ETA: 0s - loss: 0.3040 86/124 [===================>..........] - ETA: 0s - loss: 0.3137 124/124 [==============================] - 0s 1ms/step - loss: 0.3198 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.4684 45/124 [=========>....................] - ETA: 0s - loss: 0.3252 87/124 [====================>.........] - ETA: 0s - loss: 0.3246 124/124 [==============================] - 0s 1ms/step - loss: 0.3147 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3582 46/124 [==========>...................] - ETA: 0s - loss: 0.3178 90/124 [====================>.........] - ETA: 0s - loss: 0.3398 124/124 [==============================] - 0s 1ms/step - loss: 0.3341 -> test with GAN.predict GAN tn, fp: 264, 42 GAN fn, tp: 5, 4 GAN f1 score: 0.145 GAN cohens kappa score: 0.103 -> test with 'LR' LR tn, fp: 234, 72 LR fn, tp: 3, 6 LR f1 score: 0.138 LR cohens kappa score: 0.091 LR average precision score: 0.131 -> test with 'RF' RF tn, fp: 299, 7 RF fn, tp: 7, 2 RF f1 score: 0.222 RF cohens kappa score: 0.199 -> test with 'GB' GB tn, fp: 291, 15 GB fn, tp: 6, 3 GB f1 score: 0.222 GB cohens kappa score: 0.191 -> test with 'KNN' KNN tn, fp: 223, 83 KNN fn, tp: 6, 3 KNN f1 score: 0.063 KNN cohens kappa score: 0.012 ====== Step 3/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 3/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 18s - loss: 0.4683 42/124 [=========>....................] - ETA: 0s - loss: 0.2980  84/124 [===================>..........] - ETA: 0s - loss: 0.3043 124/124 [==============================] - 0s 1ms/step - loss: 0.3040 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.3657 42/124 [=========>....................] - ETA: 0s - loss: 0.2747 82/124 [==================>...........] - ETA: 0s - loss: 0.2828 123/124 [============================>.] - ETA: 0s - loss: 0.2792 124/124 [==============================] - 0s 1ms/step - loss: 0.2783 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.4312 41/124 [========>.....................] - ETA: 0s - loss: 0.2754 82/124 [==================>...........] - ETA: 0s - loss: 0.2526 124/124 [==============================] - ETA: 0s - loss: 0.2657 124/124 [==============================] - 0s 1ms/step - loss: 0.2657 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.4078 43/124 [=========>....................] - ETA: 0s - loss: 0.2434 85/124 [===================>..........] - ETA: 0s - loss: 0.2595 124/124 [==============================] - 0s 1ms/step - loss: 0.2578 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2135 43/124 [=========>....................] - ETA: 0s - loss: 0.2488 83/124 [===================>..........] - ETA: 0s - loss: 0.2675 121/124 [============================>.] - ETA: 0s - loss: 0.2625 124/124 [==============================] - 0s 1ms/step - loss: 0.2637 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.1223 43/124 [=========>....................] - ETA: 0s - loss: 0.2628 84/124 [===================>..........] - ETA: 0s - loss: 0.2607 124/124 [==============================] - 0s 1ms/step - loss: 0.2566 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.1019 42/124 [=========>....................] - ETA: 0s - loss: 0.2473 84/124 [===================>..........] - ETA: 0s - loss: 0.2378 124/124 [==============================] - 0s 1ms/step - loss: 0.2492 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2260 43/124 [=========>....................] - ETA: 0s - loss: 0.2434 83/124 [===================>..........] - ETA: 0s - loss: 0.2337 124/124 [==============================] - 0s 1ms/step - loss: 0.2449 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.1200 41/124 [========>.....................] - ETA: 0s - loss: 0.2251 82/124 [==================>...........] - ETA: 0s - loss: 0.2358 123/124 [============================>.] - ETA: 0s - loss: 0.2453 124/124 [==============================] - 0s 1ms/step - loss: 0.2447 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.2162 35/124 [=======>......................] - ETA: 0s - loss: 0.2702 72/124 [================>.............] - ETA: 0s - loss: 0.2655 110/124 [=========================>....] - ETA: 0s - loss: 0.2428 124/124 [==============================] - 0s 1ms/step - loss: 0.2435 -> test with GAN.predict GAN tn, fp: 281, 29 GAN fn, tp: 7, 4 GAN f1 score: 0.182 GAN cohens kappa score: 0.137 -> test with 'LR' LR tn, fp: 234, 76 LR fn, tp: 4, 7 LR f1 score: 0.149 LR cohens kappa score: 0.094 LR average precision score: 0.175 -> test with 'RF' RF tn, fp: 303, 7 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.027 -> test with 'GB' GB tn, fp: 296, 14 GB fn, tp: 10, 1 GB f1 score: 0.077 GB cohens kappa score: 0.039 -> test with 'KNN' KNN tn, fp: 252, 58 KNN fn, tp: 8, 3 KNN f1 score: 0.083 KNN cohens kappa score: 0.027 ------ Step 3/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 19s - loss: 0.4181 36/124 [=======>......................] - ETA: 0s - loss: 0.3569  73/124 [================>.............] - ETA: 0s - loss: 0.3548 112/124 [==========================>...] - ETA: 0s - loss: 0.3548 124/124 [==============================] - 0s 1ms/step - loss: 0.3572 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.8288 40/124 [========>.....................] - ETA: 0s - loss: 0.3546 80/124 [==================>...........] - ETA: 0s - loss: 0.3563 118/124 [===========================>..] - ETA: 0s - loss: 0.3501 124/124 [==============================] - 0s 1ms/step - loss: 0.3523 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2291 34/124 [=======>......................] - ETA: 0s - loss: 0.3372 74/124 [================>.............] - ETA: 0s - loss: 0.3542 115/124 [==========================>...] - ETA: 0s - loss: 0.3563 124/124 [==============================] - 0s 1ms/step - loss: 0.3558 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.4462 41/124 [========>.....................] - ETA: 0s - loss: 0.3592 77/124 [=================>............] - ETA: 0s - loss: 0.3581 115/124 [==========================>...] - ETA: 0s - loss: 0.3525 124/124 [==============================] - 0s 1ms/step - loss: 0.3515 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.5710 39/124 [========>.....................] - ETA: 0s - loss: 0.3882 66/124 [==============>...............] - ETA: 0s - loss: 0.3769 97/124 [======================>.......] - ETA: 0s - loss: 0.3699 124/124 [==============================] - 0s 2ms/step - loss: 0.3626 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4558 40/124 [========>.....................] - ETA: 0s - loss: 0.3713 80/124 [==================>...........] - ETA: 0s - loss: 0.3564 117/124 [===========================>..] - ETA: 0s - loss: 0.3503 124/124 [==============================] - 0s 1ms/step - loss: 0.3486 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2918 41/124 [========>.....................] - ETA: 0s - loss: 0.3380 81/124 [==================>...........] - ETA: 0s - loss: 0.3354 120/124 [============================>.] - ETA: 0s - loss: 0.3468 124/124 [==============================] - 0s 1ms/step - loss: 0.3461 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.1439 40/124 [========>.....................] - ETA: 0s - loss: 0.3296 80/124 [==================>...........] - ETA: 0s - loss: 0.3463 121/124 [============================>.] - ETA: 0s - loss: 0.3508 124/124 [==============================] - 0s 1ms/step - loss: 0.3495 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.4851 42/124 [=========>....................] - ETA: 0s - loss: 0.3506 84/124 [===================>..........] - ETA: 0s - loss: 0.3325 122/124 [============================>.] - ETA: 0s - loss: 0.3411 124/124 [==============================] - 0s 1ms/step - loss: 0.3440 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3554 36/124 [=======>......................] - ETA: 0s - loss: 0.3345 73/124 [================>.............] - ETA: 0s - loss: 0.3469 112/124 [==========================>...] - ETA: 0s - loss: 0.3503 124/124 [==============================] - 0s 1ms/step - loss: 0.3494 -> test with GAN.predict GAN tn, fp: 250, 60 GAN fn, tp: 6, 5 GAN f1 score: 0.132 GAN cohens kappa score: 0.078 -> test with 'LR' LR tn, fp: 206, 104 LR fn, tp: 2, 9 LR f1 score: 0.145 LR cohens kappa score: 0.088 LR average precision score: 0.259 -> test with 'RF' RF tn, fp: 296, 14 RF fn, tp: 8, 3 RF f1 score: 0.214 RF cohens kappa score: 0.180 -> test with 'GB' GB tn, fp: 288, 22 GB fn, tp: 10, 1 GB f1 score: 0.059 GB cohens kappa score: 0.013 -> test with 'KNN' KNN tn, fp: 231, 79 KNN fn, tp: 8, 3 KNN f1 score: 0.065 KNN cohens kappa score: 0.004 ------ Step 3/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 20s - loss: 0.2541 42/124 [=========>....................] - ETA: 0s - loss: 0.3551  83/124 [===================>..........] - ETA: 0s - loss: 0.3435 123/124 [============================>.] - ETA: 0s - loss: 0.3325 124/124 [==============================] - 0s 1ms/step - loss: 0.3330 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2714 43/124 [=========>....................] - ETA: 0s - loss: 0.3341 85/124 [===================>..........] - ETA: 0s - loss: 0.3293 124/124 [==============================] - 0s 1ms/step - loss: 0.3258 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.4941 43/124 [=========>....................] - ETA: 0s - loss: 0.3806 85/124 [===================>..........] - ETA: 0s - loss: 0.3484 124/124 [==============================] - 0s 1ms/step - loss: 0.3377 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.2478 43/124 [=========>....................] - ETA: 0s - loss: 0.2923 84/124 [===================>..........] - ETA: 0s - loss: 0.3200 124/124 [==============================] - 0s 1ms/step - loss: 0.3231 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2848 43/124 [=========>....................] - ETA: 0s - loss: 0.3118 84/124 [===================>..........] - ETA: 0s - loss: 0.3157 124/124 [==============================] - 0s 1ms/step - loss: 0.3281 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2715 40/124 [========>.....................] - ETA: 0s - loss: 0.3222 80/124 [==================>...........] - ETA: 0s - loss: 0.3217 122/124 [============================>.] - ETA: 0s - loss: 0.3206 124/124 [==============================] - 0s 1ms/step - loss: 0.3218 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.5223 42/124 [=========>....................] - ETA: 0s - loss: 0.3348 84/124 [===================>..........] - ETA: 0s - loss: 0.3304 124/124 [==============================] - 0s 1ms/step - loss: 0.3306 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3681 41/124 [========>.....................] - ETA: 0s - loss: 0.3367 82/124 [==================>...........] - ETA: 0s - loss: 0.3258 122/124 [============================>.] - ETA: 0s - loss: 0.3176 124/124 [==============================] - 0s 1ms/step - loss: 0.3193 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2527 42/124 [=========>....................] - ETA: 0s - loss: 0.3127 82/124 [==================>...........] - ETA: 0s - loss: 0.3160 124/124 [==============================] - ETA: 0s - loss: 0.3206 124/124 [==============================] - 0s 1ms/step - loss: 0.3206 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3591 41/124 [========>.....................] - ETA: 0s - loss: 0.3223 82/124 [==================>...........] - ETA: 0s - loss: 0.3150 121/124 [============================>.] - ETA: 0s - loss: 0.3203 124/124 [==============================] - 0s 1ms/step - loss: 0.3203 -> test with GAN.predict GAN tn, fp: 268, 42 GAN fn, tp: 7, 4 GAN f1 score: 0.140 GAN cohens kappa score: 0.090 -> test with 'LR' LR tn, fp: 213, 97 LR fn, tp: 5, 6 LR f1 score: 0.105 LR cohens kappa score: 0.046 LR average precision score: 0.083 -> test with 'RF' RF tn, fp: 297, 13 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.039 -> test with 'GB' GB tn, fp: 286, 24 GB fn, tp: 9, 2 GB f1 score: 0.108 GB cohens kappa score: 0.063 -> test with 'KNN' KNN tn, fp: 219, 91 KNN fn, tp: 9, 2 KNN f1 score: 0.038 KNN cohens kappa score: -0.024 ------ Step 3/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 19s - loss: 0.4161 42/124 [=========>....................] - ETA: 0s - loss: 0.3548  82/124 [==================>...........] - ETA: 0s - loss: 0.3539 123/124 [============================>.] - ETA: 0s - loss: 0.3645 124/124 [==============================] - 0s 1ms/step - loss: 0.3652 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2439 41/124 [========>.....................] - ETA: 0s - loss: 0.3633 81/124 [==================>...........] - ETA: 0s - loss: 0.3560 119/124 [===========================>..] - ETA: 0s - loss: 0.3573 124/124 [==============================] - 0s 1ms/step - loss: 0.3561 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.4061 41/124 [========>.....................] - ETA: 0s - loss: 0.3426 80/124 [==================>...........] - ETA: 0s - loss: 0.3522 118/124 [===========================>..] - ETA: 0s - loss: 0.3496 124/124 [==============================] - 0s 1ms/step - loss: 0.3488 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3337 41/124 [========>.....................] - ETA: 0s - loss: 0.3394 82/124 [==================>...........] - ETA: 0s - loss: 0.3443 122/124 [============================>.] - ETA: 0s - loss: 0.3464 124/124 [==============================] - 0s 1ms/step - loss: 0.3492 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2211 41/124 [========>.....................] - ETA: 0s - loss: 0.3554 83/124 [===================>..........] - ETA: 0s - loss: 0.3491 124/124 [==============================] - ETA: 0s - loss: 0.3545 124/124 [==============================] - 0s 1ms/step - loss: 0.3545 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2691 40/124 [========>.....................] - ETA: 0s - loss: 0.3642 80/124 [==================>...........] - ETA: 0s - loss: 0.3441 122/124 [============================>.] - ETA: 0s - loss: 0.3471 124/124 [==============================] - 0s 1ms/step - loss: 0.3479 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2950 39/124 [========>.....................] - ETA: 0s - loss: 0.3207 80/124 [==================>...........] - ETA: 0s - loss: 0.3348 119/124 [===========================>..] - ETA: 0s - loss: 0.3416 124/124 [==============================] - 0s 1ms/step - loss: 0.3435 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3480 42/124 [=========>....................] - ETA: 0s - loss: 0.3556 82/124 [==================>...........] - ETA: 0s - loss: 0.3541 123/124 [============================>.] - ETA: 0s - loss: 0.3476 124/124 [==============================] - 0s 1ms/step - loss: 0.3470 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.1729 42/124 [=========>....................] - ETA: 0s - loss: 0.3257 84/124 [===================>..........] - ETA: 0s - loss: 0.3354 124/124 [==============================] - 0s 1ms/step - loss: 0.3456 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.4115 42/124 [=========>....................] - ETA: 0s - loss: 0.3494 79/124 [==================>...........] - ETA: 0s - loss: 0.3456 119/124 [===========================>..] - ETA: 0s - loss: 0.3433 124/124 [==============================] - 0s 1ms/step - loss: 0.3448 -> test with GAN.predict GAN tn, fp: 253, 57 GAN fn, tp: 6, 5 GAN f1 score: 0.137 GAN cohens kappa score: 0.084 -> test with 'LR' LR tn, fp: 202, 108 LR fn, tp: 2, 9 LR f1 score: 0.141 LR cohens kappa score: 0.083 LR average precision score: 0.175 -> test with 'RF' RF tn, fp: 301, 9 RF fn, tp: 10, 1 RF f1 score: 0.095 RF cohens kappa score: 0.065 -> test with 'GB' GB tn, fp: 285, 25 GB fn, tp: 10, 1 GB f1 score: 0.054 GB cohens kappa score: 0.006 -> test with 'KNN' KNN tn, fp: 223, 87 KNN fn, tp: 7, 4 KNN f1 score: 0.078 KNN cohens kappa score: 0.018 ------ Step 3/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1196 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 16s - loss: 0.2254 45/124 [=========>....................] - ETA: 0s - loss: 0.3729  89/124 [====================>.........] - ETA: 0s - loss: 0.3888 124/124 [==============================] - 0s 1ms/step - loss: 0.3817 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.4311 42/124 [=========>....................] - ETA: 0s - loss: 0.3914 79/124 [==================>...........] - ETA: 0s - loss: 0.3719 118/124 [===========================>..] - ETA: 0s - loss: 0.3756 124/124 [==============================] - 0s 1ms/step - loss: 0.3708 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2064 43/124 [=========>....................] - ETA: 0s - loss: 0.3541 88/124 [====================>.........] - ETA: 0s - loss: 0.3572 124/124 [==============================] - 0s 1ms/step - loss: 0.3606 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.5810 44/124 [=========>....................] - ETA: 0s - loss: 0.3498 88/124 [====================>.........] - ETA: 0s - loss: 0.3544 124/124 [==============================] - 0s 1ms/step - loss: 0.3579 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3408 45/124 [=========>....................] - ETA: 0s - loss: 0.3608 90/124 [====================>.........] - ETA: 0s - loss: 0.3540 124/124 [==============================] - 0s 1ms/step - loss: 0.3542 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.1321 46/124 [==========>...................] - ETA: 0s - loss: 0.3387 90/124 [====================>.........] - ETA: 0s - loss: 0.3628 124/124 [==============================] - 0s 1ms/step - loss: 0.3638 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2814 39/124 [========>.....................] - ETA: 0s - loss: 0.3667 83/124 [===================>..........] - ETA: 0s - loss: 0.3555 124/124 [==============================] - 0s 1ms/step - loss: 0.3536 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2153 45/124 [=========>....................] - ETA: 0s - loss: 0.3364 90/124 [====================>.........] - ETA: 0s - loss: 0.3455 124/124 [==============================] - 0s 1ms/step - loss: 0.3520 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3098 45/124 [=========>....................] - ETA: 0s - loss: 0.3541 89/124 [====================>.........] - ETA: 0s - loss: 0.3539 124/124 [==============================] - 0s 1ms/step - loss: 0.3549 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.4050 42/124 [=========>....................] - ETA: 0s - loss: 0.3590 88/124 [====================>.........] - ETA: 0s - loss: 0.3490 124/124 [==============================] - 0s 1ms/step - loss: 0.3603 -> test with GAN.predict GAN tn, fp: 258, 48 GAN fn, tp: 7, 2 GAN f1 score: 0.068 GAN cohens kappa score: 0.020 -> test with 'LR' LR tn, fp: 219, 87 LR fn, tp: 2, 7 LR f1 score: 0.136 LR cohens kappa score: 0.088 LR average precision score: 0.201 -> test with 'RF' RF tn, fp: 293, 13 RF fn, tp: 9, 0 RF f1 score: 0.000 RF cohens kappa score: -0.035 -> test with 'GB' GB tn, fp: 287, 19 GB fn, tp: 7, 2 GB f1 score: 0.133 GB cohens kappa score: 0.097 -> test with 'KNN' KNN tn, fp: 221, 85 KNN fn, tp: 6, 3 KNN f1 score: 0.062 KNN cohens kappa score: 0.011 ====== Step 4/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 4/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 18s - loss: 0.4666 38/124 [========>.....................] - ETA: 0s - loss: 0.4665  71/124 [================>.............] - ETA: 0s - loss: 0.4412 107/124 [========================>.....] - ETA: 0s - loss: 0.4292 124/124 [==============================] - 0s 1ms/step - loss: 0.4295 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.4976 42/124 [=========>....................] - ETA: 0s - loss: 0.4425 83/124 [===================>..........] - ETA: 0s - loss: 0.4368 120/124 [============================>.] - ETA: 0s - loss: 0.4294 124/124 [==============================] - 0s 1ms/step - loss: 0.4307 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3930 42/124 [=========>....................] - ETA: 0s - loss: 0.4418 83/124 [===================>..........] - ETA: 0s - loss: 0.4352 124/124 [==============================] - 0s 1ms/step - loss: 0.4253 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3641 42/124 [=========>....................] - ETA: 0s - loss: 0.4004 82/124 [==================>...........] - ETA: 0s - loss: 0.4239 123/124 [============================>.] - ETA: 0s - loss: 0.4171 124/124 [==============================] - 0s 1ms/step - loss: 0.4171 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.6030 43/124 [=========>....................] - ETA: 0s - loss: 0.4550 85/124 [===================>..........] - ETA: 0s - loss: 0.4333 124/124 [==============================] - ETA: 0s - loss: 0.4159 124/124 [==============================] - 0s 1ms/step - loss: 0.4159 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.3027 43/124 [=========>....................] - ETA: 0s - loss: 0.4115 85/124 [===================>..........] - ETA: 0s - loss: 0.4092 124/124 [==============================] - 0s 1ms/step - loss: 0.4076 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2696 42/124 [=========>....................] - ETA: 0s - loss: 0.3887 84/124 [===================>..........] - ETA: 0s - loss: 0.4052 124/124 [==============================] - 0s 1ms/step - loss: 0.4033 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2951 42/124 [=========>....................] - ETA: 0s - loss: 0.3871 82/124 [==================>...........] - ETA: 0s - loss: 0.3947 124/124 [==============================] - ETA: 0s - loss: 0.4047 124/124 [==============================] - 0s 1ms/step - loss: 0.4047 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.4796 43/124 [=========>....................] - ETA: 0s - loss: 0.4083 84/124 [===================>..........] - ETA: 0s - loss: 0.3995 124/124 [==============================] - 0s 1ms/step - loss: 0.3997 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.1935 41/124 [========>.....................] - ETA: 0s - loss: 0.3589 83/124 [===================>..........] - ETA: 0s - loss: 0.3796 124/124 [==============================] - ETA: 0s - loss: 0.3880 124/124 [==============================] - 0s 1ms/step - loss: 0.3880 -> test with GAN.predict GAN tn, fp: 211, 99 GAN fn, tp: 4, 7 GAN f1 score: 0.120 GAN cohens kappa score: 0.061 -> test with 'LR' LR tn, fp: 221, 89 LR fn, tp: 2, 9 LR f1 score: 0.165 LR cohens kappa score: 0.110 LR average precision score: 0.371 -> test with 'RF' RF tn, fp: 305, 5 RF fn, tp: 10, 1 RF f1 score: 0.118 RF cohens kappa score: 0.096 -> test with 'GB' GB tn, fp: 297, 13 GB fn, tp: 7, 4 GB f1 score: 0.286 GB cohens kappa score: 0.255 -> test with 'KNN' KNN tn, fp: 220, 90 KNN fn, tp: 5, 6 KNN f1 score: 0.112 KNN cohens kappa score: 0.054 ------ Step 4/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 36s - loss: 0.2942 30/124 [======>.......................] - ETA: 0s - loss: 0.3117  54/124 [============>.................] - ETA: 0s - loss: 0.3066 84/124 [===================>..........] - ETA: 0s - loss: 0.3018 119/124 [===========================>..] - ETA: 0s - loss: 0.3106 124/124 [==============================] - 1s 2ms/step - loss: 0.3130 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2676 38/124 [========>.....................] - ETA: 0s - loss: 0.3067 65/124 [==============>...............] - ETA: 0s - loss: 0.2986 93/124 [=====================>........] - ETA: 0s - loss: 0.3152 124/124 [==============================] - 0s 2ms/step - loss: 0.3053 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.4003 23/124 [====>.........................] - ETA: 0s - loss: 0.2765 52/124 [===========>..................] - ETA: 0s - loss: 0.2973 76/124 [=================>............] - ETA: 0s - loss: 0.2999 100/124 [=======================>......] - ETA: 0s - loss: 0.2925 124/124 [==============================] - 0s 2ms/step - loss: 0.3024 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3438 29/124 [======>.......................] - ETA: 0s - loss: 0.2881 54/124 [============>.................] - ETA: 0s - loss: 0.2987 70/124 [===============>..............] - ETA: 0s - loss: 0.3017 87/124 [====================>.........] - ETA: 0s - loss: 0.3019 103/124 [=======================>......] - ETA: 0s - loss: 0.3001 119/124 [===========================>..] - ETA: 0s - loss: 0.3006 124/124 [==============================] - 0s 3ms/step - loss: 0.3000 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3087 17/124 [===>..........................] - ETA: 0s - loss: 0.3175 33/124 [======>.......................] - ETA: 0s - loss: 0.3212 48/124 [==========>...................] - ETA: 0s - loss: 0.3014 65/124 [==============>...............] - ETA: 0s - loss: 0.3093 82/124 [==================>...........] - ETA: 0s - loss: 0.3128 107/124 [========================>.....] - ETA: 0s - loss: 0.3022 124/124 [==============================] - 0s 3ms/step - loss: 0.3012 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.2814 26/124 [=====>........................] - ETA: 0s - loss: 0.2889 49/124 [==========>...................] - ETA: 0s - loss: 0.2899 71/124 [================>.............] - ETA: 0s - loss: 0.2888 96/124 [======================>.......] - ETA: 0s - loss: 0.2997 116/124 [===========================>..] - ETA: 0s - loss: 0.3062 124/124 [==============================] - 0s 2ms/step - loss: 0.3100 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2143 26/124 [=====>........................] - ETA: 0s - loss: 0.2615 49/124 [==========>...................] - ETA: 0s - loss: 0.2749 78/124 [=================>............] - ETA: 0s - loss: 0.2884 110/124 [=========================>....] - ETA: 0s - loss: 0.2893 124/124 [==============================] - 0s 2ms/step - loss: 0.2969 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.1992 28/124 [=====>........................] - ETA: 0s - loss: 0.2618 59/124 [=============>................] - ETA: 0s - loss: 0.2801 86/124 [===================>..........] - ETA: 0s - loss: 0.2935 103/124 [=======================>......] - ETA: 0s - loss: 0.2949 121/124 [============================>.] - ETA: 0s - loss: 0.2995 124/124 [==============================] - 0s 2ms/step - loss: 0.3005 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3204 20/124 [===>..........................] - ETA: 0s - loss: 0.2883 48/124 [==========>...................] - ETA: 0s - loss: 0.2962 71/124 [================>.............] - ETA: 0s - loss: 0.2852 95/124 [=====================>........] - ETA: 0s - loss: 0.2961 121/124 [============================>.] - ETA: 0s - loss: 0.3016 124/124 [==============================] - 0s 2ms/step - loss: 0.3021 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.2329 27/124 [=====>........................] - ETA: 0s - loss: 0.2901 54/124 [============>.................] - ETA: 0s - loss: 0.2898 85/124 [===================>..........] - ETA: 0s - loss: 0.2979 113/124 [==========================>...] - ETA: 0s - loss: 0.2923 124/124 [==============================] - 0s 2ms/step - loss: 0.2929 -> test with GAN.predict GAN tn, fp: 263, 47 GAN fn, tp: 7, 4 GAN f1 score: 0.129 GAN cohens kappa score: 0.077 -> test with 'LR' LR tn, fp: 211, 99 LR fn, tp: 3, 8 LR f1 score: 0.136 LR cohens kappa score: 0.078 LR average precision score: 0.200 -> test with 'RF' RF tn, fp: 300, 10 RF fn, tp: 10, 1 RF f1 score: 0.091 RF cohens kappa score: 0.059 -> test with 'GB' GB tn, fp: 289, 21 GB fn, tp: 9, 2 GB f1 score: 0.118 GB cohens kappa score: 0.075 -> test with 'KNN' KNN tn, fp: 234, 76 KNN fn, tp: 10, 1 KNN f1 score: 0.023 KNN cohens kappa score: -0.040 ------ Step 4/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 20s - loss: 0.2900 41/124 [========>.....................] - ETA: 0s - loss: 0.3277  83/124 [===================>..........] - ETA: 0s - loss: 0.3295 124/124 [==============================] - ETA: 0s - loss: 0.3364 124/124 [==============================] - 0s 1ms/step - loss: 0.3364 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.3078 41/124 [========>.....................] - ETA: 0s - loss: 0.3134 83/124 [===================>..........] - ETA: 0s - loss: 0.3173 124/124 [==============================] - 0s 1ms/step - loss: 0.3229 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.2463 38/124 [========>.....................] - ETA: 0s - loss: 0.3202 71/124 [================>.............] - ETA: 0s - loss: 0.3178 106/124 [========================>.....] - ETA: 0s - loss: 0.3179 124/124 [==============================] - 0s 1ms/step - loss: 0.3196 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.1903 42/124 [=========>....................] - ETA: 0s - loss: 0.3220 84/124 [===================>..........] - ETA: 0s - loss: 0.3311 124/124 [==============================] - 0s 1ms/step - loss: 0.3264 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.1689 42/124 [=========>....................] - ETA: 0s - loss: 0.2804 83/124 [===================>..........] - ETA: 0s - loss: 0.3069 120/124 [============================>.] - ETA: 0s - loss: 0.3153 124/124 [==============================] - 0s 1ms/step - loss: 0.3140 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4859 37/124 [=======>......................] - ETA: 0s - loss: 0.3116 75/124 [=================>............] - ETA: 0s - loss: 0.2981 116/124 [===========================>..] - ETA: 0s - loss: 0.3149 124/124 [==============================] - 0s 1ms/step - loss: 0.3158 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2525 42/124 [=========>....................] - ETA: 0s - loss: 0.3161 82/124 [==================>...........] - ETA: 0s - loss: 0.3354 121/124 [============================>.] - ETA: 0s - loss: 0.3193 124/124 [==============================] - 0s 1ms/step - loss: 0.3193 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3858 40/124 [========>.....................] - ETA: 0s - loss: 0.2977 79/124 [==================>...........] - ETA: 0s - loss: 0.3028 117/124 [===========================>..] - ETA: 0s - loss: 0.3146 124/124 [==============================] - 0s 1ms/step - loss: 0.3116 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.1556 39/124 [========>.....................] - ETA: 0s - loss: 0.3072 79/124 [==================>...........] - ETA: 0s - loss: 0.3167 115/124 [==========================>...] - ETA: 0s - loss: 0.3142 124/124 [==============================] - 0s 1ms/step - loss: 0.3129 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3781 40/124 [========>.....................] - ETA: 0s - loss: 0.2943 80/124 [==================>...........] - ETA: 0s - loss: 0.2934 120/124 [============================>.] - ETA: 0s - loss: 0.3024 124/124 [==============================] - 0s 1ms/step - loss: 0.3024 -> test with GAN.predict GAN tn, fp: 281, 29 GAN fn, tp: 10, 1 GAN f1 score: 0.049 GAN cohens kappa score: -0.001 -> test with 'LR' LR tn, fp: 232, 78 LR fn, tp: 5, 6 LR f1 score: 0.126 LR cohens kappa score: 0.070 LR average precision score: 0.108 -> test with 'RF' RF tn, fp: 300, 10 RF fn, tp: 10, 1 RF f1 score: 0.091 RF cohens kappa score: 0.059 -> test with 'GB' GB tn, fp: 289, 21 GB fn, tp: 9, 2 GB f1 score: 0.118 GB cohens kappa score: 0.075 -> test with 'KNN' KNN tn, fp: 224, 86 KNN fn, tp: 10, 1 KNN f1 score: 0.020 KNN cohens kappa score: -0.043 ------ Step 4/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 19s - loss: 0.1820 41/124 [========>.....................] - ETA: 0s - loss: 0.2954  82/124 [==================>...........] - ETA: 0s - loss: 0.2958 124/124 [==============================] - ETA: 0s - loss: 0.3064 124/124 [==============================] - 0s 1ms/step - loss: 0.3064 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2461 42/124 [=========>....................] - ETA: 0s - loss: 0.3013 84/124 [===================>..........] - ETA: 0s - loss: 0.3086 121/124 [============================>.] - ETA: 0s - loss: 0.3128 124/124 [==============================] - 0s 1ms/step - loss: 0.3105 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3161 42/124 [=========>....................] - ETA: 0s - loss: 0.3052 81/124 [==================>...........] - ETA: 0s - loss: 0.2939 122/124 [============================>.] - ETA: 0s - loss: 0.3024 124/124 [==============================] - 0s 1ms/step - loss: 0.3021 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.1460 42/124 [=========>....................] - ETA: 0s - loss: 0.2983 82/124 [==================>...........] - ETA: 0s - loss: 0.3026 121/124 [============================>.] - ETA: 0s - loss: 0.2994 124/124 [==============================] - 0s 1ms/step - loss: 0.2987 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.4572 42/124 [=========>....................] - ETA: 0s - loss: 0.2783 83/124 [===================>..........] - ETA: 0s - loss: 0.2957 124/124 [==============================] - ETA: 0s - loss: 0.2954 124/124 [==============================] - 0s 1ms/step - loss: 0.2954 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.6064 41/124 [========>.....................] - ETA: 0s - loss: 0.2957 80/124 [==================>...........] - ETA: 0s - loss: 0.2893 119/124 [===========================>..] - ETA: 0s - loss: 0.2956 124/124 [==============================] - 0s 1ms/step - loss: 0.2960 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.3611 42/124 [=========>....................] - ETA: 0s - loss: 0.2887 83/124 [===================>..........] - ETA: 0s - loss: 0.2889 124/124 [==============================] - ETA: 0s - loss: 0.2940 124/124 [==============================] - 0s 1ms/step - loss: 0.2940 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.1737 42/124 [=========>....................] - ETA: 0s - loss: 0.3028 82/124 [==================>...........] - ETA: 0s - loss: 0.2925 123/124 [============================>.] - ETA: 0s - loss: 0.2934 124/124 [==============================] - 0s 1ms/step - loss: 0.2928 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.5618 41/124 [========>.....................] - ETA: 0s - loss: 0.3183 81/124 [==================>...........] - ETA: 0s - loss: 0.3005 122/124 [============================>.] - ETA: 0s - loss: 0.2978 124/124 [==============================] - 0s 1ms/step - loss: 0.2968 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3116 40/124 [========>.....................] - ETA: 0s - loss: 0.3076 76/124 [=================>............] - ETA: 0s - loss: 0.2873 113/124 [==========================>...] - ETA: 0s - loss: 0.2945 124/124 [==============================] - 0s 1ms/step - loss: 0.2880 -> test with GAN.predict GAN tn, fp: 261, 49 GAN fn, tp: 5, 6 GAN f1 score: 0.182 GAN cohens kappa score: 0.132 -> test with 'LR' LR tn, fp: 216, 94 LR fn, tp: 1, 10 LR f1 score: 0.174 LR cohens kappa score: 0.119 LR average precision score: 0.153 -> test with 'RF' RF tn, fp: 304, 6 RF fn, tp: 9, 2 RF f1 score: 0.211 RF cohens kappa score: 0.187 -> test with 'GB' GB tn, fp: 296, 14 GB fn, tp: 9, 2 GB f1 score: 0.148 GB cohens kappa score: 0.112 -> test with 'KNN' KNN tn, fp: 242, 68 KNN fn, tp: 8, 3 KNN f1 score: 0.073 KNN cohens kappa score: 0.015 ------ Step 4/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1196 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 18s - loss: 0.2120 40/124 [========>.....................] - ETA: 0s - loss: 0.3024  84/124 [===================>..........] - ETA: 0s - loss: 0.3029 124/124 [==============================] - 0s 1ms/step - loss: 0.2985 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.1347 45/124 [=========>....................] - ETA: 0s - loss: 0.2791 89/124 [====================>.........] - ETA: 0s - loss: 0.2967 124/124 [==============================] - 0s 1ms/step - loss: 0.2995 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3405 45/124 [=========>....................] - ETA: 0s - loss: 0.2940 88/124 [====================>.........] - ETA: 0s - loss: 0.2870 124/124 [==============================] - 0s 1ms/step - loss: 0.2958 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.2844 44/124 [=========>....................] - ETA: 0s - loss: 0.2916 88/124 [====================>.........] - ETA: 0s - loss: 0.2936 124/124 [==============================] - 0s 1ms/step - loss: 0.2955 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.2504 40/124 [========>.....................] - ETA: 0s - loss: 0.3117 77/124 [=================>............] - ETA: 0s - loss: 0.2906 113/124 [==========================>...] - ETA: 0s - loss: 0.2912 124/124 [==============================] - 0s 1ms/step - loss: 0.2926 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.1401 45/124 [=========>....................] - ETA: 0s - loss: 0.2800 90/124 [====================>.........] - ETA: 0s - loss: 0.2854 124/124 [==============================] - 0s 1ms/step - loss: 0.2910 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.3011 45/124 [=========>....................] - ETA: 0s - loss: 0.2982 86/124 [===================>..........] - ETA: 0s - loss: 0.2843 124/124 [==============================] - 0s 1ms/step - loss: 0.2857 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.2072 46/124 [==========>...................] - ETA: 0s - loss: 0.2738 89/124 [====================>.........] - ETA: 0s - loss: 0.2784 124/124 [==============================] - 0s 1ms/step - loss: 0.2857 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2171 45/124 [=========>....................] - ETA: 0s - loss: 0.3065 88/124 [====================>.........] - ETA: 0s - loss: 0.2759 124/124 [==============================] - 0s 1ms/step - loss: 0.2828 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3393 37/124 [=======>......................] - ETA: 0s - loss: 0.2967 74/124 [================>.............] - ETA: 0s - loss: 0.2753 105/124 [========================>.....] - ETA: 0s - loss: 0.2764 124/124 [==============================] - 0s 1ms/step - loss: 0.2824 -> test with GAN.predict GAN tn, fp: 264, 42 GAN fn, tp: 8, 1 GAN f1 score: 0.038 GAN cohens kappa score: -0.009 -> test with 'LR' LR tn, fp: 206, 100 LR fn, tp: 5, 4 LR f1 score: 0.071 LR cohens kappa score: 0.019 LR average precision score: 0.051 -> test with 'RF' RF tn, fp: 286, 20 RF fn, tp: 8, 1 RF f1 score: 0.067 RF cohens kappa score: 0.028 -> test with 'GB' GB tn, fp: 266, 40 GB fn, tp: 8, 1 GB f1 score: 0.040 GB cohens kappa score: -0.007 -> test with 'KNN' KNN tn, fp: 215, 91 KNN fn, tp: 7, 2 KNN f1 score: 0.039 KNN cohens kappa score: -0.014 ====== Step 5/5 ======= -> Shuffling data -> Spliting data to slices ------ Step 5/5: Slice 1/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 21s - loss: 0.2127 41/124 [========>.....................] - ETA: 0s - loss: 0.3197  77/124 [=================>............] - ETA: 0s - loss: 0.3191 119/124 [===========================>..] - ETA: 0s - loss: 0.3204 124/124 [==============================] - 0s 1ms/step - loss: 0.3204 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2233 41/124 [========>.....................] - ETA: 0s - loss: 0.3164 82/124 [==================>...........] - ETA: 0s - loss: 0.3065 120/124 [============================>.] - ETA: 0s - loss: 0.3069 124/124 [==============================] - 0s 1ms/step - loss: 0.3118 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.1218 41/124 [========>.....................] - ETA: 0s - loss: 0.3230 78/124 [=================>............] - ETA: 0s - loss: 0.3176 119/124 [===========================>..] - ETA: 0s - loss: 0.3185 124/124 [==============================] - 0s 1ms/step - loss: 0.3171 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3351 43/124 [=========>....................] - ETA: 0s - loss: 0.3029 85/124 [===================>..........] - ETA: 0s - loss: 0.3053 124/124 [==============================] - 0s 1ms/step - loss: 0.3034 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.4119 42/124 [=========>....................] - ETA: 0s - loss: 0.3215 84/124 [===================>..........] - ETA: 0s - loss: 0.3136 124/124 [==============================] - 0s 1ms/step - loss: 0.3077 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.1728 42/124 [=========>....................] - ETA: 0s - loss: 0.3043 84/124 [===================>..........] - ETA: 0s - loss: 0.3121 124/124 [==============================] - 0s 1ms/step - loss: 0.3030 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2807 42/124 [=========>....................] - ETA: 0s - loss: 0.2966 81/124 [==================>...........] - ETA: 0s - loss: 0.3002 123/124 [============================>.] - ETA: 0s - loss: 0.2961 124/124 [==============================] - 0s 1ms/step - loss: 0.2954 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.4064 42/124 [=========>....................] - ETA: 0s - loss: 0.2961 84/124 [===================>..........] - ETA: 0s - loss: 0.2888 124/124 [==============================] - ETA: 0s - loss: 0.2970 124/124 [==============================] - 0s 1ms/step - loss: 0.2970 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2772 39/124 [========>.....................] - ETA: 0s - loss: 0.2728 80/124 [==================>...........] - ETA: 0s - loss: 0.2937 121/124 [============================>.] - ETA: 0s - loss: 0.2967 124/124 [==============================] - 0s 1ms/step - loss: 0.2954 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3018 40/124 [========>.....................] - ETA: 0s - loss: 0.2885 79/124 [==================>...........] - ETA: 0s - loss: 0.2881 121/124 [============================>.] - ETA: 0s - loss: 0.2900 124/124 [==============================] - 0s 1ms/step - loss: 0.2920 -> test with GAN.predict GAN tn, fp: 269, 41 GAN fn, tp: 9, 2 GAN f1 score: 0.074 GAN cohens kappa score: 0.021 -> test with 'LR' LR tn, fp: 223, 87 LR fn, tp: 5, 6 LR f1 score: 0.115 LR cohens kappa score: 0.058 LR average precision score: 0.078 -> test with 'RF' RF tn, fp: 298, 12 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.037 -> test with 'GB' GB tn, fp: 291, 19 GB fn, tp: 10, 1 GB f1 score: 0.065 GB cohens kappa score: 0.021 -> test with 'KNN' KNN tn, fp: 215, 95 KNN fn, tp: 8, 3 KNN f1 score: 0.055 KNN cohens kappa score: -0.007 ------ Step 5/5: Slice 2/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 19s - loss: 0.3640 42/124 [=========>....................] - ETA: 0s - loss: 0.3123  83/124 [===================>..........] - ETA: 0s - loss: 0.3103 123/124 [============================>.] - ETA: 0s - loss: 0.3034 124/124 [==============================] - 0s 1ms/step - loss: 0.3026 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2422 41/124 [========>.....................] - ETA: 0s - loss: 0.3149 82/124 [==================>...........] - ETA: 0s - loss: 0.2878 118/124 [===========================>..] - ETA: 0s - loss: 0.2855 124/124 [==============================] - 0s 1ms/step - loss: 0.2885 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.1955 39/124 [========>.....................] - ETA: 0s - loss: 0.3181 80/124 [==================>...........] - ETA: 0s - loss: 0.3014 120/124 [============================>.] - ETA: 0s - loss: 0.2940 124/124 [==============================] - 0s 1ms/step - loss: 0.2937 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.1577 41/124 [========>.....................] - ETA: 0s - loss: 0.2767 81/124 [==================>...........] - ETA: 0s - loss: 0.2869 122/124 [============================>.] - ETA: 0s - loss: 0.2840 124/124 [==============================] - 0s 1ms/step - loss: 0.2847 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.4159 41/124 [========>.....................] - ETA: 0s - loss: 0.2873 73/124 [================>.............] - ETA: 0s - loss: 0.2882 108/124 [=========================>....] - ETA: 0s - loss: 0.2902 124/124 [==============================] - 0s 1ms/step - loss: 0.2877 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.3492 42/124 [=========>....................] - ETA: 0s - loss: 0.2815 84/124 [===================>..........] - ETA: 0s - loss: 0.2838 124/124 [==============================] - 0s 1ms/step - loss: 0.2860 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.2059 42/124 [=========>....................] - ETA: 0s - loss: 0.2821 83/124 [===================>..........] - ETA: 0s - loss: 0.2936 122/124 [============================>.] - ETA: 0s - loss: 0.2856 124/124 [==============================] - 0s 1ms/step - loss: 0.2871 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3026 42/124 [=========>....................] - ETA: 0s - loss: 0.3057 75/124 [=================>............] - ETA: 0s - loss: 0.2891 110/124 [=========================>....] - ETA: 0s - loss: 0.2780 124/124 [==============================] - 0s 1ms/step - loss: 0.2836 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2926 40/124 [========>.....................] - ETA: 0s - loss: 0.2956 78/124 [=================>............] - ETA: 0s - loss: 0.2928 118/124 [===========================>..] - ETA: 0s - loss: 0.2877 124/124 [==============================] - 0s 1ms/step - loss: 0.2850 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3314 41/124 [========>.....................] - ETA: 0s - loss: 0.2795 81/124 [==================>...........] - ETA: 0s - loss: 0.2815 121/124 [============================>.] - ETA: 0s - loss: 0.2859 124/124 [==============================] - 0s 1ms/step - loss: 0.2855 -> test with GAN.predict GAN tn, fp: 273, 37 GAN fn, tp: 9, 2 GAN f1 score: 0.080 GAN cohens kappa score: 0.028 -> test with 'LR' LR tn, fp: 228, 82 LR fn, tp: 5, 6 LR f1 score: 0.121 LR cohens kappa score: 0.064 LR average precision score: 0.105 -> test with 'RF' RF tn, fp: 300, 10 RF fn, tp: 11, 0 RF f1 score: 0.000 RF cohens kappa score: -0.034 -> test with 'GB' GB tn, fp: 294, 16 GB fn, tp: 10, 1 GB f1 score: 0.071 GB cohens kappa score: 0.031 -> test with 'KNN' KNN tn, fp: 230, 80 KNN fn, tp: 8, 3 KNN f1 score: 0.064 KNN cohens kappa score: 0.004 ------ Step 5/5: Slice 3/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 20s - loss: 0.4811 43/124 [=========>....................] - ETA: 0s - loss: 0.3906  85/124 [===================>..........] - ETA: 0s - loss: 0.3910 124/124 [==============================] - 0s 1ms/step - loss: 0.3950 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.3638 42/124 [=========>....................] - ETA: 0s - loss: 0.3883 82/124 [==================>...........] - ETA: 0s - loss: 0.3831 122/124 [============================>.] - ETA: 0s - loss: 0.3802 124/124 [==============================] - 0s 1ms/step - loss: 0.3809 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.4351 42/124 [=========>....................] - ETA: 0s - loss: 0.3819 84/124 [===================>..........] - ETA: 0s - loss: 0.3835 124/124 [==============================] - 0s 1ms/step - loss: 0.3839 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3181 43/124 [=========>....................] - ETA: 0s - loss: 0.3652 85/124 [===================>..........] - ETA: 0s - loss: 0.3636 124/124 [==============================] - 0s 1ms/step - loss: 0.3670 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3300 40/124 [========>.....................] - ETA: 0s - loss: 0.3502 80/124 [==================>...........] - ETA: 0s - loss: 0.3609 118/124 [===========================>..] - ETA: 0s - loss: 0.3666 124/124 [==============================] - 0s 1ms/step - loss: 0.3675 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4303 41/124 [========>.....................] - ETA: 0s - loss: 0.3691 81/124 [==================>...........] - ETA: 0s - loss: 0.3808 123/124 [============================>.] - ETA: 0s - loss: 0.3692 124/124 [==============================] - 0s 1ms/step - loss: 0.3696 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.3779 42/124 [=========>....................] - ETA: 0s - loss: 0.3725 84/124 [===================>..........] - ETA: 0s - loss: 0.3654 124/124 [==============================] - 0s 1ms/step - loss: 0.3683 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.4295 43/124 [=========>....................] - ETA: 0s - loss: 0.3897 84/124 [===================>..........] - ETA: 0s - loss: 0.3779 124/124 [==============================] - 0s 1ms/step - loss: 0.3603 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2753 43/124 [=========>....................] - ETA: 0s - loss: 0.3842 85/124 [===================>..........] - ETA: 0s - loss: 0.3609 124/124 [==============================] - 0s 1ms/step - loss: 0.3652 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.2860 42/124 [=========>....................] - ETA: 0s - loss: 0.3479 82/124 [==================>...........] - ETA: 0s - loss: 0.3603 117/124 [===========================>..] - ETA: 0s - loss: 0.3650 124/124 [==============================] - 0s 1ms/step - loss: 0.3616 -> test with GAN.predict GAN tn, fp: 246, 64 GAN fn, tp: 5, 6 GAN f1 score: 0.148 GAN cohens kappa score: 0.095 -> test with 'LR' LR tn, fp: 194, 116 LR fn, tp: 0, 11 LR f1 score: 0.159 LR cohens kappa score: 0.103 LR average precision score: 0.271 -> test with 'RF' RF tn, fp: 300, 10 RF fn, tp: 10, 1 RF f1 score: 0.091 RF cohens kappa score: 0.059 -> test with 'GB' GB tn, fp: 283, 27 GB fn, tp: 9, 2 GB f1 score: 0.100 GB cohens kappa score: 0.053 -> test with 'KNN' KNN tn, fp: 220, 90 KNN fn, tp: 6, 5 KNN f1 score: 0.094 KNN cohens kappa score: 0.035 ------ Step 5/5: Slice 4/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1194 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 20s - loss: 0.5531 43/124 [=========>....................] - ETA: 0s - loss: 0.3685  82/124 [==================>...........] - ETA: 0s - loss: 0.3654 122/124 [============================>.] - ETA: 0s - loss: 0.3815 124/124 [==============================] - 0s 1ms/step - loss: 0.3810 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.4199 42/124 [=========>....................] - ETA: 0s - loss: 0.3635 84/124 [===================>..........] - ETA: 0s - loss: 0.3797 124/124 [==============================] - 0s 1ms/step - loss: 0.3734 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3668 42/124 [=========>....................] - ETA: 0s - loss: 0.3584 83/124 [===================>..........] - ETA: 0s - loss: 0.3802 121/124 [============================>.] - ETA: 0s - loss: 0.3673 124/124 [==============================] - 0s 1ms/step - loss: 0.3680 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3835 37/124 [=======>......................] - ETA: 0s - loss: 0.3436 76/124 [=================>............] - ETA: 0s - loss: 0.3571 115/124 [==========================>...] - ETA: 0s - loss: 0.3687 124/124 [==============================] - 0s 1ms/step - loss: 0.3696 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3170 42/124 [=========>....................] - ETA: 0s - loss: 0.3629 82/124 [==================>...........] - ETA: 0s - loss: 0.3478 121/124 [============================>.] - ETA: 0s - loss: 0.3585 124/124 [==============================] - 0s 1ms/step - loss: 0.3597 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.4137 42/124 [=========>....................] - ETA: 0s - loss: 0.3811 84/124 [===================>..........] - ETA: 0s - loss: 0.3565 124/124 [==============================] - 0s 1ms/step - loss: 0.3573 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.5313 42/124 [=========>....................] - ETA: 0s - loss: 0.3538 81/124 [==================>...........] - ETA: 0s - loss: 0.3585 122/124 [============================>.] - ETA: 0s - loss: 0.3541 124/124 [==============================] - 0s 1ms/step - loss: 0.3545 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.4588 42/124 [=========>....................] - ETA: 0s - loss: 0.3455 83/124 [===================>..........] - ETA: 0s - loss: 0.3388 124/124 [==============================] - ETA: 0s - loss: 0.3568 124/124 [==============================] - 0s 1ms/step - loss: 0.3568 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.3355 37/124 [=======>......................] - ETA: 0s - loss: 0.3494 74/124 [================>.............] - ETA: 0s - loss: 0.3544 109/124 [=========================>....] - ETA: 0s - loss: 0.3445 124/124 [==============================] - 0s 1ms/step - loss: 0.3479 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.4649 41/124 [========>.....................] - ETA: 0s - loss: 0.3595 74/124 [================>.............] - ETA: 0s - loss: 0.3503 114/124 [==========================>...] - ETA: 0s - loss: 0.3498 124/124 [==============================] - 0s 1ms/step - loss: 0.3487 -> test with GAN.predict GAN tn, fp: 233, 77 GAN fn, tp: 4, 7 GAN f1 score: 0.147 GAN cohens kappa score: 0.092 -> test with 'LR' LR tn, fp: 214, 96 LR fn, tp: 3, 8 LR f1 score: 0.139 LR cohens kappa score: 0.082 LR average precision score: 0.195 -> test with 'RF' RF tn, fp: 298, 12 RF fn, tp: 8, 3 RF f1 score: 0.231 RF cohens kappa score: 0.199 -> test with 'GB' GB tn, fp: 282, 28 GB fn, tp: 7, 4 GB f1 score: 0.186 GB cohens kappa score: 0.142 -> test with 'KNN' KNN tn, fp: 226, 84 KNN fn, tp: 8, 3 KNN f1 score: 0.061 KNN cohens kappa score: 0.000 ------ Step 5/5: Slice 5/5 ------- -> Reset the GAN -> Train generator for synthetic samples -> create 1196 synthetic samples -> retrain GAN for predict Epoch 1/10 1/124 [..............................] - ETA: 17s - loss: 0.2697 40/124 [========>.....................] - ETA: 0s - loss: 0.3793  84/124 [===================>..........] - ETA: 0s - loss: 0.3648 124/124 [==============================] - 0s 1ms/step - loss: 0.3674 Epoch 2/10 1/124 [..............................] - ETA: 0s - loss: 0.2286 44/124 [=========>....................] - ETA: 0s - loss: 0.3812 85/124 [===================>..........] - ETA: 0s - loss: 0.3701 124/124 [==============================] - 0s 1ms/step - loss: 0.3797 Epoch 3/10 1/124 [..............................] - ETA: 0s - loss: 0.3859 45/124 [=========>....................] - ETA: 0s - loss: 0.3750 83/124 [===================>..........] - ETA: 0s - loss: 0.3652 120/124 [============================>.] - ETA: 0s - loss: 0.3680 124/124 [==============================] - 0s 1ms/step - loss: 0.3705 Epoch 4/10 1/124 [..............................] - ETA: 0s - loss: 0.3749 42/124 [=========>....................] - ETA: 0s - loss: 0.3582 85/124 [===================>..........] - ETA: 0s - loss: 0.3641 124/124 [==============================] - 0s 1ms/step - loss: 0.3607 Epoch 5/10 1/124 [..............................] - ETA: 0s - loss: 0.3067 45/124 [=========>....................] - ETA: 0s - loss: 0.3557 90/124 [====================>.........] - ETA: 0s - loss: 0.3596 124/124 [==============================] - 0s 1ms/step - loss: 0.3547 Epoch 6/10 1/124 [..............................] - ETA: 0s - loss: 0.5966 41/124 [========>.....................] - ETA: 0s - loss: 0.3864 84/124 [===================>..........] - ETA: 0s - loss: 0.3619 124/124 [==============================] - 0s 1ms/step - loss: 0.3628 Epoch 7/10 1/124 [..............................] - ETA: 0s - loss: 0.4231 43/124 [=========>....................] - ETA: 0s - loss: 0.3740 86/124 [===================>..........] - ETA: 0s - loss: 0.3637 124/124 [==============================] - 0s 1ms/step - loss: 0.3555 Epoch 8/10 1/124 [..............................] - ETA: 0s - loss: 0.3539 45/124 [=========>....................] - ETA: 0s - loss: 0.3689 88/124 [====================>.........] - ETA: 0s - loss: 0.3496 124/124 [==============================] - 0s 1ms/step - loss: 0.3653 Epoch 9/10 1/124 [..............................] - ETA: 0s - loss: 0.2320 45/124 [=========>....................] - ETA: 0s - loss: 0.3505 89/124 [====================>.........] - ETA: 0s - loss: 0.3620 124/124 [==============================] - 0s 1ms/step - loss: 0.3629 Epoch 10/10 1/124 [..............................] - ETA: 0s - loss: 0.3257 42/124 [=========>....................] - ETA: 0s - loss: 0.4400 85/124 [===================>..........] - ETA: 0s - loss: 0.3822 124/124 [==============================] - 0s 1ms/step - loss: 0.3580 -> test with GAN.predict GAN tn, fp: 262, 44 GAN fn, tp: 4, 5 GAN f1 score: 0.172 GAN cohens kappa score: 0.130 -> test with 'LR' LR tn, fp: 238, 68 LR fn, tp: 3, 6 LR f1 score: 0.145 LR cohens kappa score: 0.099 LR average precision score: 0.169 -> test with 'RF' RF tn, fp: 294, 12 RF fn, tp: 7, 2 RF f1 score: 0.174 RF cohens kappa score: 0.144 -> test with 'GB' GB tn, fp: 291, 15 GB fn, tp: 7, 2 GB f1 score: 0.154 GB cohens kappa score: 0.121 -> test with 'KNN' KNN tn, fp: 227, 79 KNN fn, tp: 5, 4 KNN f1 score: 0.087 KNN cohens kappa score: 0.037 ### Exercise is done. -----[ LR ]----- maximum: LR tn, fp: 243, 116 LR fn, tp: 6, 11 LR f1 score: 0.174 LR cohens kappa score: 0.119 LR average precision score: 0.371 average: LR tn, fp: 218.24, 90.96 LR fn, tp: 3.24, 7.36 LR f1 score: 0.135 LR cohens kappa score: 0.080 LR average precision score: 0.173 minimum: LR tn, fp: 194, 67 LR fn, tp: 0, 4 LR f1 score: 0.071 LR cohens kappa score: 0.019 LR average precision score: 0.051 -----[ RF ]----- maximum: RF tn, fp: 305, 20 RF fn, tp: 11, 3 RF f1 score: 0.231 RF cohens kappa score: 0.199 average: RF tn, fp: 298.72, 10.48 RF fn, tp: 9.6, 1.0 RF f1 score: 0.086 RF cohens kappa score: 0.055 minimum: RF tn, fp: 286, 5 RF fn, tp: 7, 0 RF f1 score: 0.000 RF cohens kappa score: -0.039 -----[ GB ]----- maximum: GB tn, fp: 301, 40 GB fn, tp: 11, 4 GB f1 score: 0.286 GB cohens kappa score: 0.255 average: GB tn, fp: 288.68, 20.52 GB fn, tp: 8.84, 1.76 GB f1 score: 0.107 GB cohens kappa score: 0.066 minimum: GB tn, fp: 266, 9 GB fn, tp: 6, 0 GB f1 score: 0.000 GB cohens kappa score: -0.048 -----[ KNN ]----- maximum: KNN tn, fp: 252, 98 KNN fn, tp: 10, 6 KNN f1 score: 0.112 KNN cohens kappa score: 0.054 average: KNN tn, fp: 227.76, 81.44 KNN fn, tp: 7.84, 2.76 KNN f1 score: 0.058 KNN cohens kappa score: -0.001 minimum: KNN tn, fp: 212, 58 KNN fn, tp: 5, 1 KNN f1 score: 0.020 KNN cohens kappa score: -0.043 -----[ GAN ]----- maximum: GAN tn, fp: 288, 99 GAN fn, tp: 10, 7 GAN f1 score: 0.182 GAN cohens kappa score: 0.137 average: GAN tn, fp: 261.76, 47.44 GAN fn, tp: 6.68, 3.92 GAN f1 score: 0.123 GAN cohens kappa score: 0.073 minimum: GAN tn, fp: 211, 22 GAN fn, tp: 4, 1 GAN f1 score: 0.038 GAN cohens kappa score: -0.009