Keras Progress Bars

The following examples show two different keras_tqdm progress bars.

TQDM notebook widget
TQDM console output

To use keras_tqdm progress bars in your own code, just add TQDMCallback or TQDMNotebookCallback to the callbacks passed to model.fit. Set verbose=0 to suppress the built-in progress bars.

MNIST Example

In this experiment, we train a Keras model on the MNIST dataset.



In [1]:

    
from mnist_model import mnist_model
from keras_tqdm import TQDMCallback, TQDMNotebookCallback









    



Using Theano backend.
WARNING (theano.gof.compilelock): Overriding existing lock by dead process '20256' (I am process '24968')
Using gpu device 0: GeForce GTX 770M (CNMeM is enabled with initial size: 80.0% of memory, cuDNN 5005)

TQDM Progress Bar (ipywidget)



In [4]:

    
mnist_model(0, [TQDMNotebookCallback()])

TQDM Progress Bar (text)



In [3]:

    
mnist_model(0, [TQDMCallback()])









    



Training:   0%|                                         | 0/10 [00:00<?, ?it/s]
Epoch: 0:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 0 - loss: 1.792, acc: 0.420  1%|     | 16/1875 [00:00<00:11, 155.34it/s]
Epoch: 0 - loss: 1.337, acc: 0.568  2%|     | 32/1875 [00:00<00:11, 154.89it/s]
Epoch: 0 - loss: 1.139, acc: 0.631  3%|▏    | 47/1875 [00:00<00:11, 152.92it/s]
Epoch: 0 - loss: 1.009, acc: 0.672  3%|▏    | 65/1875 [00:00<00:11, 158.88it/s]
Epoch: 0 - loss: 0.928, acc: 0.697  4%|▏    | 84/1875 [00:00<00:10, 166.65it/s]
Epoch: 0 - loss: 0.876, acc: 0.718  5%|▏   | 103/1875 [00:00<00:10, 171.62it/s]
Epoch: 0 - loss: 0.826, acc: 0.731  7%|▎   | 122/1875 [00:00<00:09, 175.77it/s]
Epoch: 0 - loss: 0.780, acc: 0.750  8%|▎   | 141/1875 [00:00<00:09, 179.81it/s]
Epoch: 0 - loss: 0.743, acc: 0.762  9%|▎   | 160/1875 [00:00<00:09, 181.70it/s]
Epoch: 0 - loss: 0.709, acc: 0.771 10%|▍   | 180/1875 [00:01<00:09, 184.25it/s]
Epoch: 0 - loss: 0.678, acc: 0.780 11%|▍   | 199/1875 [00:01<00:09, 185.39it/s]
Epoch: 0 - loss: 0.656, acc: 0.786 12%|▍   | 218/1875 [00:01<00:09, 184.04it/s]
Epoch: 0 - loss: 0.635, acc: 0.794 13%|▌   | 237/1875 [00:01<00:08, 184.17it/s]
Epoch: 0 - loss: 0.627, acc: 0.798 14%|▌   | 256/1875 [00:01<00:08, 184.26it/s]
Epoch: 0 - loss: 0.612, acc: 0.803 15%|▌   | 275/1875 [00:01<00:08, 184.32it/s]
Epoch: 0 - loss: 0.607, acc: 0.805 16%|▋   | 294/1875 [00:01<00:08, 183.83it/s]
Epoch: 0 - loss: 0.593, acc: 0.810 17%|▋   | 314/1875 [00:01<00:08, 186.29it/s]
Epoch: 0 - loss: 0.584, acc: 0.813 18%|▋   | 333/1875 [00:01<00:08, 187.39it/s]
Epoch: 0 - loss: 0.570, acc: 0.818 19%|▊   | 352/1875 [00:01<00:08, 187.61it/s]
Epoch: 0 - loss: 0.560, acc: 0.821 20%|▊   | 372/1875 [00:02<00:07, 188.46it/s]
Epoch: 0 - loss: 0.555, acc: 0.824 21%|▊   | 391/1875 [00:02<00:07, 187.80it/s]
Epoch: 0 - loss: 0.547, acc: 0.826 22%|▊   | 410/1875 [00:02<00:07, 188.45it/s]
Epoch: 0 - loss: 0.539, acc: 0.830 23%|▉   | 430/1875 [00:02<00:07, 188.52it/s]
Epoch: 0 - loss: 0.534, acc: 0.831 24%|▉   | 449/1875 [00:02<00:07, 187.29it/s]
Epoch: 0 - loss: 0.528, acc: 0.833 25%|▉   | 468/1875 [00:02<00:07, 186.43it/s]
Epoch: 0 - loss: 0.523, acc: 0.835 26%|█   | 487/1875 [00:02<00:07, 186.93it/s]
Epoch: 0 - loss: 0.519, acc: 0.836 27%|█   | 506/1875 [00:02<00:07, 187.29it/s]
Epoch: 0 - loss: 0.513, acc: 0.837 28%|█   | 525/1875 [00:02<00:07, 185.89it/s]
Epoch: 0 - loss: 0.506, acc: 0.839 29%|█▏  | 544/1875 [00:02<00:07, 184.38it/s]
Epoch: 0 - loss: 0.503, acc: 0.841 30%|█▏  | 563/1875 [00:03<00:07, 184.40it/s]
Epoch: 0 - loss: 0.500, acc: 0.842 31%|█▏  | 583/1875 [00:03<00:06, 185.67it/s]
Epoch: 0 - loss: 0.496, acc: 0.844 32%|█▎  | 602/1875 [00:03<00:06, 185.30it/s]
Epoch: 0 - loss: 0.492, acc: 0.845 33%|█▎  | 622/1875 [00:03<00:06, 187.35it/s]
Epoch: 0 - loss: 0.488, acc: 0.846 34%|█▎  | 641/1875 [00:03<00:06, 186.48it/s]
Epoch: 0 - loss: 0.485, acc: 0.848 35%|█▍  | 660/1875 [00:03<00:06, 185.87it/s]
Epoch: 0 - loss: 0.482, acc: 0.849 36%|█▍  | 679/1875 [00:03<00:06, 186.54it/s]
Epoch: 0 - loss: 0.480, acc: 0.850 37%|█▍  | 698/1875 [00:03<00:06, 187.01it/s]
Epoch: 0 - loss: 0.476, acc: 0.851 38%|█▌  | 717/1875 [00:03<00:06, 187.34it/s]
Epoch: 0 - loss: 0.473, acc: 0.852 39%|█▌  | 736/1875 [00:04<00:06, 187.02it/s]
Epoch: 0 - loss: 0.470, acc: 0.853 40%|█▌  | 755/1875 [00:04<00:05, 186.80it/s]
Epoch: 0 - loss: 0.467, acc: 0.854 41%|█▋  | 775/1875 [00:04<00:05, 187.88it/s]
Epoch: 0 - loss: 0.465, acc: 0.855 42%|█▋  | 794/1875 [00:04<00:05, 186.30it/s]
Epoch: 0 - loss: 0.464, acc: 0.855 43%|█▋  | 813/1875 [00:04<00:05, 186.29it/s]
Epoch: 0 - loss: 0.462, acc: 0.856 44%|█▊  | 832/1875 [00:04<00:05, 186.29it/s]
Epoch: 0 - loss: 0.459, acc: 0.857 45%|█▊  | 851/1875 [00:04<00:05, 186.28it/s]
Epoch: 0 - loss: 0.457, acc: 0.858 46%|█▊  | 870/1875 [00:04<00:05, 186.28it/s]
Epoch: 0 - loss: 0.453, acc: 0.859 47%|█▉  | 889/1875 [00:04<00:05, 186.83it/s]
Epoch: 0 - loss: 0.450, acc: 0.860 48%|█▉  | 908/1875 [00:04<00:05, 184.49it/s]
Epoch: 0 - loss: 0.448, acc: 0.860 49%|█▉  | 927/1875 [00:05<00:05, 185.02it/s]
Epoch: 0 - loss: 0.446, acc: 0.861 50%|██  | 946/1875 [00:05<00:04, 185.94it/s]
Epoch: 0 - loss: 0.443, acc: 0.862 51%|██  | 965/1875 [00:05<00:04, 186.59it/s]
Epoch: 0 - loss: 0.441, acc: 0.863 52%|██  | 984/1875 [00:05<00:04, 185.40it/s]
Epoch: 0 - loss: 0.439, acc: 0.863 53%|█▌ | 1003/1875 [00:05<00:04, 184.58it/s]
Epoch: 0 - loss: 0.437, acc: 0.864 55%|█▋ | 1022/1875 [00:05<00:04, 184.01it/s]
Epoch: 0 - loss: 0.435, acc: 0.865 56%|█▋ | 1041/1875 [00:05<00:04, 184.68it/s]
Epoch: 0 - loss: 0.432, acc: 0.866 57%|█▋ | 1060/1875 [00:05<00:04, 184.08it/s]
Epoch: 0 - loss: 0.430, acc: 0.866 58%|█▋ | 1079/1875 [00:05<00:04, 184.20it/s]
Epoch: 0 - loss: 0.428, acc: 0.867 59%|█▊ | 1098/1875 [00:05<00:04, 185.36it/s]
Epoch: 0 - loss: 0.426, acc: 0.867 60%|█▊ | 1117/1875 [00:06<00:04, 185.09it/s]
Epoch: 0 - loss: 0.424, acc: 0.868 61%|█▊ | 1136/1875 [00:06<00:03, 185.44it/s]
Epoch: 0 - loss: 0.423, acc: 0.869 62%|█▊ | 1155/1875 [00:06<00:03, 186.24it/s]
Epoch: 0 - loss: 0.422, acc: 0.869 63%|█▉ | 1174/1875 [00:06<00:03, 185.16it/s]
Epoch: 0 - loss: 0.419, acc: 0.870 64%|█▉ | 1193/1875 [00:06<00:03, 185.49it/s]
Epoch: 0 - loss: 0.417, acc: 0.870 65%|█▉ | 1213/1875 [00:06<00:03, 186.96it/s]
Epoch: 0 - loss: 0.415, acc: 0.871 66%|█▉ | 1232/1875 [00:06<00:03, 185.66it/s]
Epoch: 0 - loss: 0.413, acc: 0.872 67%|██ | 1251/1875 [00:06<00:03, 184.22it/s]
Epoch: 0 - loss: 0.412, acc: 0.872 68%|██ | 1270/1875 [00:06<00:03, 182.17it/s]
Epoch: 0 - loss: 0.411, acc: 0.873 69%|██ | 1289/1875 [00:06<00:03, 182.86it/s]
Epoch: 0 - loss: 0.409, acc: 0.873 70%|██ | 1308/1875 [00:07<00:03, 184.94it/s]
Epoch: 0 - loss: 0.407, acc: 0.873 71%|██ | 1328/1875 [00:07<00:02, 186.57it/s]
Epoch: 0 - loss: 0.406, acc: 0.874 72%|██▏| 1347/1875 [00:07<00:02, 186.48it/s]
Epoch: 0 - loss: 0.405, acc: 0.874 73%|██▏| 1366/1875 [00:07<00:02, 185.33it/s]
Epoch: 0 - loss: 0.403, acc: 0.875 74%|██▏| 1385/1875 [00:07<00:02, 183.99it/s]
Epoch: 0 - loss: 0.402, acc: 0.875 75%|██▏| 1404/1875 [00:07<00:02, 184.67it/s]
Epoch: 0 - loss: 0.401, acc: 0.875 76%|██▎| 1423/1875 [00:07<00:02, 185.15it/s]
Epoch: 0 - loss: 0.399, acc: 0.875 77%|██▎| 1442/1875 [00:07<00:02, 184.94it/s]
Epoch: 0 - loss: 0.398, acc: 0.876 78%|██▎| 1461/1875 [00:07<00:02, 185.89it/s]
Epoch: 0 - loss: 0.397, acc: 0.876 79%|██▎| 1481/1875 [00:08<00:02, 187.77it/s]
Epoch: 0 - loss: 0.396, acc: 0.877 80%|██▍| 1500/1875 [00:08<00:02, 187.32it/s]
Epoch: 0 - loss: 0.395, acc: 0.877 81%|██▍| 1519/1875 [00:08<00:01, 186.45it/s]
Epoch: 0 - loss: 0.393, acc: 0.877 82%|██▍| 1539/1875 [00:08<00:01, 187.64it/s]
Epoch: 0 - loss: 0.391, acc: 0.878 83%|██▍| 1558/1875 [00:08<00:01, 186.68it/s]
Epoch: 0 - loss: 0.390, acc: 0.879 84%|██▌| 1577/1875 [00:08<00:01, 186.56it/s]
Epoch: 0 - loss: 0.389, acc: 0.879 85%|██▌| 1597/1875 [00:08<00:01, 188.78it/s]
Epoch: 0 - loss: 0.388, acc: 0.879 86%|██▌| 1616/1875 [00:08<00:01, 187.46it/s]
Epoch: 0 - loss: 0.387, acc: 0.880 87%|██▌| 1635/1875 [00:08<00:01, 184.38it/s]
Epoch: 0 - loss: 0.386, acc: 0.880 88%|██▋| 1654/1875 [00:08<00:01, 184.41it/s]
Epoch: 0 - loss: 0.384, acc: 0.880 89%|██▋| 1674/1875 [00:09<00:01, 185.67it/s]
Epoch: 0 - loss: 0.383, acc: 0.881 90%|██▋| 1693/1875 [00:09<00:00, 185.85it/s]
Epoch: 0 - loss: 0.382, acc: 0.881 91%|██▋| 1712/1875 [00:09<00:00, 185.98it/s]
Epoch: 0 - loss: 0.380, acc: 0.882 92%|██▊| 1731/1875 [00:09<00:00, 183.90it/s]
Epoch: 0 - loss: 0.380, acc: 0.882 93%|██▊| 1751/1875 [00:09<00:00, 186.35it/s]
Epoch: 0 - loss: 0.380, acc: 0.882 94%|██▊| 1770/1875 [00:09<00:00, 183.62it/s]
Epoch: 0 - loss: 0.378, acc: 0.882 95%|██▊| 1789/1875 [00:09<00:00, 184.41it/s]
Epoch: 0 - loss: 0.377, acc: 0.883 96%|██▉| 1808/1875 [00:09<00:00, 182.30it/s]
Epoch: 0 - loss: 0.376, acc: 0.883 97%|██▉| 1827/1875 [00:09<00:00, 181.90it/s]
Epoch: 0 - loss: 0.374, acc: 0.884 98%|██▉| 1846/1875 [00:10<00:00, 180.58it/s]
Epoch: 0 - loss: 0.373, acc: 0.884 99%|██▉| 1865/1875 [00:10<00:00, 181.21it/s]
Epoch: 0 - loss: 0.373, acc: 0.884, val_loss: 0.148, val_acc: 0.956100%|█| 1875/1875 [00:10<00:00, 33.71it/s]
Training:  10%|███▎                             | 1/10 [00:10<01:38, 10.97s/it]
Epoch: 1:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 1 - loss: 0.268, acc: 0.914  1%|     | 19/1875 [00:00<00:09, 186.27it/s]
Epoch: 1 - loss: 0.258, acc: 0.919  2%|     | 38/1875 [00:00<00:09, 184.65it/s]
Epoch: 1 - loss: 0.269, acc: 0.914  3%|▏    | 55/1875 [00:00<00:10, 179.99it/s]
Epoch: 1 - loss: 0.274, acc: 0.914  4%|▏    | 73/1875 [00:00<00:10, 179.46it/s]
Epoch: 1 - loss: 0.259, acc: 0.918  5%|▏    | 92/1875 [00:00<00:09, 181.45it/s]
Epoch: 1 - loss: 0.264, acc: 0.918  6%|▏   | 110/1875 [00:00<00:09, 181.01it/s]
Epoch: 1 - loss: 0.261, acc: 0.919  7%|▎   | 129/1875 [00:00<00:09, 183.09it/s]
Epoch: 1 - loss: 0.260, acc: 0.919  8%|▎   | 148/1875 [00:00<00:09, 182.44it/s]
Epoch: 1 - loss: 0.261, acc: 0.918  9%|▎   | 167/1875 [00:00<00:09, 184.11it/s]
Epoch: 1 - loss: 0.260, acc: 0.918 10%|▍   | 186/1875 [00:01<00:09, 184.75it/s]
Epoch: 1 - loss: 0.259, acc: 0.918 11%|▍   | 205/1875 [00:01<00:09, 185.21it/s]
Epoch: 1 - loss: 0.260, acc: 0.918 12%|▍   | 225/1875 [00:01<00:08, 186.76it/s]
Epoch: 1 - loss: 0.262, acc: 0.917 13%|▌   | 244/1875 [00:01<00:08, 187.16it/s]
Epoch: 1 - loss: 0.263, acc: 0.917 14%|▌   | 263/1875 [00:01<00:08, 185.26it/s]
Epoch: 1 - loss: 0.261, acc: 0.918 15%|▌   | 282/1875 [00:01<00:08, 185.02it/s]
Epoch: 1 - loss: 0.259, acc: 0.918 16%|▋   | 301/1875 [00:01<00:08, 182.19it/s]
Epoch: 1 - loss: 0.256, acc: 0.919 17%|▋   | 320/1875 [00:01<00:08, 182.87it/s]
Epoch: 1 - loss: 0.256, acc: 0.919 18%|▋   | 339/1875 [00:01<00:08, 182.29it/s]
Epoch: 1 - loss: 0.253, acc: 0.920 19%|▊   | 358/1875 [00:01<00:08, 181.89it/s]
Epoch: 1 - loss: 0.251, acc: 0.921 20%|▊   | 377/1875 [00:02<00:08, 179.55it/s]
Epoch: 1 - loss: 0.253, acc: 0.920 21%|▊   | 395/1875 [00:02<00:08, 175.99it/s]
Epoch: 1 - loss: 0.252, acc: 0.921 22%|▉   | 414/1875 [00:02<00:08, 178.45it/s]
Epoch: 1 - loss: 0.252, acc: 0.921 23%|▉   | 433/1875 [00:02<00:07, 181.25it/s]
Epoch: 1 - loss: 0.253, acc: 0.921 24%|▉   | 452/1875 [00:02<00:07, 182.20it/s]
Epoch: 1 - loss: 0.251, acc: 0.921 25%|█   | 471/1875 [00:02<00:07, 183.40it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 26%|█   | 491/1875 [00:02<00:07, 185.47it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 27%|█   | 510/1875 [00:02<00:07, 184.63it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 28%|█▏  | 529/1875 [00:02<00:07, 181.93it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 29%|█▏  | 548/1875 [00:03<00:07, 183.21it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 30%|█▏  | 567/1875 [00:03<00:07, 183.05it/s]
Epoch: 1 - loss: 0.250, acc: 0.922 31%|█▎  | 586/1875 [00:03<00:07, 181.37it/s]
Epoch: 1 - loss: 0.250, acc: 0.922 32%|█▎  | 605/1875 [00:03<00:07, 181.25it/s]
Epoch: 1 - loss: 0.248, acc: 0.923 33%|█▎  | 624/1875 [00:03<00:06, 181.68it/s]
Epoch: 1 - loss: 0.249, acc: 0.923 34%|█▎  | 643/1875 [00:03<00:06, 183.03it/s]
Epoch: 1 - loss: 0.251, acc: 0.922 35%|█▍  | 662/1875 [00:03<00:06, 181.88it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 36%|█▍  | 681/1875 [00:03<00:06, 182.12it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 37%|█▍  | 700/1875 [00:03<00:06, 182.82it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 38%|█▌  | 720/1875 [00:03<00:06, 184.54it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 39%|█▌  | 739/1875 [00:04<00:06, 186.14it/s]
Epoch: 1 - loss: 0.249, acc: 0.923 40%|█▌  | 758/1875 [00:04<00:05, 186.73it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 41%|█▋  | 777/1875 [00:04<00:06, 182.30it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 43%|█▋  | 797/1875 [00:04<00:05, 184.68it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 44%|█▋  | 816/1875 [00:04<00:05, 182.49it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 45%|█▊  | 835/1875 [00:04<00:05, 182.55it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 46%|█▊  | 854/1875 [00:04<00:05, 183.65it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 47%|█▊  | 873/1875 [00:04<00:05, 182.31it/s]
Epoch: 1 - loss: 0.250, acc: 0.923 48%|█▉  | 892/1875 [00:04<00:05, 180.86it/s]
Epoch: 1 - loss: 0.249, acc: 0.924 49%|█▉  | 911/1875 [00:04<00:05, 181.93it/s]
Epoch: 1 - loss: 0.249, acc: 0.924 50%|█▉  | 930/1875 [00:05<00:05, 182.16it/s]
Epoch: 1 - loss: 0.250, acc: 0.924 51%|██  | 949/1875 [00:05<00:05, 178.71it/s]
Epoch: 1 - loss: 0.250, acc: 0.924 52%|██  | 967/1875 [00:05<00:05, 175.95it/s]
Epoch: 1 - loss: 0.251, acc: 0.923 53%|██  | 986/1875 [00:05<00:04, 177.92it/s]
Epoch: 1 - loss: 0.251, acc: 0.923 54%|█▌ | 1005/1875 [00:05<00:04, 180.35it/s]
Epoch: 1 - loss: 0.250, acc: 0.924 55%|█▋ | 1024/1875 [00:05<00:04, 179.50it/s]
Epoch: 1 - loss: 0.249, acc: 0.924 56%|█▋ | 1043/1875 [00:05<00:04, 181.48it/s]
Epoch: 1 - loss: 0.248, acc: 0.924 57%|█▋ | 1062/1875 [00:05<00:04, 181.32it/s]
Epoch: 1 - loss: 0.248, acc: 0.924 58%|█▋ | 1081/1875 [00:05<00:04, 181.73it/s]
Epoch: 1 - loss: 0.248, acc: 0.925 59%|█▊ | 1100/1875 [00:06<00:04, 183.07it/s]
Epoch: 1 - loss: 0.248, acc: 0.924 60%|█▊ | 1119/1875 [00:06<00:04, 182.43it/s]
Epoch: 1 - loss: 0.247, acc: 0.925 61%|█▊ | 1138/1875 [00:06<00:04, 184.10it/s]
Epoch: 1 - loss: 0.247, acc: 0.925 62%|█▊ | 1157/1875 [00:06<00:03, 184.75it/s]
Epoch: 1 - loss: 0.246, acc: 0.925 63%|█▉ | 1176/1875 [00:06<00:03, 180.97it/s]
Epoch: 1 - loss: 0.245, acc: 0.925 64%|█▉ | 1195/1875 [00:06<00:03, 181.48it/s]
Epoch: 1 - loss: 0.245, acc: 0.925 65%|█▉ | 1214/1875 [00:06<00:03, 182.37it/s]
Epoch: 1 - loss: 0.244, acc: 0.925 66%|█▉ | 1233/1875 [00:06<00:03, 180.90it/s]
Epoch: 1 - loss: 0.244, acc: 0.925 67%|██ | 1252/1875 [00:06<00:03, 181.96it/s]
Epoch: 1 - loss: 0.244, acc: 0.925 68%|██ | 1271/1875 [00:06<00:03, 183.23it/s]
Epoch: 1 - loss: 0.244, acc: 0.925 69%|██ | 1290/1875 [00:07<00:03, 183.60it/s]
Epoch: 1 - loss: 0.244, acc: 0.925 70%|██ | 1309/1875 [00:07<00:03, 184.39it/s]
Epoch: 1 - loss: 0.243, acc: 0.926 71%|██ | 1328/1875 [00:07<00:02, 185.50it/s]
Epoch: 1 - loss: 0.243, acc: 0.926 72%|██▏| 1347/1875 [00:07<00:02, 185.73it/s]
Epoch: 1 - loss: 0.243, acc: 0.926 73%|██▏| 1366/1875 [00:07<00:02, 185.89it/s]
Epoch: 1 - loss: 0.242, acc: 0.926 74%|██▏| 1385/1875 [00:07<00:02, 186.55it/s]
Epoch: 1 - loss: 0.242, acc: 0.926 75%|██▏| 1404/1875 [00:07<00:02, 184.30it/s]
Epoch: 1 - loss: 0.242, acc: 0.926 76%|██▎| 1423/1875 [00:07<00:02, 182.75it/s]
Epoch: 1 - loss: 0.241, acc: 0.926 77%|██▎| 1442/1875 [00:07<00:02, 183.80it/s]
Epoch: 1 - loss: 0.241, acc: 0.926 78%|██▎| 1461/1875 [00:07<00:02, 185.07it/s]
Epoch: 1 - loss: 0.241, acc: 0.926 79%|██▎| 1480/1875 [00:08<00:02, 185.98it/s]
Epoch: 1 - loss: 0.241, acc: 0.926 80%|██▍| 1499/1875 [00:08<00:02, 186.61it/s]
Epoch: 1 - loss: 0.242, acc: 0.926 81%|██▍| 1518/1875 [00:08<00:01, 185.42it/s]
Epoch: 1 - loss: 0.241, acc: 0.926 82%|██▍| 1537/1875 [00:08<00:01, 185.68it/s]
Epoch: 1 - loss: 0.241, acc: 0.927 83%|██▍| 1556/1875 [00:08<00:01, 186.40it/s]
Epoch: 1 - loss: 0.240, acc: 0.927 84%|██▌| 1575/1875 [00:08<00:01, 185.82it/s]
Epoch: 1 - loss: 0.240, acc: 0.927 85%|██▌| 1594/1875 [00:08<00:01, 186.50it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 86%|██▌| 1613/1875 [00:08<00:01, 186.98it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 87%|██▌| 1632/1875 [00:08<00:01, 186.22it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 88%|██▋| 1651/1875 [00:09<00:01, 184.61it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 89%|██▋| 1670/1875 [00:09<00:01, 184.03it/s]
Epoch: 1 - loss: 0.238, acc: 0.927 90%|██▋| 1689/1875 [00:09<00:01, 184.70it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 91%|██▋| 1708/1875 [00:09<00:00, 185.71it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 92%|██▊| 1727/1875 [00:09<00:00, 186.43it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 93%|██▊| 1746/1875 [00:09<00:00, 186.38it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 94%|██▊| 1765/1875 [00:09<00:00, 186.35it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 95%|██▊| 1784/1875 [00:09<00:00, 186.33it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 96%|██▉| 1803/1875 [00:09<00:00, 185.76it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 97%|██▉| 1822/1875 [00:09<00:00, 185.37it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 98%|██▉| 1841/1875 [00:10<00:00, 184.56it/s]
Epoch: 1 - loss: 0.239, acc: 0.927 99%|██▉| 1860/1875 [00:10<00:00, 185.61it/s]
Epoch: 1 - loss: 0.239, acc: 0.927, val_loss: 0.120, val_acc: 0.963100%|█| 1875/1875 [00:11<00:00, 47.23it/s]
Training:  20%|██████▌                          | 2/10 [00:21<01:27, 10.99s/it]
Epoch: 2:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 2 - loss: 0.162, acc: 0.951  1%|     | 19/1875 [00:00<00:09, 188.12it/s]
Epoch: 2 - loss: 0.202, acc: 0.940  2%|     | 38/1875 [00:00<00:09, 187.56it/s]
Epoch: 2 - loss: 0.208, acc: 0.940  3%|▏    | 57/1875 [00:00<00:09, 187.73it/s]
Epoch: 2 - loss: 0.203, acc: 0.940  4%|▏    | 76/1875 [00:00<00:09, 186.74it/s]
Epoch: 2 - loss: 0.190, acc: 0.942  5%|▎    | 95/1875 [00:00<00:09, 186.60it/s]
Epoch: 2 - loss: 0.192, acc: 0.942  6%|▏   | 114/1875 [00:00<00:09, 187.05it/s]
Epoch: 2 - loss: 0.197, acc: 0.942  7%|▎   | 133/1875 [00:00<00:09, 185.72it/s]
Epoch: 2 - loss: 0.195, acc: 0.942  8%|▎   | 152/1875 [00:00<00:09, 185.89it/s]
Epoch: 2 - loss: 0.196, acc: 0.942  9%|▎   | 171/1875 [00:00<00:09, 184.92it/s]
Epoch: 2 - loss: 0.195, acc: 0.941 10%|▍   | 190/1875 [00:01<00:09, 185.87it/s]
Epoch: 2 - loss: 0.193, acc: 0.942 11%|▍   | 209/1875 [00:01<00:08, 185.99it/s]
Epoch: 2 - loss: 0.198, acc: 0.940 12%|▍   | 228/1875 [00:01<00:08, 186.07it/s]
Epoch: 2 - loss: 0.201, acc: 0.939 13%|▌   | 247/1875 [00:01<00:08, 184.51it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 14%|▌   | 266/1875 [00:01<00:08, 183.43it/s]
Epoch: 2 - loss: 0.201, acc: 0.939 15%|▌   | 285/1875 [00:01<00:08, 182.68it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 16%|▋   | 304/1875 [00:01<00:08, 183.74it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 17%|▋   | 323/1875 [00:01<00:08, 185.03it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 18%|▋   | 342/1875 [00:01<00:08, 185.40it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 19%|▊   | 362/1875 [00:01<00:08, 186.90it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 20%|▊   | 381/1875 [00:02<00:08, 185.07it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 21%|▊   | 400/1875 [00:02<00:07, 185.98it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 22%|▉   | 419/1875 [00:02<00:07, 184.98it/s]
Epoch: 2 - loss: 0.201, acc: 0.937 23%|▉   | 438/1875 [00:02<00:07, 185.37it/s]
Epoch: 2 - loss: 0.201, acc: 0.937 24%|▉   | 458/1875 [00:02<00:07, 186.87it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 25%|█   | 477/1875 [00:02<00:07, 184.52it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 27%|█   | 497/1875 [00:02<00:07, 185.74it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 28%|█   | 516/1875 [00:02<00:07, 186.45it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 29%|█▏  | 535/1875 [00:02<00:07, 185.31it/s]
Epoch: 2 - loss: 0.207, acc: 0.936 30%|█▏  | 554/1875 [00:02<00:07, 186.69it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 31%|█▏  | 573/1875 [00:03<00:07, 185.47it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 32%|█▎  | 592/1875 [00:03<00:06, 184.09it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 33%|█▎  | 611/1875 [00:03<00:06, 185.28it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 34%|█▎  | 630/1875 [00:03<00:06, 184.50it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 35%|█▍  | 649/1875 [00:03<00:06, 185.57it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 36%|█▍  | 668/1875 [00:03<00:06, 185.78it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 37%|█▍  | 687/1875 [00:03<00:06, 185.93it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 38%|█▌  | 706/1875 [00:03<00:06, 185.49it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 39%|█▌  | 725/1875 [00:03<00:06, 186.27it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 40%|█▌  | 744/1875 [00:04<00:06, 186.82it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 41%|█▋  | 763/1875 [00:04<00:05, 187.21it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 42%|█▋  | 782/1875 [00:04<00:05, 186.38it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 43%|█▋  | 802/1875 [00:04<00:05, 187.06it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 44%|█▊  | 821/1875 [00:04<00:05, 186.82it/s]
Epoch: 2 - loss: 0.207, acc: 0.936 45%|█▊  | 841/1875 [00:04<00:05, 188.97it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 46%|█▊  | 860/1875 [00:04<00:05, 188.15it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 47%|█▉  | 879/1875 [00:04<00:05, 186.48it/s]
Epoch: 2 - loss: 0.206, acc: 0.936 48%|█▉  | 898/1875 [00:04<00:05, 185.87it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 49%|█▉  | 918/1875 [00:04<00:05, 187.23it/s]
Epoch: 2 - loss: 0.204, acc: 0.936 50%|█▉  | 937/1875 [00:05<00:05, 185.85it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 51%|██  | 956/1875 [00:05<00:04, 186.52it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 52%|██  | 976/1875 [00:05<00:04, 187.16it/s]
Epoch: 2 - loss: 0.204, acc: 0.936 53%|██  | 995/1875 [00:05<00:04, 187.45it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 54%|█▌ | 1014/1875 [00:05<00:04, 184.37it/s]
Epoch: 2 - loss: 0.204, acc: 0.936 55%|█▋ | 1033/1875 [00:05<00:04, 183.86it/s]
Epoch: 2 - loss: 0.204, acc: 0.936 56%|█▋ | 1052/1875 [00:05<00:04, 183.51it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 57%|█▋ | 1071/1875 [00:05<00:04, 183.26it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 58%|█▋ | 1090/1875 [00:05<00:04, 182.04it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 59%|█▊ | 1109/1875 [00:05<00:04, 181.19it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 60%|█▊ | 1128/1875 [00:06<00:04, 183.22it/s]
Epoch: 2 - loss: 0.204, acc: 0.936 61%|█▊ | 1147/1875 [00:06<00:03, 184.12it/s]
Epoch: 2 - loss: 0.205, acc: 0.936 62%|█▊ | 1166/1875 [00:06<00:03, 184.76it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 63%|█▉ | 1185/1875 [00:06<00:03, 185.76it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 64%|█▉ | 1204/1875 [00:06<00:03, 186.46it/s]
Epoch: 2 - loss: 0.204, acc: 0.937 65%|█▉ | 1223/1875 [00:06<00:03, 186.95it/s]
Epoch: 2 - loss: 0.203, acc: 0.937 66%|█▉ | 1242/1875 [00:06<00:03, 187.86it/s]
Epoch: 2 - loss: 0.202, acc: 0.937 67%|██ | 1261/1875 [00:06<00:03, 185.73it/s]
Epoch: 2 - loss: 0.202, acc: 0.937 68%|██ | 1280/1875 [00:06<00:03, 183.74it/s]
Epoch: 2 - loss: 0.201, acc: 0.937 69%|██ | 1299/1875 [00:07<00:03, 185.03it/s]
Epoch: 2 - loss: 0.201, acc: 0.937 70%|██ | 1318/1875 [00:07<00:02, 185.95it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 71%|██▏| 1337/1875 [00:07<00:02, 185.50it/s]
Epoch: 2 - loss: 0.200, acc: 0.937 72%|██▏| 1356/1875 [00:07<00:02, 185.73it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 73%|██▏| 1375/1875 [00:07<00:02, 186.44it/s]
Epoch: 2 - loss: 0.201, acc: 0.938 74%|██▏| 1394/1875 [00:07<00:02, 186.94it/s]
Epoch: 2 - loss: 0.201, acc: 0.938 75%|██▎| 1413/1875 [00:07<00:02, 186.19it/s]
Epoch: 2 - loss: 0.201, acc: 0.937 76%|██▎| 1432/1875 [00:07<00:02, 186.77it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 77%|██▎| 1451/1875 [00:07<00:02, 186.62it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 78%|██▎| 1470/1875 [00:07<00:02, 185.42it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 79%|██▍| 1489/1875 [00:08<00:02, 185.68it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 80%|██▍| 1508/1875 [00:08<00:01, 184.77it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 81%|██▍| 1527/1875 [00:08<00:01, 184.68it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 82%|██▍| 1546/1875 [00:08<00:01, 182.49it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 83%|██▌| 1565/1875 [00:08<00:01, 182.02it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 84%|██▌| 1584/1875 [00:08<00:01, 183.81it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 85%|██▌| 1603/1875 [00:08<00:01, 182.94it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 87%|██▌| 1622/1875 [00:08<00:01, 182.34it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 88%|██▋| 1641/1875 [00:08<00:01, 184.04it/s]
Epoch: 2 - loss: 0.198, acc: 0.939 89%|██▋| 1660/1875 [00:08<00:01, 184.17it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 90%|██▋| 1679/1875 [00:09<00:01, 185.33it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 91%|██▋| 1698/1875 [00:09<00:00, 182.93it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 92%|██▋| 1717/1875 [00:09<00:00, 183.92it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 93%|██▊| 1736/1875 [00:09<00:00, 184.62it/s]
Epoch: 2 - loss: 0.200, acc: 0.938 94%|██▊| 1755/1875 [00:09<00:00, 184.04it/s]
Epoch: 2 - loss: 0.199, acc: 0.939 95%|██▊| 1774/1875 [00:09<00:00, 183.10it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 96%|██▊| 1793/1875 [00:09<00:00, 184.04it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 97%|██▉| 1812/1875 [00:09<00:00, 182.05it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 98%|██▉| 1832/1875 [00:09<00:00, 184.50it/s]
Epoch: 2 - loss: 0.199, acc: 0.938 99%|██▉| 1851/1875 [00:09<00:00, 182.89it/s]
Epoch: 2 - loss: 0.198, acc: 0.939100%|██▉| 1870/1875 [00:10<00:00, 183.89it/s]
Epoch: 2 - loss: 0.198, acc: 0.939, val_loss: 0.112, val_acc: 0.968100%|█| 1875/1875 [00:10<00:00, 18.25it/s]
Training:  30%|█████████▉                       | 3/10 [00:32<01:16, 10.98s/it]
Epoch: 3:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 3 - loss: 0.214, acc: 0.933  1%|     | 20/1875 [00:00<00:09, 190.48it/s]
Epoch: 3 - loss: 0.211, acc: 0.937  2%|     | 39/1875 [00:00<00:09, 189.76it/s]
Epoch: 3 - loss: 0.194, acc: 0.940  3%|▏    | 58/1875 [00:00<00:09, 188.70it/s]
Epoch: 3 - loss: 0.187, acc: 0.943  4%|▏    | 77/1875 [00:00<00:09, 187.97it/s]
Epoch: 3 - loss: 0.191, acc: 0.941  5%|▎    | 96/1875 [00:00<00:09, 187.46it/s]
Epoch: 3 - loss: 0.186, acc: 0.943  6%|▏   | 115/1875 [00:00<00:09, 187.10it/s]
Epoch: 3 - loss: 0.180, acc: 0.945  7%|▎   | 134/1875 [00:00<00:09, 187.40it/s]
Epoch: 3 - loss: 0.182, acc: 0.943  8%|▎   | 154/1875 [00:00<00:09, 188.85it/s]
Epoch: 3 - loss: 0.180, acc: 0.943  9%|▎   | 173/1875 [00:00<00:09, 187.51it/s]
Epoch: 3 - loss: 0.186, acc: 0.941 10%|▍   | 193/1875 [00:01<00:08, 188.39it/s]
Epoch: 3 - loss: 0.183, acc: 0.941 11%|▍   | 213/1875 [00:01<00:08, 188.48it/s]
Epoch: 3 - loss: 0.184, acc: 0.941 12%|▍   | 232/1875 [00:01<00:08, 186.16it/s]
Epoch: 3 - loss: 0.186, acc: 0.941 13%|▌   | 251/1875 [00:01<00:08, 186.74it/s]
Epoch: 3 - loss: 0.189, acc: 0.940 14%|▌   | 271/1875 [00:01<00:08, 187.85it/s]
Epoch: 3 - loss: 0.188, acc: 0.940 16%|▌   | 291/1875 [00:01<00:08, 188.63it/s]
Epoch: 3 - loss: 0.189, acc: 0.940 17%|▋   | 311/1875 [00:01<00:08, 188.64it/s]
Epoch: 3 - loss: 0.192, acc: 0.940 18%|▋   | 331/1875 [00:01<00:08, 190.27it/s]
Epoch: 3 - loss: 0.191, acc: 0.940 19%|▋   | 350/1875 [00:01<00:08, 189.62it/s]
Epoch: 3 - loss: 0.189, acc: 0.940 20%|▊   | 369/1875 [00:01<00:08, 188.04it/s]
Epoch: 3 - loss: 0.191, acc: 0.940 21%|▊   | 388/1875 [00:02<00:07, 186.41it/s]
Epoch: 3 - loss: 0.191, acc: 0.939 22%|▊   | 408/1875 [00:02<00:07, 187.08it/s]
Epoch: 3 - loss: 0.189, acc: 0.940 23%|▉   | 427/1875 [00:02<00:07, 186.29it/s]
Epoch: 3 - loss: 0.186, acc: 0.941 24%|▉   | 446/1875 [00:02<00:07, 186.83it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 25%|▉   | 465/1875 [00:02<00:07, 187.22it/s]
Epoch: 3 - loss: 0.189, acc: 0.941 26%|█   | 484/1875 [00:02<00:07, 186.93it/s]
Epoch: 3 - loss: 0.189, acc: 0.941 27%|█   | 503/1875 [00:02<00:07, 185.64it/s]
Epoch: 3 - loss: 0.189, acc: 0.941 28%|█   | 522/1875 [00:02<00:07, 185.29it/s]
Epoch: 3 - loss: 0.188, acc: 0.942 29%|█▏  | 542/1875 [00:02<00:07, 187.87it/s]
Epoch: 3 - loss: 0.188, acc: 0.942 30%|█▏  | 561/1875 [00:02<00:07, 186.83it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 31%|█▏  | 580/1875 [00:03<00:06, 187.77it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 32%|█▎  | 600/1875 [00:03<00:06, 189.11it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 33%|█▎  | 619/1875 [00:03<00:06, 188.25it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 34%|█▎  | 638/1875 [00:03<00:06, 188.21it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 35%|█▍  | 657/1875 [00:03<00:06, 187.07it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 36%|█▍  | 676/1875 [00:03<00:06, 186.83it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 37%|█▍  | 695/1875 [00:03<00:06, 187.77it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 38%|█▌  | 714/1875 [00:03<00:06, 187.32it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 39%|█▌  | 733/1875 [00:03<00:06, 187.00it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 40%|█▌  | 753/1875 [00:04<00:05, 188.03it/s]
Epoch: 3 - loss: 0.187, acc: 0.942 41%|█▋  | 773/1875 [00:04<00:05, 188.76it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 42%|█▋  | 792/1875 [00:04<00:05, 188.57it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 43%|█▋  | 811/1875 [00:04<00:05, 185.67it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 44%|█▊  | 830/1875 [00:04<00:05, 184.77it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 45%|█▊  | 849/1875 [00:04<00:05, 185.22it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 46%|█▊  | 868/1875 [00:04<00:05, 181.28it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 47%|█▉  | 887/1875 [00:04<00:05, 176.64it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 48%|█▉  | 906/1875 [00:04<00:05, 177.91it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 49%|█▉  | 925/1875 [00:04<00:05, 178.31it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 50%|██  | 943/1875 [00:05<00:05, 178.81it/s]
Epoch: 3 - loss: 0.183, acc: 0.943 51%|██  | 962/1875 [00:05<00:05, 180.99it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 52%|██  | 981/1875 [00:05<00:04, 182.54it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 53%|█▌ | 1000/1875 [00:05<00:04, 183.11it/s]
Epoch: 3 - loss: 0.183, acc: 0.943 54%|█▋ | 1019/1875 [00:05<00:04, 182.46it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 55%|█▋ | 1038/1875 [00:05<00:04, 180.97it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 56%|█▋ | 1057/1875 [00:05<00:04, 183.05it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 57%|█▋ | 1076/1875 [00:05<00:04, 182.95it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 58%|█▊ | 1095/1875 [00:05<00:04, 180.27it/s]
Epoch: 3 - loss: 0.183, acc: 0.943 59%|█▊ | 1114/1875 [00:06<00:04, 182.55it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 60%|█▊ | 1133/1875 [00:06<00:04, 181.03it/s]
Epoch: 3 - loss: 0.183, acc: 0.943 61%|█▊ | 1152/1875 [00:06<00:04, 175.49it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 62%|█▊ | 1171/1875 [00:06<00:03, 178.09it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 63%|█▉ | 1190/1875 [00:06<00:03, 180.47it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 64%|█▉ | 1209/1875 [00:06<00:03, 180.10it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 65%|█▉ | 1228/1875 [00:06<00:03, 181.39it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 67%|█▉ | 1247/1875 [00:06<00:03, 182.30it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 68%|██ | 1266/1875 [00:06<00:03, 182.42it/s]
Epoch: 3 - loss: 0.186, acc: 0.943 69%|██ | 1285/1875 [00:06<00:03, 184.63it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 70%|██ | 1304/1875 [00:07<00:03, 184.04it/s]
Epoch: 3 - loss: 0.185, acc: 0.943 71%|██ | 1323/1875 [00:07<00:02, 184.71it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 72%|██▏| 1342/1875 [00:07<00:02, 185.17it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 73%|██▏| 1361/1875 [00:07<00:02, 183.89it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 74%|██▏| 1380/1875 [00:07<00:02, 184.60it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 75%|██▏| 1400/1875 [00:07<00:02, 186.84it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 76%|██▎| 1419/1875 [00:07<00:02, 187.22it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 77%|██▎| 1438/1875 [00:07<00:02, 187.49it/s]
Epoch: 3 - loss: 0.184, acc: 0.944 78%|██▎| 1457/1875 [00:07<00:02, 186.57it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 79%|██▎| 1476/1875 [00:07<00:02, 185.39it/s]
Epoch: 3 - loss: 0.184, acc: 0.944 80%|██▍| 1495/1875 [00:08<00:02, 182.97it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 81%|██▍| 1514/1875 [00:08<00:01, 182.89it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 82%|██▍| 1533/1875 [00:08<00:01, 184.97it/s]
Epoch: 3 - loss: 0.184, acc: 0.944 83%|██▍| 1552/1875 [00:08<00:01, 185.36it/s]
Epoch: 3 - loss: 0.184, acc: 0.944 84%|██▌| 1571/1875 [00:08<00:01, 185.09it/s]
Epoch: 3 - loss: 0.184, acc: 0.943 85%|██▌| 1590/1875 [00:08<00:01, 185.44it/s]
Epoch: 3 - loss: 0.184, acc: 0.944 86%|██▌| 1609/1875 [00:08<00:01, 184.07it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 87%|██▌| 1628/1875 [00:08<00:01, 185.27it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 88%|██▋| 1647/1875 [00:08<00:01, 182.36it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 89%|██▋| 1666/1875 [00:09<00:01, 183.52it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 90%|██▋| 1685/1875 [00:09<00:01, 184.88it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 91%|██▋| 1704/1875 [00:09<00:00, 184.75it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 92%|██▊| 1723/1875 [00:09<00:00, 185.75it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 93%|██▊| 1742/1875 [00:09<00:00, 184.82it/s]
Epoch: 3 - loss: 0.183, acc: 0.944 94%|██▊| 1761/1875 [00:09<00:00, 185.26it/s]
Epoch: 3 - loss: 0.182, acc: 0.944 95%|██▊| 1780/1875 [00:09<00:00, 183.41it/s]
Epoch: 3 - loss: 0.182, acc: 0.944 96%|██▉| 1799/1875 [00:09<00:00, 183.19it/s]
Epoch: 3 - loss: 0.182, acc: 0.944 97%|██▉| 1818/1875 [00:09<00:00, 182.52it/s]
Epoch: 3 - loss: 0.182, acc: 0.944 98%|██▉| 1837/1875 [00:09<00:00, 177.45it/s]
Epoch: 3 - loss: 0.181, acc: 0.944 99%|██▉| 1856/1875 [00:10<00:00, 179.50it/s]
Epoch: 3 - loss: 0.181, acc: 0.944, val_loss: 0.094, val_acc: 0.974100%|█| 1875/1875 [00:10<00:00, 55.70it/s]
Training:  40%|█████████████▏                   | 4/10 [00:43<01:05, 10.97s/it]
Epoch: 4:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 4 - loss: 0.171, acc: 0.944  1%|     | 19/1875 [00:00<00:09, 190.00it/s]
Epoch: 4 - loss: 0.166, acc: 0.950  2%|     | 38/1875 [00:00<00:09, 189.43it/s]
Epoch: 4 - loss: 0.158, acc: 0.954  3%|▏    | 57/1875 [00:00<00:09, 189.04it/s]
Epoch: 4 - loss: 0.152, acc: 0.955  4%|▏    | 76/1875 [00:00<00:09, 185.99it/s]
Epoch: 4 - loss: 0.140, acc: 0.957  5%|▎    | 95/1875 [00:00<00:09, 187.17it/s]
Epoch: 4 - loss: 0.143, acc: 0.954  6%|▏   | 114/1875 [00:00<00:09, 186.90it/s]
Epoch: 4 - loss: 0.147, acc: 0.954  7%|▎   | 133/1875 [00:00<00:09, 186.17it/s]
Epoch: 4 - loss: 0.150, acc: 0.954  8%|▎   | 152/1875 [00:00<00:09, 186.20it/s]
Epoch: 4 - loss: 0.149, acc: 0.954  9%|▎   | 171/1875 [00:00<00:09, 185.13it/s]
Epoch: 4 - loss: 0.150, acc: 0.954 10%|▍   | 190/1875 [00:01<00:09, 185.47it/s]
Epoch: 4 - loss: 0.152, acc: 0.953 11%|▍   | 209/1875 [00:01<00:08, 185.71it/s]
Epoch: 4 - loss: 0.153, acc: 0.952 12%|▍   | 228/1875 [00:01<00:08, 185.88it/s]
Epoch: 4 - loss: 0.153, acc: 0.952 13%|▌   | 247/1875 [00:01<00:08, 184.37it/s]
Epoch: 4 - loss: 0.152, acc: 0.952 14%|▌   | 266/1875 [00:01<00:08, 185.48it/s]
Epoch: 4 - loss: 0.154, acc: 0.951 15%|▌   | 285/1875 [00:01<00:08, 185.18it/s]
Epoch: 4 - loss: 0.157, acc: 0.951 16%|▋   | 304/1875 [00:01<00:08, 184.96it/s]
Epoch: 4 - loss: 0.159, acc: 0.950 17%|▋   | 324/1875 [00:01<00:08, 187.11it/s]
Epoch: 4 - loss: 0.159, acc: 0.951 18%|▋   | 343/1875 [00:01<00:08, 186.31it/s]
Epoch: 4 - loss: 0.159, acc: 0.950 19%|▊   | 362/1875 [00:01<00:08, 184.67it/s]
Epoch: 4 - loss: 0.159, acc: 0.951 20%|▊   | 381/1875 [00:02<00:08, 184.61it/s]
Epoch: 4 - loss: 0.161, acc: 0.950 21%|▊   | 401/1875 [00:02<00:07, 187.38it/s]
Epoch: 4 - loss: 0.161, acc: 0.950 22%|▉   | 420/1875 [00:02<00:07, 187.04it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 23%|▉   | 439/1875 [00:02<00:07, 187.92it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 24%|▉   | 458/1875 [00:02<00:07, 187.98it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 25%|█   | 477/1875 [00:02<00:07, 188.02it/s]
Epoch: 4 - loss: 0.168, acc: 0.949 26%|█   | 496/1875 [00:02<00:07, 187.49it/s]
Epoch: 4 - loss: 0.168, acc: 0.949 27%|█   | 515/1875 [00:02<00:07, 187.68it/s]
Epoch: 4 - loss: 0.168, acc: 0.948 28%|█▏  | 534/1875 [00:02<00:07, 185.61it/s]
Epoch: 4 - loss: 0.169, acc: 0.948 29%|█▏  | 553/1875 [00:02<00:07, 185.27it/s]
Epoch: 4 - loss: 0.168, acc: 0.948 31%|█▏  | 572/1875 [00:03<00:07, 185.03it/s]
Epoch: 4 - loss: 0.168, acc: 0.948 32%|█▎  | 591/1875 [00:03<00:06, 185.94it/s]
Epoch: 4 - loss: 0.169, acc: 0.948 33%|█▎  | 610/1875 [00:03<00:06, 186.59it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 34%|█▎  | 629/1875 [00:03<00:06, 185.95it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 35%|█▍  | 648/1875 [00:03<00:06, 186.05it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 36%|█▍  | 667/1875 [00:03<00:06, 186.11it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 37%|█▍  | 686/1875 [00:03<00:06, 185.07it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 38%|█▌  | 705/1875 [00:03<00:06, 184.35it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 39%|█▌  | 724/1875 [00:03<00:06, 186.01it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 40%|█▌  | 743/1875 [00:03<00:06, 183.93it/s]
Epoch: 4 - loss: 0.168, acc: 0.949 41%|█▋  | 763/1875 [00:04<00:05, 186.36it/s]
Epoch: 4 - loss: 0.168, acc: 0.949 42%|█▋  | 782/1875 [00:04<00:05, 184.17it/s]
Epoch: 4 - loss: 0.168, acc: 0.949 43%|█▋  | 801/1875 [00:04<00:05, 184.26it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 44%|█▋  | 820/1875 [00:04<00:05, 183.25it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 45%|█▊  | 839/1875 [00:04<00:05, 183.62it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 46%|█▊  | 859/1875 [00:04<00:05, 185.62it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 47%|█▉  | 879/1875 [00:04<00:05, 187.05it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 48%|█▉  | 898/1875 [00:04<00:05, 184.10it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 49%|█▉  | 917/1875 [00:04<00:05, 182.62it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 50%|█▉  | 937/1875 [00:05<00:05, 184.91it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 51%|██  | 957/1875 [00:05<00:04, 186.54it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 52%|██  | 976/1875 [00:05<00:04, 185.37it/s]
Epoch: 4 - loss: 0.164, acc: 0.950 53%|██  | 996/1875 [00:05<00:04, 186.87it/s]
Epoch: 4 - loss: 0.164, acc: 0.950 54%|█▋ | 1016/1875 [00:05<00:04, 189.54it/s]
Epoch: 4 - loss: 0.164, acc: 0.950 55%|█▋ | 1035/1875 [00:05<00:04, 189.11it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 56%|█▋ | 1054/1875 [00:05<00:04, 187.69it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 57%|█▋ | 1073/1875 [00:05<00:04, 183.47it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 58%|█▋ | 1092/1875 [00:05<00:04, 184.30it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 59%|█▊ | 1111/1875 [00:05<00:04, 184.35it/s]
Epoch: 4 - loss: 0.162, acc: 0.950 60%|█▊ | 1130/1875 [00:06<00:04, 182.79it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 61%|█▊ | 1149/1875 [00:06<00:03, 183.82it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 62%|█▊ | 1168/1875 [00:06<00:03, 184.01it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 63%|█▉ | 1187/1875 [00:06<00:03, 182.56it/s]
Epoch: 4 - loss: 0.163, acc: 0.950 64%|█▉ | 1206/1875 [00:06<00:03, 182.07it/s]
Epoch: 4 - loss: 0.164, acc: 0.950 65%|█▉ | 1225/1875 [00:06<00:03, 183.31it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 66%|█▉ | 1245/1875 [00:06<00:03, 185.40it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 67%|██ | 1264/1875 [00:06<00:03, 182.98it/s]
Epoch: 4 - loss: 0.164, acc: 0.950 68%|██ | 1283/1875 [00:06<00:03, 182.90it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 69%|██ | 1302/1875 [00:07<00:03, 183.90it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 70%|██ | 1321/1875 [00:07<00:03, 182.48it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 71%|██▏| 1340/1875 [00:07<00:02, 182.02it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 72%|██▏| 1359/1875 [00:07<00:02, 180.66it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 73%|██▏| 1378/1875 [00:07<00:02, 179.72it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 75%|██▏| 1397/1875 [00:07<00:02, 180.60it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 76%|██▎| 1416/1875 [00:07<00:02, 182.79it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 77%|██▎| 1435/1875 [00:07<00:02, 182.24it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 78%|██▎| 1454/1875 [00:07<00:02, 182.90it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 79%|██▎| 1473/1875 [00:07<00:02, 183.37it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 80%|██▍| 1492/1875 [00:08<00:02, 184.23it/s]
Epoch: 4 - loss: 0.164, acc: 0.949 81%|██▍| 1511/1875 [00:08<00:01, 182.71it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 82%|██▍| 1530/1875 [00:08<00:01, 183.76it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 83%|██▍| 1549/1875 [00:08<00:01, 184.51it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 84%|██▌| 1568/1875 [00:08<00:01, 181.33it/s]
Epoch: 4 - loss: 0.165, acc: 0.949 85%|██▌| 1587/1875 [00:08<00:01, 182.26it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 86%|██▌| 1606/1875 [00:08<00:01, 183.44it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 87%|██▌| 1625/1875 [00:08<00:01, 179.07it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 88%|██▋| 1643/1875 [00:08<00:01, 174.65it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 89%|██▋| 1662/1875 [00:09<00:01, 177.98it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 90%|██▋| 1681/1875 [00:09<00:01, 178.86it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 91%|██▋| 1699/1875 [00:09<00:00, 178.14it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 92%|██▊| 1719/1875 [00:09<00:00, 181.67it/s]
Epoch: 4 - loss: 0.167, acc: 0.949 93%|██▊| 1738/1875 [00:09<00:00, 180.94it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 94%|██▊| 1757/1875 [00:09<00:00, 181.46it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 95%|██▊| 1776/1875 [00:09<00:00, 180.79it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 96%|██▊| 1795/1875 [00:09<00:00, 174.37it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 97%|██▉| 1813/1875 [00:09<00:00, 170.03it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 98%|██▉| 1831/1875 [00:09<00:00, 170.45it/s]
Epoch: 4 - loss: 0.166, acc: 0.949 99%|██▉| 1849/1875 [00:10<00:00, 171.72it/s]
Epoch: 4 - loss: 0.166, acc: 0.949100%|██▉| 1867/1875 [00:10<00:00, 173.62it/s]
Epoch: 4 - loss: 0.166, acc: 0.949, val_loss: 0.087, val_acc: 0.975100%|█| 1875/1875 [00:11<00:00, 28.08it/s]
Training:  50%|████████████████▌                | 5/10 [00:54<00:54, 10.98s/it]
Epoch: 5:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 5 - loss: 0.141, acc: 0.961  1%|     | 19/1875 [00:00<00:10, 184.47it/s]
Epoch: 5 - loss: 0.123, acc: 0.966  2%|     | 38/1875 [00:00<00:09, 184.47it/s]
Epoch: 5 - loss: 0.147, acc: 0.959  3%|▏    | 57/1875 [00:00<00:09, 183.93it/s]
Epoch: 5 - loss: 0.152, acc: 0.956  4%|▏    | 75/1875 [00:00<00:09, 182.73it/s]
Epoch: 5 - loss: 0.148, acc: 0.957  5%|▎    | 94/1875 [00:00<00:09, 184.32it/s]
Epoch: 5 - loss: 0.144, acc: 0.956  6%|▏   | 113/1875 [00:00<00:09, 185.99it/s]
Epoch: 5 - loss: 0.144, acc: 0.956  7%|▎   | 132/1875 [00:00<00:09, 185.53it/s]
Epoch: 5 - loss: 0.143, acc: 0.956  8%|▎   | 151/1875 [00:00<00:09, 184.67it/s]
Epoch: 5 - loss: 0.143, acc: 0.957  9%|▎   | 171/1875 [00:00<00:09, 186.37it/s]
Epoch: 5 - loss: 0.148, acc: 0.956 10%|▍   | 190/1875 [00:01<00:09, 186.34it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 11%|▍   | 209/1875 [00:01<00:08, 185.78it/s]
Epoch: 5 - loss: 0.147, acc: 0.956 12%|▍   | 228/1875 [00:01<00:08, 185.38it/s]
Epoch: 5 - loss: 0.149, acc: 0.956 13%|▌   | 247/1875 [00:01<00:08, 184.03it/s]
Epoch: 5 - loss: 0.150, acc: 0.955 14%|▌   | 266/1875 [00:01<00:08, 184.70it/s]
Epoch: 5 - loss: 0.147, acc: 0.956 15%|▌   | 285/1875 [00:01<00:08, 184.63it/s]
Epoch: 5 - loss: 0.147, acc: 0.956 16%|▋   | 305/1875 [00:01<00:08, 185.82it/s]
Epoch: 5 - loss: 0.147, acc: 0.957 17%|▋   | 324/1875 [00:01<00:08, 184.34it/s]
Epoch: 5 - loss: 0.149, acc: 0.956 18%|▋   | 344/1875 [00:01<00:08, 186.14it/s]
Epoch: 5 - loss: 0.148, acc: 0.956 19%|▊   | 363/1875 [00:01<00:08, 184.01it/s]
Epoch: 5 - loss: 0.148, acc: 0.956 20%|▊   | 382/1875 [00:02<00:08, 184.15it/s]
Epoch: 5 - loss: 0.148, acc: 0.956 21%|▊   | 401/1875 [00:02<00:07, 185.87it/s]
Epoch: 5 - loss: 0.149, acc: 0.955 22%|▉   | 420/1875 [00:02<00:07, 186.54it/s]
Epoch: 5 - loss: 0.149, acc: 0.956 23%|▉   | 439/1875 [00:02<00:07, 187.01it/s]
Epoch: 5 - loss: 0.148, acc: 0.956 24%|▉   | 458/1875 [00:02<00:07, 186.24it/s]
Epoch: 5 - loss: 0.150, acc: 0.956 25%|█   | 477/1875 [00:02<00:07, 185.70it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 26%|█   | 496/1875 [00:02<00:07, 185.87it/s]
Epoch: 5 - loss: 0.152, acc: 0.955 27%|█   | 515/1875 [00:02<00:07, 186.54it/s]
Epoch: 5 - loss: 0.152, acc: 0.955 28%|█▏  | 534/1875 [00:02<00:07, 186.46it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 29%|█▏  | 553/1875 [00:02<00:07, 185.86it/s]
Epoch: 5 - loss: 0.152, acc: 0.955 31%|█▏  | 572/1875 [00:03<00:07, 183.82it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 32%|█▎  | 591/1875 [00:03<00:06, 184.55it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 33%|█▎  | 610/1875 [00:03<00:06, 184.53it/s]
Epoch: 5 - loss: 0.149, acc: 0.955 34%|█▎  | 629/1875 [00:03<00:06, 185.05it/s]
Epoch: 5 - loss: 0.150, acc: 0.955 35%|█▍  | 648/1875 [00:03<00:06, 185.41it/s]
Epoch: 5 - loss: 0.150, acc: 0.954 36%|█▍  | 667/1875 [00:03<00:06, 184.05it/s]
Epoch: 5 - loss: 0.150, acc: 0.955 37%|█▍  | 686/1875 [00:03<00:06, 185.25it/s]
Epoch: 5 - loss: 0.150, acc: 0.955 38%|█▌  | 705/1875 [00:03<00:06, 185.56it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 39%|█▌  | 724/1875 [00:03<00:06, 185.77it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 40%|█▌  | 743/1875 [00:04<00:06, 184.84it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 41%|█▋  | 762/1875 [00:04<00:06, 183.65it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 42%|█▋  | 781/1875 [00:04<00:05, 184.97it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 43%|█▋  | 800/1875 [00:04<00:05, 185.90it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 44%|█▋  | 819/1875 [00:04<00:05, 186.56it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 45%|█▊  | 839/1875 [00:04<00:05, 187.19it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 46%|█▊  | 858/1875 [00:04<00:05, 185.82it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 47%|█▊  | 877/1875 [00:04<00:05, 185.96it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 48%|█▉  | 896/1875 [00:04<00:05, 185.51it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 49%|█▉  | 915/1875 [00:04<00:05, 185.74it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 50%|█▉  | 935/1875 [00:05<00:05, 187.13it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 51%|██  | 954/1875 [00:05<00:04, 186.33it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 52%|██  | 973/1875 [00:05<00:04, 186.31it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 53%|██  | 992/1875 [00:05<00:04, 184.67it/s]
Epoch: 5 - loss: 0.151, acc: 0.955 54%|█▌ | 1011/1875 [00:05<00:04, 184.61it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 55%|█▋ | 1030/1875 [00:05<00:04, 186.19it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 56%|█▋ | 1050/1875 [00:05<00:04, 187.46it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 57%|█▋ | 1069/1875 [00:05<00:04, 188.21it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 58%|█▋ | 1088/1875 [00:05<00:04, 187.63it/s]
Epoch: 5 - loss: 0.153, acc: 0.954 59%|█▊ | 1108/1875 [00:05<00:04, 188.47it/s]
Epoch: 5 - loss: 0.153, acc: 0.953 60%|█▊ | 1127/1875 [00:06<00:03, 188.37it/s]
Epoch: 5 - loss: 0.153, acc: 0.954 61%|█▊ | 1146/1875 [00:06<00:03, 187.18it/s]
Epoch: 5 - loss: 0.153, acc: 0.953 62%|█▊ | 1165/1875 [00:06<00:03, 185.27it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 63%|█▉ | 1184/1875 [00:06<00:03, 185.57it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 64%|█▉ | 1203/1875 [00:06<00:03, 186.33it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 65%|█▉ | 1222/1875 [00:06<00:03, 186.31it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 66%|█▉ | 1241/1875 [00:06<00:03, 185.21it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 67%|██ | 1260/1875 [00:06<00:03, 184.99it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 68%|██ | 1279/1875 [00:06<00:03, 184.29it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 69%|██ | 1298/1875 [00:06<00:03, 184.34it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 70%|██ | 1317/1875 [00:07<00:03, 182.78it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 71%|██▏| 1336/1875 [00:07<00:02, 183.82it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 72%|██▏| 1355/1875 [00:07<00:02, 181.90it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 73%|██▏| 1374/1875 [00:07<00:02, 182.66it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 74%|██▏| 1393/1875 [00:07<00:02, 181.10it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 75%|██▎| 1412/1875 [00:07<00:02, 183.15it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 76%|██▎| 1431/1875 [00:07<00:02, 181.96it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 77%|██▎| 1450/1875 [00:07<00:02, 181.14it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 78%|██▎| 1469/1875 [00:07<00:02, 182.12it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 79%|██▍| 1488/1875 [00:08<00:02, 180.22it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 80%|██▍| 1507/1875 [00:08<00:02, 182.52it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 81%|██▍| 1526/1875 [00:08<00:01, 180.49it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 82%|██▍| 1545/1875 [00:08<00:01, 181.14it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 83%|██▌| 1564/1875 [00:08<00:01, 182.13it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 84%|██▌| 1584/1875 [00:08<00:01, 184.55it/s]
Epoch: 5 - loss: 0.152, acc: 0.954 85%|██▌| 1603/1875 [00:08<00:01, 180.84it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 87%|██▌| 1622/1875 [00:08<00:01, 180.87it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 88%|██▋| 1641/1875 [00:08<00:01, 182.99it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 89%|██▋| 1660/1875 [00:08<00:01, 182.90it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 90%|██▋| 1679/1875 [00:09<00:01, 180.75it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 91%|██▋| 1698/1875 [00:09<00:00, 181.33it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 92%|██▋| 1717/1875 [00:09<00:00, 181.22it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 93%|██▊| 1736/1875 [00:09<00:00, 182.70it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 94%|██▊| 1755/1875 [00:09<00:00, 184.30it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 95%|██▊| 1774/1875 [00:09<00:00, 184.35it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 96%|██▊| 1793/1875 [00:09<00:00, 183.85it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 97%|██▉| 1812/1875 [00:09<00:00, 182.44it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 98%|██▉| 1831/1875 [00:09<00:00, 181.99it/s]
Epoch: 5 - loss: 0.151, acc: 0.954 99%|██▉| 1850/1875 [00:10<00:00, 182.20it/s]
Epoch: 5 - loss: 0.151, acc: 0.954100%|██▉| 1870/1875 [00:10<00:00, 184.61it/s]
Epoch: 5 - loss: 0.151, acc: 0.954, val_loss: 0.084, val_acc: 0.975100%|█| 1875/1875 [00:10<00:00, 18.79it/s]
Training:  60%|███████████████████▊             | 6/10 [01:05<00:43, 10.98s/it]
Epoch: 6:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 6 - loss: 0.116, acc: 0.957  1%|     | 19/1875 [00:00<00:09, 186.27it/s]
Epoch: 6 - loss: 0.130, acc: 0.955  2%|     | 38/1875 [00:00<00:09, 187.38it/s]
Epoch: 6 - loss: 0.136, acc: 0.953  3%|▏    | 57/1875 [00:00<00:09, 186.49it/s]
Epoch: 6 - loss: 0.138, acc: 0.954  4%|▏    | 76/1875 [00:00<00:09, 184.80it/s]
Epoch: 6 - loss: 0.142, acc: 0.953  5%|▎    | 95/1875 [00:00<00:09, 185.24it/s]
Epoch: 6 - loss: 0.140, acc: 0.955  6%|▏   | 115/1875 [00:00<00:09, 186.78it/s]
Epoch: 6 - loss: 0.138, acc: 0.956  7%|▎   | 134/1875 [00:00<00:09, 186.08it/s]
Epoch: 6 - loss: 0.136, acc: 0.956  8%|▎   | 153/1875 [00:00<00:09, 187.24it/s]
Epoch: 6 - loss: 0.137, acc: 0.956  9%|▎   | 172/1875 [00:00<00:09, 185.31it/s]
Epoch: 6 - loss: 0.137, acc: 0.955 10%|▍   | 191/1875 [00:01<00:09, 186.14it/s]
Epoch: 6 - loss: 0.139, acc: 0.956 11%|▍   | 210/1875 [00:01<00:08, 186.73it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 12%|▍   | 230/1875 [00:01<00:08, 187.84it/s]
Epoch: 6 - loss: 0.137, acc: 0.956 13%|▌   | 249/1875 [00:01<00:08, 185.72it/s]
Epoch: 6 - loss: 0.137, acc: 0.956 14%|▌   | 268/1875 [00:01<00:08, 184.80it/s]
Epoch: 6 - loss: 0.137, acc: 0.956 15%|▌   | 287/1875 [00:01<00:08, 184.70it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 16%|▋   | 306/1875 [00:01<00:08, 185.17it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 17%|▋   | 325/1875 [00:01<00:08, 183.88it/s]
Epoch: 6 - loss: 0.139, acc: 0.956 18%|▋   | 344/1875 [00:01<00:08, 183.52it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 19%|▊   | 363/1875 [00:01<00:08, 184.34it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 20%|▊   | 382/1875 [00:02<00:08, 184.92it/s]
Epoch: 6 - loss: 0.138, acc: 0.956 21%|▊   | 401/1875 [00:02<00:07, 186.41it/s]
Epoch: 6 - loss: 0.141, acc: 0.955 22%|▉   | 420/1875 [00:02<00:07, 186.92it/s]
Epoch: 6 - loss: 0.141, acc: 0.955 23%|▉   | 439/1875 [00:02<00:07, 186.18it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 24%|▉   | 458/1875 [00:02<00:07, 185.66it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 25%|█   | 477/1875 [00:02<00:07, 185.84it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 26%|█   | 496/1875 [00:02<00:07, 185.43it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 28%|█   | 516/1875 [00:02<00:07, 187.97it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 29%|█▏  | 535/1875 [00:02<00:07, 187.46it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 30%|█▏  | 554/1875 [00:02<00:07, 187.10it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 31%|█▏  | 573/1875 [00:03<00:06, 186.85it/s]
Epoch: 6 - loss: 0.143, acc: 0.956 32%|█▎  | 592/1875 [00:03<00:06, 185.58it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 33%|█▎  | 611/1875 [00:03<00:06, 184.71it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 34%|█▎  | 630/1875 [00:03<00:06, 185.17it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 35%|█▍  | 649/1875 [00:03<00:06, 183.36it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 36%|█▍  | 669/1875 [00:03<00:06, 185.43it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 37%|█▍  | 688/1875 [00:03<00:06, 186.23it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 38%|█▌  | 707/1875 [00:03<00:06, 183.02it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 39%|█▌  | 726/1875 [00:03<00:06, 183.98it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 40%|█▌  | 745/1875 [00:04<00:06, 183.59it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 41%|█▋  | 764/1875 [00:04<00:06, 182.79it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 42%|█▋  | 783/1875 [00:04<00:05, 184.36it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 43%|█▋  | 802/1875 [00:04<00:05, 185.47it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 44%|█▊  | 821/1875 [00:04<00:05, 184.63it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 45%|█▊  | 840/1875 [00:04<00:05, 184.58it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 46%|█▊  | 859/1875 [00:04<00:05, 182.95it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 47%|█▊  | 878/1875 [00:04<00:05, 183.93it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 48%|█▉  | 897/1875 [00:04<00:05, 181.45it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 49%|█▉  | 916/1875 [00:04<00:05, 181.30it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 50%|█▉  | 935/1875 [00:05<00:05, 182.77it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 51%|██  | 954/1875 [00:05<00:05, 182.22it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 52%|██  | 973/1875 [00:05<00:05, 180.28it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 53%|██  | 992/1875 [00:05<00:04, 182.04it/s]
Epoch: 6 - loss: 0.140, acc: 0.956 54%|█▌ | 1011/1875 [00:05<00:04, 182.76it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 55%|█▋ | 1030/1875 [00:05<00:04, 183.27it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 56%|█▋ | 1049/1875 [00:05<00:04, 183.63it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 57%|█▋ | 1068/1875 [00:05<00:04, 184.95it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 58%|█▋ | 1087/1875 [00:05<00:04, 185.35it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 59%|█▊ | 1106/1875 [00:05<00:04, 184.01it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 60%|█▊ | 1125/1875 [00:06<00:04, 182.55it/s]
Epoch: 6 - loss: 0.139, acc: 0.957 61%|█▊ | 1144/1875 [00:06<00:03, 184.19it/s]
Epoch: 6 - loss: 0.140, acc: 0.957 62%|█▊ | 1163/1875 [00:06<00:03, 184.81it/s]
Epoch: 6 - loss: 0.140, acc: 0.957 63%|█▉ | 1182/1875 [00:06<00:03, 184.17it/s]
Epoch: 6 - loss: 0.140, acc: 0.957 64%|█▉ | 1202/1875 [00:06<00:03, 186.02it/s]
Epoch: 6 - loss: 0.140, acc: 0.957 65%|█▉ | 1221/1875 [00:06<00:03, 182.87it/s]
Epoch: 6 - loss: 0.141, acc: 0.957 66%|█▉ | 1240/1875 [00:06<00:03, 184.41it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 67%|██ | 1259/1875 [00:06<00:03, 183.36it/s]
Epoch: 6 - loss: 0.140, acc: 0.957 68%|██ | 1278/1875 [00:06<00:03, 183.16it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 69%|██ | 1297/1875 [00:07<00:03, 184.08it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 70%|██ | 1317/1875 [00:07<00:02, 187.00it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 71%|██▏| 1336/1875 [00:07<00:02, 187.33it/s]
Epoch: 6 - loss: 0.141, acc: 0.956 72%|██▏| 1355/1875 [00:07<00:02, 187.01it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 73%|██▏| 1374/1875 [00:07<00:02, 183.01it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 74%|██▏| 1393/1875 [00:07<00:02, 184.52it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 75%|██▎| 1412/1875 [00:07<00:02, 185.04it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 76%|██▎| 1431/1875 [00:07<00:02, 181.69it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 77%|██▎| 1450/1875 [00:07<00:02, 182.51it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 78%|██▎| 1469/1875 [00:07<00:02, 183.62it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 79%|██▍| 1488/1875 [00:08<00:02, 184.41it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 80%|██▍| 1507/1875 [00:08<00:01, 184.97it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 81%|██▍| 1526/1875 [00:08<00:01, 184.82it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 82%|██▍| 1545/1875 [00:08<00:01, 184.17it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 83%|██▌| 1564/1875 [00:08<00:01, 182.14it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 84%|██▌| 1583/1875 [00:08<00:01, 182.83it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 85%|██▌| 1602/1875 [00:08<00:01, 181.74it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 86%|██▌| 1621/1875 [00:08<00:01, 182.03it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 87%|██▌| 1640/1875 [00:08<00:01, 182.75it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 88%|██▋| 1659/1875 [00:08<00:01, 184.33it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 89%|██▋| 1678/1875 [00:09<00:01, 185.45it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 91%|██▋| 1697/1875 [00:09<00:00, 186.24it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 92%|██▋| 1716/1875 [00:09<00:00, 184.62it/s]
Epoch: 6 - loss: 0.142, acc: 0.955 93%|██▊| 1736/1875 [00:09<00:00, 186.34it/s]
Epoch: 6 - loss: 0.143, acc: 0.956 94%|██▊| 1755/1875 [00:09<00:00, 186.32it/s]
Epoch: 6 - loss: 0.142, acc: 0.956 95%|██▊| 1774/1875 [00:09<00:00, 185.76it/s]
Epoch: 6 - loss: 0.143, acc: 0.955 96%|██▊| 1793/1875 [00:09<00:00, 183.23it/s]
Epoch: 6 - loss: 0.143, acc: 0.956 97%|██▉| 1812/1875 [00:09<00:00, 182.54it/s]
Epoch: 6 - loss: 0.143, acc: 0.956 98%|██▉| 1831/1875 [00:09<00:00, 183.64it/s]
Epoch: 6 - loss: 0.143, acc: 0.956 99%|██▉| 1850/1875 [00:10<00:00, 181.78it/s]
Epoch: 6 - loss: 0.143, acc: 0.956100%|██▉| 1869/1875 [00:10<00:00, 181.53it/s]
Epoch: 6 - loss: 0.143, acc: 0.956, val_loss: 0.076, val_acc: 0.977100%|█| 1875/1875 [00:10<00:00, 21.71it/s]
Training:  70%|███████████████████████          | 7/10 [01:16<00:32, 10.98s/it]
Epoch: 7:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 7 - loss: 0.186, acc: 0.943  1%|     | 18/1875 [00:00<00:10, 176.47it/s]
Epoch: 7 - loss: 0.165, acc: 0.954  2%|     | 37/1875 [00:00<00:10, 179.81it/s]
Epoch: 7 - loss: 0.148, acc: 0.955  3%|▏    | 56/1875 [00:00<00:10, 181.18it/s]
Epoch: 7 - loss: 0.139, acc: 0.957  4%|▏    | 75/1875 [00:00<00:09, 182.68it/s]
Epoch: 7 - loss: 0.134, acc: 0.958  5%|▎    | 94/1875 [00:00<00:09, 183.21it/s]
Epoch: 7 - loss: 0.131, acc: 0.958  6%|▏   | 113/1875 [00:00<00:09, 183.59it/s]
Epoch: 7 - loss: 0.127, acc: 0.960  7%|▎   | 132/1875 [00:00<00:09, 184.92it/s]
Epoch: 7 - loss: 0.126, acc: 0.961  8%|▎   | 150/1875 [00:00<00:09, 182.30it/s]
Epoch: 7 - loss: 0.124, acc: 0.961  9%|▎   | 168/1875 [00:00<00:09, 181.06it/s]
Epoch: 7 - loss: 0.126, acc: 0.961 10%|▍   | 187/1875 [00:01<00:09, 181.55it/s]
Epoch: 7 - loss: 0.127, acc: 0.961 11%|▍   | 205/1875 [00:01<00:09, 179.99it/s]
Epoch: 7 - loss: 0.127, acc: 0.961 12%|▍   | 223/1875 [00:01<00:09, 176.81it/s]
Epoch: 7 - loss: 0.129, acc: 0.961 13%|▌   | 242/1875 [00:01<00:09, 178.54it/s]
Epoch: 7 - loss: 0.127, acc: 0.961 14%|▌   | 261/1875 [00:01<00:08, 181.31it/s]
Epoch: 7 - loss: 0.128, acc: 0.961 15%|▌   | 280/1875 [00:01<00:08, 180.17it/s]
Epoch: 7 - loss: 0.130, acc: 0.960 16%|▋   | 299/1875 [00:01<00:08, 181.96it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 17%|▋   | 318/1875 [00:01<00:08, 181.14it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 18%|▋   | 337/1875 [00:01<00:08, 182.65it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 19%|▊   | 356/1875 [00:01<00:08, 181.61it/s]
Epoch: 7 - loss: 0.129, acc: 0.960 20%|▊   | 375/1875 [00:02<00:08, 182.46it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 21%|▊   | 394/1875 [00:02<00:08, 183.59it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 22%|▉   | 413/1875 [00:02<00:07, 183.85it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 23%|▉   | 432/1875 [00:02<00:07, 184.57it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 24%|▉   | 451/1875 [00:02<00:07, 186.17it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 25%|█   | 470/1875 [00:02<00:07, 184.57it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 26%|█   | 489/1875 [00:02<00:07, 184.00it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 27%|█   | 508/1875 [00:02<00:07, 185.22it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 28%|█   | 527/1875 [00:02<00:07, 184.45it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 29%|█▏  | 546/1875 [00:02<00:07, 185.54it/s]
Epoch: 7 - loss: 0.130, acc: 0.959 30%|█▏  | 565/1875 [00:03<00:07, 185.76it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 31%|█▏  | 584/1875 [00:03<00:07, 184.29it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 32%|█▎  | 603/1875 [00:03<00:06, 185.42it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 33%|█▎  | 623/1875 [00:03<00:06, 186.91it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 34%|█▎  | 642/1875 [00:03<00:06, 186.72it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 35%|█▍  | 661/1875 [00:03<00:06, 186.04it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 36%|█▍  | 680/1875 [00:03<00:06, 182.88it/s]
Epoch: 7 - loss: 0.135, acc: 0.957 37%|█▍  | 699/1875 [00:03<00:06, 183.89it/s]
Epoch: 7 - loss: 0.135, acc: 0.957 38%|█▌  | 718/1875 [00:03<00:06, 185.14it/s]
Epoch: 7 - loss: 0.135, acc: 0.957 39%|█▌  | 737/1875 [00:04<00:06, 184.40it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 40%|█▌  | 756/1875 [00:04<00:06, 184.96it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 41%|█▋  | 776/1875 [00:04<00:05, 187.63it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 42%|█▋  | 795/1875 [00:04<00:05, 185.57it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 43%|█▋  | 814/1875 [00:04<00:05, 186.33it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 44%|█▊  | 833/1875 [00:04<00:05, 186.86it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 45%|█▊  | 852/1875 [00:04<00:05, 186.69it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 46%|█▊  | 871/1875 [00:04<00:05, 183.32it/s]
Epoch: 7 - loss: 0.133, acc: 0.958 47%|█▉  | 890/1875 [00:04<00:05, 183.13it/s]
Epoch: 7 - loss: 0.132, acc: 0.958 48%|█▉  | 909/1875 [00:04<00:05, 181.95it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 49%|█▉  | 928/1875 [00:05<00:05, 180.61it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 51%|██  | 947/1875 [00:05<00:05, 182.27it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 52%|██  | 966/1875 [00:05<00:04, 183.46it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 53%|██  | 985/1875 [00:05<00:04, 184.83it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 54%|█▌ | 1004/1875 [00:05<00:04, 185.81it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 55%|█▋ | 1023/1875 [00:05<00:04, 184.86it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 56%|█▋ | 1042/1875 [00:05<00:04, 186.37it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 57%|█▋ | 1061/1875 [00:05<00:04, 184.71it/s]
Epoch: 7 - loss: 0.131, acc: 0.959 58%|█▋ | 1080/1875 [00:05<00:04, 184.10it/s]
Epoch: 7 - loss: 0.132, acc: 0.959 59%|█▊ | 1099/1875 [00:05<00:04, 185.29it/s]
Epoch: 7 - loss: 0.133, acc: 0.959 60%|█▊ | 1118/1875 [00:06<00:04, 185.04it/s]
Epoch: 7 - loss: 0.133, acc: 0.959 61%|█▊ | 1137/1875 [00:06<00:03, 185.41it/s]
Epoch: 7 - loss: 0.133, acc: 0.959 62%|█▊ | 1156/1875 [00:06<00:03, 184.05it/s]
Epoch: 7 - loss: 0.133, acc: 0.959 63%|█▉ | 1175/1875 [00:06<00:03, 185.25it/s]
Epoch: 7 - loss: 0.134, acc: 0.959 64%|█▉ | 1194/1875 [00:06<00:03, 184.48it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 65%|█▉ | 1213/1875 [00:06<00:03, 185.55it/s]
Epoch: 7 - loss: 0.134, acc: 0.958 66%|█▉ | 1232/1875 [00:06<00:03, 186.32it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 67%|██ | 1251/1875 [00:06<00:03, 183.60it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 68%|██ | 1270/1875 [00:06<00:03, 184.93it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 69%|██ | 1289/1875 [00:07<00:03, 185.88it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 70%|██ | 1308/1875 [00:07<00:03, 185.45it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 71%|██ | 1327/1875 [00:07<00:02, 185.70it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 72%|██▏| 1346/1875 [00:07<00:02, 186.42it/s]
Epoch: 7 - loss: 0.135, acc: 0.958 73%|██▏| 1365/1875 [00:07<00:02, 186.93it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 74%|██▏| 1384/1875 [00:07<00:02, 187.84it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 75%|██▏| 1403/1875 [00:07<00:02, 184.63it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 76%|██▎| 1422/1875 [00:07<00:02, 184.58it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 77%|██▎| 1442/1875 [00:07<00:02, 185.79it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 78%|██▎| 1461/1875 [00:07<00:02, 185.39it/s]
Epoch: 7 - loss: 0.136, acc: 0.958 79%|██▎| 1480/1875 [00:08<00:02, 183.51it/s]
Epoch: 7 - loss: 0.137, acc: 0.958 80%|██▍| 1500/1875 [00:08<00:02, 185.54it/s]
Epoch: 7 - loss: 0.137, acc: 0.957 81%|██▍| 1519/1875 [00:08<00:01, 183.61it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 82%|██▍| 1538/1875 [00:08<00:01, 184.40it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 83%|██▍| 1557/1875 [00:08<00:01, 183.88it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 84%|██▌| 1576/1875 [00:08<00:01, 184.59it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 85%|██▌| 1595/1875 [00:08<00:01, 182.43it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 86%|██▌| 1614/1875 [00:08<00:01, 183.57it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 87%|██▌| 1634/1875 [00:08<00:01, 185.59it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 88%|██▋| 1653/1875 [00:08<00:01, 183.64it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 89%|██▋| 1672/1875 [00:09<00:01, 184.96it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 90%|██▋| 1691/1875 [00:09<00:00, 185.35it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 91%|██▋| 1710/1875 [00:09<00:00, 185.09it/s]
Epoch: 7 - loss: 0.139, acc: 0.957 92%|██▊| 1729/1875 [00:09<00:00, 184.90it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 93%|██▊| 1748/1875 [00:09<00:00, 184.23it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 94%|██▊| 1768/1875 [00:09<00:00, 185.54it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 95%|██▊| 1787/1875 [00:09<00:00, 185.22it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 96%|██▉| 1806/1875 [00:09<00:00, 186.08it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 97%|██▉| 1825/1875 [00:09<00:00, 185.59it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 98%|██▉| 1844/1875 [00:09<00:00, 186.89it/s]
Epoch: 7 - loss: 0.138, acc: 0.957 99%|██▉| 1863/1875 [00:10<00:00, 186.16it/s]
Epoch: 7 - loss: 0.138, acc: 0.957, val_loss: 0.077, val_acc: 0.977100%|█| 1875/1875 [00:10<00:00, 40.22it/s]
Training:  80%|██████████████████████████▍      | 8/10 [01:27<00:21, 10.97s/it]
Epoch: 8:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 8 - loss: 0.109, acc: 0.970  1%|     | 18/1875 [00:00<00:10, 178.22it/s]
Epoch: 8 - loss: 0.119, acc: 0.962  2%|     | 37/1875 [00:00<00:10, 181.08it/s]
Epoch: 8 - loss: 0.115, acc: 0.963  3%|▏    | 56/1875 [00:00<00:09, 183.13it/s]
Epoch: 8 - loss: 0.124, acc: 0.961  4%|▏    | 75/1875 [00:00<00:09, 183.53it/s]
Epoch: 8 - loss: 0.117, acc: 0.964  5%|▎    | 95/1875 [00:00<00:09, 186.08it/s]
Epoch: 8 - loss: 0.117, acc: 0.964  6%|▏   | 114/1875 [00:00<00:09, 187.24it/s]
Epoch: 8 - loss: 0.118, acc: 0.965  7%|▎   | 133/1875 [00:00<00:09, 186.40it/s]
Epoch: 8 - loss: 0.120, acc: 0.964  8%|▎   | 153/1875 [00:00<00:09, 187.60it/s]
Epoch: 8 - loss: 0.121, acc: 0.962  9%|▎   | 172/1875 [00:00<00:09, 185.56it/s]
Epoch: 8 - loss: 0.118, acc: 0.963 10%|▍   | 192/1875 [00:01<00:08, 187.01it/s]
Epoch: 8 - loss: 0.116, acc: 0.963 11%|▍   | 212/1875 [00:01<00:08, 188.03it/s]
Epoch: 8 - loss: 0.118, acc: 0.963 12%|▍   | 231/1875 [00:01<00:08, 187.50it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 13%|▌   | 250/1875 [00:01<00:08, 186.03it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 14%|▌   | 269/1875 [00:01<00:08, 186.11it/s]
Epoch: 8 - loss: 0.119, acc: 0.963 15%|▌   | 288/1875 [00:01<00:08, 185.61it/s]
Epoch: 8 - loss: 0.119, acc: 0.964 16%|▋   | 307/1875 [00:01<00:08, 186.36it/s]
Epoch: 8 - loss: 0.118, acc: 0.964 17%|▋   | 326/1875 [00:01<00:08, 184.70it/s]
Epoch: 8 - loss: 0.117, acc: 0.964 18%|▋   | 345/1875 [00:01<00:08, 185.71it/s]
Epoch: 8 - loss: 0.118, acc: 0.963 19%|▊   | 365/1875 [00:01<00:08, 187.64it/s]
Epoch: 8 - loss: 0.117, acc: 0.963 20%|▊   | 384/1875 [00:02<00:07, 187.79it/s]
Epoch: 8 - loss: 0.117, acc: 0.963 21%|▊   | 403/1875 [00:02<00:07, 187.89it/s]
Epoch: 8 - loss: 0.118, acc: 0.962 23%|▉   | 422/1875 [00:02<00:07, 186.30it/s]
Epoch: 8 - loss: 0.119, acc: 0.962 24%|▉   | 442/1875 [00:02<00:07, 187.53it/s]
Epoch: 8 - loss: 0.117, acc: 0.962 25%|▉   | 461/1875 [00:02<00:07, 188.27it/s]
Epoch: 8 - loss: 0.117, acc: 0.962 26%|█   | 480/1875 [00:02<00:07, 187.66it/s]
Epoch: 8 - loss: 0.116, acc: 0.962 27%|█   | 499/1875 [00:02<00:07, 184.52it/s]
Epoch: 8 - loss: 0.118, acc: 0.962 28%|█   | 518/1875 [00:02<00:07, 181.85it/s]
Epoch: 8 - loss: 0.119, acc: 0.962 29%|█▏  | 537/1875 [00:02<00:07, 183.16it/s]
Epoch: 8 - loss: 0.119, acc: 0.962 30%|█▏  | 556/1875 [00:02<00:07, 184.08it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 31%|█▏  | 575/1875 [00:03<00:06, 185.82it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 32%|█▎  | 595/1875 [00:03<00:06, 187.19it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 33%|█▎  | 615/1875 [00:03<00:06, 188.16it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 34%|█▎  | 634/1875 [00:03<00:06, 185.40it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 35%|█▍  | 653/1875 [00:03<00:06, 185.12it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 36%|█▍  | 672/1875 [00:03<00:06, 182.79it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 37%|█▍  | 691/1875 [00:03<00:06, 182.23it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 38%|█▌  | 710/1875 [00:03<00:06, 181.33it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 39%|█▌  | 729/1875 [00:03<00:06, 181.21it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 40%|█▌  | 748/1875 [00:04<00:06, 182.18it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 41%|█▋  | 768/1875 [00:04<00:05, 185.62it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 42%|█▋  | 787/1875 [00:04<00:05, 184.73it/s]
Epoch: 8 - loss: 0.120, acc: 0.963 43%|█▋  | 806/1875 [00:04<00:05, 185.19it/s]
Epoch: 8 - loss: 0.119, acc: 0.963 44%|█▊  | 825/1875 [00:04<00:05, 185.51it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 45%|█▊  | 844/1875 [00:04<00:05, 185.74it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 46%|█▊  | 863/1875 [00:04<00:05, 184.28it/s]
Epoch: 8 - loss: 0.120, acc: 0.962 47%|█▉  | 882/1875 [00:04<00:05, 185.41it/s]
Epoch: 8 - loss: 0.121, acc: 0.962 48%|█▉  | 901/1875 [00:04<00:05, 185.67it/s]
Epoch: 8 - loss: 0.121, acc: 0.962 49%|█▉  | 920/1875 [00:04<00:05, 183.70it/s]
Epoch: 8 - loss: 0.122, acc: 0.962 50%|██  | 939/1875 [00:05<00:05, 182.86it/s]
Epoch: 8 - loss: 0.122, acc: 0.962 51%|██  | 958/1875 [00:05<00:05, 183.34it/s]
Epoch: 8 - loss: 0.122, acc: 0.961 52%|██  | 977/1875 [00:05<00:04, 183.15it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 53%|██  | 996/1875 [00:05<00:04, 184.61it/s]
Epoch: 8 - loss: 0.123, acc: 0.961 54%|█▌ | 1015/1875 [00:05<00:04, 184.03it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 55%|█▋ | 1034/1875 [00:05<00:04, 184.16it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 56%|█▋ | 1053/1875 [00:05<00:04, 185.33it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 57%|█▋ | 1072/1875 [00:05<00:04, 185.61it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 58%|█▋ | 1091/1875 [00:05<00:04, 184.19it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 59%|█▊ | 1110/1875 [00:05<00:04, 184.27it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 60%|█▊ | 1129/1875 [00:06<00:04, 183.80it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 61%|█▊ | 1148/1875 [00:06<00:03, 184.00it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 62%|█▊ | 1167/1875 [00:06<00:03, 184.14it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 63%|█▉ | 1186/1875 [00:06<00:03, 185.86it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 64%|█▉ | 1205/1875 [00:06<00:03, 183.29it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 65%|█▉ | 1224/1875 [00:06<00:03, 183.11it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 66%|█▉ | 1243/1875 [00:06<00:03, 180.89it/s]
Epoch: 8 - loss: 0.125, acc: 0.960 67%|██ | 1262/1875 [00:06<00:03, 181.43it/s]
Epoch: 8 - loss: 0.125, acc: 0.960 68%|██ | 1281/1875 [00:06<00:03, 182.33it/s]
Epoch: 8 - loss: 0.125, acc: 0.960 69%|██ | 1301/1875 [00:07<00:03, 184.70it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 70%|██ | 1321/1875 [00:07<00:02, 186.92it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 71%|██▏| 1340/1875 [00:07<00:02, 187.83it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 72%|██▏| 1359/1875 [00:07<00:02, 184.63it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 73%|██▏| 1378/1875 [00:07<00:02, 183.51it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 75%|██▏| 1397/1875 [00:07<00:02, 184.33it/s]
Epoch: 8 - loss: 0.123, acc: 0.961 76%|██▎| 1416/1875 [00:07<00:02, 183.84it/s]
Epoch: 8 - loss: 0.123, acc: 0.961 77%|██▎| 1436/1875 [00:07<00:02, 185.78it/s]
Epoch: 8 - loss: 0.123, acc: 0.961 78%|██▎| 1455/1875 [00:07<00:02, 183.77it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 79%|██▎| 1474/1875 [00:07<00:02, 182.39it/s]
Epoch: 8 - loss: 0.124, acc: 0.961 80%|██▍| 1493/1875 [00:08<00:02, 183.54it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 81%|██▍| 1512/1875 [00:08<00:01, 182.75it/s]
Epoch: 8 - loss: 0.125, acc: 0.961 82%|██▍| 1531/1875 [00:08<00:01, 184.33it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 83%|██▍| 1550/1875 [00:08<00:01, 184.37it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 84%|██▌| 1569/1875 [00:08<00:01, 184.94it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 85%|██▌| 1588/1875 [00:08<00:01, 180.58it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 86%|██▌| 1607/1875 [00:08<00:01, 181.73it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 87%|██▌| 1626/1875 [00:08<00:01, 182.54it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 88%|██▋| 1645/1875 [00:08<00:01, 183.11it/s]
Epoch: 8 - loss: 0.126, acc: 0.961 89%|██▋| 1664/1875 [00:09<00:01, 184.05it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 90%|██▋| 1683/1875 [00:09<00:01, 183.64it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 91%|██▋| 1702/1875 [00:09<00:00, 184.42it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 92%|██▊| 1721/1875 [00:09<00:00, 184.98it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 93%|██▊| 1740/1875 [00:09<00:00, 186.45it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 94%|██▊| 1759/1875 [00:09<00:00, 186.95it/s]
Epoch: 8 - loss: 0.127, acc: 0.961 95%|██▊| 1778/1875 [00:09<00:00, 186.20it/s]
Epoch: 8 - loss: 0.128, acc: 0.961 96%|██▉| 1797/1875 [00:09<00:00, 183.52it/s]
Epoch: 8 - loss: 0.128, acc: 0.961 97%|██▉| 1816/1875 [00:09<00:00, 184.88it/s]
Epoch: 8 - loss: 0.128, acc: 0.961 98%|██▉| 1835/1875 [00:09<00:00, 184.75it/s]
Epoch: 8 - loss: 0.128, acc: 0.960 99%|██▉| 1854/1875 [00:10<00:00, 185.21it/s]
Epoch: 8 - loss: 0.128, acc: 0.960100%|██▉| 1873/1875 [00:10<00:00, 184.45it/s]
Epoch: 8 - loss: 0.129, acc: 0.960, val_loss: 0.083, val_acc: 0.975100%|█| 1875/1875 [00:10<00:00,  7.98it/s]
Training:  90%|█████████████████████████████▋   | 9/10 [01:38<00:10, 10.96s/it]
Epoch: 9:   0%|                                       | 0/1875 [00:00<?, ?it/s]
Epoch: 9 - loss: 0.121, acc: 0.962  1%|     | 18/1875 [00:00<00:10, 171.43it/s]
Epoch: 9 - loss: 0.110, acc: 0.964  2%|     | 37/1875 [00:00<00:10, 175.63it/s]
Epoch: 9 - loss: 0.116, acc: 0.963  3%|▏    | 56/1875 [00:00<00:10, 178.69it/s]
Epoch: 9 - loss: 0.111, acc: 0.963  4%|▏    | 75/1875 [00:00<00:09, 180.39it/s]
Epoch: 9 - loss: 0.114, acc: 0.962  5%|▎    | 94/1875 [00:00<00:09, 181.59it/s]
Epoch: 9 - loss: 0.113, acc: 0.963  6%|▏   | 112/1875 [00:00<00:09, 181.11it/s]
Epoch: 9 - loss: 0.110, acc: 0.964  7%|▎   | 131/1875 [00:00<00:09, 182.10it/s]
Epoch: 9 - loss: 0.111, acc: 0.963  8%|▎   | 151/1875 [00:00<00:09, 185.05it/s]
Epoch: 9 - loss: 0.116, acc: 0.962  9%|▎   | 170/1875 [00:00<00:09, 185.42it/s]
Epoch: 9 - loss: 0.118, acc: 0.962 10%|▍   | 189/1875 [00:01<00:09, 185.67it/s]
Epoch: 9 - loss: 0.117, acc: 0.962 11%|▍   | 208/1875 [00:01<00:08, 185.85it/s]
Epoch: 9 - loss: 0.118, acc: 0.962 12%|▍   | 227/1875 [00:01<00:09, 182.76it/s]
Epoch: 9 - loss: 0.120, acc: 0.962 13%|▌   | 246/1875 [00:01<00:08, 181.69it/s]
Epoch: 9 - loss: 0.120, acc: 0.962 14%|▌   | 265/1875 [00:01<00:08, 182.51it/s]
Epoch: 9 - loss: 0.120, acc: 0.962 15%|▌   | 284/1875 [00:01<00:08, 183.63it/s]
Epoch: 9 - loss: 0.123, acc: 0.962 16%|▋   | 303/1875 [00:01<00:08, 183.35it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 17%|▋   | 322/1875 [00:01<00:08, 184.75it/s]
Epoch: 9 - loss: 0.125, acc: 0.961 18%|▋   | 341/1875 [00:01<00:08, 185.75it/s]
Epoch: 9 - loss: 0.125, acc: 0.961 19%|▊   | 360/1875 [00:01<00:08, 185.91it/s]
Epoch: 9 - loss: 0.126, acc: 0.961 20%|▊   | 379/1875 [00:02<00:08, 185.47it/s]
Epoch: 9 - loss: 0.124, acc: 0.962 21%|▊   | 398/1875 [00:02<00:07, 186.26it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 22%|▉   | 417/1875 [00:02<00:07, 184.63it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 23%|▉   | 436/1875 [00:02<00:07, 185.12it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 24%|▉   | 455/1875 [00:02<00:07, 186.01it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 25%|█   | 474/1875 [00:02<00:07, 186.64it/s]
Epoch: 9 - loss: 0.126, acc: 0.961 26%|█   | 493/1875 [00:02<00:07, 187.63it/s]
Epoch: 9 - loss: 0.126, acc: 0.961 27%|█   | 512/1875 [00:02<00:07, 187.22it/s]
Epoch: 9 - loss: 0.125, acc: 0.961 28%|█▏  | 531/1875 [00:02<00:07, 185.84it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 29%|█▏  | 550/1875 [00:02<00:07, 185.97it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 30%|█▏  | 569/1875 [00:03<00:06, 186.61it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 31%|█▎  | 589/1875 [00:03<00:06, 187.75it/s]
Epoch: 9 - loss: 0.121, acc: 0.961 32%|█▎  | 608/1875 [00:03<00:06, 187.31it/s]
Epoch: 9 - loss: 0.122, acc: 0.961 33%|█▎  | 627/1875 [00:03<00:06, 184.81it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 34%|█▍  | 646/1875 [00:03<00:06, 185.25it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 35%|█▍  | 665/1875 [00:03<00:06, 186.10it/s]
Epoch: 9 - loss: 0.122, acc: 0.961 36%|█▍  | 684/1875 [00:03<00:06, 184.53it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 37%|█▍  | 703/1875 [00:03<00:06, 183.44it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 39%|█▌  | 722/1875 [00:03<00:06, 183.75it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 40%|█▌  | 741/1875 [00:04<00:06, 183.96it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 41%|█▌  | 760/1875 [00:04<00:06, 184.11it/s]
Epoch: 9 - loss: 0.123, acc: 0.961 42%|█▋  | 779/1875 [00:04<00:05, 184.76it/s]
Epoch: 9 - loss: 0.124, acc: 0.961 43%|█▋  | 798/1875 [00:04<00:05, 185.75it/s]
Epoch: 9 - loss: 0.125, acc: 0.961 44%|█▋  | 817/1875 [00:04<00:05, 184.29it/s]
Epoch: 9 - loss: 0.126, acc: 0.960 45%|█▊  | 836/1875 [00:04<00:05, 183.80it/s]
Epoch: 9 - loss: 0.126, acc: 0.960 46%|█▊  | 855/1875 [00:04<00:05, 185.08it/s]
Epoch: 9 - loss: 0.127, acc: 0.960 47%|█▊  | 875/1875 [00:04<00:05, 186.67it/s]
Epoch: 9 - loss: 0.127, acc: 0.960 48%|█▉  | 894/1875 [00:04<00:05, 186.00it/s]
Epoch: 9 - loss: 0.127, acc: 0.960 49%|█▉  | 913/1875 [00:04<00:05, 185.54it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 50%|█▉  | 932/1875 [00:05<00:05, 185.76it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 51%|██  | 951/1875 [00:05<00:04, 186.46it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 52%|██  | 970/1875 [00:05<00:04, 184.77it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 53%|██  | 989/1875 [00:05<00:04, 184.68it/s]
Epoch: 9 - loss: 0.129, acc: 0.959 54%|█▌ | 1008/1875 [00:05<00:04, 186.24it/s]
Epoch: 9 - loss: 0.129, acc: 0.959 55%|█▋ | 1027/1875 [00:05<00:04, 185.16it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 56%|█▋ | 1046/1875 [00:05<00:04, 183.88it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 57%|█▋ | 1065/1875 [00:05<00:04, 185.13it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 58%|█▋ | 1084/1875 [00:05<00:04, 184.93it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 59%|█▊ | 1103/1875 [00:05<00:04, 185.33it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 60%|█▊ | 1122/1875 [00:06<00:04, 185.07it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 61%|█▊ | 1141/1875 [00:06<00:03, 185.98it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 62%|█▊ | 1160/1875 [00:06<00:03, 186.61it/s]
Epoch: 9 - loss: 0.131, acc: 0.959 63%|█▉ | 1179/1875 [00:06<00:03, 185.42it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 64%|█▉ | 1198/1875 [00:06<00:03, 185.13it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 65%|█▉ | 1217/1875 [00:06<00:03, 185.47it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 66%|█▉ | 1236/1875 [00:06<00:03, 185.71it/s]
Epoch: 9 - loss: 0.131, acc: 0.959 67%|██ | 1255/1875 [00:06<00:03, 186.43it/s]
Epoch: 9 - loss: 0.131, acc: 0.959 68%|██ | 1274/1875 [00:06<00:03, 186.38it/s]
Epoch: 9 - loss: 0.131, acc: 0.959 69%|██ | 1293/1875 [00:06<00:03, 185.26it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 70%|██ | 1312/1875 [00:07<00:03, 185.02it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 71%|██▏| 1331/1875 [00:07<00:02, 182.72it/s]
Epoch: 9 - loss: 0.130, acc: 0.959 72%|██▏| 1350/1875 [00:07<00:02, 182.71it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 73%|██▏| 1369/1875 [00:07<00:02, 182.71it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 74%|██▏| 1388/1875 [00:07<00:02, 180.62it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 75%|██▎| 1407/1875 [00:07<00:02, 182.28it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 76%|██▎| 1426/1875 [00:07<00:02, 181.88it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 77%|██▎| 1445/1875 [00:07<00:02, 182.65it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 78%|██▎| 1464/1875 [00:07<00:02, 183.72it/s]
Epoch: 9 - loss: 0.130, acc: 0.960 79%|██▎| 1483/1875 [00:08<00:02, 184.48it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 80%|██▍| 1502/1875 [00:08<00:02, 185.01it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 81%|██▍| 1522/1875 [00:08<00:01, 187.14it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 82%|██▍| 1542/1875 [00:08<00:01, 188.13it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 83%|██▍| 1561/1875 [00:08<00:01, 188.13it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 84%|██▌| 1580/1875 [00:08<00:01, 188.12it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 85%|██▌| 1599/1875 [00:08<00:01, 185.91it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 86%|██▌| 1618/1875 [00:08<00:01, 184.40it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 87%|██▌| 1637/1875 [00:08<00:01, 184.96it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 88%|██▋| 1656/1875 [00:08<00:01, 182.68it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 89%|██▋| 1675/1875 [00:09<00:01, 183.21it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 90%|██▋| 1694/1875 [00:09<00:00, 183.05it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 91%|██▋| 1713/1875 [00:09<00:00, 183.48it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 92%|██▊| 1732/1875 [00:09<00:00, 184.84it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 93%|██▊| 1751/1875 [00:09<00:00, 185.27it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 94%|██▊| 1770/1875 [00:09<00:00, 184.49it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 95%|██▊| 1789/1875 [00:09<00:00, 184.48it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 96%|██▉| 1808/1875 [00:09<00:00, 185.56it/s]
Epoch: 9 - loss: 0.128, acc: 0.960 97%|██▉| 1827/1875 [00:09<00:00, 184.69it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 98%|██▉| 1846/1875 [00:09<00:00, 184.09it/s]
Epoch: 9 - loss: 0.129, acc: 0.960 99%|██▉| 1865/1875 [00:10<00:00, 183.13it/s]
Epoch: 9 - loss: 0.129, acc: 0.960, val_loss: 0.072, val_acc: 0.978100%|█| 1875/1875 [00:10<00:00, 34.46it/s]
Training: 100%|████████████████████████████████| 10/10 [01:49<00:00, 10.96s/it]