Convolutional Autoencoder

Sticking with the MNIST dataset, let's improve our autoencoder's performance using convolutional layers. Again, loading modules and the data.



In [1]:

    
%matplotlib inline

import numpy as np
import tensorflow as tf
import matplotlib.pyplot as plt



In [2]:

    
from tensorflow.examples.tutorials.mnist import input_data
mnist = input_data.read_data_sets('MNIST_data', validation_size=0)









    



Extracting MNIST_data/train-images-idx3-ubyte.gz
Extracting MNIST_data/train-labels-idx1-ubyte.gz
Extracting MNIST_data/t10k-images-idx3-ubyte.gz
Extracting MNIST_data/t10k-labels-idx1-ubyte.gz



In [3]:

    
img = mnist.train.images[2]
plt.imshow(img.reshape((28, 28)), cmap='Greys_r')









    Out[3]:





<matplotlib.image.AxesImage at 0x11f13a048>

Network Architecture

The encoder part of the network will be a typical convolutional pyramid. Each convolutional layer will be followed by a max-pooling layer to reduce the dimensions of the layers. The decoder though might be something new to you. The decoder needs to convert from a narrow representation to a wide reconstructed image. For example, the representation could be a 4x4x8 max-pool layer. This is the output of the encoder, but also the input to the decoder. We want to get a 28x28x1 image out from the decoder so we need to work our way back up from the narrow decoder input layer. A schematic of the network is shown below.

Here our final encoder layer has size 4x4x8 = 128. The original images have size 28x28 = 784, so the encoded vector is roughly 16% the size of the original image. These are just suggested sizes for each of the layers. Feel free to change the depths and sizes, but remember our goal here is to find a small representation of the input data.

What's going on with the decoder

Okay, so the decoder has these "Upsample" layers that you might not have seen before. First off, I'll discuss a bit what these layers aren't. Usually, you'll see deconvolutional layers used to increase the width and height of the layers. They work almost exactly the same as convolutional layers, but it reverse. A stride in the input layer results in a larger stride in the deconvolutional layer. For example, if you have a 3x3 kernel, a 3x3 patch in the input layer will be reduced to one unit in a convolutional layer. Comparatively, one unit in the input layer will be expanded to a 3x3 path in a deconvolutional layer. Deconvolution is often called "transpose convolution" which is what you'll find with the TensorFlow API, with tf.nn.conv2d_transpose.

However, deconvolutional layers can lead to artifacts in the final images, such as checkerboard patterns. This is due to overlap in the kernels which can be avoided by setting the stride and kernel size equal. In this Distill article from Augustus Odena, et al, the authors show that these checkerboard artifacts can be avoided by resizing the layers using nearest neighbor or bilinear interpolation (upsampling) followed by a convolutional layer. In TensorFlow, this is easily done with tf.image.resize_images, followed by a convolution. Be sure to read the Distill article to get a better understanding of deconvolutional layers and why we're using upsampling.

Exercise: Build the network shown above. Remember that a convolutional layer with strides of 1 and 'same' padding won't reduce the height and width. That is, if the input is 28x28 and the convolution layer has stride = 1 and 'same' padding, the convolutional layer will also be 28x28. The max-pool layers are used the reduce the width and height. A stride of 2 will reduce the size by 2. Odena et al claim that nearest neighbor interpolation works best for the upsampling, so make sure to include that as a parameter in tf.image.resize_images or use tf.image.resize_nearest_neighbor.



In [7]:

    
learning_rate = 0.001
inputs_ = tf.placeholder(tf.float32, (None, 28, 28, 1), name='input')
targets_ = tf.placeholder(tf.float32, (None, 28, 28, 1), name='input')

### Encoder
conv1 = tf.layers.conv2d(inputs_, 16, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 28x28x16
maxpool1 = tf.layers.max_pooling2d(conv1, (2, 2), (2, 2), padding='SAME')
# Now 14x14x16
conv2 = tf.layers.conv2d(maxpool1, 8, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 14x14x8
maxpool2 = tf.layers.max_pooling2d(conv2, (2, 2), (2, 2), padding='SAME')
# Now 7x7x8
conv3 = tf.layers.conv2d(maxpool2, 8, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 7x7x8
encoded = tf.layers.max_pooling2d(conv3, (2, 2), (2, 2), padding='SAME')
# Now 4x4x8

### Decoder
upsample1 = tf.image.resize_nearest_neighbor(encoded, (7, 7))
# Now 7x7x8
conv4 = tf.layers.conv2d(upsample1, 8, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 7x7x8
upsample2 = tf.image.resize_nearest_neighbor(conv4, (14, 14))
# Now 14x14x8
conv5 = tf.layers.conv2d(upsample2, 8, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 14x14x8
upsample3 = tf.image.resize_nearest_neighbor(conv5, (28, 28))
# Now 28x28x8
conv6 = tf.layers.conv2d(upsample3, 16, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 28x28x16

logits = tf.layers.conv2d(conv6, 1, (3, 3), padding='SAME', activation=None)
#Now 28x28x1

# Pass logits through sigmoid to get reconstructed image
decoded = tf.nn.sigmoid(logits)

# Pass logits through sigmoid and calculate the cross-entropy loss
loss = tf.nn.sigmoid_cross_entropy_with_logits(labels=targets_, logits=logits)

# Get cost and define the optimizer
cost = tf.reduce_mean(loss)
opt = tf.train.AdamOptimizer(learning_rate).minimize(cost)

Training

As before, here wi'll train the network. Instead of flattening the images though, we can pass them in as 28x28x1 arrays.



In [8]:

    
sess = tf.Session()



In [9]:

    
epochs = 20
batch_size = 200
sess.run(tf.global_variables_initializer())
for e in range(epochs):
    for ii in range(mnist.train.num_examples//batch_size):
        batch = mnist.train.next_batch(batch_size)
        imgs = batch[0].reshape((-1, 28, 28, 1))
        batch_cost, _ = sess.run([cost, opt], feed_dict={inputs_: imgs,
                                                         targets_: imgs})

        print("Epoch: {}/{}...".format(e+1, epochs),
              "Training loss: {:.4f}".format(batch_cost))









    



Epoch: 1/20... Training loss: 0.7062
Epoch: 1/20... Training loss: 0.6997
Epoch: 1/20... Training loss: 0.6952
Epoch: 1/20... Training loss: 0.6922
Epoch: 1/20... Training loss: 0.6902
Epoch: 1/20... Training loss: 0.6886
Epoch: 1/20... Training loss: 0.6873
Epoch: 1/20... Training loss: 0.6860
Epoch: 1/20... Training loss: 0.6847
Epoch: 1/20... Training loss: 0.6831
Epoch: 1/20... Training loss: 0.6814
Epoch: 1/20... Training loss: 0.6794
Epoch: 1/20... Training loss: 0.6771
Epoch: 1/20... Training loss: 0.6742
Epoch: 1/20... Training loss: 0.6705
Epoch: 1/20... Training loss: 0.6669
Epoch: 1/20... Training loss: 0.6614
Epoch: 1/20... Training loss: 0.6560
Epoch: 1/20... Training loss: 0.6484
Epoch: 1/20... Training loss: 0.6399
Epoch: 1/20... Training loss: 0.6303
Epoch: 1/20... Training loss: 0.6191
Epoch: 1/20... Training loss: 0.6054
Epoch: 1/20... Training loss: 0.5905
Epoch: 1/20... Training loss: 0.5761
Epoch: 1/20... Training loss: 0.5607
Epoch: 1/20... Training loss: 0.5426
Epoch: 1/20... Training loss: 0.5371
Epoch: 1/20... Training loss: 0.5257
Epoch: 1/20... Training loss: 0.5249
Epoch: 1/20... Training loss: 0.5219
Epoch: 1/20... Training loss: 0.5329
Epoch: 1/20... Training loss: 0.5243
Epoch: 1/20... Training loss: 0.5116
Epoch: 1/20... Training loss: 0.5258
Epoch: 1/20... Training loss: 0.5018
Epoch: 1/20... Training loss: 0.4937
Epoch: 1/20... Training loss: 0.4843
Epoch: 1/20... Training loss: 0.4794
Epoch: 1/20... Training loss: 0.4744
Epoch: 1/20... Training loss: 0.4728
Epoch: 1/20... Training loss: 0.4593
Epoch: 1/20... Training loss: 0.4542
Epoch: 1/20... Training loss: 0.4474
Epoch: 1/20... Training loss: 0.4406
Epoch: 1/20... Training loss: 0.4275
Epoch: 1/20... Training loss: 0.4150
Epoch: 1/20... Training loss: 0.4249
Epoch: 1/20... Training loss: 0.4125
Epoch: 1/20... Training loss: 0.4043
Epoch: 1/20... Training loss: 0.4048
Epoch: 1/20... Training loss: 0.3893
Epoch: 1/20... Training loss: 0.3867
Epoch: 1/20... Training loss: 0.3760
Epoch: 1/20... Training loss: 0.3633
Epoch: 1/20... Training loss: 0.3636
Epoch: 1/20... Training loss: 0.3518
Epoch: 1/20... Training loss: 0.3490
Epoch: 1/20... Training loss: 0.3455
Epoch: 1/20... Training loss: 0.3410
Epoch: 1/20... Training loss: 0.3265
Epoch: 1/20... Training loss: 0.3195
Epoch: 1/20... Training loss: 0.3209
Epoch: 1/20... Training loss: 0.3134
Epoch: 1/20... Training loss: 0.3108
Epoch: 1/20... Training loss: 0.3053
Epoch: 1/20... Training loss: 0.2990
Epoch: 1/20... Training loss: 0.2983
Epoch: 1/20... Training loss: 0.2937
Epoch: 1/20... Training loss: 0.2908
Epoch: 1/20... Training loss: 0.2899
Epoch: 1/20... Training loss: 0.2818
Epoch: 1/20... Training loss: 0.2830
Epoch: 1/20... Training loss: 0.2674
Epoch: 1/20... Training loss: 0.2786
Epoch: 1/20... Training loss: 0.2727
Epoch: 1/20... Training loss: 0.2850
Epoch: 1/20... Training loss: 0.2664
Epoch: 1/20... Training loss: 0.2628
Epoch: 1/20... Training loss: 0.2579
Epoch: 1/20... Training loss: 0.2631
Epoch: 1/20... Training loss: 0.2601
Epoch: 1/20... Training loss: 0.2626
Epoch: 1/20... Training loss: 0.2531
Epoch: 1/20... Training loss: 0.2515
Epoch: 1/20... Training loss: 0.2505
Epoch: 1/20... Training loss: 0.2487
Epoch: 1/20... Training loss: 0.2457
Epoch: 1/20... Training loss: 0.2546
Epoch: 1/20... Training loss: 0.2532
Epoch: 1/20... Training loss: 0.2431
Epoch: 1/20... Training loss: 0.2424
Epoch: 1/20... Training loss: 0.2370
Epoch: 1/20... Training loss: 0.2425
Epoch: 1/20... Training loss: 0.2432
Epoch: 1/20... Training loss: 0.2331
Epoch: 1/20... Training loss: 0.2381
Epoch: 1/20... Training loss: 0.2391
Epoch: 1/20... Training loss: 0.2389
Epoch: 1/20... Training loss: 0.2266
Epoch: 1/20... Training loss: 0.2283
Epoch: 1/20... Training loss: 0.2328
Epoch: 1/20... Training loss: 0.2239
Epoch: 1/20... Training loss: 0.2198
Epoch: 1/20... Training loss: 0.2325
Epoch: 1/20... Training loss: 0.2277
Epoch: 1/20... Training loss: 0.2209
Epoch: 1/20... Training loss: 0.2265
Epoch: 1/20... Training loss: 0.2234
Epoch: 1/20... Training loss: 0.2189
Epoch: 1/20... Training loss: 0.2210
Epoch: 1/20... Training loss: 0.2190
Epoch: 1/20... Training loss: 0.2246
Epoch: 1/20... Training loss: 0.2221
Epoch: 1/20... Training loss: 0.2206
Epoch: 1/20... Training loss: 0.2154
Epoch: 1/20... Training loss: 0.2120
Epoch: 1/20... Training loss: 0.2144
Epoch: 1/20... Training loss: 0.2181
Epoch: 1/20... Training loss: 0.2153
Epoch: 1/20... Training loss: 0.2119
Epoch: 1/20... Training loss: 0.2146
Epoch: 1/20... Training loss: 0.2144
Epoch: 1/20... Training loss: 0.2137
Epoch: 1/20... Training loss: 0.2129
Epoch: 1/20... Training loss: 0.2122
Epoch: 1/20... Training loss: 0.2086
Epoch: 1/20... Training loss: 0.2034
Epoch: 1/20... Training loss: 0.2154
Epoch: 1/20... Training loss: 0.2000
Epoch: 1/20... Training loss: 0.2098
Epoch: 1/20... Training loss: 0.2141
Epoch: 1/20... Training loss: 0.2105
Epoch: 1/20... Training loss: 0.2045
Epoch: 1/20... Training loss: 0.2079
Epoch: 1/20... Training loss: 0.1995
Epoch: 1/20... Training loss: 0.2010
Epoch: 1/20... Training loss: 0.1969
Epoch: 1/20... Training loss: 0.2010
Epoch: 1/20... Training loss: 0.2000
Epoch: 1/20... Training loss: 0.1991
Epoch: 1/20... Training loss: 0.1990
Epoch: 1/20... Training loss: 0.2011
Epoch: 1/20... Training loss: 0.1981
Epoch: 1/20... Training loss: 0.2020
Epoch: 1/20... Training loss: 0.1988
Epoch: 1/20... Training loss: 0.1890
Epoch: 1/20... Training loss: 0.1923
Epoch: 1/20... Training loss: 0.1898
Epoch: 1/20... Training loss: 0.1913
Epoch: 1/20... Training loss: 0.1945
Epoch: 1/20... Training loss: 0.1958
Epoch: 1/20... Training loss: 0.1919
Epoch: 1/20... Training loss: 0.1937
Epoch: 1/20... Training loss: 0.1941
Epoch: 1/20... Training loss: 0.1842
Epoch: 1/20... Training loss: 0.1839
Epoch: 1/20... Training loss: 0.1890
Epoch: 1/20... Training loss: 0.1914
Epoch: 1/20... Training loss: 0.1853
Epoch: 1/20... Training loss: 0.1861
Epoch: 1/20... Training loss: 0.1792
Epoch: 1/20... Training loss: 0.1776
Epoch: 1/20... Training loss: 0.1856
Epoch: 1/20... Training loss: 0.1868
Epoch: 1/20... Training loss: 0.1854
Epoch: 1/20... Training loss: 0.1908
Epoch: 1/20... Training loss: 0.1841
Epoch: 1/20... Training loss: 0.1864
Epoch: 1/20... Training loss: 0.1838
Epoch: 1/20... Training loss: 0.1890
Epoch: 1/20... Training loss: 0.1849
Epoch: 1/20... Training loss: 0.1805
Epoch: 1/20... Training loss: 0.1724
Epoch: 1/20... Training loss: 0.1857
Epoch: 1/20... Training loss: 0.1806
Epoch: 1/20... Training loss: 0.1819
Epoch: 1/20... Training loss: 0.1831
Epoch: 1/20... Training loss: 0.1850
Epoch: 1/20... Training loss: 0.1816
Epoch: 1/20... Training loss: 0.1806
Epoch: 1/20... Training loss: 0.1769
Epoch: 1/20... Training loss: 0.1760
Epoch: 1/20... Training loss: 0.1765
Epoch: 1/20... Training loss: 0.1742
Epoch: 1/20... Training loss: 0.1741
Epoch: 1/20... Training loss: 0.1812
Epoch: 1/20... Training loss: 0.1860
Epoch: 1/20... Training loss: 0.1767
Epoch: 1/20... Training loss: 0.1803
Epoch: 1/20... Training loss: 0.1766
Epoch: 1/20... Training loss: 0.1727
Epoch: 1/20... Training loss: 0.1779
Epoch: 1/20... Training loss: 0.1742
Epoch: 1/20... Training loss: 0.1753
Epoch: 1/20... Training loss: 0.1789
Epoch: 1/20... Training loss: 0.1749
Epoch: 1/20... Training loss: 0.1692
Epoch: 1/20... Training loss: 0.1734
Epoch: 1/20... Training loss: 0.1771
Epoch: 1/20... Training loss: 0.1686
Epoch: 1/20... Training loss: 0.1729
Epoch: 1/20... Training loss: 0.1640
Epoch: 1/20... Training loss: 0.1766
Epoch: 1/20... Training loss: 0.1717
Epoch: 1/20... Training loss: 0.1735
Epoch: 1/20... Training loss: 0.1722
Epoch: 1/20... Training loss: 0.1779
Epoch: 1/20... Training loss: 0.1695
Epoch: 1/20... Training loss: 0.1661
Epoch: 1/20... Training loss: 0.1734
Epoch: 1/20... Training loss: 0.1719
Epoch: 1/20... Training loss: 0.1695
Epoch: 1/20... Training loss: 0.1717
Epoch: 1/20... Training loss: 0.1658
Epoch: 1/20... Training loss: 0.1694
Epoch: 1/20... Training loss: 0.1693
Epoch: 1/20... Training loss: 0.1673
Epoch: 1/20... Training loss: 0.1745
Epoch: 1/20... Training loss: 0.1664
Epoch: 1/20... Training loss: 0.1668
Epoch: 1/20... Training loss: 0.1682
Epoch: 1/20... Training loss: 0.1697
Epoch: 1/20... Training loss: 0.1629
Epoch: 1/20... Training loss: 0.1697
Epoch: 1/20... Training loss: 0.1680
Epoch: 1/20... Training loss: 0.1621
Epoch: 1/20... Training loss: 0.1757
Epoch: 1/20... Training loss: 0.1665
Epoch: 1/20... Training loss: 0.1706
Epoch: 1/20... Training loss: 0.1681
Epoch: 1/20... Training loss: 0.1689
Epoch: 1/20... Training loss: 0.1695
Epoch: 1/20... Training loss: 0.1611
Epoch: 1/20... Training loss: 0.1644
Epoch: 1/20... Training loss: 0.1689
Epoch: 1/20... Training loss: 0.1667
Epoch: 1/20... Training loss: 0.1660
Epoch: 1/20... Training loss: 0.1673
Epoch: 1/20... Training loss: 0.1659
Epoch: 1/20... Training loss: 0.1602
Epoch: 1/20... Training loss: 0.1611
Epoch: 1/20... Training loss: 0.1660
Epoch: 1/20... Training loss: 0.1613
Epoch: 1/20... Training loss: 0.1635
Epoch: 1/20... Training loss: 0.1639
Epoch: 1/20... Training loss: 0.1669
Epoch: 1/20... Training loss: 0.1636
Epoch: 1/20... Training loss: 0.1568
Epoch: 1/20... Training loss: 0.1602
Epoch: 1/20... Training loss: 0.1657
Epoch: 1/20... Training loss: 0.1704
Epoch: 1/20... Training loss: 0.1599
Epoch: 1/20... Training loss: 0.1603
Epoch: 1/20... Training loss: 0.1558
Epoch: 1/20... Training loss: 0.1590
Epoch: 1/20... Training loss: 0.1607
Epoch: 1/20... Training loss: 0.1576
Epoch: 1/20... Training loss: 0.1605
Epoch: 1/20... Training loss: 0.1559
Epoch: 1/20... Training loss: 0.1557
Epoch: 1/20... Training loss: 0.1617
Epoch: 1/20... Training loss: 0.1596
Epoch: 1/20... Training loss: 0.1607
Epoch: 1/20... Training loss: 0.1603
Epoch: 1/20... Training loss: 0.1588
Epoch: 1/20... Training loss: 0.1628
Epoch: 1/20... Training loss: 0.1543
Epoch: 1/20... Training loss: 0.1620
Epoch: 1/20... Training loss: 0.1632
Epoch: 1/20... Training loss: 0.1513
Epoch: 1/20... Training loss: 0.1605
Epoch: 1/20... Training loss: 0.1599
Epoch: 1/20... Training loss: 0.1556
Epoch: 1/20... Training loss: 0.1590
Epoch: 1/20... Training loss: 0.1569
Epoch: 1/20... Training loss: 0.1588
Epoch: 1/20... Training loss: 0.1523
Epoch: 1/20... Training loss: 0.1617
Epoch: 1/20... Training loss: 0.1552
Epoch: 1/20... Training loss: 0.1584
Epoch: 1/20... Training loss: 0.1611
Epoch: 1/20... Training loss: 0.1541
Epoch: 1/20... Training loss: 0.1510
Epoch: 1/20... Training loss: 0.1553
Epoch: 1/20... Training loss: 0.1607
Epoch: 1/20... Training loss: 0.1563
Epoch: 1/20... Training loss: 0.1539
Epoch: 1/20... Training loss: 0.1547
Epoch: 1/20... Training loss: 0.1573
Epoch: 1/20... Training loss: 0.1601
Epoch: 1/20... Training loss: 0.1557
Epoch: 1/20... Training loss: 0.1542
Epoch: 1/20... Training loss: 0.1538
Epoch: 1/20... Training loss: 0.1538
Epoch: 1/20... Training loss: 0.1566
Epoch: 1/20... Training loss: 0.1534
Epoch: 1/20... Training loss: 0.1553
Epoch: 1/20... Training loss: 0.1532
Epoch: 1/20... Training loss: 0.1522
Epoch: 2/20... Training loss: 0.1516
Epoch: 2/20... Training loss: 0.1590
Epoch: 2/20... Training loss: 0.1522
Epoch: 2/20... Training loss: 0.1565
Epoch: 2/20... Training loss: 0.1578
Epoch: 2/20... Training loss: 0.1536
Epoch: 2/20... Training loss: 0.1550
Epoch: 2/20... Training loss: 0.1520
Epoch: 2/20... Training loss: 0.1505
Epoch: 2/20... Training loss: 0.1517
Epoch: 2/20... Training loss: 0.1567
Epoch: 2/20... Training loss: 0.1522
Epoch: 2/20... Training loss: 0.1545
Epoch: 2/20... Training loss: 0.1520
Epoch: 2/20... Training loss: 0.1545
Epoch: 2/20... Training loss: 0.1558
Epoch: 2/20... Training loss: 0.1539
Epoch: 2/20... Training loss: 0.1496
Epoch: 2/20... Training loss: 0.1527
Epoch: 2/20... Training loss: 0.1454
Epoch: 2/20... Training loss: 0.1551
Epoch: 2/20... Training loss: 0.1466
Epoch: 2/20... Training loss: 0.1448
Epoch: 2/20... Training loss: 0.1497
Epoch: 2/20... Training loss: 0.1483
Epoch: 2/20... Training loss: 0.1489
Epoch: 2/20... Training loss: 0.1480
Epoch: 2/20... Training loss: 0.1532
Epoch: 2/20... Training loss: 0.1436
Epoch: 2/20... Training loss: 0.1526
Epoch: 2/20... Training loss: 0.1470
Epoch: 2/20... Training loss: 0.1502
Epoch: 2/20... Training loss: 0.1467
Epoch: 2/20... Training loss: 0.1471
Epoch: 2/20... Training loss: 0.1505
Epoch: 2/20... Training loss: 0.1494
Epoch: 2/20... Training loss: 0.1528
Epoch: 2/20... Training loss: 0.1505
Epoch: 2/20... Training loss: 0.1460
Epoch: 2/20... Training loss: 0.1505
Epoch: 2/20... Training loss: 0.1501
Epoch: 2/20... Training loss: 0.1438
Epoch: 2/20... Training loss: 0.1435
Epoch: 2/20... Training loss: 0.1447
Epoch: 2/20... Training loss: 0.1518
Epoch: 2/20... Training loss: 0.1460
Epoch: 2/20... Training loss: 0.1483
Epoch: 2/20... Training loss: 0.1552
Epoch: 2/20... Training loss: 0.1456
Epoch: 2/20... Training loss: 0.1483
Epoch: 2/20... Training loss: 0.1442
Epoch: 2/20... Training loss: 0.1440
Epoch: 2/20... Training loss: 0.1530
Epoch: 2/20... Training loss: 0.1513
Epoch: 2/20... Training loss: 0.1472
Epoch: 2/20... Training loss: 0.1490
Epoch: 2/20... Training loss: 0.1466
Epoch: 2/20... Training loss: 0.1514
Epoch: 2/20... Training loss: 0.1469
Epoch: 2/20... Training loss: 0.1489
Epoch: 2/20... Training loss: 0.1487
Epoch: 2/20... Training loss: 0.1432
Epoch: 2/20... Training loss: 0.1426
Epoch: 2/20... Training loss: 0.1479
Epoch: 2/20... Training loss: 0.1454
Epoch: 2/20... Training loss: 0.1437
Epoch: 2/20... Training loss: 0.1472
Epoch: 2/20... Training loss: 0.1527
Epoch: 2/20... Training loss: 0.1436
Epoch: 2/20... Training loss: 0.1487
Epoch: 2/20... Training loss: 0.1479
Epoch: 2/20... Training loss: 0.1479
Epoch: 2/20... Training loss: 0.1464
Epoch: 2/20... Training loss: 0.1473
Epoch: 2/20... Training loss: 0.1451
Epoch: 2/20... Training loss: 0.1491
Epoch: 2/20... Training loss: 0.1434
Epoch: 2/20... Training loss: 0.1444
Epoch: 2/20... Training loss: 0.1408
Epoch: 2/20... Training loss: 0.1448
Epoch: 2/20... Training loss: 0.1465
Epoch: 2/20... Training loss: 0.1532
Epoch: 2/20... Training loss: 0.1438
Epoch: 2/20... Training loss: 0.1519
Epoch: 2/20... Training loss: 0.1468
Epoch: 2/20... Training loss: 0.1444
Epoch: 2/20... Training loss: 0.1455
Epoch: 2/20... Training loss: 0.1488
Epoch: 2/20... Training loss: 0.1428
Epoch: 2/20... Training loss: 0.1478
Epoch: 2/20... Training loss: 0.1485
Epoch: 2/20... Training loss: 0.1465
Epoch: 2/20... Training loss: 0.1427
Epoch: 2/20... Training loss: 0.1460
Epoch: 2/20... Training loss: 0.1458
Epoch: 2/20... Training loss: 0.1448
Epoch: 2/20... Training loss: 0.1413
Epoch: 2/20... Training loss: 0.1435
Epoch: 2/20... Training loss: 0.1441
Epoch: 2/20... Training loss: 0.1474
Epoch: 2/20... Training loss: 0.1344
Epoch: 2/20... Training loss: 0.1462
Epoch: 2/20... Training loss: 0.1437
Epoch: 2/20... Training loss: 0.1446
Epoch: 2/20... Training loss: 0.1429
Epoch: 2/20... Training loss: 0.1447
Epoch: 2/20... Training loss: 0.1410
Epoch: 2/20... Training loss: 0.1383
Epoch: 2/20... Training loss: 0.1428
Epoch: 2/20... Training loss: 0.1425
Epoch: 2/20... Training loss: 0.1415
Epoch: 2/20... Training loss: 0.1427
Epoch: 2/20... Training loss: 0.1500
Epoch: 2/20... Training loss: 0.1432
Epoch: 2/20... Training loss: 0.1447
Epoch: 2/20... Training loss: 0.1450
Epoch: 2/20... Training loss: 0.1412
Epoch: 2/20... Training loss: 0.1411
Epoch: 2/20... Training loss: 0.1378
Epoch: 2/20... Training loss: 0.1348
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1442
Epoch: 2/20... Training loss: 0.1392
Epoch: 2/20... Training loss: 0.1428
Epoch: 2/20... Training loss: 0.1350
Epoch: 2/20... Training loss: 0.1434
Epoch: 2/20... Training loss: 0.1426
Epoch: 2/20... Training loss: 0.1370
Epoch: 2/20... Training loss: 0.1401
Epoch: 2/20... Training loss: 0.1427
Epoch: 2/20... Training loss: 0.1372
Epoch: 2/20... Training loss: 0.1454
Epoch: 2/20... Training loss: 0.1462
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1368
Epoch: 2/20... Training loss: 0.1406
Epoch: 2/20... Training loss: 0.1445
Epoch: 2/20... Training loss: 0.1436
Epoch: 2/20... Training loss: 0.1391
Epoch: 2/20... Training loss: 0.1422
Epoch: 2/20... Training loss: 0.1432
Epoch: 2/20... Training loss: 0.1441
Epoch: 2/20... Training loss: 0.1411
Epoch: 2/20... Training loss: 0.1382
Epoch: 2/20... Training loss: 0.1417
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1386
Epoch: 2/20... Training loss: 0.1351
Epoch: 2/20... Training loss: 0.1418
Epoch: 2/20... Training loss: 0.1413
Epoch: 2/20... Training loss: 0.1445
Epoch: 2/20... Training loss: 0.1368
Epoch: 2/20... Training loss: 0.1366
Epoch: 2/20... Training loss: 0.1384
Epoch: 2/20... Training loss: 0.1418
Epoch: 2/20... Training loss: 0.1413
Epoch: 2/20... Training loss: 0.1383
Epoch: 2/20... Training loss: 0.1411
Epoch: 2/20... Training loss: 0.1382
Epoch: 2/20... Training loss: 0.1372
Epoch: 2/20... Training loss: 0.1351
Epoch: 2/20... Training loss: 0.1395
Epoch: 2/20... Training loss: 0.1394
Epoch: 2/20... Training loss: 0.1378
Epoch: 2/20... Training loss: 0.1388
Epoch: 2/20... Training loss: 0.1389
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1405
Epoch: 2/20... Training loss: 0.1366
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1444
Epoch: 2/20... Training loss: 0.1428
Epoch: 2/20... Training loss: 0.1354
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1350
Epoch: 2/20... Training loss: 0.1403
Epoch: 2/20... Training loss: 0.1367
Epoch: 2/20... Training loss: 0.1360
Epoch: 2/20... Training loss: 0.1382
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1402
Epoch: 2/20... Training loss: 0.1450
Epoch: 2/20... Training loss: 0.1331
Epoch: 2/20... Training loss: 0.1336
Epoch: 2/20... Training loss: 0.1412
Epoch: 2/20... Training loss: 0.1381
Epoch: 2/20... Training loss: 0.1397
Epoch: 2/20... Training loss: 0.1366
Epoch: 2/20... Training loss: 0.1377
Epoch: 2/20... Training loss: 0.1392
Epoch: 2/20... Training loss: 0.1348
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1353
Epoch: 2/20... Training loss: 0.1336
Epoch: 2/20... Training loss: 0.1431
Epoch: 2/20... Training loss: 0.1331
Epoch: 2/20... Training loss: 0.1378
Epoch: 2/20... Training loss: 0.1394
Epoch: 2/20... Training loss: 0.1330
Epoch: 2/20... Training loss: 0.1339
Epoch: 2/20... Training loss: 0.1408
Epoch: 2/20... Training loss: 0.1329
Epoch: 2/20... Training loss: 0.1371
Epoch: 2/20... Training loss: 0.1313
Epoch: 2/20... Training loss: 0.1315
Epoch: 2/20... Training loss: 0.1395
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1306
Epoch: 2/20... Training loss: 0.1305
Epoch: 2/20... Training loss: 0.1323
Epoch: 2/20... Training loss: 0.1355
Epoch: 2/20... Training loss: 0.1362
Epoch: 2/20... Training loss: 0.1303
Epoch: 2/20... Training loss: 0.1353
Epoch: 2/20... Training loss: 0.1375
Epoch: 2/20... Training loss: 0.1394
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1370
Epoch: 2/20... Training loss: 0.1349
Epoch: 2/20... Training loss: 0.1345
Epoch: 2/20... Training loss: 0.1328
Epoch: 2/20... Training loss: 0.1305
Epoch: 2/20... Training loss: 0.1336
Epoch: 2/20... Training loss: 0.1338
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1295
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1365
Epoch: 2/20... Training loss: 0.1365
Epoch: 2/20... Training loss: 0.1289
Epoch: 2/20... Training loss: 0.1351
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1360
Epoch: 2/20... Training loss: 0.1383
Epoch: 2/20... Training loss: 0.1250
Epoch: 2/20... Training loss: 0.1360
Epoch: 2/20... Training loss: 0.1342
Epoch: 2/20... Training loss: 0.1351
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1337
Epoch: 2/20... Training loss: 0.1339
Epoch: 2/20... Training loss: 0.1340
Epoch: 2/20... Training loss: 0.1332
Epoch: 2/20... Training loss: 0.1323
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1316
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1325
Epoch: 2/20... Training loss: 0.1335
Epoch: 2/20... Training loss: 0.1412
Epoch: 2/20... Training loss: 0.1333
Epoch: 2/20... Training loss: 0.1340
Epoch: 2/20... Training loss: 0.1311
Epoch: 2/20... Training loss: 0.1329
Epoch: 2/20... Training loss: 0.1381
Epoch: 2/20... Training loss: 0.1316
Epoch: 2/20... Training loss: 0.1285
Epoch: 2/20... Training loss: 0.1307
Epoch: 2/20... Training loss: 0.1294
Epoch: 2/20... Training loss: 0.1350
Epoch: 2/20... Training loss: 0.1370
Epoch: 2/20... Training loss: 0.1346
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1301
Epoch: 2/20... Training loss: 0.1301
Epoch: 2/20... Training loss: 0.1339
Epoch: 2/20... Training loss: 0.1332
Epoch: 2/20... Training loss: 0.1345
Epoch: 2/20... Training loss: 0.1307
Epoch: 2/20... Training loss: 0.1286
Epoch: 2/20... Training loss: 0.1314
Epoch: 2/20... Training loss: 0.1347
Epoch: 2/20... Training loss: 0.1285
Epoch: 2/20... Training loss: 0.1309
Epoch: 2/20... Training loss: 0.1337
Epoch: 2/20... Training loss: 0.1309
Epoch: 2/20... Training loss: 0.1354
Epoch: 2/20... Training loss: 0.1339
Epoch: 2/20... Training loss: 0.1290
Epoch: 2/20... Training loss: 0.1377
Epoch: 2/20... Training loss: 0.1271
Epoch: 2/20... Training loss: 0.1286
Epoch: 2/20... Training loss: 0.1346
Epoch: 2/20... Training loss: 0.1264
Epoch: 2/20... Training loss: 0.1304
Epoch: 2/20... Training loss: 0.1272
Epoch: 2/20... Training loss: 0.1290
Epoch: 2/20... Training loss: 0.1265
Epoch: 2/20... Training loss: 0.1326
Epoch: 2/20... Training loss: 0.1278
Epoch: 2/20... Training loss: 0.1298
Epoch: 2/20... Training loss: 0.1314
Epoch: 2/20... Training loss: 0.1267
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1366
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1279
Epoch: 2/20... Training loss: 0.1251
Epoch: 2/20... Training loss: 0.1340
Epoch: 2/20... Training loss: 0.1317
Epoch: 3/20... Training loss: 0.1332
Epoch: 3/20... Training loss: 0.1277
Epoch: 3/20... Training loss: 0.1323
Epoch: 3/20... Training loss: 0.1321
Epoch: 3/20... Training loss: 0.1374
Epoch: 3/20... Training loss: 0.1347
Epoch: 3/20... Training loss: 0.1315
Epoch: 3/20... Training loss: 0.1316
Epoch: 3/20... Training loss: 0.1309
Epoch: 3/20... Training loss: 0.1294
Epoch: 3/20... Training loss: 0.1255
Epoch: 3/20... Training loss: 0.1328
Epoch: 3/20... Training loss: 0.1309
Epoch: 3/20... Training loss: 0.1303
Epoch: 3/20... Training loss: 0.1288
Epoch: 3/20... Training loss: 0.1254
Epoch: 3/20... Training loss: 0.1272
Epoch: 3/20... Training loss: 0.1257
Epoch: 3/20... Training loss: 0.1321
Epoch: 3/20... Training loss: 0.1307
Epoch: 3/20... Training loss: 0.1307
Epoch: 3/20... Training loss: 0.1242
Epoch: 3/20... Training loss: 0.1318
Epoch: 3/20... Training loss: 0.1359
Epoch: 3/20... Training loss: 0.1288
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1345
Epoch: 3/20... Training loss: 0.1267
Epoch: 3/20... Training loss: 0.1353
Epoch: 3/20... Training loss: 0.1301
Epoch: 3/20... Training loss: 0.1329
Epoch: 3/20... Training loss: 0.1322
Epoch: 3/20... Training loss: 0.1345
Epoch: 3/20... Training loss: 0.1283
Epoch: 3/20... Training loss: 0.1303
Epoch: 3/20... Training loss: 0.1236
Epoch: 3/20... Training loss: 0.1249
Epoch: 3/20... Training loss: 0.1237
Epoch: 3/20... Training loss: 0.1248
Epoch: 3/20... Training loss: 0.1274
Epoch: 3/20... Training loss: 0.1305
Epoch: 3/20... Training loss: 0.1253
Epoch: 3/20... Training loss: 0.1267
Epoch: 3/20... Training loss: 0.1259
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1284
Epoch: 3/20... Training loss: 0.1253
Epoch: 3/20... Training loss: 0.1302
Epoch: 3/20... Training loss: 0.1281
Epoch: 3/20... Training loss: 0.1296
Epoch: 3/20... Training loss: 0.1293
Epoch: 3/20... Training loss: 0.1271
Epoch: 3/20... Training loss: 0.1276
Epoch: 3/20... Training loss: 0.1255
Epoch: 3/20... Training loss: 0.1276
Epoch: 3/20... Training loss: 0.1256
Epoch: 3/20... Training loss: 0.1194
Epoch: 3/20... Training loss: 0.1328
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1226
Epoch: 3/20... Training loss: 0.1304
Epoch: 3/20... Training loss: 0.1304
Epoch: 3/20... Training loss: 0.1260
Epoch: 3/20... Training loss: 0.1281
Epoch: 3/20... Training loss: 0.1250
Epoch: 3/20... Training loss: 0.1323
Epoch: 3/20... Training loss: 0.1277
Epoch: 3/20... Training loss: 0.1283
Epoch: 3/20... Training loss: 0.1256
Epoch: 3/20... Training loss: 0.1266
Epoch: 3/20... Training loss: 0.1289
Epoch: 3/20... Training loss: 0.1285
Epoch: 3/20... Training loss: 0.1245
Epoch: 3/20... Training loss: 0.1254
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1310
Epoch: 3/20... Training loss: 0.1248
Epoch: 3/20... Training loss: 0.1304
Epoch: 3/20... Training loss: 0.1266
Epoch: 3/20... Training loss: 0.1222
Epoch: 3/20... Training loss: 0.1272
Epoch: 3/20... Training loss: 0.1270
Epoch: 3/20... Training loss: 0.1207
Epoch: 3/20... Training loss: 0.1280
Epoch: 3/20... Training loss: 0.1301
Epoch: 3/20... Training loss: 0.1289
Epoch: 3/20... Training loss: 0.1274
Epoch: 3/20... Training loss: 0.1296
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1224
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1225
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1271
Epoch: 3/20... Training loss: 0.1267
Epoch: 3/20... Training loss: 0.1246
Epoch: 3/20... Training loss: 0.1248
Epoch: 3/20... Training loss: 0.1274
Epoch: 3/20... Training loss: 0.1254
Epoch: 3/20... Training loss: 0.1239
Epoch: 3/20... Training loss: 0.1265
Epoch: 3/20... Training loss: 0.1272
Epoch: 3/20... Training loss: 0.1198
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1243
Epoch: 3/20... Training loss: 0.1274
Epoch: 3/20... Training loss: 0.1212
Epoch: 3/20... Training loss: 0.1278
Epoch: 3/20... Training loss: 0.1303
Epoch: 3/20... Training loss: 0.1240
Epoch: 3/20... Training loss: 0.1277
Epoch: 3/20... Training loss: 0.1238
Epoch: 3/20... Training loss: 0.1217
Epoch: 3/20... Training loss: 0.1223
Epoch: 3/20... Training loss: 0.1222
Epoch: 3/20... Training loss: 0.1274
Epoch: 3/20... Training loss: 0.1262
Epoch: 3/20... Training loss: 0.1286
Epoch: 3/20... Training loss: 0.1223
Epoch: 3/20... Training loss: 0.1272
Epoch: 3/20... Training loss: 0.1264
Epoch: 3/20... Training loss: 0.1269
Epoch: 3/20... Training loss: 0.1330
Epoch: 3/20... Training loss: 0.1271
Epoch: 3/20... Training loss: 0.1224
Epoch: 3/20... Training loss: 0.1241
Epoch: 3/20... Training loss: 0.1239
Epoch: 3/20... Training loss: 0.1275
Epoch: 3/20... Training loss: 0.1196
Epoch: 3/20... Training loss: 0.1243
Epoch: 3/20... Training loss: 0.1258
Epoch: 3/20... Training loss: 0.1270
Epoch: 3/20... Training loss: 0.1265
Epoch: 3/20... Training loss: 0.1222
Epoch: 3/20... Training loss: 0.1180
Epoch: 3/20... Training loss: 0.1228
Epoch: 3/20... Training loss: 0.1233
Epoch: 3/20... Training loss: 0.1189
Epoch: 3/20... Training loss: 0.1216
Epoch: 3/20... Training loss: 0.1229
Epoch: 3/20... Training loss: 0.1249
Epoch: 3/20... Training loss: 0.1261
Epoch: 3/20... Training loss: 0.1250
Epoch: 3/20... Training loss: 0.1206
Epoch: 3/20... Training loss: 0.1257
Epoch: 3/20... Training loss: 0.1182
Epoch: 3/20... Training loss: 0.1229
Epoch: 3/20... Training loss: 0.1252
Epoch: 3/20... Training loss: 0.1244
Epoch: 3/20... Training loss: 0.1238
Epoch: 3/20... Training loss: 0.1282
Epoch: 3/20... Training loss: 0.1240
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1281
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1147
Epoch: 3/20... Training loss: 0.1252
Epoch: 3/20... Training loss: 0.1266
Epoch: 3/20... Training loss: 0.1238
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1260
Epoch: 3/20... Training loss: 0.1248
Epoch: 3/20... Training loss: 0.1244
Epoch: 3/20... Training loss: 0.1242
Epoch: 3/20... Training loss: 0.1239
Epoch: 3/20... Training loss: 0.1276
Epoch: 3/20... Training loss: 0.1238
Epoch: 3/20... Training loss: 0.1276
Epoch: 3/20... Training loss: 0.1169
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1193
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1240
Epoch: 3/20... Training loss: 0.1250
Epoch: 3/20... Training loss: 0.1189
Epoch: 3/20... Training loss: 0.1262
Epoch: 3/20... Training loss: 0.1212
Epoch: 3/20... Training loss: 0.1216
Epoch: 3/20... Training loss: 0.1269
Epoch: 3/20... Training loss: 0.1223
Epoch: 3/20... Training loss: 0.1260
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1186
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1254
Epoch: 3/20... Training loss: 0.1236
Epoch: 3/20... Training loss: 0.1198
Epoch: 3/20... Training loss: 0.1221
Epoch: 3/20... Training loss: 0.1262
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1260
Epoch: 3/20... Training loss: 0.1233
Epoch: 3/20... Training loss: 0.1199
Epoch: 3/20... Training loss: 0.1271
Epoch: 3/20... Training loss: 0.1188
Epoch: 3/20... Training loss: 0.1272
Epoch: 3/20... Training loss: 0.1220
Epoch: 3/20... Training loss: 0.1239
Epoch: 3/20... Training loss: 0.1184
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1187
Epoch: 3/20... Training loss: 0.1237
Epoch: 3/20... Training loss: 0.1262
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1212
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1213
Epoch: 3/20... Training loss: 0.1227
Epoch: 3/20... Training loss: 0.1212
Epoch: 3/20... Training loss: 0.1223
Epoch: 3/20... Training loss: 0.1186
Epoch: 3/20... Training loss: 0.1198
Epoch: 3/20... Training loss: 0.1245
Epoch: 3/20... Training loss: 0.1177
Epoch: 3/20... Training loss: 0.1225
Epoch: 3/20... Training loss: 0.1231
Epoch: 3/20... Training loss: 0.1212
Epoch: 3/20... Training loss: 0.1252
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1216
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1190
Epoch: 3/20... Training loss: 0.1174
Epoch: 3/20... Training loss: 0.1258
Epoch: 3/20... Training loss: 0.1206
Epoch: 3/20... Training loss: 0.1167
Epoch: 3/20... Training loss: 0.1249
Epoch: 3/20... Training loss: 0.1218
Epoch: 3/20... Training loss: 0.1202
Epoch: 3/20... Training loss: 0.1187
Epoch: 3/20... Training loss: 0.1226
Epoch: 3/20... Training loss: 0.1210
Epoch: 3/20... Training loss: 0.1197
Epoch: 3/20... Training loss: 0.1240
Epoch: 3/20... Training loss: 0.1221
Epoch: 3/20... Training loss: 0.1186
Epoch: 3/20... Training loss: 0.1265
Epoch: 3/20... Training loss: 0.1203
Epoch: 3/20... Training loss: 0.1233
Epoch: 3/20... Training loss: 0.1160
Epoch: 3/20... Training loss: 0.1221
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1211
Epoch: 3/20... Training loss: 0.1193
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1202
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1220
Epoch: 3/20... Training loss: 0.1214
Epoch: 3/20... Training loss: 0.1195
Epoch: 3/20... Training loss: 0.1237
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1228
Epoch: 3/20... Training loss: 0.1185
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1250
Epoch: 3/20... Training loss: 0.1194
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1222
Epoch: 3/20... Training loss: 0.1223
Epoch: 3/20... Training loss: 0.1213
Epoch: 3/20... Training loss: 0.1251
Epoch: 3/20... Training loss: 0.1235
Epoch: 3/20... Training loss: 0.1189
Epoch: 3/20... Training loss: 0.1207
Epoch: 3/20... Training loss: 0.1226
Epoch: 3/20... Training loss: 0.1249
Epoch: 3/20... Training loss: 0.1244
Epoch: 3/20... Training loss: 0.1186
Epoch: 3/20... Training loss: 0.1257
Epoch: 3/20... Training loss: 0.1190
Epoch: 3/20... Training loss: 0.1163
Epoch: 3/20... Training loss: 0.1162
Epoch: 3/20... Training loss: 0.1188
Epoch: 3/20... Training loss: 0.1226
Epoch: 3/20... Training loss: 0.1249
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1248
Epoch: 3/20... Training loss: 0.1189
Epoch: 3/20... Training loss: 0.1208
Epoch: 3/20... Training loss: 0.1209
Epoch: 3/20... Training loss: 0.1140
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1232
Epoch: 3/20... Training loss: 0.1176
Epoch: 3/20... Training loss: 0.1187
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1184
Epoch: 3/20... Training loss: 0.1216
Epoch: 3/20... Training loss: 0.1214
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1150
Epoch: 3/20... Training loss: 0.1268
Epoch: 3/20... Training loss: 0.1235
Epoch: 3/20... Training loss: 0.1204
Epoch: 3/20... Training loss: 0.1215
Epoch: 4/20... Training loss: 0.1225
Epoch: 4/20... Training loss: 0.1163
Epoch: 4/20... Training loss: 0.1206
Epoch: 4/20... Training loss: 0.1283
Epoch: 4/20... Training loss: 0.1217
Epoch: 4/20... Training loss: 0.1171
Epoch: 4/20... Training loss: 0.1199
Epoch: 4/20... Training loss: 0.1169
Epoch: 4/20... Training loss: 0.1177
Epoch: 4/20... Training loss: 0.1173
Epoch: 4/20... Training loss: 0.1190
Epoch: 4/20... Training loss: 0.1198
Epoch: 4/20... Training loss: 0.1205
Epoch: 4/20... Training loss: 0.1187
Epoch: 4/20... Training loss: 0.1203
Epoch: 4/20... Training loss: 0.1216
Epoch: 4/20... Training loss: 0.1248
Epoch: 4/20... Training loss: 0.1155
Epoch: 4/20... Training loss: 0.1211
Epoch: 4/20... Training loss: 0.1232
Epoch: 4/20... Training loss: 0.1194
Epoch: 4/20... Training loss: 0.1230
Epoch: 4/20... Training loss: 0.1228
Epoch: 4/20... Training loss: 0.1226
Epoch: 4/20... Training loss: 0.1220
Epoch: 4/20... Training loss: 0.1194
Epoch: 4/20... Training loss: 0.1206
Epoch: 4/20... Training loss: 0.1228
Epoch: 4/20... Training loss: 0.1129
Epoch: 4/20... Training loss: 0.1172
Epoch: 4/20... Training loss: 0.1220
Epoch: 4/20... Training loss: 0.1188
Epoch: 4/20... Training loss: 0.1189
Epoch: 4/20... Training loss: 0.1249
Epoch: 4/20... Training loss: 0.1207
Epoch: 4/20... Training loss: 0.1189
Epoch: 4/20... Training loss: 0.1141
Epoch: 4/20... Training loss: 0.1206
Epoch: 4/20... Training loss: 0.1218
Epoch: 4/20... Training loss: 0.1159
Epoch: 4/20... Training loss: 0.1143
Epoch: 4/20... Training loss: 0.1187
Epoch: 4/20... Training loss: 0.1215
Epoch: 4/20... Training loss: 0.1211
Epoch: 4/20... Training loss: 0.1233
Epoch: 4/20... Training loss: 0.1218
Epoch: 4/20... Training loss: 0.1188
Epoch: 4/20... Training loss: 0.1176
Epoch: 4/20... Training loss: 0.1234
Epoch: 4/20... Training loss: 0.1176
Epoch: 4/20... Training loss: 0.1145
Epoch: 4/20... Training loss: 0.1204
Epoch: 4/20... Training loss: 0.1188
Epoch: 4/20... Training loss: 0.1185
Epoch: 4/20... Training loss: 0.1203
Epoch: 4/20... Training loss: 0.1243
Epoch: 4/20... Training loss: 0.1129
Epoch: 4/20... Training loss: 0.1186
Epoch: 4/20... Training loss: 0.1177
Epoch: 4/20... Training loss: 0.1145
Epoch: 4/20... Training loss: 0.1237
Epoch: 4/20... Training loss: 0.1218
Epoch: 4/20... Training loss: 0.1169
Epoch: 4/20... Training loss: 0.1161
Epoch: 4/20... Training loss: 0.1199
Epoch: 4/20... Training loss: 0.1237
Epoch: 4/20... Training loss: 0.1220
Epoch: 4/20... Training loss: 0.1202
Epoch: 4/20... Training loss: 0.1196
Epoch: 4/20... Training loss: 0.1175
Epoch: 4/20... Training loss: 0.1166
Epoch: 4/20... Training loss: 0.1157
Epoch: 4/20... Training loss: 0.1221
Epoch: 4/20... Training loss: 0.1203
Epoch: 4/20... Training loss: 0.1198
Epoch: 4/20... Training loss: 0.1170
Epoch: 4/20... Training loss: 0.1186
Epoch: 4/20... Training loss: 0.1161
Epoch: 4/20... Training loss: 0.1170
Epoch: 4/20... Training loss: 0.1155
Epoch: 4/20... Training loss: 0.1216
Epoch: 4/20... Training loss: 0.1159
Epoch: 4/20... Training loss: 0.1222
Epoch: 4/20... Training loss: 0.1126
Epoch: 4/20... Training loss: 0.1186
Epoch: 4/20... Training loss: 0.1150
Epoch: 4/20... Training loss: 0.1166
Epoch: 4/20... Training loss: 0.1205
Epoch: 4/20... Training loss: 0.1209
Epoch: 4/20... Training loss: 0.1211
Epoch: 4/20... Training loss: 0.1197
Epoch: 4/20... Training loss: 0.1213
Epoch: 4/20... Training loss: 0.1210
Epoch: 4/20... Training loss: 0.1145
Epoch: 4/20... Training loss: 0.1219
Epoch: 4/20... Training loss: 0.1196
Epoch: 4/20... Training loss: 0.1174
Epoch: 4/20... Training loss: 0.1184
Epoch: 4/20... Training loss: 0.1191
Epoch: 4/20... Training loss: 0.1161
Epoch: 4/20... Training loss: 0.1181
Epoch: 4/20... Training loss: 0.1200
Epoch: 4/20... Training loss: 0.1171
Epoch: 4/20... Training loss: 0.1193
Epoch: 4/20... Training loss: 0.1195
Epoch: 4/20... Training loss: 0.1168
Epoch: 4/20... Training loss: 0.1201
Epoch: 4/20... Training loss: 0.1184
Epoch: 4/20... Training loss: 0.1148
Epoch: 4/20... Training loss: 0.1180
Epoch: 4/20... Training loss: 0.1170
Epoch: 4/20... Training loss: 0.1154
Epoch: 4/20... Training loss: 0.1128
Epoch: 4/20... Training loss: 0.1104
Epoch: 4/20... Training loss: 0.1197
Epoch: 4/20... Training loss: 0.1195
Epoch: 4/20... Training loss: 0.1132
Epoch: 4/20... Training loss: 0.1161
Epoch: 4/20... Training loss: 0.1215
Epoch: 4/20... Training loss: 0.1201
Epoch: 4/20... Training loss: 0.1201
Epoch: 4/20... Training loss: 0.1211
Epoch: 4/20... Training loss: 0.1198
Epoch: 4/20... Training loss: 0.1196
Epoch: 4/20... Training loss: 0.1190
Epoch: 4/20... Training loss: 0.1203
Epoch: 4/20... Training loss: 0.1142
Epoch: 4/20... Training loss: 0.1157
Epoch: 4/20... Training loss: 0.1167
Epoch: 4/20... Training loss: 0.1138
Epoch: 4/20... Training loss: 0.1177
Epoch: 4/20... Training loss: 0.1189
Epoch: 4/20... Training loss: 0.1238
Epoch: 4/20... Training loss: 0.1162
Epoch: 4/20... Training loss: 0.1168
Epoch: 4/20... Training loss: 0.1165
Epoch: 4/20... Training loss: 0.1210
Epoch: 4/20... Training loss: 0.1164
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1136
Epoch: 4/20... Training loss: 0.1186
Epoch: 4/20... Training loss: 0.1166
Epoch: 4/20... Training loss: 0.1137
Epoch: 4/20... Training loss: 0.1181
Epoch: 4/20... Training loss: 0.1178
Epoch: 4/20... Training loss: 0.1223
Epoch: 4/20... Training loss: 0.1152
Epoch: 4/20... Training loss: 0.1206
Epoch: 4/20... Training loss: 0.1169
Epoch: 4/20... Training loss: 0.1137
Epoch: 4/20... Training loss: 0.1198
Epoch: 4/20... Training loss: 0.1155
Epoch: 4/20... Training loss: 0.1211
Epoch: 4/20... Training loss: 0.1223
Epoch: 4/20... Training loss: 0.1172
Epoch: 4/20... Training loss: 0.1233
Epoch: 4/20... Training loss: 0.1175
Epoch: 4/20... Training loss: 0.1200
Epoch: 4/20... Training loss: 0.1155
Epoch: 4/20... Training loss: 0.1158
Epoch: 4/20... Training loss: 0.1199
Epoch: 4/20... Training loss: 0.1189
Epoch: 4/20... Training loss: 0.1196
Epoch: 4/20... Training loss: 0.1137
Epoch: 4/20... Training loss: 0.1166
Epoch: 4/20... Training loss: 0.1191
Epoch: 4/20... Training loss: 0.1183
Epoch: 4/20... Training loss: 0.1142
Epoch: 4/20... Training loss: 0.1172
Epoch: 4/20... Training loss: 0.1130
Epoch: 4/20... Training loss: 0.1212
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1153
Epoch: 4/20... Training loss: 0.1195
Epoch: 4/20... Training loss: 0.1212
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1161
Epoch: 4/20... Training loss: 0.1176
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1182
Epoch: 4/20... Training loss: 0.1153
Epoch: 4/20... Training loss: 0.1173
Epoch: 4/20... Training loss: 0.1166
Epoch: 4/20... Training loss: 0.1131
Epoch: 4/20... Training loss: 0.1183
Epoch: 4/20... Training loss: 0.1150
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1188
Epoch: 4/20... Training loss: 0.1118
Epoch: 4/20... Training loss: 0.1194
Epoch: 4/20... Training loss: 0.1183
Epoch: 4/20... Training loss: 0.1168
Epoch: 4/20... Training loss: 0.1160
Epoch: 4/20... Training loss: 0.1169
Epoch: 4/20... Training loss: 0.1171
Epoch: 4/20... Training loss: 0.1181
Epoch: 4/20... Training loss: 0.1178
Epoch: 4/20... Training loss: 0.1193
Epoch: 4/20... Training loss: 0.1155
Epoch: 4/20... Training loss: 0.1213
Epoch: 4/20... Training loss: 0.1157
Epoch: 4/20... Training loss: 0.1187
Epoch: 4/20... Training loss: 0.1096
Epoch: 4/20... Training loss: 0.1145
Epoch: 4/20... Training loss: 0.1145
Epoch: 4/20... Training loss: 0.1176
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1216
Epoch: 4/20... Training loss: 0.1197
Epoch: 4/20... Training loss: 0.1191
Epoch: 4/20... Training loss: 0.1237
Epoch: 4/20... Training loss: 0.1140
Epoch: 4/20... Training loss: 0.1206
Epoch: 4/20... Training loss: 0.1174
Epoch: 4/20... Training loss: 0.1165
Epoch: 4/20... Training loss: 0.1192
Epoch: 4/20... Training loss: 0.1179
Epoch: 4/20... Training loss: 0.1218
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1159
Epoch: 4/20... Training loss: 0.1117
Epoch: 4/20... Training loss: 0.1168
Epoch: 4/20... Training loss: 0.1110
Epoch: 4/20... Training loss: 0.1185
Epoch: 4/20... Training loss: 0.1150
Epoch: 4/20... Training loss: 0.1180
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1140
Epoch: 4/20... Training loss: 0.1151
Epoch: 4/20... Training loss: 0.1167
Epoch: 4/20... Training loss: 0.1160
Epoch: 4/20... Training loss: 0.1153
Epoch: 4/20... Training loss: 0.1156
Epoch: 4/20... Training loss: 0.1165
Epoch: 4/20... Training loss: 0.1176
Epoch: 4/20... Training loss: 0.1189
Epoch: 4/20... Training loss: 0.1128
Epoch: 4/20... Training loss: 0.1197
Epoch: 4/20... Training loss: 0.1116
Epoch: 4/20... Training loss: 0.1172
Epoch: 4/20... Training loss: 0.1116
Epoch: 4/20... Training loss: 0.1185
Epoch: 4/20... Training loss: 0.1201
Epoch: 4/20... Training loss: 0.1201
Epoch: 4/20... Training loss: 0.1187
Epoch: 4/20... Training loss: 0.1177
Epoch: 4/20... Training loss: 0.1132
Epoch: 4/20... Training loss: 0.1208
Epoch: 4/20... Training loss: 0.1187
Epoch: 4/20... Training loss: 0.1222
Epoch: 4/20... Training loss: 0.1138
Epoch: 4/20... Training loss: 0.1183
Epoch: 4/20... Training loss: 0.1140
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1159
Epoch: 4/20... Training loss: 0.1172
Epoch: 4/20... Training loss: 0.1162
Epoch: 4/20... Training loss: 0.1160
Epoch: 4/20... Training loss: 0.1070
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1182
Epoch: 4/20... Training loss: 0.1146
Epoch: 4/20... Training loss: 0.1147
Epoch: 4/20... Training loss: 0.1152
Epoch: 4/20... Training loss: 0.1102
Epoch: 4/20... Training loss: 0.1149
Epoch: 4/20... Training loss: 0.1140
Epoch: 4/20... Training loss: 0.1154
Epoch: 4/20... Training loss: 0.1180
Epoch: 4/20... Training loss: 0.1152
Epoch: 4/20... Training loss: 0.1137
Epoch: 4/20... Training loss: 0.1115
Epoch: 4/20... Training loss: 0.1135
Epoch: 4/20... Training loss: 0.1132
Epoch: 4/20... Training loss: 0.1116
Epoch: 4/20... Training loss: 0.1157
Epoch: 4/20... Training loss: 0.1147
Epoch: 4/20... Training loss: 0.1164
Epoch: 4/20... Training loss: 0.1175
Epoch: 4/20... Training loss: 0.1142
Epoch: 4/20... Training loss: 0.1158
Epoch: 4/20... Training loss: 0.1133
Epoch: 4/20... Training loss: 0.1165
Epoch: 4/20... Training loss: 0.1137
Epoch: 4/20... Training loss: 0.1184
Epoch: 4/20... Training loss: 0.1123
Epoch: 4/20... Training loss: 0.1184
Epoch: 4/20... Training loss: 0.1156
Epoch: 4/20... Training loss: 0.1193
Epoch: 4/20... Training loss: 0.1210
Epoch: 4/20... Training loss: 0.1117
Epoch: 4/20... Training loss: 0.1100
Epoch: 4/20... Training loss: 0.1158
Epoch: 4/20... Training loss: 0.1192
Epoch: 4/20... Training loss: 0.1194
Epoch: 4/20... Training loss: 0.1113
Epoch: 4/20... Training loss: 0.1159
Epoch: 4/20... Training loss: 0.1141
Epoch: 4/20... Training loss: 0.1161
Epoch: 5/20... Training loss: 0.1146
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1171
Epoch: 5/20... Training loss: 0.1170
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1192
Epoch: 5/20... Training loss: 0.1156
Epoch: 5/20... Training loss: 0.1149
Epoch: 5/20... Training loss: 0.1168
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1114
Epoch: 5/20... Training loss: 0.1175
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1178
Epoch: 5/20... Training loss: 0.1142
Epoch: 5/20... Training loss: 0.1165
Epoch: 5/20... Training loss: 0.1144
Epoch: 5/20... Training loss: 0.1163
Epoch: 5/20... Training loss: 0.1112
Epoch: 5/20... Training loss: 0.1155
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1181
Epoch: 5/20... Training loss: 0.1125
Epoch: 5/20... Training loss: 0.1154
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1138
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1170
Epoch: 5/20... Training loss: 0.1196
Epoch: 5/20... Training loss: 0.1174
Epoch: 5/20... Training loss: 0.1155
Epoch: 5/20... Training loss: 0.1118
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1177
Epoch: 5/20... Training loss: 0.1124
Epoch: 5/20... Training loss: 0.1187
Epoch: 5/20... Training loss: 0.1118
Epoch: 5/20... Training loss: 0.1133
Epoch: 5/20... Training loss: 0.1147
Epoch: 5/20... Training loss: 0.1151
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1178
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1115
Epoch: 5/20... Training loss: 0.1115
Epoch: 5/20... Training loss: 0.1107
Epoch: 5/20... Training loss: 0.1099
Epoch: 5/20... Training loss: 0.1161
Epoch: 5/20... Training loss: 0.1111
Epoch: 5/20... Training loss: 0.1133
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1178
Epoch: 5/20... Training loss: 0.1155
Epoch: 5/20... Training loss: 0.1165
Epoch: 5/20... Training loss: 0.1164
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1128
Epoch: 5/20... Training loss: 0.1161
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1171
Epoch: 5/20... Training loss: 0.1140
Epoch: 5/20... Training loss: 0.1163
Epoch: 5/20... Training loss: 0.1140
Epoch: 5/20... Training loss: 0.1173
Epoch: 5/20... Training loss: 0.1129
Epoch: 5/20... Training loss: 0.1168
Epoch: 5/20... Training loss: 0.1124
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1223
Epoch: 5/20... Training loss: 0.1108
Epoch: 5/20... Training loss: 0.1142
Epoch: 5/20... Training loss: 0.1180
Epoch: 5/20... Training loss: 0.1162
Epoch: 5/20... Training loss: 0.1166
Epoch: 5/20... Training loss: 0.1124
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1149
Epoch: 5/20... Training loss: 0.1175
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1146
Epoch: 5/20... Training loss: 0.1129
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1164
Epoch: 5/20... Training loss: 0.1106
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1168
Epoch: 5/20... Training loss: 0.1171
Epoch: 5/20... Training loss: 0.1136
Epoch: 5/20... Training loss: 0.1122
Epoch: 5/20... Training loss: 0.1141
Epoch: 5/20... Training loss: 0.1114
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1177
Epoch: 5/20... Training loss: 0.1139
Epoch: 5/20... Training loss: 0.1166
Epoch: 5/20... Training loss: 0.1179
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1151
Epoch: 5/20... Training loss: 0.1150
Epoch: 5/20... Training loss: 0.1140
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1165
Epoch: 5/20... Training loss: 0.1192
Epoch: 5/20... Training loss: 0.1128
Epoch: 5/20... Training loss: 0.1121
Epoch: 5/20... Training loss: 0.1163
Epoch: 5/20... Training loss: 0.1198
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1149
Epoch: 5/20... Training loss: 0.1156
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1102
Epoch: 5/20... Training loss: 0.1165
Epoch: 5/20... Training loss: 0.1126
Epoch: 5/20... Training loss: 0.1123
Epoch: 5/20... Training loss: 0.1153
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1071
Epoch: 5/20... Training loss: 0.1111
Epoch: 5/20... Training loss: 0.1133
Epoch: 5/20... Training loss: 0.1174
Epoch: 5/20... Training loss: 0.1115
Epoch: 5/20... Training loss: 0.1098
Epoch: 5/20... Training loss: 0.1125
Epoch: 5/20... Training loss: 0.1109
Epoch: 5/20... Training loss: 0.1152
Epoch: 5/20... Training loss: 0.1116
Epoch: 5/20... Training loss: 0.1142
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1158
Epoch: 5/20... Training loss: 0.1112
Epoch: 5/20... Training loss: 0.1152
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1106
Epoch: 5/20... Training loss: 0.1163
Epoch: 5/20... Training loss: 0.1128
Epoch: 5/20... Training loss: 0.1176
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1155
Epoch: 5/20... Training loss: 0.1170
Epoch: 5/20... Training loss: 0.1093
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1153
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1103
Epoch: 5/20... Training loss: 0.1168
Epoch: 5/20... Training loss: 0.1095
Epoch: 5/20... Training loss: 0.1109
Epoch: 5/20... Training loss: 0.1164
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1131
Epoch: 5/20... Training loss: 0.1105
Epoch: 5/20... Training loss: 0.1154
Epoch: 5/20... Training loss: 0.1161
Epoch: 5/20... Training loss: 0.1097
Epoch: 5/20... Training loss: 0.1111
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1094
Epoch: 5/20... Training loss: 0.1133
Epoch: 5/20... Training loss: 0.1158
Epoch: 5/20... Training loss: 0.1138
Epoch: 5/20... Training loss: 0.1157
Epoch: 5/20... Training loss: 0.1101
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1188
Epoch: 5/20... Training loss: 0.1133
Epoch: 5/20... Training loss: 0.1142
Epoch: 5/20... Training loss: 0.1131
Epoch: 5/20... Training loss: 0.1142
Epoch: 5/20... Training loss: 0.1151
Epoch: 5/20... Training loss: 0.1134
Epoch: 5/20... Training loss: 0.1124
Epoch: 5/20... Training loss: 0.1113
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1121
Epoch: 5/20... Training loss: 0.1122
Epoch: 5/20... Training loss: 0.1181
Epoch: 5/20... Training loss: 0.1136
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1134
Epoch: 5/20... Training loss: 0.1147
Epoch: 5/20... Training loss: 0.1126
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1156
Epoch: 5/20... Training loss: 0.1158
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1149
Epoch: 5/20... Training loss: 0.1205
Epoch: 5/20... Training loss: 0.1185
Epoch: 5/20... Training loss: 0.1161
Epoch: 5/20... Training loss: 0.1156
Epoch: 5/20... Training loss: 0.1166
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1155
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1122
Epoch: 5/20... Training loss: 0.1177
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1151
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1120
Epoch: 5/20... Training loss: 0.1097
Epoch: 5/20... Training loss: 0.1147
Epoch: 5/20... Training loss: 0.1090
Epoch: 5/20... Training loss: 0.1124
Epoch: 5/20... Training loss: 0.1153
Epoch: 5/20... Training loss: 0.1138
Epoch: 5/20... Training loss: 0.1120
Epoch: 5/20... Training loss: 0.1128
Epoch: 5/20... Training loss: 0.1065
Epoch: 5/20... Training loss: 0.1117
Epoch: 5/20... Training loss: 0.1105
Epoch: 5/20... Training loss: 0.1111
Epoch: 5/20... Training loss: 0.1121
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1110
Epoch: 5/20... Training loss: 0.1147
Epoch: 5/20... Training loss: 0.1134
Epoch: 5/20... Training loss: 0.1109
Epoch: 5/20... Training loss: 0.1147
Epoch: 5/20... Training loss: 0.1140
Epoch: 5/20... Training loss: 0.1113
Epoch: 5/20... Training loss: 0.1140
Epoch: 5/20... Training loss: 0.1099
Epoch: 5/20... Training loss: 0.1159
Epoch: 5/20... Training loss: 0.1111
Epoch: 5/20... Training loss: 0.1100
Epoch: 5/20... Training loss: 0.1126
Epoch: 5/20... Training loss: 0.1088
Epoch: 5/20... Training loss: 0.1122
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1118
Epoch: 5/20... Training loss: 0.1184
Epoch: 5/20... Training loss: 0.1134
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1121
Epoch: 5/20... Training loss: 0.1148
Epoch: 5/20... Training loss: 0.1132
Epoch: 5/20... Training loss: 0.1146
Epoch: 5/20... Training loss: 0.1131
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1112
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1160
Epoch: 5/20... Training loss: 0.1109
Epoch: 5/20... Training loss: 0.1123
Epoch: 5/20... Training loss: 0.1153
Epoch: 5/20... Training loss: 0.1143
Epoch: 5/20... Training loss: 0.1149
Epoch: 5/20... Training loss: 0.1125
Epoch: 5/20... Training loss: 0.1122
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1128
Epoch: 5/20... Training loss: 0.1135
Epoch: 5/20... Training loss: 0.1115
Epoch: 5/20... Training loss: 0.1100
Epoch: 5/20... Training loss: 0.1112
Epoch: 5/20... Training loss: 0.1064
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1126
Epoch: 5/20... Training loss: 0.1098
Epoch: 5/20... Training loss: 0.1118
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1092
Epoch: 5/20... Training loss: 0.1055
Epoch: 5/20... Training loss: 0.1076
Epoch: 5/20... Training loss: 0.1154
Epoch: 5/20... Training loss: 0.1080
Epoch: 5/20... Training loss: 0.1102
Epoch: 5/20... Training loss: 0.1136
Epoch: 5/20... Training loss: 0.1137
Epoch: 5/20... Training loss: 0.1167
Epoch: 5/20... Training loss: 0.1071
Epoch: 5/20... Training loss: 0.1141
Epoch: 5/20... Training loss: 0.1058
Epoch: 5/20... Training loss: 0.1127
Epoch: 5/20... Training loss: 0.1146
Epoch: 5/20... Training loss: 0.1121
Epoch: 5/20... Training loss: 0.1130
Epoch: 5/20... Training loss: 0.1153
Epoch: 5/20... Training loss: 0.1173
Epoch: 5/20... Training loss: 0.1119
Epoch: 5/20... Training loss: 0.1145
Epoch: 5/20... Training loss: 0.1101
Epoch: 5/20... Training loss: 0.1116
Epoch: 5/20... Training loss: 0.1099
Epoch: 5/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1149
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1135
Epoch: 6/20... Training loss: 0.1066
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1142
Epoch: 6/20... Training loss: 0.1157
Epoch: 6/20... Training loss: 0.1132
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1147
Epoch: 6/20... Training loss: 0.1082
Epoch: 6/20... Training loss: 0.1096
Epoch: 6/20... Training loss: 0.1116
Epoch: 6/20... Training loss: 0.1073
Epoch: 6/20... Training loss: 0.1152
Epoch: 6/20... Training loss: 0.1161
Epoch: 6/20... Training loss: 0.1130
Epoch: 6/20... Training loss: 0.1101
Epoch: 6/20... Training loss: 0.1121
Epoch: 6/20... Training loss: 0.1093
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1131
Epoch: 6/20... Training loss: 0.1139
Epoch: 6/20... Training loss: 0.1055
Epoch: 6/20... Training loss: 0.1145
Epoch: 6/20... Training loss: 0.1140
Epoch: 6/20... Training loss: 0.1144
Epoch: 6/20... Training loss: 0.1139
Epoch: 6/20... Training loss: 0.1127
Epoch: 6/20... Training loss: 0.1103
Epoch: 6/20... Training loss: 0.1148
Epoch: 6/20... Training loss: 0.1099
Epoch: 6/20... Training loss: 0.1136
Epoch: 6/20... Training loss: 0.1138
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1108
Epoch: 6/20... Training loss: 0.1058
Epoch: 6/20... Training loss: 0.1092
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1100
Epoch: 6/20... Training loss: 0.1134
Epoch: 6/20... Training loss: 0.1087
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1125
Epoch: 6/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1075
Epoch: 6/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1178
Epoch: 6/20... Training loss: 0.1166
Epoch: 6/20... Training loss: 0.1150
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1153
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1139
Epoch: 6/20... Training loss: 0.1147
Epoch: 6/20... Training loss: 0.1107
Epoch: 6/20... Training loss: 0.1134
Epoch: 6/20... Training loss: 0.1130
Epoch: 6/20... Training loss: 0.1108
Epoch: 6/20... Training loss: 0.1092
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1165
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1095
Epoch: 6/20... Training loss: 0.1123
Epoch: 6/20... Training loss: 0.1092
Epoch: 6/20... Training loss: 0.1127
Epoch: 6/20... Training loss: 0.1145
Epoch: 6/20... Training loss: 0.1161
Epoch: 6/20... Training loss: 0.1099
Epoch: 6/20... Training loss: 0.1144
Epoch: 6/20... Training loss: 0.1127
Epoch: 6/20... Training loss: 0.1111
Epoch: 6/20... Training loss: 0.1140
Epoch: 6/20... Training loss: 0.1118
Epoch: 6/20... Training loss: 0.1167
Epoch: 6/20... Training loss: 0.1080
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1122
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1103
Epoch: 6/20... Training loss: 0.1079
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1067
Epoch: 6/20... Training loss: 0.1112
Epoch: 6/20... Training loss: 0.1132
Epoch: 6/20... Training loss: 0.1130
Epoch: 6/20... Training loss: 0.1141
Epoch: 6/20... Training loss: 0.1118
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1108
Epoch: 6/20... Training loss: 0.1122
Epoch: 6/20... Training loss: 0.1148
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1137
Epoch: 6/20... Training loss: 0.1115
Epoch: 6/20... Training loss: 0.1141
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1119
Epoch: 6/20... Training loss: 0.1107
Epoch: 6/20... Training loss: 0.1091
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1112
Epoch: 6/20... Training loss: 0.1134
Epoch: 6/20... Training loss: 0.1134
Epoch: 6/20... Training loss: 0.1097
Epoch: 6/20... Training loss: 0.1170
Epoch: 6/20... Training loss: 0.1101
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1127
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1097
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1097
Epoch: 6/20... Training loss: 0.1142
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1110
Epoch: 6/20... Training loss: 0.1121
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1115
Epoch: 6/20... Training loss: 0.1115
Epoch: 6/20... Training loss: 0.1143
Epoch: 6/20... Training loss: 0.1085
Epoch: 6/20... Training loss: 0.1092
Epoch: 6/20... Training loss: 0.1055
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1096
Epoch: 6/20... Training loss: 0.1163
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1144
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1085
Epoch: 6/20... Training loss: 0.1128
Epoch: 6/20... Training loss: 0.1073
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1117
Epoch: 6/20... Training loss: 0.1075
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1090
Epoch: 6/20... Training loss: 0.1127
Epoch: 6/20... Training loss: 0.1134
Epoch: 6/20... Training loss: 0.1136
Epoch: 6/20... Training loss: 0.1101
Epoch: 6/20... Training loss: 0.1051
Epoch: 6/20... Training loss: 0.1133
Epoch: 6/20... Training loss: 0.1117
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1082
Epoch: 6/20... Training loss: 0.1096
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1114
Epoch: 6/20... Training loss: 0.1137
Epoch: 6/20... Training loss: 0.1128
Epoch: 6/20... Training loss: 0.1147
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1041
Epoch: 6/20... Training loss: 0.1083
Epoch: 6/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1126
Epoch: 6/20... Training loss: 0.1116
Epoch: 6/20... Training loss: 0.1098
Epoch: 6/20... Training loss: 0.1077
Epoch: 6/20... Training loss: 0.1105
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1074
Epoch: 6/20... Training loss: 0.1118
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1084
Epoch: 6/20... Training loss: 0.1096
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1126
Epoch: 6/20... Training loss: 0.1115
Epoch: 6/20... Training loss: 0.1069
Epoch: 6/20... Training loss: 0.1058
Epoch: 6/20... Training loss: 0.1087
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1097
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1103
Epoch: 6/20... Training loss: 0.1136
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1114
Epoch: 6/20... Training loss: 0.1124
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1130
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1121
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1108
Epoch: 6/20... Training loss: 0.1098
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1114
Epoch: 6/20... Training loss: 0.1100
Epoch: 6/20... Training loss: 0.1090
Epoch: 6/20... Training loss: 0.1092
Epoch: 6/20... Training loss: 0.1060
Epoch: 6/20... Training loss: 0.1091
Epoch: 6/20... Training loss: 0.1104
Epoch: 6/20... Training loss: 0.1051
Epoch: 6/20... Training loss: 0.1101
Epoch: 6/20... Training loss: 0.1125
Epoch: 6/20... Training loss: 0.1133
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1099
Epoch: 6/20... Training loss: 0.1157
Epoch: 6/20... Training loss: 0.1080
Epoch: 6/20... Training loss: 0.1162
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1076
Epoch: 6/20... Training loss: 0.1093
Epoch: 6/20... Training loss: 0.1151
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1129
Epoch: 6/20... Training loss: 0.1079
Epoch: 6/20... Training loss: 0.1093
Epoch: 6/20... Training loss: 0.1133
Epoch: 6/20... Training loss: 0.1083
Epoch: 6/20... Training loss: 0.1109
Epoch: 6/20... Training loss: 0.1091
Epoch: 6/20... Training loss: 0.1090
Epoch: 6/20... Training loss: 0.1090
Epoch: 6/20... Training loss: 0.1107
Epoch: 6/20... Training loss: 0.1128
Epoch: 6/20... Training loss: 0.1049
Epoch: 6/20... Training loss: 0.1122
Epoch: 6/20... Training loss: 0.1091
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1083
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1096
Epoch: 6/20... Training loss: 0.1095
Epoch: 6/20... Training loss: 0.1107
Epoch: 6/20... Training loss: 0.1169
Epoch: 6/20... Training loss: 0.1084
Epoch: 6/20... Training loss: 0.1077
Epoch: 6/20... Training loss: 0.1191
Epoch: 6/20... Training loss: 0.1132
Epoch: 6/20... Training loss: 0.1115
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1073
Epoch: 6/20... Training loss: 0.1080
Epoch: 6/20... Training loss: 0.1124
Epoch: 6/20... Training loss: 0.1111
Epoch: 6/20... Training loss: 0.1041
Epoch: 6/20... Training loss: 0.1086
Epoch: 6/20... Training loss: 0.1052
Epoch: 6/20... Training loss: 0.1119
Epoch: 6/20... Training loss: 0.1076
Epoch: 6/20... Training loss: 0.1088
Epoch: 6/20... Training loss: 0.1120
Epoch: 6/20... Training loss: 0.1174
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1089
Epoch: 6/20... Training loss: 0.1080
Epoch: 6/20... Training loss: 0.1143
Epoch: 6/20... Training loss: 0.1103
Epoch: 6/20... Training loss: 0.1070
Epoch: 6/20... Training loss: 0.1077
Epoch: 6/20... Training loss: 0.1073
Epoch: 6/20... Training loss: 0.1093
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1085
Epoch: 6/20... Training loss: 0.1063
Epoch: 6/20... Training loss: 0.1116
Epoch: 6/20... Training loss: 0.1060
Epoch: 6/20... Training loss: 0.1028
Epoch: 6/20... Training loss: 0.1063
Epoch: 6/20... Training loss: 0.1106
Epoch: 6/20... Training loss: 0.1130
Epoch: 6/20... Training loss: 0.1125
Epoch: 6/20... Training loss: 0.1094
Epoch: 6/20... Training loss: 0.1118
Epoch: 6/20... Training loss: 0.1133
Epoch: 6/20... Training loss: 0.1113
Epoch: 6/20... Training loss: 0.1091
Epoch: 6/20... Training loss: 0.1060
Epoch: 6/20... Training loss: 0.1102
Epoch: 6/20... Training loss: 0.1082
Epoch: 6/20... Training loss: 0.1108
Epoch: 6/20... Training loss: 0.1100
Epoch: 6/20... Training loss: 0.1090
Epoch: 6/20... Training loss: 0.1071
Epoch: 6/20... Training loss: 0.1124
Epoch: 6/20... Training loss: 0.1128
Epoch: 6/20... Training loss: 0.1079
Epoch: 6/20... Training loss: 0.1117
Epoch: 7/20... Training loss: 0.1056
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1071
Epoch: 7/20... Training loss: 0.1095
Epoch: 7/20... Training loss: 0.1108
Epoch: 7/20... Training loss: 0.1121
Epoch: 7/20... Training loss: 0.1081
Epoch: 7/20... Training loss: 0.1107
Epoch: 7/20... Training loss: 0.1077
Epoch: 7/20... Training loss: 0.1127
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1062
Epoch: 7/20... Training loss: 0.1113
Epoch: 7/20... Training loss: 0.1109
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1056
Epoch: 7/20... Training loss: 0.1073
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1092
Epoch: 7/20... Training loss: 0.1103
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1081
Epoch: 7/20... Training loss: 0.1124
Epoch: 7/20... Training loss: 0.1050
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1078
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1125
Epoch: 7/20... Training loss: 0.1128
Epoch: 7/20... Training loss: 0.1080
Epoch: 7/20... Training loss: 0.1109
Epoch: 7/20... Training loss: 0.1075
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1093
Epoch: 7/20... Training loss: 0.1080
Epoch: 7/20... Training loss: 0.1044
Epoch: 7/20... Training loss: 0.1120
Epoch: 7/20... Training loss: 0.1109
Epoch: 7/20... Training loss: 0.1065
Epoch: 7/20... Training loss: 0.1110
Epoch: 7/20... Training loss: 0.1086
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1101
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1119
Epoch: 7/20... Training loss: 0.1125
Epoch: 7/20... Training loss: 0.1121
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1066
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1122
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1090
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1058
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1086
Epoch: 7/20... Training loss: 0.1105
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1076
Epoch: 7/20... Training loss: 0.1113
Epoch: 7/20... Training loss: 0.1055
Epoch: 7/20... Training loss: 0.1131
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1099
Epoch: 7/20... Training loss: 0.1154
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1044
Epoch: 7/20... Training loss: 0.1084
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1095
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1136
Epoch: 7/20... Training loss: 0.1115
Epoch: 7/20... Training loss: 0.1079
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1111
Epoch: 7/20... Training loss: 0.1062
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1077
Epoch: 7/20... Training loss: 0.1068
Epoch: 7/20... Training loss: 0.1116
Epoch: 7/20... Training loss: 0.1060
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1067
Epoch: 7/20... Training loss: 0.1107
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1035
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1058
Epoch: 7/20... Training loss: 0.1101
Epoch: 7/20... Training loss: 0.1076
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1160
Epoch: 7/20... Training loss: 0.1047
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1075
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1074
Epoch: 7/20... Training loss: 0.1125
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1103
Epoch: 7/20... Training loss: 0.1097
Epoch: 7/20... Training loss: 0.1093
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1076
Epoch: 7/20... Training loss: 0.1135
Epoch: 7/20... Training loss: 0.1093
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1090
Epoch: 7/20... Training loss: 0.1057
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1079
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1055
Epoch: 7/20... Training loss: 0.1115
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1081
Epoch: 7/20... Training loss: 0.1137
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1131
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1107
Epoch: 7/20... Training loss: 0.1066
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1095
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1116
Epoch: 7/20... Training loss: 0.1084
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1115
Epoch: 7/20... Training loss: 0.1117
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1132
Epoch: 7/20... Training loss: 0.1044
Epoch: 7/20... Training loss: 0.1101
Epoch: 7/20... Training loss: 0.1115
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1017
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1129
Epoch: 7/20... Training loss: 0.1123
Epoch: 7/20... Training loss: 0.1079
Epoch: 7/20... Training loss: 0.1134
Epoch: 7/20... Training loss: 0.1063
Epoch: 7/20... Training loss: 0.1123
Epoch: 7/20... Training loss: 0.1052
Epoch: 7/20... Training loss: 0.1055
Epoch: 7/20... Training loss: 0.1047
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1092
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1090
Epoch: 7/20... Training loss: 0.1032
Epoch: 7/20... Training loss: 0.1049
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1077
Epoch: 7/20... Training loss: 0.1135
Epoch: 7/20... Training loss: 0.1071
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1072
Epoch: 7/20... Training loss: 0.1110
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1065
Epoch: 7/20... Training loss: 0.1114
Epoch: 7/20... Training loss: 0.1097
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1123
Epoch: 7/20... Training loss: 0.1057
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1051
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1093
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1099
Epoch: 7/20... Training loss: 0.1099
Epoch: 7/20... Training loss: 0.1095
Epoch: 7/20... Training loss: 0.1053
Epoch: 7/20... Training loss: 0.1054
Epoch: 7/20... Training loss: 0.1093
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1147
Epoch: 7/20... Training loss: 0.1095
Epoch: 7/20... Training loss: 0.1112
Epoch: 7/20... Training loss: 0.1073
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1107
Epoch: 7/20... Training loss: 0.1137
Epoch: 7/20... Training loss: 0.1105
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1141
Epoch: 7/20... Training loss: 0.1035
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1132
Epoch: 7/20... Training loss: 0.1046
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1065
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1044
Epoch: 7/20... Training loss: 0.1054
Epoch: 7/20... Training loss: 0.1100
Epoch: 7/20... Training loss: 0.1055
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1040
Epoch: 7/20... Training loss: 0.1082
Epoch: 7/20... Training loss: 0.1053
Epoch: 7/20... Training loss: 0.1084
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1090
Epoch: 7/20... Training loss: 0.1081
Epoch: 7/20... Training loss: 0.1088
Epoch: 7/20... Training loss: 0.1106
Epoch: 7/20... Training loss: 0.1051
Epoch: 7/20... Training loss: 0.1102
Epoch: 7/20... Training loss: 0.1102
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1072
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1032
Epoch: 7/20... Training loss: 0.1111
Epoch: 7/20... Training loss: 0.1104
Epoch: 7/20... Training loss: 0.1080
Epoch: 7/20... Training loss: 0.1107
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1096
Epoch: 7/20... Training loss: 0.1075
Epoch: 7/20... Training loss: 0.1079
Epoch: 7/20... Training loss: 0.1087
Epoch: 7/20... Training loss: 0.1124
Epoch: 7/20... Training loss: 0.1057
Epoch: 7/20... Training loss: 0.1062
Epoch: 7/20... Training loss: 0.1109
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1098
Epoch: 7/20... Training loss: 0.1036
Epoch: 7/20... Training loss: 0.1074
Epoch: 7/20... Training loss: 0.1068
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1060
Epoch: 7/20... Training loss: 0.1081
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1071
Epoch: 7/20... Training loss: 0.1043
Epoch: 7/20... Training loss: 0.1067
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1094
Epoch: 7/20... Training loss: 0.1069
Epoch: 7/20... Training loss: 0.1089
Epoch: 7/20... Training loss: 0.1059
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1132
Epoch: 7/20... Training loss: 0.1038
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1119
Epoch: 7/20... Training loss: 0.1077
Epoch: 7/20... Training loss: 0.1070
Epoch: 7/20... Training loss: 0.1056
Epoch: 7/20... Training loss: 0.1074
Epoch: 7/20... Training loss: 0.1083
Epoch: 7/20... Training loss: 0.1063
Epoch: 7/20... Training loss: 0.1062
Epoch: 7/20... Training loss: 0.1047
Epoch: 7/20... Training loss: 0.1072
Epoch: 7/20... Training loss: 0.1073
Epoch: 7/20... Training loss: 0.1084
Epoch: 7/20... Training loss: 0.1091
Epoch: 7/20... Training loss: 0.1105
Epoch: 7/20... Training loss: 0.1061
Epoch: 7/20... Training loss: 0.1062
Epoch: 7/20... Training loss: 0.1113
Epoch: 7/20... Training loss: 0.1097
Epoch: 7/20... Training loss: 0.1085
Epoch: 7/20... Training loss: 0.1074
Epoch: 7/20... Training loss: 0.1030
Epoch: 7/20... Training loss: 0.1104
Epoch: 7/20... Training loss: 0.1064
Epoch: 7/20... Training loss: 0.1033
Epoch: 7/20... Training loss: 0.1090
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1084
Epoch: 8/20... Training loss: 0.1124
Epoch: 8/20... Training loss: 0.1041
Epoch: 8/20... Training loss: 0.1056
Epoch: 8/20... Training loss: 0.1058
Epoch: 8/20... Training loss: 0.1029
Epoch: 8/20... Training loss: 0.1101
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1070
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1107
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1082
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1118
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1026
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1097
Epoch: 8/20... Training loss: 0.1099
Epoch: 8/20... Training loss: 0.1086
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1102
Epoch: 8/20... Training loss: 0.1054
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1082
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1084
Epoch: 8/20... Training loss: 0.1061
Epoch: 8/20... Training loss: 0.1060
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1059
Epoch: 8/20... Training loss: 0.1046
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1062
Epoch: 8/20... Training loss: 0.1112
Epoch: 8/20... Training loss: 0.1106
Epoch: 8/20... Training loss: 0.1025
Epoch: 8/20... Training loss: 0.1033
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1110
Epoch: 8/20... Training loss: 0.1111
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1089
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1071
Epoch: 8/20... Training loss: 0.1074
Epoch: 8/20... Training loss: 0.1051
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1054
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1052
Epoch: 8/20... Training loss: 0.1049
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1092
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1097
Epoch: 8/20... Training loss: 0.1074
Epoch: 8/20... Training loss: 0.1105
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1092
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1089
Epoch: 8/20... Training loss: 0.1089
Epoch: 8/20... Training loss: 0.1088
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1114
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1080
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1061
Epoch: 8/20... Training loss: 0.1038
Epoch: 8/20... Training loss: 0.1090
Epoch: 8/20... Training loss: 0.1070
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1060
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1062
Epoch: 8/20... Training loss: 0.1017
Epoch: 8/20... Training loss: 0.1107
Epoch: 8/20... Training loss: 0.1085
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1055
Epoch: 8/20... Training loss: 0.1047
Epoch: 8/20... Training loss: 0.1139
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1056
Epoch: 8/20... Training loss: 0.1088
Epoch: 8/20... Training loss: 0.1131
Epoch: 8/20... Training loss: 0.1065
Epoch: 8/20... Training loss: 0.1090
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1051
Epoch: 8/20... Training loss: 0.1039
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1109
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1090
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1105
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1099
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1071
Epoch: 8/20... Training loss: 0.1104
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1074
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1084
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1055
Epoch: 8/20... Training loss: 0.1086
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1080
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1102
Epoch: 8/20... Training loss: 0.1042
Epoch: 8/20... Training loss: 0.1060
Epoch: 8/20... Training loss: 0.1062
Epoch: 8/20... Training loss: 0.1058
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1074
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1065
Epoch: 8/20... Training loss: 0.1097
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1104
Epoch: 8/20... Training loss: 0.1095
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1043
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1054
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1049
Epoch: 8/20... Training loss: 0.1052
Epoch: 8/20... Training loss: 0.1055
Epoch: 8/20... Training loss: 0.1034
Epoch: 8/20... Training loss: 0.1109
Epoch: 8/20... Training loss: 0.1043
Epoch: 8/20... Training loss: 0.1074
Epoch: 8/20... Training loss: 0.1096
Epoch: 8/20... Training loss: 0.1059
Epoch: 8/20... Training loss: 0.1135
Epoch: 8/20... Training loss: 0.1022
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1065
Epoch: 8/20... Training loss: 0.1057
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1041
Epoch: 8/20... Training loss: 0.1080
Epoch: 8/20... Training loss: 0.1040
Epoch: 8/20... Training loss: 0.1045
Epoch: 8/20... Training loss: 0.1044
Epoch: 8/20... Training loss: 0.1104
Epoch: 8/20... Training loss: 0.1033
Epoch: 8/20... Training loss: 0.1078
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1072
Epoch: 8/20... Training loss: 0.1085
Epoch: 8/20... Training loss: 0.1037
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1039
Epoch: 8/20... Training loss: 0.1061
Epoch: 8/20... Training loss: 0.1076
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1080
Epoch: 8/20... Training loss: 0.1052
Epoch: 8/20... Training loss: 0.1041
Epoch: 8/20... Training loss: 0.1053
Epoch: 8/20... Training loss: 0.1068
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1049
Epoch: 8/20... Training loss: 0.1048
Epoch: 8/20... Training loss: 0.1115
Epoch: 8/20... Training loss: 0.1058
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1062
Epoch: 8/20... Training loss: 0.1045
Epoch: 8/20... Training loss: 0.1099
Epoch: 8/20... Training loss: 0.1039
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1070
Epoch: 8/20... Training loss: 0.1016
Epoch: 8/20... Training loss: 0.1118
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1044
Epoch: 8/20... Training loss: 0.1096
Epoch: 8/20... Training loss: 0.1021
Epoch: 8/20... Training loss: 0.1011
Epoch: 8/20... Training loss: 0.1114
Epoch: 8/20... Training loss: 0.1075
Epoch: 8/20... Training loss: 0.1076
Epoch: 8/20... Training loss: 0.1029
Epoch: 8/20... Training loss: 0.1081
Epoch: 8/20... Training loss: 0.1089
Epoch: 8/20... Training loss: 0.1060
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1117
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1057
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1063
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1085
Epoch: 8/20... Training loss: 0.1077
Epoch: 8/20... Training loss: 0.1121
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1050
Epoch: 8/20... Training loss: 0.1034
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1039
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1080
Epoch: 8/20... Training loss: 0.1070
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1028
Epoch: 8/20... Training loss: 0.1056
Epoch: 8/20... Training loss: 0.1052
Epoch: 8/20... Training loss: 0.1106
Epoch: 8/20... Training loss: 0.1058
Epoch: 8/20... Training loss: 0.1065
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1089
Epoch: 8/20... Training loss: 0.1085
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1047
Epoch: 8/20... Training loss: 0.1053
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1081
Epoch: 8/20... Training loss: 0.1040
Epoch: 8/20... Training loss: 0.1092
Epoch: 8/20... Training loss: 0.1081
Epoch: 8/20... Training loss: 0.1042
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1079
Epoch: 8/20... Training loss: 0.1088
Epoch: 8/20... Training loss: 0.1103
Epoch: 8/20... Training loss: 0.1101
Epoch: 8/20... Training loss: 0.1088
Epoch: 8/20... Training loss: 0.1087
Epoch: 8/20... Training loss: 0.1088
Epoch: 8/20... Training loss: 0.1041
Epoch: 8/20... Training loss: 0.1091
Epoch: 8/20... Training loss: 0.1033
Epoch: 8/20... Training loss: 0.1061
Epoch: 8/20... Training loss: 0.1066
Epoch: 8/20... Training loss: 0.1069
Epoch: 8/20... Training loss: 0.1067
Epoch: 8/20... Training loss: 0.1070
Epoch: 8/20... Training loss: 0.1015
Epoch: 8/20... Training loss: 0.1028
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1058
Epoch: 8/20... Training loss: 0.1046
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1036
Epoch: 8/20... Training loss: 0.1025
Epoch: 8/20... Training loss: 0.1017
Epoch: 8/20... Training loss: 0.1073
Epoch: 8/20... Training loss: 0.1094
Epoch: 8/20... Training loss: 0.1109
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1114
Epoch: 8/20... Training loss: 0.1035
Epoch: 8/20... Training loss: 0.1052
Epoch: 8/20... Training loss: 0.1051
Epoch: 8/20... Training loss: 0.1060
Epoch: 8/20... Training loss: 0.1083
Epoch: 8/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1084
Epoch: 9/20... Training loss: 0.1091
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1098
Epoch: 9/20... Training loss: 0.1091
Epoch: 9/20... Training loss: 0.1042
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1034
Epoch: 9/20... Training loss: 0.1081
Epoch: 9/20... Training loss: 0.1018
Epoch: 9/20... Training loss: 0.1072
Epoch: 9/20... Training loss: 0.1031
Epoch: 9/20... Training loss: 0.1072
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1059
Epoch: 9/20... Training loss: 0.1036
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1021
Epoch: 9/20... Training loss: 0.1033
Epoch: 9/20... Training loss: 0.1085
Epoch: 9/20... Training loss: 0.1107
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1042
Epoch: 9/20... Training loss: 0.1084
Epoch: 9/20... Training loss: 0.1091
Epoch: 9/20... Training loss: 0.1046
Epoch: 9/20... Training loss: 0.1083
Epoch: 9/20... Training loss: 0.1076
Epoch: 9/20... Training loss: 0.1075
Epoch: 9/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1047
Epoch: 9/20... Training loss: 0.1034
Epoch: 9/20... Training loss: 0.1059
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1052
Epoch: 9/20... Training loss: 0.1046
Epoch: 9/20... Training loss: 0.1078
Epoch: 9/20... Training loss: 0.1052
Epoch: 9/20... Training loss: 0.1028
Epoch: 9/20... Training loss: 0.1030
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1025
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1061
Epoch: 9/20... Training loss: 0.1054
Epoch: 9/20... Training loss: 0.1029
Epoch: 9/20... Training loss: 0.1028
Epoch: 9/20... Training loss: 0.1048
Epoch: 9/20... Training loss: 0.1102
Epoch: 9/20... Training loss: 0.1079
Epoch: 9/20... Training loss: 0.1061
Epoch: 9/20... Training loss: 0.1092
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1032
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1108
Epoch: 9/20... Training loss: 0.1049
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1045
Epoch: 9/20... Training loss: 0.1080
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1114
Epoch: 9/20... Training loss: 0.1016
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1076
Epoch: 9/20... Training loss: 0.1078
Epoch: 9/20... Training loss: 0.1034
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1086
Epoch: 9/20... Training loss: 0.1004
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1031
Epoch: 9/20... Training loss: 0.1027
Epoch: 9/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1010
Epoch: 9/20... Training loss: 0.1048
Epoch: 9/20... Training loss: 0.1102
Epoch: 9/20... Training loss: 0.1060
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1074
Epoch: 9/20... Training loss: 0.1054
Epoch: 9/20... Training loss: 0.1082
Epoch: 9/20... Training loss: 0.1068
Epoch: 9/20... Training loss: 0.1076
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1023
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1065
Epoch: 9/20... Training loss: 0.1083
Epoch: 9/20... Training loss: 0.1044
Epoch: 9/20... Training loss: 0.1029
Epoch: 9/20... Training loss: 0.1059
Epoch: 9/20... Training loss: 0.1088
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1049
Epoch: 9/20... Training loss: 0.1051
Epoch: 9/20... Training loss: 0.1046
Epoch: 9/20... Training loss: 0.1047
Epoch: 9/20... Training loss: 0.1068
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1013
Epoch: 9/20... Training loss: 0.1099
Epoch: 9/20... Training loss: 0.1080
Epoch: 9/20... Training loss: 0.1048
Epoch: 9/20... Training loss: 0.1080
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1072
Epoch: 9/20... Training loss: 0.1004
Epoch: 9/20... Training loss: 0.1061
Epoch: 9/20... Training loss: 0.1088
Epoch: 9/20... Training loss: 0.1056
Epoch: 9/20... Training loss: 0.1019
Epoch: 9/20... Training loss: 0.1017
Epoch: 9/20... Training loss: 0.1023
Epoch: 9/20... Training loss: 0.1045
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1056
Epoch: 9/20... Training loss: 0.1041
Epoch: 9/20... Training loss: 0.1085
Epoch: 9/20... Training loss: 0.1041
Epoch: 9/20... Training loss: 0.1011
Epoch: 9/20... Training loss: 0.1040
Epoch: 9/20... Training loss: 0.1036
Epoch: 9/20... Training loss: 0.1082
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1023
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1065
Epoch: 9/20... Training loss: 0.1054
Epoch: 9/20... Training loss: 0.1060
Epoch: 9/20... Training loss: 0.1003
Epoch: 9/20... Training loss: 0.1055
Epoch: 9/20... Training loss: 0.1074
Epoch: 9/20... Training loss: 0.1067
Epoch: 9/20... Training loss: 0.1056
Epoch: 9/20... Training loss: 0.1066
Epoch: 9/20... Training loss: 0.1023
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1038
Epoch: 9/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1046
Epoch: 9/20... Training loss: 0.1096
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1067
Epoch: 9/20... Training loss: 0.1047
Epoch: 9/20... Training loss: 0.1057
Epoch: 9/20... Training loss: 0.1040
Epoch: 9/20... Training loss: 0.1054
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1085
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1069
Epoch: 9/20... Training loss: 0.1039
Epoch: 9/20... Training loss: 0.1054
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1018
Epoch: 9/20... Training loss: 0.1057
Epoch: 9/20... Training loss: 0.1026
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1092
Epoch: 9/20... Training loss: 0.1088
Epoch: 9/20... Training loss: 0.1063
Epoch: 9/20... Training loss: 0.1045
Epoch: 9/20... Training loss: 0.1036
Epoch: 9/20... Training loss: 0.1049
Epoch: 9/20... Training loss: 0.1005
Epoch: 9/20... Training loss: 0.1055
Epoch: 9/20... Training loss: 0.1019
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1065
Epoch: 9/20... Training loss: 0.1087
Epoch: 9/20... Training loss: 0.1063
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1099
Epoch: 9/20... Training loss: 0.1074
Epoch: 9/20... Training loss: 0.1061
Epoch: 9/20... Training loss: 0.1027
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1052
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1056
Epoch: 9/20... Training loss: 0.1030
Epoch: 9/20... Training loss: 0.1045
Epoch: 9/20... Training loss: 0.1090
Epoch: 9/20... Training loss: 0.1040
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1037
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1055
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1026
Epoch: 9/20... Training loss: 0.1047
Epoch: 9/20... Training loss: 0.1063
Epoch: 9/20... Training loss: 0.1056
Epoch: 9/20... Training loss: 0.1067
Epoch: 9/20... Training loss: 0.1081
Epoch: 9/20... Training loss: 0.1064
Epoch: 9/20... Training loss: 0.1079
Epoch: 9/20... Training loss: 0.1040
Epoch: 9/20... Training loss: 0.1105
Epoch: 9/20... Training loss: 0.1036
Epoch: 9/20... Training loss: 0.1052
Epoch: 9/20... Training loss: 0.1044
Epoch: 9/20... Training loss: 0.1075
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1044
Epoch: 9/20... Training loss: 0.1048
Epoch: 9/20... Training loss: 0.1108
Epoch: 9/20... Training loss: 0.1090
Epoch: 9/20... Training loss: 0.1099
Epoch: 9/20... Training loss: 0.1075
Epoch: 9/20... Training loss: 0.1029
Epoch: 9/20... Training loss: 0.1066
Epoch: 9/20... Training loss: 0.1042
Epoch: 9/20... Training loss: 0.1100
Epoch: 9/20... Training loss: 0.1040
Epoch: 9/20... Training loss: 0.1042
Epoch: 9/20... Training loss: 0.1013
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1092
Epoch: 9/20... Training loss: 0.1088
Epoch: 9/20... Training loss: 0.1024
Epoch: 9/20... Training loss: 0.1082
Epoch: 9/20... Training loss: 0.1059
Epoch: 9/20... Training loss: 0.1025
Epoch: 9/20... Training loss: 0.1075
Epoch: 9/20... Training loss: 0.1068
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1078
Epoch: 9/20... Training loss: 0.1076
Epoch: 9/20... Training loss: 0.1075
Epoch: 9/20... Training loss: 0.0990
Epoch: 9/20... Training loss: 0.1074
Epoch: 9/20... Training loss: 0.1078
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1122
Epoch: 9/20... Training loss: 0.1081
Epoch: 9/20... Training loss: 0.1067
Epoch: 9/20... Training loss: 0.1077
Epoch: 9/20... Training loss: 0.1031
Epoch: 9/20... Training loss: 0.1042
Epoch: 9/20... Training loss: 0.1049
Epoch: 9/20... Training loss: 0.1068
Epoch: 9/20... Training loss: 0.1051
Epoch: 9/20... Training loss: 0.1060
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1033
Epoch: 9/20... Training loss: 0.1096
Epoch: 9/20... Training loss: 0.1018
Epoch: 9/20... Training loss: 0.1071
Epoch: 9/20... Training loss: 0.1053
Epoch: 9/20... Training loss: 0.1044
Epoch: 9/20... Training loss: 0.1055
Epoch: 9/20... Training loss: 0.1052
Epoch: 9/20... Training loss: 0.1034
Epoch: 9/20... Training loss: 0.1070
Epoch: 9/20... Training loss: 0.1083
Epoch: 9/20... Training loss: 0.1073
Epoch: 9/20... Training loss: 0.1105
Epoch: 9/20... Training loss: 0.1082
Epoch: 9/20... Training loss: 0.1049
Epoch: 9/20... Training loss: 0.1003
Epoch: 9/20... Training loss: 0.1041
Epoch: 9/20... Training loss: 0.1047
Epoch: 9/20... Training loss: 0.1037
Epoch: 9/20... Training loss: 0.1026
Epoch: 9/20... Training loss: 0.1060
Epoch: 9/20... Training loss: 0.1061
Epoch: 9/20... Training loss: 0.1081
Epoch: 9/20... Training loss: 0.1072
Epoch: 9/20... Training loss: 0.1062
Epoch: 9/20... Training loss: 0.1058
Epoch: 9/20... Training loss: 0.1029
Epoch: 9/20... Training loss: 0.1009
Epoch: 9/20... Training loss: 0.1039
Epoch: 9/20... Training loss: 0.1038
Epoch: 9/20... Training loss: 0.1026
Epoch: 9/20... Training loss: 0.1087
Epoch: 9/20... Training loss: 0.1088
Epoch: 9/20... Training loss: 0.1043
Epoch: 9/20... Training loss: 0.1027
Epoch: 9/20... Training loss: 0.1068
Epoch: 9/20... Training loss: 0.1067
Epoch: 9/20... Training loss: 0.1014
Epoch: 9/20... Training loss: 0.1050
Epoch: 9/20... Training loss: 0.1104
Epoch: 9/20... Training loss: 0.1033
Epoch: 9/20... Training loss: 0.1119
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1051
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1027
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1036
Epoch: 10/20... Training loss: 0.1072
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1029
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1075
Epoch: 10/20... Training loss: 0.1079
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1078
Epoch: 10/20... Training loss: 0.1049
Epoch: 10/20... Training loss: 0.1061
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1057
Epoch: 10/20... Training loss: 0.1077
Epoch: 10/20... Training loss: 0.1069
Epoch: 10/20... Training loss: 0.1085
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1048
Epoch: 10/20... Training loss: 0.1037
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1048
Epoch: 10/20... Training loss: 0.1079
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1071
Epoch: 10/20... Training loss: 0.1022
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1035
Epoch: 10/20... Training loss: 0.1072
Epoch: 10/20... Training loss: 0.1072
Epoch: 10/20... Training loss: 0.1061
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1095
Epoch: 10/20... Training loss: 0.1057
Epoch: 10/20... Training loss: 0.1032
Epoch: 10/20... Training loss: 0.1059
Epoch: 10/20... Training loss: 0.1052
Epoch: 10/20... Training loss: 0.1003
Epoch: 10/20... Training loss: 0.1102
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1047
Epoch: 10/20... Training loss: 0.1067
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1013
Epoch: 10/20... Training loss: 0.1036
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1056
Epoch: 10/20... Training loss: 0.1006
Epoch: 10/20... Training loss: 0.1052
Epoch: 10/20... Training loss: 0.1076
Epoch: 10/20... Training loss: 0.1075
Epoch: 10/20... Training loss: 0.1025
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1076
Epoch: 10/20... Training loss: 0.0996
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1036
Epoch: 10/20... Training loss: 0.1045
Epoch: 10/20... Training loss: 0.1071
Epoch: 10/20... Training loss: 0.1023
Epoch: 10/20... Training loss: 0.1067
Epoch: 10/20... Training loss: 0.1037
Epoch: 10/20... Training loss: 0.1082
Epoch: 10/20... Training loss: 0.1039
Epoch: 10/20... Training loss: 0.1087
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1039
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1021
Epoch: 10/20... Training loss: 0.1048
Epoch: 10/20... Training loss: 0.1078
Epoch: 10/20... Training loss: 0.1072
Epoch: 10/20... Training loss: 0.1001
Epoch: 10/20... Training loss: 0.0982
Epoch: 10/20... Training loss: 0.1021
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1055
Epoch: 10/20... Training loss: 0.1061
Epoch: 10/20... Training loss: 0.1047
Epoch: 10/20... Training loss: 0.1074
Epoch: 10/20... Training loss: 0.1069
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1092
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1045
Epoch: 10/20... Training loss: 0.1069
Epoch: 10/20... Training loss: 0.1057
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1037
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1056
Epoch: 10/20... Training loss: 0.1049
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1066
Epoch: 10/20... Training loss: 0.1059
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1086
Epoch: 10/20... Training loss: 0.1051
Epoch: 10/20... Training loss: 0.1013
Epoch: 10/20... Training loss: 0.1015
Epoch: 10/20... Training loss: 0.1041
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1049
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1086
Epoch: 10/20... Training loss: 0.1051
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1050
Epoch: 10/20... Training loss: 0.1052
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1076
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1079
Epoch: 10/20... Training loss: 0.1023
Epoch: 10/20... Training loss: 0.1009
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1017
Epoch: 10/20... Training loss: 0.1010
Epoch: 10/20... Training loss: 0.1016
Epoch: 10/20... Training loss: 0.1041
Epoch: 10/20... Training loss: 0.1082
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1051
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1015
Epoch: 10/20... Training loss: 0.1007
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1058
Epoch: 10/20... Training loss: 0.1055
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.0997
Epoch: 10/20... Training loss: 0.1027
Epoch: 10/20... Training loss: 0.1067
Epoch: 10/20... Training loss: 0.1030
Epoch: 10/20... Training loss: 0.1063
Epoch: 10/20... Training loss: 0.1023
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1069
Epoch: 10/20... Training loss: 0.1039
Epoch: 10/20... Training loss: 0.1073
Epoch: 10/20... Training loss: 0.1036
Epoch: 10/20... Training loss: 0.1029
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1047
Epoch: 10/20... Training loss: 0.1047
Epoch: 10/20... Training loss: 0.1060
Epoch: 10/20... Training loss: 0.1059
Epoch: 10/20... Training loss: 0.1060
Epoch: 10/20... Training loss: 0.1018
Epoch: 10/20... Training loss: 0.1072
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1037
Epoch: 10/20... Training loss: 0.1026
Epoch: 10/20... Training loss: 0.1084
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1082
Epoch: 10/20... Training loss: 0.1014
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1029
Epoch: 10/20... Training loss: 0.1033
Epoch: 10/20... Training loss: 0.1052
Epoch: 10/20... Training loss: 0.1057
Epoch: 10/20... Training loss: 0.1110
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1066
Epoch: 10/20... Training loss: 0.1025
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1016
Epoch: 10/20... Training loss: 0.1026
Epoch: 10/20... Training loss: 0.0982
Epoch: 10/20... Training loss: 0.1053
Epoch: 10/20... Training loss: 0.1065
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1067
Epoch: 10/20... Training loss: 0.1027
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1019
Epoch: 10/20... Training loss: 0.1036
Epoch: 10/20... Training loss: 0.1073
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1017
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1040
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1073
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1058
Epoch: 10/20... Training loss: 0.1033
Epoch: 10/20... Training loss: 0.0982
Epoch: 10/20... Training loss: 0.1060
Epoch: 10/20... Training loss: 0.1056
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1017
Epoch: 10/20... Training loss: 0.1055
Epoch: 10/20... Training loss: 0.1030
Epoch: 10/20... Training loss: 0.1085
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1003
Epoch: 10/20... Training loss: 0.1012
Epoch: 10/20... Training loss: 0.1039
Epoch: 10/20... Training loss: 0.1085
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1040
Epoch: 10/20... Training loss: 0.1023
Epoch: 10/20... Training loss: 0.1048
Epoch: 10/20... Training loss: 0.1037
Epoch: 10/20... Training loss: 0.1032
Epoch: 10/20... Training loss: 0.1041
Epoch: 10/20... Training loss: 0.1020
Epoch: 10/20... Training loss: 0.1044
Epoch: 10/20... Training loss: 0.1076
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1078
Epoch: 10/20... Training loss: 0.1050
Epoch: 10/20... Training loss: 0.1063
Epoch: 10/20... Training loss: 0.1068
Epoch: 10/20... Training loss: 0.1049
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1040
Epoch: 10/20... Training loss: 0.1043
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1083
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1058
Epoch: 10/20... Training loss: 0.1007
Epoch: 10/20... Training loss: 0.1060
Epoch: 10/20... Training loss: 0.1025
Epoch: 10/20... Training loss: 0.1040
Epoch: 10/20... Training loss: 0.1055
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1029
Epoch: 10/20... Training loss: 0.1034
Epoch: 10/20... Training loss: 0.1017
Epoch: 10/20... Training loss: 0.1067
Epoch: 10/20... Training loss: 0.1088
Epoch: 10/20... Training loss: 0.1079
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1040
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1014
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1079
Epoch: 10/20... Training loss: 0.1076
Epoch: 10/20... Training loss: 0.1035
Epoch: 10/20... Training loss: 0.1030
Epoch: 10/20... Training loss: 0.1108
Epoch: 10/20... Training loss: 0.1042
Epoch: 10/20... Training loss: 0.1050
Epoch: 10/20... Training loss: 0.0999
Epoch: 10/20... Training loss: 0.1021
Epoch: 10/20... Training loss: 0.1071
Epoch: 10/20... Training loss: 0.1069
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1038
Epoch: 10/20... Training loss: 0.1025
Epoch: 10/20... Training loss: 0.1070
Epoch: 10/20... Training loss: 0.1032
Epoch: 10/20... Training loss: 0.1033
Epoch: 10/20... Training loss: 0.1024
Epoch: 10/20... Training loss: 0.1028
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1046
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1051
Epoch: 10/20... Training loss: 0.1062
Epoch: 10/20... Training loss: 0.1054
Epoch: 10/20... Training loss: 0.1064
Epoch: 10/20... Training loss: 0.1058
Epoch: 10/20... Training loss: 0.1031
Epoch: 10/20... Training loss: 0.1013
Epoch: 10/20... Training loss: 0.1064
Epoch: 11/20... Training loss: 0.1007
Epoch: 11/20... Training loss: 0.1010
Epoch: 11/20... Training loss: 0.1059
Epoch: 11/20... Training loss: 0.1035
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1081
Epoch: 11/20... Training loss: 0.1020
Epoch: 11/20... Training loss: 0.1027
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1068
Epoch: 11/20... Training loss: 0.1040
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1028
Epoch: 11/20... Training loss: 0.1063
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1041
Epoch: 11/20... Training loss: 0.1058
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1053
Epoch: 11/20... Training loss: 0.1073
Epoch: 11/20... Training loss: 0.1072
Epoch: 11/20... Training loss: 0.1052
Epoch: 11/20... Training loss: 0.1088
Epoch: 11/20... Training loss: 0.1067
Epoch: 11/20... Training loss: 0.1063
Epoch: 11/20... Training loss: 0.1060
Epoch: 11/20... Training loss: 0.1031
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.0994
Epoch: 11/20... Training loss: 0.1058
Epoch: 11/20... Training loss: 0.1064
Epoch: 11/20... Training loss: 0.1040
Epoch: 11/20... Training loss: 0.1028
Epoch: 11/20... Training loss: 0.1041
Epoch: 11/20... Training loss: 0.1058
Epoch: 11/20... Training loss: 0.1017
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1031
Epoch: 11/20... Training loss: 0.1006
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1023
Epoch: 11/20... Training loss: 0.1056
Epoch: 11/20... Training loss: 0.1020
Epoch: 11/20... Training loss: 0.1070
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1080
Epoch: 11/20... Training loss: 0.1017
Epoch: 11/20... Training loss: 0.1017
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1024
Epoch: 11/20... Training loss: 0.1068
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1072
Epoch: 11/20... Training loss: 0.1018
Epoch: 11/20... Training loss: 0.1059
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1068
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1076
Epoch: 11/20... Training loss: 0.1059
Epoch: 11/20... Training loss: 0.1061
Epoch: 11/20... Training loss: 0.1060
Epoch: 11/20... Training loss: 0.1043
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1065
Epoch: 11/20... Training loss: 0.0959
Epoch: 11/20... Training loss: 0.1048
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.1034
Epoch: 11/20... Training loss: 0.1074
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.1048
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1066
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1018
Epoch: 11/20... Training loss: 0.1021
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1003
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1071
Epoch: 11/20... Training loss: 0.1094
Epoch: 11/20... Training loss: 0.0998
Epoch: 11/20... Training loss: 0.1014
Epoch: 11/20... Training loss: 0.1034
Epoch: 11/20... Training loss: 0.1018
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1046
Epoch: 11/20... Training loss: 0.1102
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1005
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1070
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1006
Epoch: 11/20... Training loss: 0.1050
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.0987
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.1035
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1010
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1063
Epoch: 11/20... Training loss: 0.1080
Epoch: 11/20... Training loss: 0.1035
Epoch: 11/20... Training loss: 0.1032
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1089
Epoch: 11/20... Training loss: 0.1043
Epoch: 11/20... Training loss: 0.1024
Epoch: 11/20... Training loss: 0.0991
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1018
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.1022
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1074
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1031
Epoch: 11/20... Training loss: 0.1053
Epoch: 11/20... Training loss: 0.1046
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1007
Epoch: 11/20... Training loss: 0.1015
Epoch: 11/20... Training loss: 0.1065
Epoch: 11/20... Training loss: 0.1006
Epoch: 11/20... Training loss: 0.1034
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1066
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1021
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1023
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1049
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1028
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1035
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1015
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1050
Epoch: 11/20... Training loss: 0.1045
Epoch: 11/20... Training loss: 0.1031
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.1001
Epoch: 11/20... Training loss: 0.1071
Epoch: 11/20... Training loss: 0.1052
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1014
Epoch: 11/20... Training loss: 0.1012
Epoch: 11/20... Training loss: 0.0998
Epoch: 11/20... Training loss: 0.1028
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1069
Epoch: 11/20... Training loss: 0.1034
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1057
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1049
Epoch: 11/20... Training loss: 0.1060
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1051
Epoch: 11/20... Training loss: 0.1043
Epoch: 11/20... Training loss: 0.1052
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1008
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1022
Epoch: 11/20... Training loss: 0.1023
Epoch: 11/20... Training loss: 0.1020
Epoch: 11/20... Training loss: 0.1048
Epoch: 11/20... Training loss: 0.1053
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1010
Epoch: 11/20... Training loss: 0.1058
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1005
Epoch: 11/20... Training loss: 0.0994
Epoch: 11/20... Training loss: 0.1053
Epoch: 11/20... Training loss: 0.1010
Epoch: 11/20... Training loss: 0.1027
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1046
Epoch: 11/20... Training loss: 0.0997
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1050
Epoch: 11/20... Training loss: 0.1020
Epoch: 11/20... Training loss: 0.1067
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1029
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1019
Epoch: 11/20... Training loss: 0.0995
Epoch: 11/20... Training loss: 0.1035
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1000
Epoch: 11/20... Training loss: 0.1050
Epoch: 11/20... Training loss: 0.1027
Epoch: 11/20... Training loss: 0.1024
Epoch: 11/20... Training loss: 0.1025
Epoch: 11/20... Training loss: 0.1040
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1018
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1060
Epoch: 11/20... Training loss: 0.1023
Epoch: 11/20... Training loss: 0.1057
Epoch: 11/20... Training loss: 0.1044
Epoch: 11/20... Training loss: 0.1066
Epoch: 11/20... Training loss: 0.1002
Epoch: 11/20... Training loss: 0.1027
Epoch: 11/20... Training loss: 0.0999
Epoch: 11/20... Training loss: 0.1009
Epoch: 11/20... Training loss: 0.1009
Epoch: 11/20... Training loss: 0.0999
Epoch: 11/20... Training loss: 0.1009
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1052
Epoch: 11/20... Training loss: 0.1033
Epoch: 11/20... Training loss: 0.1017
Epoch: 11/20... Training loss: 0.1009
Epoch: 11/20... Training loss: 0.1030
Epoch: 11/20... Training loss: 0.0971
Epoch: 11/20... Training loss: 0.1038
Epoch: 11/20... Training loss: 0.1015
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1017
Epoch: 11/20... Training loss: 0.1041
Epoch: 11/20... Training loss: 0.1064
Epoch: 11/20... Training loss: 0.1037
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1049
Epoch: 11/20... Training loss: 0.1042
Epoch: 11/20... Training loss: 0.1054
Epoch: 11/20... Training loss: 0.1047
Epoch: 11/20... Training loss: 0.1026
Epoch: 11/20... Training loss: 0.1023
Epoch: 11/20... Training loss: 0.1021
Epoch: 11/20... Training loss: 0.0991
Epoch: 11/20... Training loss: 0.1095
Epoch: 11/20... Training loss: 0.1013
Epoch: 11/20... Training loss: 0.1039
Epoch: 11/20... Training loss: 0.1007
Epoch: 11/20... Training loss: 0.1055
Epoch: 11/20... Training loss: 0.1092
Epoch: 11/20... Training loss: 0.1012
Epoch: 11/20... Training loss: 0.1014
Epoch: 11/20... Training loss: 0.1036
Epoch: 11/20... Training loss: 0.1022
Epoch: 11/20... Training loss: 0.1057
Epoch: 11/20... Training loss: 0.1077
Epoch: 11/20... Training loss: 0.0995
Epoch: 11/20... Training loss: 0.0992
Epoch: 11/20... Training loss: 0.1092
Epoch: 11/20... Training loss: 0.1019
Epoch: 12/20... Training loss: 0.1053
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.1029
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.0988
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.1067
Epoch: 12/20... Training loss: 0.1040
Epoch: 12/20... Training loss: 0.1028
Epoch: 12/20... Training loss: 0.1066
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1007
Epoch: 12/20... Training loss: 0.1004
Epoch: 12/20... Training loss: 0.1061
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.1014
Epoch: 12/20... Training loss: 0.1027
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1010
Epoch: 12/20... Training loss: 0.1072
Epoch: 12/20... Training loss: 0.1059
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1053
Epoch: 12/20... Training loss: 0.1067
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.0976
Epoch: 12/20... Training loss: 0.1066
Epoch: 12/20... Training loss: 0.1009
Epoch: 12/20... Training loss: 0.1036
Epoch: 12/20... Training loss: 0.1023
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.0994
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.0992
Epoch: 12/20... Training loss: 0.1068
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.0995
Epoch: 12/20... Training loss: 0.1028
Epoch: 12/20... Training loss: 0.1062
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1025
Epoch: 12/20... Training loss: 0.1008
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1025
Epoch: 12/20... Training loss: 0.1092
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.1041
Epoch: 12/20... Training loss: 0.1014
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1051
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1009
Epoch: 12/20... Training loss: 0.1053
Epoch: 12/20... Training loss: 0.1036
Epoch: 12/20... Training loss: 0.1045
Epoch: 12/20... Training loss: 0.1051
Epoch: 12/20... Training loss: 0.1059
Epoch: 12/20... Training loss: 0.1029
Epoch: 12/20... Training loss: 0.1030
Epoch: 12/20... Training loss: 0.1011
Epoch: 12/20... Training loss: 0.1055
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.0979
Epoch: 12/20... Training loss: 0.1011
Epoch: 12/20... Training loss: 0.1049
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1048
Epoch: 12/20... Training loss: 0.1065
Epoch: 12/20... Training loss: 0.0989
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.0990
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1012
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1031
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.1078
Epoch: 12/20... Training loss: 0.1017
Epoch: 12/20... Training loss: 0.1004
Epoch: 12/20... Training loss: 0.1015
Epoch: 12/20... Training loss: 0.1062
Epoch: 12/20... Training loss: 0.1051
Epoch: 12/20... Training loss: 0.1025
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1017
Epoch: 12/20... Training loss: 0.0994
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1065
Epoch: 12/20... Training loss: 0.1019
Epoch: 12/20... Training loss: 0.1040
Epoch: 12/20... Training loss: 0.1075
Epoch: 12/20... Training loss: 0.0999
Epoch: 12/20... Training loss: 0.1001
Epoch: 12/20... Training loss: 0.0994
Epoch: 12/20... Training loss: 0.1042
Epoch: 12/20... Training loss: 0.0999
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1008
Epoch: 12/20... Training loss: 0.1074
Epoch: 12/20... Training loss: 0.1048
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.1000
Epoch: 12/20... Training loss: 0.1025
Epoch: 12/20... Training loss: 0.1010
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1003
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1045
Epoch: 12/20... Training loss: 0.1039
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1060
Epoch: 12/20... Training loss: 0.1049
Epoch: 12/20... Training loss: 0.1002
Epoch: 12/20... Training loss: 0.1051
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1063
Epoch: 12/20... Training loss: 0.1033
Epoch: 12/20... Training loss: 0.1059
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1030
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1000
Epoch: 12/20... Training loss: 0.1026
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1045
Epoch: 12/20... Training loss: 0.1062
Epoch: 12/20... Training loss: 0.1030
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.0997
Epoch: 12/20... Training loss: 0.1029
Epoch: 12/20... Training loss: 0.1031
Epoch: 12/20... Training loss: 0.0993
Epoch: 12/20... Training loss: 0.0992
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1040
Epoch: 12/20... Training loss: 0.1023
Epoch: 12/20... Training loss: 0.1005
Epoch: 12/20... Training loss: 0.1060
Epoch: 12/20... Training loss: 0.0994
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1001
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.0997
Epoch: 12/20... Training loss: 0.1064
Epoch: 12/20... Training loss: 0.1029
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1067
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1000
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.0984
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1032
Epoch: 12/20... Training loss: 0.1006
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.1049
Epoch: 12/20... Training loss: 0.1025
Epoch: 12/20... Training loss: 0.1012
Epoch: 12/20... Training loss: 0.0996
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1009
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.1006
Epoch: 12/20... Training loss: 0.1011
Epoch: 12/20... Training loss: 0.1053
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1080
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.0977
Epoch: 12/20... Training loss: 0.0985
Epoch: 12/20... Training loss: 0.1039
Epoch: 12/20... Training loss: 0.1027
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1065
Epoch: 12/20... Training loss: 0.1053
Epoch: 12/20... Training loss: 0.1001
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1003
Epoch: 12/20... Training loss: 0.1000
Epoch: 12/20... Training loss: 0.0992
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1034
Epoch: 12/20... Training loss: 0.1012
Epoch: 12/20... Training loss: 0.1050
Epoch: 12/20... Training loss: 0.0998
Epoch: 12/20... Training loss: 0.1070
Epoch: 12/20... Training loss: 0.0987
Epoch: 12/20... Training loss: 0.1015
Epoch: 12/20... Training loss: 0.1031
Epoch: 12/20... Training loss: 0.1018
Epoch: 12/20... Training loss: 0.1005
Epoch: 12/20... Training loss: 0.0983
Epoch: 12/20... Training loss: 0.1048
Epoch: 12/20... Training loss: 0.1032
Epoch: 12/20... Training loss: 0.1055
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1064
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1043
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.0986
Epoch: 12/20... Training loss: 0.1021
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.1015
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1027
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1024
Epoch: 12/20... Training loss: 0.1014
Epoch: 12/20... Training loss: 0.0992
Epoch: 12/20... Training loss: 0.1015
Epoch: 12/20... Training loss: 0.1045
Epoch: 12/20... Training loss: 0.1038
Epoch: 12/20... Training loss: 0.1073
Epoch: 12/20... Training loss: 0.1000
Epoch: 12/20... Training loss: 0.1013
Epoch: 12/20... Training loss: 0.1062
Epoch: 12/20... Training loss: 0.1048
Epoch: 12/20... Training loss: 0.1029
Epoch: 12/20... Training loss: 0.1039
Epoch: 12/20... Training loss: 0.1031
Epoch: 12/20... Training loss: 0.1020
Epoch: 12/20... Training loss: 0.1010
Epoch: 12/20... Training loss: 0.1049
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1056
Epoch: 12/20... Training loss: 0.1002
Epoch: 12/20... Training loss: 0.1012
Epoch: 12/20... Training loss: 0.1016
Epoch: 12/20... Training loss: 0.0985
Epoch: 12/20... Training loss: 0.1030
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1065
Epoch: 12/20... Training loss: 0.0972
Epoch: 12/20... Training loss: 0.1061
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1042
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1015
Epoch: 12/20... Training loss: 0.1011
Epoch: 12/20... Training loss: 0.1042
Epoch: 12/20... Training loss: 0.0995
Epoch: 12/20... Training loss: 0.1028
Epoch: 12/20... Training loss: 0.0989
Epoch: 12/20... Training loss: 0.1003
Epoch: 12/20... Training loss: 0.1009
Epoch: 12/20... Training loss: 0.1011
Epoch: 12/20... Training loss: 0.1023
Epoch: 12/20... Training loss: 0.1017
Epoch: 12/20... Training loss: 0.1033
Epoch: 12/20... Training loss: 0.1039
Epoch: 12/20... Training loss: 0.1072
Epoch: 12/20... Training loss: 0.0986
Epoch: 12/20... Training loss: 0.1033
Epoch: 12/20... Training loss: 0.1016
Epoch: 12/20... Training loss: 0.1046
Epoch: 12/20... Training loss: 0.1041
Epoch: 12/20... Training loss: 0.1019
Epoch: 12/20... Training loss: 0.1076
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.1019
Epoch: 12/20... Training loss: 0.1023
Epoch: 12/20... Training loss: 0.1054
Epoch: 12/20... Training loss: 0.1035
Epoch: 12/20... Training loss: 0.1012
Epoch: 12/20... Training loss: 0.1041
Epoch: 12/20... Training loss: 0.1002
Epoch: 12/20... Training loss: 0.1041
Epoch: 12/20... Training loss: 0.1068
Epoch: 12/20... Training loss: 0.1022
Epoch: 12/20... Training loss: 0.1037
Epoch: 12/20... Training loss: 0.1040
Epoch: 12/20... Training loss: 0.1027
Epoch: 12/20... Training loss: 0.1044
Epoch: 12/20... Training loss: 0.0982
Epoch: 12/20... Training loss: 0.1008
Epoch: 12/20... Training loss: 0.1065
Epoch: 12/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1032
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.1046
Epoch: 13/20... Training loss: 0.1025
Epoch: 13/20... Training loss: 0.1011
Epoch: 13/20... Training loss: 0.1046
Epoch: 13/20... Training loss: 0.1052
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1011
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1027
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.0974
Epoch: 13/20... Training loss: 0.1054
Epoch: 13/20... Training loss: 0.1003
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1052
Epoch: 13/20... Training loss: 0.1064
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1046
Epoch: 13/20... Training loss: 0.1013
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.1067
Epoch: 13/20... Training loss: 0.1054
Epoch: 13/20... Training loss: 0.1060
Epoch: 13/20... Training loss: 0.1027
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.0990
Epoch: 13/20... Training loss: 0.1057
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1013
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1008
Epoch: 13/20... Training loss: 0.1047
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1005
Epoch: 13/20... Training loss: 0.1018
Epoch: 13/20... Training loss: 0.1077
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1064
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1018
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1051
Epoch: 13/20... Training loss: 0.1000
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1018
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1057
Epoch: 13/20... Training loss: 0.1044
Epoch: 13/20... Training loss: 0.1037
Epoch: 13/20... Training loss: 0.0988
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1009
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1043
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1061
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.1076
Epoch: 13/20... Training loss: 0.1042
Epoch: 13/20... Training loss: 0.1011
Epoch: 13/20... Training loss: 0.1053
Epoch: 13/20... Training loss: 0.1066
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1019
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1045
Epoch: 13/20... Training loss: 0.0998
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1040
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.0990
Epoch: 13/20... Training loss: 0.1031
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1009
Epoch: 13/20... Training loss: 0.1040
Epoch: 13/20... Training loss: 0.0990
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1062
Epoch: 13/20... Training loss: 0.1068
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1038
Epoch: 13/20... Training loss: 0.1035
Epoch: 13/20... Training loss: 0.1057
Epoch: 13/20... Training loss: 0.0998
Epoch: 13/20... Training loss: 0.1013
Epoch: 13/20... Training loss: 0.0973
Epoch: 13/20... Training loss: 0.1020
Epoch: 13/20... Training loss: 0.1071
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1032
Epoch: 13/20... Training loss: 0.1000
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1013
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.1005
Epoch: 13/20... Training loss: 0.1022
Epoch: 13/20... Training loss: 0.1014
Epoch: 13/20... Training loss: 0.1045
Epoch: 13/20... Training loss: 0.0996
Epoch: 13/20... Training loss: 0.1015
Epoch: 13/20... Training loss: 0.1043
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1063
Epoch: 13/20... Training loss: 0.0971
Epoch: 13/20... Training loss: 0.1056
Epoch: 13/20... Training loss: 0.1017
Epoch: 13/20... Training loss: 0.1068
Epoch: 13/20... Training loss: 0.1006
Epoch: 13/20... Training loss: 0.0996
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1014
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.0996
Epoch: 13/20... Training loss: 0.1013
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1027
Epoch: 13/20... Training loss: 0.1009
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1049
Epoch: 13/20... Training loss: 0.1004
Epoch: 13/20... Training loss: 0.0991
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.0953
Epoch: 13/20... Training loss: 0.1032
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1032
Epoch: 13/20... Training loss: 0.0997
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1039
Epoch: 13/20... Training loss: 0.1039
Epoch: 13/20... Training loss: 0.0987
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1045
Epoch: 13/20... Training loss: 0.0980
Epoch: 13/20... Training loss: 0.1050
Epoch: 13/20... Training loss: 0.0986
Epoch: 13/20... Training loss: 0.1048
Epoch: 13/20... Training loss: 0.1050
Epoch: 13/20... Training loss: 0.1040
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.0988
Epoch: 13/20... Training loss: 0.1040
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1014
Epoch: 13/20... Training loss: 0.0995
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.0984
Epoch: 13/20... Training loss: 0.0997
Epoch: 13/20... Training loss: 0.1016
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1045
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.1033
Epoch: 13/20... Training loss: 0.0958
Epoch: 13/20... Training loss: 0.0991
Epoch: 13/20... Training loss: 0.1004
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.1044
Epoch: 13/20... Training loss: 0.1086
Epoch: 13/20... Training loss: 0.1020
Epoch: 13/20... Training loss: 0.1076
Epoch: 13/20... Training loss: 0.0969
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.1020
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1039
Epoch: 13/20... Training loss: 0.0962
Epoch: 13/20... Training loss: 0.1040
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.0972
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1022
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1051
Epoch: 13/20... Training loss: 0.1018
Epoch: 13/20... Training loss: 0.0972
Epoch: 13/20... Training loss: 0.1051
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1046
Epoch: 13/20... Training loss: 0.1032
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.0958
Epoch: 13/20... Training loss: 0.1053
Epoch: 13/20... Training loss: 0.0987
Epoch: 13/20... Training loss: 0.1058
Epoch: 13/20... Training loss: 0.1033
Epoch: 13/20... Training loss: 0.1005
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.0997
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.0985
Epoch: 13/20... Training loss: 0.1031
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1004
Epoch: 13/20... Training loss: 0.1004
Epoch: 13/20... Training loss: 0.1006
Epoch: 13/20... Training loss: 0.1036
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.0993
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1014
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1037
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1021
Epoch: 13/20... Training loss: 0.1011
Epoch: 13/20... Training loss: 0.0983
Epoch: 13/20... Training loss: 0.1015
Epoch: 13/20... Training loss: 0.0974
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1024
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.0976
Epoch: 13/20... Training loss: 0.1025
Epoch: 13/20... Training loss: 0.1027
Epoch: 13/20... Training loss: 0.0982
Epoch: 13/20... Training loss: 0.1048
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1009
Epoch: 13/20... Training loss: 0.1025
Epoch: 13/20... Training loss: 0.1004
Epoch: 13/20... Training loss: 0.1007
Epoch: 13/20... Training loss: 0.1003
Epoch: 13/20... Training loss: 0.1031
Epoch: 13/20... Training loss: 0.1012
Epoch: 13/20... Training loss: 0.1041
Epoch: 13/20... Training loss: 0.1039
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1010
Epoch: 13/20... Training loss: 0.1009
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1020
Epoch: 13/20... Training loss: 0.0973
Epoch: 13/20... Training loss: 0.1045
Epoch: 13/20... Training loss: 0.1043
Epoch: 13/20... Training loss: 0.1039
Epoch: 13/20... Training loss: 0.0972
Epoch: 13/20... Training loss: 0.0980
Epoch: 13/20... Training loss: 0.1019
Epoch: 13/20... Training loss: 0.1043
Epoch: 13/20... Training loss: 0.1054
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.1034
Epoch: 13/20... Training loss: 0.1046
Epoch: 13/20... Training loss: 0.1027
Epoch: 13/20... Training loss: 0.0974
Epoch: 13/20... Training loss: 0.1042
Epoch: 13/20... Training loss: 0.1030
Epoch: 13/20... Training loss: 0.1029
Epoch: 13/20... Training loss: 0.0991
Epoch: 13/20... Training loss: 0.1025
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1017
Epoch: 13/20... Training loss: 0.0974
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.1051
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1023
Epoch: 13/20... Training loss: 0.1073
Epoch: 13/20... Training loss: 0.1033
Epoch: 13/20... Training loss: 0.1026
Epoch: 13/20... Training loss: 0.1028
Epoch: 13/20... Training loss: 0.1049
Epoch: 13/20... Training loss: 0.0999
Epoch: 13/20... Training loss: 0.1001
Epoch: 13/20... Training loss: 0.1025
Epoch: 13/20... Training loss: 0.1002
Epoch: 13/20... Training loss: 0.1010
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.0996
Epoch: 14/20... Training loss: 0.1001
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.1032
Epoch: 14/20... Training loss: 0.1011
Epoch: 14/20... Training loss: 0.0995
Epoch: 14/20... Training loss: 0.1040
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.0983
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.0982
Epoch: 14/20... Training loss: 0.0988
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.0975
Epoch: 14/20... Training loss: 0.0996
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.1004
Epoch: 14/20... Training loss: 0.1015
Epoch: 14/20... Training loss: 0.0998
Epoch: 14/20... Training loss: 0.1033
Epoch: 14/20... Training loss: 0.1051
Epoch: 14/20... Training loss: 0.1011
Epoch: 14/20... Training loss: 0.0964
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.0992
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.0976
Epoch: 14/20... Training loss: 0.1020
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1015
Epoch: 14/20... Training loss: 0.1000
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.1036
Epoch: 14/20... Training loss: 0.0987
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.1071
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.1031
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.0982
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.0998
Epoch: 14/20... Training loss: 0.1034
Epoch: 14/20... Training loss: 0.1011
Epoch: 14/20... Training loss: 0.1010
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1001
Epoch: 14/20... Training loss: 0.0998
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.1028
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.0990
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.1010
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1027
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1053
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.0996
Epoch: 14/20... Training loss: 0.1002
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1049
Epoch: 14/20... Training loss: 0.1037
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1042
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.1043
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.1004
Epoch: 14/20... Training loss: 0.1001
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.0991
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.0985
Epoch: 14/20... Training loss: 0.1047
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.0996
Epoch: 14/20... Training loss: 0.1022
Epoch: 14/20... Training loss: 0.1043
Epoch: 14/20... Training loss: 0.0998
Epoch: 14/20... Training loss: 0.1030
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.0974
Epoch: 14/20... Training loss: 0.0978
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.0979
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.1011
Epoch: 14/20... Training loss: 0.1024
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.0997
Epoch: 14/20... Training loss: 0.1000
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.1031
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1039
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1034
Epoch: 14/20... Training loss: 0.0993
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.1018
Epoch: 14/20... Training loss: 0.1047
Epoch: 14/20... Training loss: 0.1016
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1049
Epoch: 14/20... Training loss: 0.1049
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1031
Epoch: 14/20... Training loss: 0.1003
Epoch: 14/20... Training loss: 0.1024
Epoch: 14/20... Training loss: 0.0959
Epoch: 14/20... Training loss: 0.1055
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.1003
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1031
Epoch: 14/20... Training loss: 0.1011
Epoch: 14/20... Training loss: 0.1036
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.0992
Epoch: 14/20... Training loss: 0.0995
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.0981
Epoch: 14/20... Training loss: 0.1012
Epoch: 14/20... Training loss: 0.1034
Epoch: 14/20... Training loss: 0.0992
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.1010
Epoch: 14/20... Training loss: 0.1007
Epoch: 14/20... Training loss: 0.0995
Epoch: 14/20... Training loss: 0.0977
Epoch: 14/20... Training loss: 0.1033
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1010
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1021
Epoch: 14/20... Training loss: 0.0998
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1047
Epoch: 14/20... Training loss: 0.0997
Epoch: 14/20... Training loss: 0.0970
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1028
Epoch: 14/20... Training loss: 0.0979
Epoch: 14/20... Training loss: 0.0990
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1032
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1021
Epoch: 14/20... Training loss: 0.1021
Epoch: 14/20... Training loss: 0.0982
Epoch: 14/20... Training loss: 0.1034
Epoch: 14/20... Training loss: 0.1003
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.0997
Epoch: 14/20... Training loss: 0.1035
Epoch: 14/20... Training loss: 0.1026
Epoch: 14/20... Training loss: 0.0996
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1030
Epoch: 14/20... Training loss: 0.1028
Epoch: 14/20... Training loss: 0.1016
Epoch: 14/20... Training loss: 0.1016
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1054
Epoch: 14/20... Training loss: 0.1053
Epoch: 14/20... Training loss: 0.0978
Epoch: 14/20... Training loss: 0.0985
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1015
Epoch: 14/20... Training loss: 0.1061
Epoch: 14/20... Training loss: 0.1022
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1059
Epoch: 14/20... Training loss: 0.1037
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.0971
Epoch: 14/20... Training loss: 0.1056
Epoch: 14/20... Training loss: 0.1015
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.1042
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.0988
Epoch: 14/20... Training loss: 0.1024
Epoch: 14/20... Training loss: 0.1039
Epoch: 14/20... Training loss: 0.0997
Epoch: 14/20... Training loss: 0.1049
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1045
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1065
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.0974
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.0987
Epoch: 14/20... Training loss: 0.1033
Epoch: 14/20... Training loss: 0.0988
Epoch: 14/20... Training loss: 0.0999
Epoch: 14/20... Training loss: 0.1041
Epoch: 14/20... Training loss: 0.1018
Epoch: 14/20... Training loss: 0.0986
Epoch: 14/20... Training loss: 0.0988
Epoch: 14/20... Training loss: 0.1053
Epoch: 14/20... Training loss: 0.1016
Epoch: 14/20... Training loss: 0.0968
Epoch: 14/20... Training loss: 0.1002
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.0962
Epoch: 14/20... Training loss: 0.0993
Epoch: 14/20... Training loss: 0.0997
Epoch: 14/20... Training loss: 0.0994
Epoch: 14/20... Training loss: 0.1007
Epoch: 14/20... Training loss: 0.0992
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.1066
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1055
Epoch: 14/20... Training loss: 0.1050
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1001
Epoch: 14/20... Training loss: 0.1020
Epoch: 14/20... Training loss: 0.0990
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.0980
Epoch: 14/20... Training loss: 0.1002
Epoch: 14/20... Training loss: 0.1036
Epoch: 14/20... Training loss: 0.1038
Epoch: 14/20... Training loss: 0.1049
Epoch: 14/20... Training loss: 0.0993
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1057
Epoch: 14/20... Training loss: 0.0963
Epoch: 14/20... Training loss: 0.1025
Epoch: 14/20... Training loss: 0.1031
Epoch: 14/20... Training loss: 0.0968
Epoch: 14/20... Training loss: 0.0983
Epoch: 14/20... Training loss: 0.1019
Epoch: 14/20... Training loss: 0.1029
Epoch: 14/20... Training loss: 0.1009
Epoch: 14/20... Training loss: 0.0986
Epoch: 14/20... Training loss: 0.0962
Epoch: 14/20... Training loss: 0.1003
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1005
Epoch: 14/20... Training loss: 0.1008
Epoch: 14/20... Training loss: 0.1014
Epoch: 14/20... Training loss: 0.1054
Epoch: 14/20... Training loss: 0.0988
Epoch: 14/20... Training loss: 0.1032
Epoch: 14/20... Training loss: 0.1037
Epoch: 14/20... Training loss: 0.1013
Epoch: 14/20... Training loss: 0.1017
Epoch: 14/20... Training loss: 0.0973
Epoch: 14/20... Training loss: 0.1007
Epoch: 14/20... Training loss: 0.1048
Epoch: 14/20... Training loss: 0.0991
Epoch: 14/20... Training loss: 0.1000
Epoch: 14/20... Training loss: 0.0947
Epoch: 14/20... Training loss: 0.1023
Epoch: 14/20... Training loss: 0.1018
Epoch: 14/20... Training loss: 0.1006
Epoch: 14/20... Training loss: 0.0984
Epoch: 14/20... Training loss: 0.0969
Epoch: 15/20... Training loss: 0.1028
Epoch: 15/20... Training loss: 0.1015
Epoch: 15/20... Training loss: 0.1002
Epoch: 15/20... Training loss: 0.0993
Epoch: 15/20... Training loss: 0.0977
Epoch: 15/20... Training loss: 0.0968
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1055
Epoch: 15/20... Training loss: 0.1027
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.1036
Epoch: 15/20... Training loss: 0.1026
Epoch: 15/20... Training loss: 0.0991
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.0995
Epoch: 15/20... Training loss: 0.1039
Epoch: 15/20... Training loss: 0.1028
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.0981
Epoch: 15/20... Training loss: 0.0989
Epoch: 15/20... Training loss: 0.0977
Epoch: 15/20... Training loss: 0.0971
Epoch: 15/20... Training loss: 0.1028
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.1033
Epoch: 15/20... Training loss: 0.1048
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.1009
Epoch: 15/20... Training loss: 0.1027
Epoch: 15/20... Training loss: 0.1024
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.1045
Epoch: 15/20... Training loss: 0.1002
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.0998
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.0995
Epoch: 15/20... Training loss: 0.1010
Epoch: 15/20... Training loss: 0.1005
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.1054
Epoch: 15/20... Training loss: 0.1024
Epoch: 15/20... Training loss: 0.1011
Epoch: 15/20... Training loss: 0.0993
Epoch: 15/20... Training loss: 0.0989
Epoch: 15/20... Training loss: 0.1059
Epoch: 15/20... Training loss: 0.1033
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.0974
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.0974
Epoch: 15/20... Training loss: 0.1009
Epoch: 15/20... Training loss: 0.1017
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.0982
Epoch: 15/20... Training loss: 0.0990
Epoch: 15/20... Training loss: 0.0946
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.1036
Epoch: 15/20... Training loss: 0.1066
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.1010
Epoch: 15/20... Training loss: 0.1032
Epoch: 15/20... Training loss: 0.0968
Epoch: 15/20... Training loss: 0.1033
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.0981
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.1004
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.1023
Epoch: 15/20... Training loss: 0.1071
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.0974
Epoch: 15/20... Training loss: 0.1030
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.0985
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1036
Epoch: 15/20... Training loss: 0.1002
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1046
Epoch: 15/20... Training loss: 0.1022
Epoch: 15/20... Training loss: 0.1052
Epoch: 15/20... Training loss: 0.1039
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1033
Epoch: 15/20... Training loss: 0.0988
Epoch: 15/20... Training loss: 0.0990
Epoch: 15/20... Training loss: 0.0950
Epoch: 15/20... Training loss: 0.0985
Epoch: 15/20... Training loss: 0.1010
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.1004
Epoch: 15/20... Training loss: 0.0984
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.1017
Epoch: 15/20... Training loss: 0.0980
Epoch: 15/20... Training loss: 0.1026
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1025
Epoch: 15/20... Training loss: 0.1050
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.0998
Epoch: 15/20... Training loss: 0.1004
Epoch: 15/20... Training loss: 0.0972
Epoch: 15/20... Training loss: 0.1016
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.0967
Epoch: 15/20... Training loss: 0.1024
Epoch: 15/20... Training loss: 0.0983
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.1016
Epoch: 15/20... Training loss: 0.1017
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1000
Epoch: 15/20... Training loss: 0.1007
Epoch: 15/20... Training loss: 0.1025
Epoch: 15/20... Training loss: 0.1026
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.1026
Epoch: 15/20... Training loss: 0.1031
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.0998
Epoch: 15/20... Training loss: 0.1047
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1015
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.0982
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.1011
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.1037
Epoch: 15/20... Training loss: 0.1015
Epoch: 15/20... Training loss: 0.0986
Epoch: 15/20... Training loss: 0.0976
Epoch: 15/20... Training loss: 0.0976
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1018
Epoch: 15/20... Training loss: 0.1028
Epoch: 15/20... Training loss: 0.1031
Epoch: 15/20... Training loss: 0.0999
Epoch: 15/20... Training loss: 0.1011
Epoch: 15/20... Training loss: 0.0982
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.0975
Epoch: 15/20... Training loss: 0.0984
Epoch: 15/20... Training loss: 0.1007
Epoch: 15/20... Training loss: 0.1017
Epoch: 15/20... Training loss: 0.1059
Epoch: 15/20... Training loss: 0.0960
Epoch: 15/20... Training loss: 0.1023
Epoch: 15/20... Training loss: 0.0991
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.0992
Epoch: 15/20... Training loss: 0.1055
Epoch: 15/20... Training loss: 0.1016
Epoch: 15/20... Training loss: 0.1043
Epoch: 15/20... Training loss: 0.1007
Epoch: 15/20... Training loss: 0.0970
Epoch: 15/20... Training loss: 0.0990
Epoch: 15/20... Training loss: 0.0990
Epoch: 15/20... Training loss: 0.1049
Epoch: 15/20... Training loss: 0.1037
Epoch: 15/20... Training loss: 0.0995
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.0993
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.1015
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.1032
Epoch: 15/20... Training loss: 0.1032
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.1010
Epoch: 15/20... Training loss: 0.1042
Epoch: 15/20... Training loss: 0.1022
Epoch: 15/20... Training loss: 0.1000
Epoch: 15/20... Training loss: 0.0973
Epoch: 15/20... Training loss: 0.0984
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1002
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1003
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1015
Epoch: 15/20... Training loss: 0.1021
Epoch: 15/20... Training loss: 0.1031
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.0988
Epoch: 15/20... Training loss: 0.1009
Epoch: 15/20... Training loss: 0.1004
Epoch: 15/20... Training loss: 0.1059
Epoch: 15/20... Training loss: 0.1027
Epoch: 15/20... Training loss: 0.1016
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.1029
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.0967
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.0989
Epoch: 15/20... Training loss: 0.0967
Epoch: 15/20... Training loss: 0.0955
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.1011
Epoch: 15/20... Training loss: 0.1008
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1023
Epoch: 15/20... Training loss: 0.1031
Epoch: 15/20... Training loss: 0.1001
Epoch: 15/20... Training loss: 0.0969
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.0993
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.1011
Epoch: 15/20... Training loss: 0.1044
Epoch: 15/20... Training loss: 0.1004
Epoch: 15/20... Training loss: 0.0985
Epoch: 15/20... Training loss: 0.0998
Epoch: 15/20... Training loss: 0.1020
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.1014
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1023
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.1027
Epoch: 15/20... Training loss: 0.1000
Epoch: 15/20... Training loss: 0.1009
Epoch: 15/20... Training loss: 0.1013
Epoch: 15/20... Training loss: 0.1012
Epoch: 15/20... Training loss: 0.1025
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.0996
Epoch: 15/20... Training loss: 0.0978
Epoch: 15/20... Training loss: 0.0997
Epoch: 15/20... Training loss: 0.1032
Epoch: 15/20... Training loss: 0.1018
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.0988
Epoch: 15/20... Training loss: 0.1035
Epoch: 15/20... Training loss: 0.0980
Epoch: 15/20... Training loss: 0.0983
Epoch: 15/20... Training loss: 0.0967
Epoch: 15/20... Training loss: 0.1033
Epoch: 15/20... Training loss: 0.0994
Epoch: 15/20... Training loss: 0.0985
Epoch: 15/20... Training loss: 0.1024
Epoch: 15/20... Training loss: 0.0962
Epoch: 15/20... Training loss: 0.0986
Epoch: 15/20... Training loss: 0.1006
Epoch: 15/20... Training loss: 0.1003
Epoch: 15/20... Training loss: 0.0975
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.0987
Epoch: 15/20... Training loss: 0.1040
Epoch: 15/20... Training loss: 0.1019
Epoch: 15/20... Training loss: 0.1010
Epoch: 15/20... Training loss: 0.0983
Epoch: 15/20... Training loss: 0.0993
Epoch: 15/20... Training loss: 0.1038
Epoch: 15/20... Training loss: 0.0991
Epoch: 15/20... Training loss: 0.1007
Epoch: 15/20... Training loss: 0.1031
Epoch: 15/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.0984
Epoch: 16/20... Training loss: 0.1047
Epoch: 16/20... Training loss: 0.1029
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.0975
Epoch: 16/20... Training loss: 0.1019
Epoch: 16/20... Training loss: 0.0973
Epoch: 16/20... Training loss: 0.1021
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.1002
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.0982
Epoch: 16/20... Training loss: 0.1012
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.1052
Epoch: 16/20... Training loss: 0.1034
Epoch: 16/20... Training loss: 0.1024
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0992
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.0985
Epoch: 16/20... Training loss: 0.1042
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.0976
Epoch: 16/20... Training loss: 0.0975
Epoch: 16/20... Training loss: 0.0974
Epoch: 16/20... Training loss: 0.1009
Epoch: 16/20... Training loss: 0.1022
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.0983
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.0969
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.0966
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.0948
Epoch: 16/20... Training loss: 0.1023
Epoch: 16/20... Training loss: 0.0989
Epoch: 16/20... Training loss: 0.1032
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1029
Epoch: 16/20... Training loss: 0.1018
Epoch: 16/20... Training loss: 0.1029
Epoch: 16/20... Training loss: 0.1021
Epoch: 16/20... Training loss: 0.0983
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.1002
Epoch: 16/20... Training loss: 0.1015
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.1029
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1053
Epoch: 16/20... Training loss: 0.1015
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.1037
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1021
Epoch: 16/20... Training loss: 0.0990
Epoch: 16/20... Training loss: 0.0987
Epoch: 16/20... Training loss: 0.1037
Epoch: 16/20... Training loss: 0.0953
Epoch: 16/20... Training loss: 0.1014
Epoch: 16/20... Training loss: 0.1026
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0964
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1019
Epoch: 16/20... Training loss: 0.0998
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.1033
Epoch: 16/20... Training loss: 0.0983
Epoch: 16/20... Training loss: 0.1036
Epoch: 16/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.1019
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.1044
Epoch: 16/20... Training loss: 0.0967
Epoch: 16/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.1052
Epoch: 16/20... Training loss: 0.1012
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1026
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.0963
Epoch: 16/20... Training loss: 0.1049
Epoch: 16/20... Training loss: 0.0993
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.1051
Epoch: 16/20... Training loss: 0.1024
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1011
Epoch: 16/20... Training loss: 0.0971
Epoch: 16/20... Training loss: 0.1014
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1023
Epoch: 16/20... Training loss: 0.1053
Epoch: 16/20... Training loss: 0.0985
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.1012
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.0982
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.0985
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0979
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.1021
Epoch: 16/20... Training loss: 0.0939
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.0980
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1027
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.1011
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1018
Epoch: 16/20... Training loss: 0.1042
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.1022
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.1017
Epoch: 16/20... Training loss: 0.0977
Epoch: 16/20... Training loss: 0.0972
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1038
Epoch: 16/20... Training loss: 0.1025
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.0972
Epoch: 16/20... Training loss: 0.1006
Epoch: 16/20... Training loss: 0.0968
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.1002
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.1033
Epoch: 16/20... Training loss: 0.1036
Epoch: 16/20... Training loss: 0.1019
Epoch: 16/20... Training loss: 0.0971
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.1011
Epoch: 16/20... Training loss: 0.1009
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1046
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.0996
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.1009
Epoch: 16/20... Training loss: 0.0969
Epoch: 16/20... Training loss: 0.1025
Epoch: 16/20... Training loss: 0.1027
Epoch: 16/20... Training loss: 0.0996
Epoch: 16/20... Training loss: 0.0967
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1009
Epoch: 16/20... Training loss: 0.0979
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.1012
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.1024
Epoch: 16/20... Training loss: 0.0982
Epoch: 16/20... Training loss: 0.1022
Epoch: 16/20... Training loss: 0.0980
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1006
Epoch: 16/20... Training loss: 0.1023
Epoch: 16/20... Training loss: 0.1023
Epoch: 16/20... Training loss: 0.0965
Epoch: 16/20... Training loss: 0.1028
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.1014
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.1043
Epoch: 16/20... Training loss: 0.0993
Epoch: 16/20... Training loss: 0.0963
Epoch: 16/20... Training loss: 0.0973
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.0979
Epoch: 16/20... Training loss: 0.1017
Epoch: 16/20... Training loss: 0.0968
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.0977
Epoch: 16/20... Training loss: 0.0976
Epoch: 16/20... Training loss: 0.1025
Epoch: 16/20... Training loss: 0.0955
Epoch: 16/20... Training loss: 0.1028
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.1037
Epoch: 16/20... Training loss: 0.1007
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.0973
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.0955
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.1040
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.1055
Epoch: 16/20... Training loss: 0.0999
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.0985
Epoch: 16/20... Training loss: 0.0970
Epoch: 16/20... Training loss: 0.0987
Epoch: 16/20... Training loss: 0.1011
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1013
Epoch: 16/20... Training loss: 0.0992
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1005
Epoch: 16/20... Training loss: 0.0996
Epoch: 16/20... Training loss: 0.0954
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.1001
Epoch: 16/20... Training loss: 0.0983
Epoch: 16/20... Training loss: 0.0982
Epoch: 16/20... Training loss: 0.0962
Epoch: 16/20... Training loss: 0.1006
Epoch: 16/20... Training loss: 0.1020
Epoch: 16/20... Training loss: 0.0987
Epoch: 16/20... Training loss: 0.0993
Epoch: 16/20... Training loss: 0.1006
Epoch: 16/20... Training loss: 0.0976
Epoch: 16/20... Training loss: 0.1029
Epoch: 16/20... Training loss: 0.0997
Epoch: 16/20... Training loss: 0.0991
Epoch: 16/20... Training loss: 0.1024
Epoch: 16/20... Training loss: 0.0988
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.1000
Epoch: 16/20... Training loss: 0.0986
Epoch: 16/20... Training loss: 0.0981
Epoch: 16/20... Training loss: 0.1014
Epoch: 16/20... Training loss: 0.1003
Epoch: 16/20... Training loss: 0.1016
Epoch: 16/20... Training loss: 0.0995
Epoch: 16/20... Training loss: 0.1010
Epoch: 16/20... Training loss: 0.1008
Epoch: 16/20... Training loss: 0.1004
Epoch: 16/20... Training loss: 0.0992
Epoch: 16/20... Training loss: 0.0990
Epoch: 16/20... Training loss: 0.0985
Epoch: 16/20... Training loss: 0.1019
Epoch: 16/20... Training loss: 0.1043
Epoch: 16/20... Training loss: 0.0994
Epoch: 16/20... Training loss: 0.0990
Epoch: 17/20... Training loss: 0.0961
Epoch: 17/20... Training loss: 0.0984
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.0997
Epoch: 17/20... Training loss: 0.0977
Epoch: 17/20... Training loss: 0.0997
Epoch: 17/20... Training loss: 0.1019
Epoch: 17/20... Training loss: 0.1051
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0977
Epoch: 17/20... Training loss: 0.0975
Epoch: 17/20... Training loss: 0.1024
Epoch: 17/20... Training loss: 0.0971
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.1031
Epoch: 17/20... Training loss: 0.1025
Epoch: 17/20... Training loss: 0.1010
Epoch: 17/20... Training loss: 0.0994
Epoch: 17/20... Training loss: 0.1045
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.0977
Epoch: 17/20... Training loss: 0.1033
Epoch: 17/20... Training loss: 0.1010
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.1020
Epoch: 17/20... Training loss: 0.1033
Epoch: 17/20... Training loss: 0.0992
Epoch: 17/20... Training loss: 0.1023
Epoch: 17/20... Training loss: 0.0971
Epoch: 17/20... Training loss: 0.0971
Epoch: 17/20... Training loss: 0.1004
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1032
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.1016
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.1016
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1018
Epoch: 17/20... Training loss: 0.1023
Epoch: 17/20... Training loss: 0.1045
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.1030
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1026
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.1005
Epoch: 17/20... Training loss: 0.1005
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.1009
Epoch: 17/20... Training loss: 0.1025
Epoch: 17/20... Training loss: 0.1007
Epoch: 17/20... Training loss: 0.0994
Epoch: 17/20... Training loss: 0.1016
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.1015
Epoch: 17/20... Training loss: 0.1018
Epoch: 17/20... Training loss: 0.1009
Epoch: 17/20... Training loss: 0.1023
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.1022
Epoch: 17/20... Training loss: 0.0973
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.1016
Epoch: 17/20... Training loss: 0.1009
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.0986
Epoch: 17/20... Training loss: 0.0966
Epoch: 17/20... Training loss: 0.1019
Epoch: 17/20... Training loss: 0.1013
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.0973
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.1028
Epoch: 17/20... Training loss: 0.1010
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.0972
Epoch: 17/20... Training loss: 0.0992
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.1021
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.0990
Epoch: 17/20... Training loss: 0.1040
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.0973
Epoch: 17/20... Training loss: 0.1023
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.0959
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.1004
Epoch: 17/20... Training loss: 0.0960
Epoch: 17/20... Training loss: 0.1029
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0947
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.1009
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0960
Epoch: 17/20... Training loss: 0.0988
Epoch: 17/20... Training loss: 0.0952
Epoch: 17/20... Training loss: 0.1033
Epoch: 17/20... Training loss: 0.1022
Epoch: 17/20... Training loss: 0.1021
Epoch: 17/20... Training loss: 0.1013
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.1047
Epoch: 17/20... Training loss: 0.1036
Epoch: 17/20... Training loss: 0.1017
Epoch: 17/20... Training loss: 0.1006
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0986
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.1022
Epoch: 17/20... Training loss: 0.1019
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0994
Epoch: 17/20... Training loss: 0.1010
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.1020
Epoch: 17/20... Training loss: 0.1016
Epoch: 17/20... Training loss: 0.0977
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.0973
Epoch: 17/20... Training loss: 0.0992
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.1011
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.0994
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.1028
Epoch: 17/20... Training loss: 0.0968
Epoch: 17/20... Training loss: 0.0986
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.1007
Epoch: 17/20... Training loss: 0.0975
Epoch: 17/20... Training loss: 0.1053
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.0990
Epoch: 17/20... Training loss: 0.0961
Epoch: 17/20... Training loss: 0.0984
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.1017
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0974
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.1020
Epoch: 17/20... Training loss: 0.1004
Epoch: 17/20... Training loss: 0.1019
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0979
Epoch: 17/20... Training loss: 0.1001
Epoch: 17/20... Training loss: 0.1001
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.0956
Epoch: 17/20... Training loss: 0.0959
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0964
Epoch: 17/20... Training loss: 0.0981
Epoch: 17/20... Training loss: 0.0989
Epoch: 17/20... Training loss: 0.0963
Epoch: 17/20... Training loss: 0.0961
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.1004
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.1026
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.1015
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.1024
Epoch: 17/20... Training loss: 0.1004
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.1019
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0986
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.1044
Epoch: 17/20... Training loss: 0.0986
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.1065
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.0972
Epoch: 17/20... Training loss: 0.0981
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0997
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.1015
Epoch: 17/20... Training loss: 0.0979
Epoch: 17/20... Training loss: 0.1001
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.1025
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.1034
Epoch: 17/20... Training loss: 0.0979
Epoch: 17/20... Training loss: 0.0971
Epoch: 17/20... Training loss: 0.0949
Epoch: 17/20... Training loss: 0.1041
Epoch: 17/20... Training loss: 0.1027
Epoch: 17/20... Training loss: 0.0981
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.0969
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.0976
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.1035
Epoch: 17/20... Training loss: 0.0978
Epoch: 17/20... Training loss: 0.0974
Epoch: 17/20... Training loss: 0.0970
Epoch: 17/20... Training loss: 0.0980
Epoch: 17/20... Training loss: 0.0959
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.0978
Epoch: 17/20... Training loss: 0.0970
Epoch: 17/20... Training loss: 0.0956
Epoch: 17/20... Training loss: 0.1021
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.1014
Epoch: 17/20... Training loss: 0.0988
Epoch: 17/20... Training loss: 0.0983
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0969
Epoch: 17/20... Training loss: 0.1000
Epoch: 17/20... Training loss: 0.1018
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.0966
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.0982
Epoch: 17/20... Training loss: 0.0973
Epoch: 17/20... Training loss: 0.1007
Epoch: 17/20... Training loss: 0.1012
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.0995
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.1008
Epoch: 17/20... Training loss: 0.0984
Epoch: 17/20... Training loss: 0.1002
Epoch: 17/20... Training loss: 0.0975
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0965
Epoch: 17/20... Training loss: 0.0987
Epoch: 17/20... Training loss: 0.1020
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0994
Epoch: 17/20... Training loss: 0.1003
Epoch: 17/20... Training loss: 0.0993
Epoch: 17/20... Training loss: 0.0991
Epoch: 17/20... Training loss: 0.0998
Epoch: 17/20... Training loss: 0.0999
Epoch: 17/20... Training loss: 0.1011
Epoch: 17/20... Training loss: 0.1026
Epoch: 17/20... Training loss: 0.1021
Epoch: 17/20... Training loss: 0.1001
Epoch: 17/20... Training loss: 0.0985
Epoch: 17/20... Training loss: 0.0985
Epoch: 17/20... Training loss: 0.0981
Epoch: 17/20... Training loss: 0.1017
Epoch: 17/20... Training loss: 0.0988
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.0996
Epoch: 17/20... Training loss: 0.1024
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.0968
Epoch: 18/20... Training loss: 0.1025
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.1028
Epoch: 18/20... Training loss: 0.1019
Epoch: 18/20... Training loss: 0.1001
Epoch: 18/20... Training loss: 0.0987
Epoch: 18/20... Training loss: 0.1032
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.0958
Epoch: 18/20... Training loss: 0.1008
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.0984
Epoch: 18/20... Training loss: 0.0994
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.0981
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.0955
Epoch: 18/20... Training loss: 0.0974
Epoch: 18/20... Training loss: 0.1030
Epoch: 18/20... Training loss: 0.0974
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.1034
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0926
Epoch: 18/20... Training loss: 0.0973
Epoch: 18/20... Training loss: 0.0983
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.1028
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.0968
Epoch: 18/20... Training loss: 0.0978
Epoch: 18/20... Training loss: 0.0972
Epoch: 18/20... Training loss: 0.0973
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.1033
Epoch: 18/20... Training loss: 0.0974
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.1017
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.0983
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.0974
Epoch: 18/20... Training loss: 0.0951
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.1009
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0977
Epoch: 18/20... Training loss: 0.0971
Epoch: 18/20... Training loss: 0.0971
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0983
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.1010
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.0968
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.0959
Epoch: 18/20... Training loss: 0.1019
Epoch: 18/20... Training loss: 0.0970
Epoch: 18/20... Training loss: 0.1022
Epoch: 18/20... Training loss: 0.0996
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.0977
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0953
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.1014
Epoch: 18/20... Training loss: 0.1029
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.0967
Epoch: 18/20... Training loss: 0.1021
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.1012
Epoch: 18/20... Training loss: 0.0975
Epoch: 18/20... Training loss: 0.1002
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0977
Epoch: 18/20... Training loss: 0.1027
Epoch: 18/20... Training loss: 0.1001
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.0972
Epoch: 18/20... Training loss: 0.1034
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.1018
Epoch: 18/20... Training loss: 0.1027
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.1002
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.0981
Epoch: 18/20... Training loss: 0.1017
Epoch: 18/20... Training loss: 0.1027
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0954
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.1010
Epoch: 18/20... Training loss: 0.1002
Epoch: 18/20... Training loss: 0.0994
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.1008
Epoch: 18/20... Training loss: 0.1026
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.0972
Epoch: 18/20... Training loss: 0.1026
Epoch: 18/20... Training loss: 0.0988
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.1002
Epoch: 18/20... Training loss: 0.0960
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.1030
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.1014
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0984
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.0981
Epoch: 18/20... Training loss: 0.0963
Epoch: 18/20... Training loss: 0.0984
Epoch: 18/20... Training loss: 0.1033
Epoch: 18/20... Training loss: 0.1005
Epoch: 18/20... Training loss: 0.1024
Epoch: 18/20... Training loss: 0.1003
Epoch: 18/20... Training loss: 0.1012
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.1033
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.1015
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.0988
Epoch: 18/20... Training loss: 0.0996
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0978
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.1023
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.0981
Epoch: 18/20... Training loss: 0.0970
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.0988
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0957
Epoch: 18/20... Training loss: 0.0997
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.1029
Epoch: 18/20... Training loss: 0.1005
Epoch: 18/20... Training loss: 0.0969
Epoch: 18/20... Training loss: 0.0994
Epoch: 18/20... Training loss: 0.0953
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0987
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.0983
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.0987
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.0945
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.1005
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.0987
Epoch: 18/20... Training loss: 0.0997
Epoch: 18/20... Training loss: 0.0981
Epoch: 18/20... Training loss: 0.0966
Epoch: 18/20... Training loss: 0.0970
Epoch: 18/20... Training loss: 0.0994
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0964
Epoch: 18/20... Training loss: 0.1008
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.0975
Epoch: 18/20... Training loss: 0.1039
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0978
Epoch: 18/20... Training loss: 0.1008
Epoch: 18/20... Training loss: 0.0967
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.1034
Epoch: 18/20... Training loss: 0.1016
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.0977
Epoch: 18/20... Training loss: 0.0988
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.0956
Epoch: 18/20... Training loss: 0.0963
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.1009
Epoch: 18/20... Training loss: 0.1003
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0965
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.1012
Epoch: 18/20... Training loss: 0.1006
Epoch: 18/20... Training loss: 0.1014
Epoch: 18/20... Training loss: 0.0948
Epoch: 18/20... Training loss: 0.1003
Epoch: 18/20... Training loss: 0.1047
Epoch: 18/20... Training loss: 0.1014
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.0993
Epoch: 18/20... Training loss: 0.1013
Epoch: 18/20... Training loss: 0.1018
Epoch: 18/20... Training loss: 0.0973
Epoch: 18/20... Training loss: 0.1011
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.0970
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.1012
Epoch: 18/20... Training loss: 0.0964
Epoch: 18/20... Training loss: 0.1008
Epoch: 18/20... Training loss: 0.0971
Epoch: 18/20... Training loss: 0.0968
Epoch: 18/20... Training loss: 0.0977
Epoch: 18/20... Training loss: 0.1019
Epoch: 18/20... Training loss: 0.0982
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.1049
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.0943
Epoch: 18/20... Training loss: 0.0961
Epoch: 18/20... Training loss: 0.1003
Epoch: 18/20... Training loss: 0.1007
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.0999
Epoch: 18/20... Training loss: 0.0983
Epoch: 18/20... Training loss: 0.0975
Epoch: 18/20... Training loss: 0.0962
Epoch: 18/20... Training loss: 0.0985
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.0992
Epoch: 18/20... Training loss: 0.0991
Epoch: 18/20... Training loss: 0.0986
Epoch: 18/20... Training loss: 0.1004
Epoch: 18/20... Training loss: 0.0989
Epoch: 18/20... Training loss: 0.1001
Epoch: 18/20... Training loss: 0.0972
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.0957
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.0998
Epoch: 18/20... Training loss: 0.0980
Epoch: 18/20... Training loss: 0.0916
Epoch: 18/20... Training loss: 0.0990
Epoch: 18/20... Training loss: 0.0955
Epoch: 18/20... Training loss: 0.0979
Epoch: 18/20... Training loss: 0.0965
Epoch: 18/20... Training loss: 0.0976
Epoch: 18/20... Training loss: 0.1001
Epoch: 18/20... Training loss: 0.0963
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.0995
Epoch: 18/20... Training loss: 0.0975
Epoch: 18/20... Training loss: 0.1000
Epoch: 18/20... Training loss: 0.1024
Epoch: 18/20... Training loss: 0.0985
Epoch: 19/20... Training loss: 0.1030
Epoch: 19/20... Training loss: 0.0942
Epoch: 19/20... Training loss: 0.1005
Epoch: 19/20... Training loss: 0.0958
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.0988
Epoch: 19/20... Training loss: 0.0947
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.0964
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.0973
Epoch: 19/20... Training loss: 0.1047
Epoch: 19/20... Training loss: 0.1006
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.1015
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.1017
Epoch: 19/20... Training loss: 0.0991
Epoch: 19/20... Training loss: 0.1025
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.1017
Epoch: 19/20... Training loss: 0.1024
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.0984
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0979
Epoch: 19/20... Training loss: 0.0966
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.0975
Epoch: 19/20... Training loss: 0.0953
Epoch: 19/20... Training loss: 0.0967
Epoch: 19/20... Training loss: 0.0975
Epoch: 19/20... Training loss: 0.0978
Epoch: 19/20... Training loss: 0.0942
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.1019
Epoch: 19/20... Training loss: 0.1002
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.1025
Epoch: 19/20... Training loss: 0.0992
Epoch: 19/20... Training loss: 0.0966
Epoch: 19/20... Training loss: 0.0950
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.0973
Epoch: 19/20... Training loss: 0.0961
Epoch: 19/20... Training loss: 0.0975
Epoch: 19/20... Training loss: 0.0956
Epoch: 19/20... Training loss: 0.0975
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.1007
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.1015
Epoch: 19/20... Training loss: 0.1012
Epoch: 19/20... Training loss: 0.0956
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.1043
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0997
Epoch: 19/20... Training loss: 0.0996
Epoch: 19/20... Training loss: 0.0972
Epoch: 19/20... Training loss: 0.1023
Epoch: 19/20... Training loss: 0.0971
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0989
Epoch: 19/20... Training loss: 0.1028
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.0963
Epoch: 19/20... Training loss: 0.1029
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.0979
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.1024
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.1017
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.0964
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.1028
Epoch: 19/20... Training loss: 0.1001
Epoch: 19/20... Training loss: 0.0939
Epoch: 19/20... Training loss: 0.0991
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.0972
Epoch: 19/20... Training loss: 0.1009
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.0952
Epoch: 19/20... Training loss: 0.1004
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.1002
Epoch: 19/20... Training loss: 0.1032
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.0984
Epoch: 19/20... Training loss: 0.1012
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.1002
Epoch: 19/20... Training loss: 0.0959
Epoch: 19/20... Training loss: 0.1005
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.0937
Epoch: 19/20... Training loss: 0.1021
Epoch: 19/20... Training loss: 0.0950
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.1012
Epoch: 19/20... Training loss: 0.0975
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.0957
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0978
Epoch: 19/20... Training loss: 0.0991
Epoch: 19/20... Training loss: 0.1025
Epoch: 19/20... Training loss: 0.1017
Epoch: 19/20... Training loss: 0.0989
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0991
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.0977
Epoch: 19/20... Training loss: 0.0988
Epoch: 19/20... Training loss: 0.1018
Epoch: 19/20... Training loss: 0.0953
Epoch: 19/20... Training loss: 0.0955
Epoch: 19/20... Training loss: 0.1007
Epoch: 19/20... Training loss: 0.0948
Epoch: 19/20... Training loss: 0.0950
Epoch: 19/20... Training loss: 0.0979
Epoch: 19/20... Training loss: 0.0997
Epoch: 19/20... Training loss: 0.1017
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.0949
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.0959
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0978
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0958
Epoch: 19/20... Training loss: 0.1008
Epoch: 19/20... Training loss: 0.0962
Epoch: 19/20... Training loss: 0.0951
Epoch: 19/20... Training loss: 0.1011
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.1009
Epoch: 19/20... Training loss: 0.0952
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0960
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0955
Epoch: 19/20... Training loss: 0.1010
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.1005
Epoch: 19/20... Training loss: 0.0979
Epoch: 19/20... Training loss: 0.0941
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.1012
Epoch: 19/20... Training loss: 0.0966
Epoch: 19/20... Training loss: 0.0989
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.0997
Epoch: 19/20... Training loss: 0.0994
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0997
Epoch: 19/20... Training loss: 0.0992
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.1000
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.1002
Epoch: 19/20... Training loss: 0.1036
Epoch: 19/20... Training loss: 0.1021
Epoch: 19/20... Training loss: 0.0981
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.1001
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.0985
Epoch: 19/20... Training loss: 0.0981
Epoch: 19/20... Training loss: 0.1011
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0983
Epoch: 19/20... Training loss: 0.0957
Epoch: 19/20... Training loss: 0.1009
Epoch: 19/20... Training loss: 0.1029
Epoch: 19/20... Training loss: 0.0971
Epoch: 19/20... Training loss: 0.1035
Epoch: 19/20... Training loss: 0.0977
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.1002
Epoch: 19/20... Training loss: 0.0985
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0992
Epoch: 19/20... Training loss: 0.0961
Epoch: 19/20... Training loss: 0.0989
Epoch: 19/20... Training loss: 0.0952
Epoch: 19/20... Training loss: 0.0952
Epoch: 19/20... Training loss: 0.0984
Epoch: 19/20... Training loss: 0.1013
Epoch: 19/20... Training loss: 0.1006
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0965
Epoch: 19/20... Training loss: 0.0979
Epoch: 19/20... Training loss: 0.1009
Epoch: 19/20... Training loss: 0.0961
Epoch: 19/20... Training loss: 0.1000
Epoch: 19/20... Training loss: 0.0981
Epoch: 19/20... Training loss: 0.0930
Epoch: 19/20... Training loss: 0.0993
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.0978
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.1005
Epoch: 19/20... Training loss: 0.0955
Epoch: 19/20... Training loss: 0.0991
Epoch: 19/20... Training loss: 0.0978
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.1022
Epoch: 19/20... Training loss: 0.0956
Epoch: 19/20... Training loss: 0.0958
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.0995
Epoch: 19/20... Training loss: 0.1010
Epoch: 19/20... Training loss: 0.0999
Epoch: 19/20... Training loss: 0.0946
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.0992
Epoch: 19/20... Training loss: 0.1000
Epoch: 19/20... Training loss: 0.0980
Epoch: 19/20... Training loss: 0.1044
Epoch: 19/20... Training loss: 0.0952
Epoch: 19/20... Training loss: 0.1014
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.0974
Epoch: 19/20... Training loss: 0.1000
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.1005
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.1003
Epoch: 19/20... Training loss: 0.1006
Epoch: 19/20... Training loss: 0.0959
Epoch: 19/20... Training loss: 0.1015
Epoch: 19/20... Training loss: 0.1001
Epoch: 19/20... Training loss: 0.0990
Epoch: 19/20... Training loss: 0.1004
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.1014
Epoch: 19/20... Training loss: 0.1022
Epoch: 19/20... Training loss: 0.0959
Epoch: 19/20... Training loss: 0.1015
Epoch: 19/20... Training loss: 0.0961
Epoch: 19/20... Training loss: 0.0957
Epoch: 19/20... Training loss: 0.0985
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.1016
Epoch: 19/20... Training loss: 0.0977
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.1018
Epoch: 19/20... Training loss: 0.0961
Epoch: 19/20... Training loss: 0.0972
Epoch: 19/20... Training loss: 0.0994
Epoch: 19/20... Training loss: 0.0965
Epoch: 19/20... Training loss: 0.1012
Epoch: 19/20... Training loss: 0.0981
Epoch: 19/20... Training loss: 0.1019
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.0987
Epoch: 19/20... Training loss: 0.0970
Epoch: 19/20... Training loss: 0.0985
Epoch: 19/20... Training loss: 0.1010
Epoch: 19/20... Training loss: 0.0976
Epoch: 19/20... Training loss: 0.0984
Epoch: 19/20... Training loss: 0.0958
Epoch: 19/20... Training loss: 0.0997
Epoch: 19/20... Training loss: 0.0967
Epoch: 19/20... Training loss: 0.0998
Epoch: 19/20... Training loss: 0.1000
Epoch: 19/20... Training loss: 0.0981
Epoch: 19/20... Training loss: 0.0969
Epoch: 19/20... Training loss: 0.0982
Epoch: 19/20... Training loss: 0.1018
Epoch: 19/20... Training loss: 0.0986
Epoch: 19/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0946
Epoch: 20/20... Training loss: 0.0973
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0971
Epoch: 20/20... Training loss: 0.0996
Epoch: 20/20... Training loss: 0.1012
Epoch: 20/20... Training loss: 0.1009
Epoch: 20/20... Training loss: 0.0973
Epoch: 20/20... Training loss: 0.0953
Epoch: 20/20... Training loss: 0.1002
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0986
Epoch: 20/20... Training loss: 0.1008
Epoch: 20/20... Training loss: 0.0987
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0984
Epoch: 20/20... Training loss: 0.1008
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.1006
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.0993
Epoch: 20/20... Training loss: 0.1005
Epoch: 20/20... Training loss: 0.0990
Epoch: 20/20... Training loss: 0.0998
Epoch: 20/20... Training loss: 0.0992
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0961
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0953
Epoch: 20/20... Training loss: 0.0985
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.1004
Epoch: 20/20... Training loss: 0.1022
Epoch: 20/20... Training loss: 0.0990
Epoch: 20/20... Training loss: 0.1002
Epoch: 20/20... Training loss: 0.0984
Epoch: 20/20... Training loss: 0.0970
Epoch: 20/20... Training loss: 0.0990
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0970
Epoch: 20/20... Training loss: 0.0993
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.1001
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.1033
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.1032
Epoch: 20/20... Training loss: 0.0956
Epoch: 20/20... Training loss: 0.1008
Epoch: 20/20... Training loss: 0.1004
Epoch: 20/20... Training loss: 0.0958
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.1017
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.0990
Epoch: 20/20... Training loss: 0.0999
Epoch: 20/20... Training loss: 0.0984
Epoch: 20/20... Training loss: 0.0961
Epoch: 20/20... Training loss: 0.0979
Epoch: 20/20... Training loss: 0.0968
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0985
Epoch: 20/20... Training loss: 0.0945
Epoch: 20/20... Training loss: 0.1000
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0992
Epoch: 20/20... Training loss: 0.0957
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0953
Epoch: 20/20... Training loss: 0.0923
Epoch: 20/20... Training loss: 0.0966
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0959
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.1012
Epoch: 20/20... Training loss: 0.0976
Epoch: 20/20... Training loss: 0.0964
Epoch: 20/20... Training loss: 0.0988
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.1001
Epoch: 20/20... Training loss: 0.0976
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.1001
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0960
Epoch: 20/20... Training loss: 0.0958
Epoch: 20/20... Training loss: 0.0971
Epoch: 20/20... Training loss: 0.0968
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.1015
Epoch: 20/20... Training loss: 0.0956
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.1023
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0952
Epoch: 20/20... Training loss: 0.1007
Epoch: 20/20... Training loss: 0.0957
Epoch: 20/20... Training loss: 0.1000
Epoch: 20/20... Training loss: 0.0947
Epoch: 20/20... Training loss: 0.1000
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.0999
Epoch: 20/20... Training loss: 0.0966
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.0965
Epoch: 20/20... Training loss: 0.0949
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0984
Epoch: 20/20... Training loss: 0.0951
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.1018
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0987
Epoch: 20/20... Training loss: 0.0971
Epoch: 20/20... Training loss: 0.0975
Epoch: 20/20... Training loss: 0.1018
Epoch: 20/20... Training loss: 0.0962
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.1006
Epoch: 20/20... Training loss: 0.0988
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.1006
Epoch: 20/20... Training loss: 0.1009
Epoch: 20/20... Training loss: 0.0985
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.1010
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.0958
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.1025
Epoch: 20/20... Training loss: 0.1006
Epoch: 20/20... Training loss: 0.1023
Epoch: 20/20... Training loss: 0.0998
Epoch: 20/20... Training loss: 0.1009
Epoch: 20/20... Training loss: 0.1018
Epoch: 20/20... Training loss: 0.1013
Epoch: 20/20... Training loss: 0.0988
Epoch: 20/20... Training loss: 0.0970
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.0968
Epoch: 20/20... Training loss: 0.1011
Epoch: 20/20... Training loss: 0.0999
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.0999
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0975
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.1003
Epoch: 20/20... Training loss: 0.0979
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0973
Epoch: 20/20... Training loss: 0.0957
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0957
Epoch: 20/20... Training loss: 0.0974
Epoch: 20/20... Training loss: 0.1002
Epoch: 20/20... Training loss: 0.1001
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.0966
Epoch: 20/20... Training loss: 0.0945
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.1036
Epoch: 20/20... Training loss: 0.1027
Epoch: 20/20... Training loss: 0.0966
Epoch: 20/20... Training loss: 0.0963
Epoch: 20/20... Training loss: 0.1022
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0964
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.1005
Epoch: 20/20... Training loss: 0.1025
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0977
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0996
Epoch: 20/20... Training loss: 0.1016
Epoch: 20/20... Training loss: 0.1004
Epoch: 20/20... Training loss: 0.0986
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.1000
Epoch: 20/20... Training loss: 0.0975
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.1028
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0987
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0968
Epoch: 20/20... Training loss: 0.1015
Epoch: 20/20... Training loss: 0.0990
Epoch: 20/20... Training loss: 0.0974
Epoch: 20/20... Training loss: 0.0965
Epoch: 20/20... Training loss: 0.1011
Epoch: 20/20... Training loss: 0.0994
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0992
Epoch: 20/20... Training loss: 0.0951
Epoch: 20/20... Training loss: 0.0959
Epoch: 20/20... Training loss: 0.0958
Epoch: 20/20... Training loss: 0.0986
Epoch: 20/20... Training loss: 0.0983
Epoch: 20/20... Training loss: 0.0976
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.1023
Epoch: 20/20... Training loss: 0.1032
Epoch: 20/20... Training loss: 0.0949
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.1020
Epoch: 20/20... Training loss: 0.0974
Epoch: 20/20... Training loss: 0.1015
Epoch: 20/20... Training loss: 0.1004
Epoch: 20/20... Training loss: 0.1013
Epoch: 20/20... Training loss: 0.1008
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0947
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0995
Epoch: 20/20... Training loss: 0.0948
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.0949
Epoch: 20/20... Training loss: 0.0993
Epoch: 20/20... Training loss: 0.0951
Epoch: 20/20... Training loss: 0.0960
Epoch: 20/20... Training loss: 0.0991
Epoch: 20/20... Training loss: 0.1005
Epoch: 20/20... Training loss: 0.0939
Epoch: 20/20... Training loss: 0.1016
Epoch: 20/20... Training loss: 0.0972
Epoch: 20/20... Training loss: 0.0950
Epoch: 20/20... Training loss: 0.0974
Epoch: 20/20... Training loss: 0.0971
Epoch: 20/20... Training loss: 0.0962
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.0996
Epoch: 20/20... Training loss: 0.1014
Epoch: 20/20... Training loss: 0.0973
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0956
Epoch: 20/20... Training loss: 0.1016
Epoch: 20/20... Training loss: 0.0992
Epoch: 20/20... Training loss: 0.0994
Epoch: 20/20... Training loss: 0.0961
Epoch: 20/20... Training loss: 0.0974
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0973
Epoch: 20/20... Training loss: 0.0971
Epoch: 20/20... Training loss: 0.1022
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0994
Epoch: 20/20... Training loss: 0.0967
Epoch: 20/20... Training loss: 0.0938
Epoch: 20/20... Training loss: 0.0962
Epoch: 20/20... Training loss: 0.0972
Epoch: 20/20... Training loss: 0.0989
Epoch: 20/20... Training loss: 0.0957
Epoch: 20/20... Training loss: 0.0955
Epoch: 20/20... Training loss: 0.0976
Epoch: 20/20... Training loss: 0.1023
Epoch: 20/20... Training loss: 0.0982
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0998
Epoch: 20/20... Training loss: 0.1000
Epoch: 20/20... Training loss: 0.1009
Epoch: 20/20... Training loss: 0.0996
Epoch: 20/20... Training loss: 0.0968
Epoch: 20/20... Training loss: 0.0993
Epoch: 20/20... Training loss: 0.0981
Epoch: 20/20... Training loss: 0.0959
Epoch: 20/20... Training loss: 0.0986
Epoch: 20/20... Training loss: 0.0980
Epoch: 20/20... Training loss: 0.0985
Epoch: 20/20... Training loss: 0.0992
Epoch: 20/20... Training loss: 0.0970
Epoch: 20/20... Training loss: 0.0997
Epoch: 20/20... Training loss: 0.0978
Epoch: 20/20... Training loss: 0.1004
Epoch: 20/20... Training loss: 0.0969
Epoch: 20/20... Training loss: 0.1001
Epoch: 20/20... Training loss: 0.1014
Epoch: 20/20... Training loss: 0.0986
Epoch: 20/20... Training loss: 0.0929
Epoch: 20/20... Training loss: 0.1011
Epoch: 20/20... Training loss: 0.1010



In [10]:

    
fig, axes = plt.subplots(nrows=2, ncols=10, sharex=True, sharey=True, figsize=(20,4))
in_imgs = mnist.test.images[:10]
reconstructed = sess.run(decoded, feed_dict={inputs_: in_imgs.reshape((10, 28, 28, 1))})

for images, row in zip([in_imgs, reconstructed], axes):
    for img, ax in zip(images, row):
        ax.imshow(img.reshape((28, 28)), cmap='Greys_r')
        ax.get_xaxis().set_visible(False)
        ax.get_yaxis().set_visible(False)


fig.tight_layout(pad=0.1)



In [11]:

    
sess.close()

Denoising

As I've mentioned before, autoencoders like the ones you've built so far aren't too useful in practive. However, they can be used to denoise images quite successfully just by training the network on noisy images. We can create the noisy images ourselves by adding Gaussian noise to the training images, then clipping the values to be between 0 and 1. We'll use noisy images as input and the original, clean images as targets. Here's an example of the noisy images I generated and the denoised images.

Since this is a harder problem for the network, we'll want to use deeper convolutional layers here, more feature maps. I suggest something like 32-32-16 for the depths of the convolutional layers in the encoder, and the same depths going backward through the decoder. Otherwise the architecture is the same as before.

Exercise: Build the network for the denoising autoencoder. It's the same as before, but with deeper layers. I suggest 32-32-16 for the depths, but you can play with these numbers, or add more layers.



In [18]:

    
learning_rate = 0.001
inputs_ = tf.placeholder(tf.float32, (None, 28, 28, 1), name='inputs')
targets_ = tf.placeholder(tf.float32, (None, 28, 28, 1), name='targets')

### Encoder
conv1 = tf.layers.conv2d(inputs_, 32, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 28x28x32
maxpool1 = tf.layers.max_pooling2d(conv1, (2, 2), (2, 2), padding='SAME')
# Now 14x14x32
conv2 = tf.layers.conv2d(maxpool1, 32, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 14x14x32
maxpool2 = tf.layers.max_pooling2d(conv2, (2, 2), (2, 2), padding='SAME')
# Now 7x7x32
conv3 = tf.layers.conv2d(maxpool2, 16, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 7x7x16
encoded = tf.layers.max_pooling2d(conv3, (2, 2), (2, 2), padding='SAME')
# Now 4x4x16

### Decoder
upsample1 = tf.image.resize_nearest_neighbor(encoded, (7, 7))
# Now 7x7x16
conv4 = tf.layers.conv2d(upsample1, 16, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 7x7x16
upsample2 = tf.image.resize_nearest_neighbor(conv4, (14, 14))
# Now 14x14x16
conv5 = tf.layers.conv2d(upsample2, 32, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 14x14x32
upsample3 = tf.image.resize_nearest_neighbor(conv5, (28, 28))
# Now 28x28x32
conv6 = tf.layers.conv2d(upsample3, 32, (3, 3), padding='SAME', activation=tf.nn.relu)
# Now 28x28x32

logits = tf.layers.conv2d(conv6, 1, (3, 3), padding='SAME', activation=None)
#Now 28x28x1

# Pass logits through sigmoid to get reconstructed image
decoded = tf.nn.sigmoid(logits)

# Pass logits through sigmoid and calculate the cross-entropy loss
loss = tf.nn.sigmoid_cross_entropy_with_logits(labels=targets_, logits=logits)

# Get cost and define the optimizer
cost = tf.reduce_mean(loss)
opt = tf.train.AdamOptimizer(learning_rate).minimize(cost)



In [19]:

    
sess = tf.Session()



In [20]:

    
epochs = 100
batch_size = 200
# Set's how much noise we're adding to the MNIST images
noise_factor = 0.5
sess.run(tf.global_variables_initializer())
for e in range(epochs):
    for ii in range(mnist.train.num_examples//batch_size):
        batch = mnist.train.next_batch(batch_size)
        # Get images from the batch
        imgs = batch[0].reshape((-1, 28, 28, 1))
        
        # Add random noise to the input images
        noisy_imgs = imgs + noise_factor * np.random.randn(*imgs.shape)
        # Clip the images to be between 0 and 1
        noisy_imgs = np.clip(noisy_imgs, 0., 1.)
        
        # Noisy images as inputs, original images as targets
        batch_cost, _ = sess.run([cost, opt], feed_dict={inputs_: noisy_imgs,
                                                         targets_: imgs})

        print("Epoch: {}/{}...".format(e+1, epochs),
              "Training loss: {:.4f}".format(batch_cost))









    



Epoch: 1/100... Training loss: 0.6880
Epoch: 1/100... Training loss: 0.6543
Epoch: 1/100... Training loss: 0.6103
Epoch: 1/100... Training loss: 0.5615
Epoch: 1/100... Training loss: 0.5164
Epoch: 1/100... Training loss: 0.5033
Epoch: 1/100... Training loss: 0.5226
Epoch: 1/100... Training loss: 0.5258
Epoch: 1/100... Training loss: 0.5327
Epoch: 1/100... Training loss: 0.5014
Epoch: 1/100... Training loss: 0.4816
Epoch: 1/100... Training loss: 0.4752
Epoch: 1/100... Training loss: 0.4741
Epoch: 1/100... Training loss: 0.4862
Epoch: 1/100... Training loss: 0.4736
Epoch: 1/100... Training loss: 0.4673
Epoch: 1/100... Training loss: 0.4475
Epoch: 1/100... Training loss: 0.4479
Epoch: 1/100... Training loss: 0.4410
Epoch: 1/100... Training loss: 0.4226
Epoch: 1/100... Training loss: 0.4029
Epoch: 1/100... Training loss: 0.4134
Epoch: 1/100... Training loss: 0.3956
Epoch: 1/100... Training loss: 0.3895
Epoch: 1/100... Training loss: 0.3846
Epoch: 1/100... Training loss: 0.3732
Epoch: 1/100... Training loss: 0.3541
Epoch: 1/100... Training loss: 0.3514
Epoch: 1/100... Training loss: 0.3431
Epoch: 1/100... Training loss: 0.3341
Epoch: 1/100... Training loss: 0.3164
Epoch: 1/100... Training loss: 0.3131
Epoch: 1/100... Training loss: 0.3018
Epoch: 1/100... Training loss: 0.2963
Epoch: 1/100... Training loss: 0.2862
Epoch: 1/100... Training loss: 0.2805
Epoch: 1/100... Training loss: 0.2819
Epoch: 1/100... Training loss: 0.2805
Epoch: 1/100... Training loss: 0.2746
Epoch: 1/100... Training loss: 0.2691
Epoch: 1/100... Training loss: 0.2705
Epoch: 1/100... Training loss: 0.2701
Epoch: 1/100... Training loss: 0.2597
Epoch: 1/100... Training loss: 0.2644
Epoch: 1/100... Training loss: 0.2710
Epoch: 1/100... Training loss: 0.2663
Epoch: 1/100... Training loss: 0.2629
Epoch: 1/100... Training loss: 0.2679
Epoch: 1/100... Training loss: 0.2649
Epoch: 1/100... Training loss: 0.2586
Epoch: 1/100... Training loss: 0.2490
Epoch: 1/100... Training loss: 0.2636
Epoch: 1/100... Training loss: 0.2572
Epoch: 1/100... Training loss: 0.2568
Epoch: 1/100... Training loss: 0.2573
Epoch: 1/100... Training loss: 0.2528
Epoch: 1/100... Training loss: 0.2558
Epoch: 1/100... Training loss: 0.2478
Epoch: 1/100... Training loss: 0.2484
Epoch: 1/100... Training loss: 0.2515
Epoch: 1/100... Training loss: 0.2479
Epoch: 1/100... Training loss: 0.2490
Epoch: 1/100... Training loss: 0.2426
Epoch: 1/100... Training loss: 0.2505
Epoch: 1/100... Training loss: 0.2350
Epoch: 1/100... Training loss: 0.2397
Epoch: 1/100... Training loss: 0.2392
Epoch: 1/100... Training loss: 0.2467
Epoch: 1/100... Training loss: 0.2406
Epoch: 1/100... Training loss: 0.2325
Epoch: 1/100... Training loss: 0.2361
Epoch: 1/100... Training loss: 0.2357
Epoch: 1/100... Training loss: 0.2398
Epoch: 1/100... Training loss: 0.2386
Epoch: 1/100... Training loss: 0.2317
Epoch: 1/100... Training loss: 0.2330
Epoch: 1/100... Training loss: 0.2313
Epoch: 1/100... Training loss: 0.2255
Epoch: 1/100... Training loss: 0.2247
Epoch: 1/100... Training loss: 0.2250
Epoch: 1/100... Training loss: 0.2295
Epoch: 1/100... Training loss: 0.2272
Epoch: 1/100... Training loss: 0.2294
Epoch: 1/100... Training loss: 0.2273
Epoch: 1/100... Training loss: 0.2247
Epoch: 1/100... Training loss: 0.2276
Epoch: 1/100... Training loss: 0.2200
Epoch: 1/100... Training loss: 0.2252
Epoch: 1/100... Training loss: 0.2272
Epoch: 1/100... Training loss: 0.2231
Epoch: 1/100... Training loss: 0.2243
Epoch: 1/100... Training loss: 0.2172
Epoch: 1/100... Training loss: 0.2171
Epoch: 1/100... Training loss: 0.2210
Epoch: 1/100... Training loss: 0.2202
Epoch: 1/100... Training loss: 0.2173
Epoch: 1/100... Training loss: 0.2258
Epoch: 1/100... Training loss: 0.2178
Epoch: 1/100... Training loss: 0.2231
Epoch: 1/100... Training loss: 0.2188
Epoch: 1/100... Training loss: 0.2153
Epoch: 1/100... Training loss: 0.2127
Epoch: 1/100... Training loss: 0.2061
Epoch: 1/100... Training loss: 0.2163
Epoch: 1/100... Training loss: 0.2136
Epoch: 1/100... Training loss: 0.2150
Epoch: 1/100... Training loss: 0.2160
Epoch: 1/100... Training loss: 0.2095
Epoch: 1/100... Training loss: 0.2093
Epoch: 1/100... Training loss: 0.2135
Epoch: 1/100... Training loss: 0.2113
Epoch: 1/100... Training loss: 0.2059
Epoch: 1/100... Training loss: 0.2084
Epoch: 1/100... Training loss: 0.2044
Epoch: 1/100... Training loss: 0.2074
Epoch: 1/100... Training loss: 0.2166
Epoch: 1/100... Training loss: 0.2092
Epoch: 1/100... Training loss: 0.2156
Epoch: 1/100... Training loss: 0.2096
Epoch: 1/100... Training loss: 0.2052
Epoch: 1/100... Training loss: 0.2085
Epoch: 1/100... Training loss: 0.2117
Epoch: 1/100... Training loss: 0.2103
Epoch: 1/100... Training loss: 0.1949
Epoch: 1/100... Training loss: 0.2002
Epoch: 1/100... Training loss: 0.2069
Epoch: 1/100... Training loss: 0.2034
Epoch: 1/100... Training loss: 0.2008
Epoch: 1/100... Training loss: 0.1992
Epoch: 1/100... Training loss: 0.2004
Epoch: 1/100... Training loss: 0.2079
Epoch: 1/100... Training loss: 0.2027
Epoch: 1/100... Training loss: 0.2049
Epoch: 1/100... Training loss: 0.2020
Epoch: 1/100... Training loss: 0.2075
Epoch: 1/100... Training loss: 0.2025
Epoch: 1/100... Training loss: 0.1954
Epoch: 1/100... Training loss: 0.2005
Epoch: 1/100... Training loss: 0.2001
Epoch: 1/100... Training loss: 0.1996
Epoch: 1/100... Training loss: 0.1967
Epoch: 1/100... Training loss: 0.2005
Epoch: 1/100... Training loss: 0.1936
Epoch: 1/100... Training loss: 0.1995
Epoch: 1/100... Training loss: 0.2006
Epoch: 1/100... Training loss: 0.1968
Epoch: 1/100... Training loss: 0.1925
Epoch: 1/100... Training loss: 0.1994
Epoch: 1/100... Training loss: 0.1918
Epoch: 1/100... Training loss: 0.1979
Epoch: 1/100... Training loss: 0.1932
Epoch: 1/100... Training loss: 0.2001
Epoch: 1/100... Training loss: 0.1936
Epoch: 1/100... Training loss: 0.1945
Epoch: 1/100... Training loss: 0.1950
Epoch: 1/100... Training loss: 0.1936
Epoch: 1/100... Training loss: 0.1912
Epoch: 1/100... Training loss: 0.1945
Epoch: 1/100... Training loss: 0.1915
Epoch: 1/100... Training loss: 0.1904
Epoch: 1/100... Training loss: 0.1872
Epoch: 1/100... Training loss: 0.1967
Epoch: 1/100... Training loss: 0.1952
Epoch: 1/100... Training loss: 0.1915
Epoch: 1/100... Training loss: 0.1951
Epoch: 1/100... Training loss: 0.1950
Epoch: 1/100... Training loss: 0.1924
Epoch: 1/100... Training loss: 0.1900
Epoch: 1/100... Training loss: 0.1950
Epoch: 1/100... Training loss: 0.1899
Epoch: 1/100... Training loss: 0.1850
Epoch: 1/100... Training loss: 0.1849
Epoch: 1/100... Training loss: 0.1881
Epoch: 1/100... Training loss: 0.1864
Epoch: 1/100... Training loss: 0.1856
Epoch: 1/100... Training loss: 0.1941
Epoch: 1/100... Training loss: 0.1857
Epoch: 1/100... Training loss: 0.1942
Epoch: 1/100... Training loss: 0.1905
Epoch: 1/100... Training loss: 0.1847
Epoch: 1/100... Training loss: 0.1843
Epoch: 1/100... Training loss: 0.1857
Epoch: 1/100... Training loss: 0.1885
Epoch: 1/100... Training loss: 0.1915
Epoch: 1/100... Training loss: 0.1875
Epoch: 1/100... Training loss: 0.1928
Epoch: 1/100... Training loss: 0.1897
Epoch: 1/100... Training loss: 0.1852
Epoch: 1/100... Training loss: 0.1892
Epoch: 1/100... Training loss: 0.1918
Epoch: 1/100... Training loss: 0.1829
Epoch: 1/100... Training loss: 0.1798
Epoch: 1/100... Training loss: 0.1860
Epoch: 1/100... Training loss: 0.1867
Epoch: 1/100... Training loss: 0.1857
Epoch: 1/100... Training loss: 0.1802
Epoch: 1/100... Training loss: 0.1862
Epoch: 1/100... Training loss: 0.1881
Epoch: 1/100... Training loss: 0.1828
Epoch: 1/100... Training loss: 0.1841
Epoch: 1/100... Training loss: 0.1866
Epoch: 1/100... Training loss: 0.1867
Epoch: 1/100... Training loss: 0.1907
Epoch: 1/100... Training loss: 0.1821
Epoch: 1/100... Training loss: 0.1805
Epoch: 1/100... Training loss: 0.1804
Epoch: 1/100... Training loss: 0.1824
Epoch: 1/100... Training loss: 0.1781
Epoch: 1/100... Training loss: 0.1831
Epoch: 1/100... Training loss: 0.1884
Epoch: 1/100... Training loss: 0.1856
Epoch: 1/100... Training loss: 0.1818
Epoch: 1/100... Training loss: 0.1839
Epoch: 1/100... Training loss: 0.1784
Epoch: 1/100... Training loss: 0.1842
Epoch: 1/100... Training loss: 0.1835
Epoch: 1/100... Training loss: 0.1793
Epoch: 1/100... Training loss: 0.1796
Epoch: 1/100... Training loss: 0.1798
Epoch: 1/100... Training loss: 0.1817
Epoch: 1/100... Training loss: 0.1765
Epoch: 1/100... Training loss: 0.1808
Epoch: 1/100... Training loss: 0.1762
Epoch: 1/100... Training loss: 0.1798
Epoch: 1/100... Training loss: 0.1801
Epoch: 1/100... Training loss: 0.1773
Epoch: 1/100... Training loss: 0.1829
Epoch: 1/100... Training loss: 0.1801
Epoch: 1/100... Training loss: 0.1775
Epoch: 1/100... Training loss: 0.1805
Epoch: 1/100... Training loss: 0.1803
Epoch: 1/100... Training loss: 0.1767
Epoch: 1/100... Training loss: 0.1824
Epoch: 1/100... Training loss: 0.1792
Epoch: 1/100... Training loss: 0.1788
Epoch: 1/100... Training loss: 0.1812
Epoch: 1/100... Training loss: 0.1859
Epoch: 1/100... Training loss: 0.1776
Epoch: 1/100... Training loss: 0.1712
Epoch: 1/100... Training loss: 0.1784
Epoch: 1/100... Training loss: 0.1791
Epoch: 1/100... Training loss: 0.1789
Epoch: 1/100... Training loss: 0.1743
Epoch: 1/100... Training loss: 0.1805
Epoch: 1/100... Training loss: 0.1772
Epoch: 1/100... Training loss: 0.1738
Epoch: 1/100... Training loss: 0.1782
Epoch: 1/100... Training loss: 0.1792
Epoch: 1/100... Training loss: 0.1742
Epoch: 1/100... Training loss: 0.1756
Epoch: 1/100... Training loss: 0.1793
Epoch: 1/100... Training loss: 0.1735
Epoch: 1/100... Training loss: 0.1745
Epoch: 1/100... Training loss: 0.1761
Epoch: 1/100... Training loss: 0.1791
Epoch: 1/100... Training loss: 0.1797
Epoch: 1/100... Training loss: 0.1813
Epoch: 1/100... Training loss: 0.1750
Epoch: 1/100... Training loss: 0.1774
Epoch: 1/100... Training loss: 0.1715
Epoch: 1/100... Training loss: 0.1793
Epoch: 1/100... Training loss: 0.1694
Epoch: 1/100... Training loss: 0.1745
Epoch: 1/100... Training loss: 0.1699
Epoch: 1/100... Training loss: 0.1710
Epoch: 1/100... Training loss: 0.1761
Epoch: 1/100... Training loss: 0.1757
Epoch: 1/100... Training loss: 0.1748
Epoch: 1/100... Training loss: 0.1742
Epoch: 1/100... Training loss: 0.1689
Epoch: 1/100... Training loss: 0.1762
Epoch: 1/100... Training loss: 0.1691
Epoch: 1/100... Training loss: 0.1738
Epoch: 1/100... Training loss: 0.1747
Epoch: 1/100... Training loss: 0.1664
Epoch: 1/100... Training loss: 0.1726
Epoch: 1/100... Training loss: 0.1699
Epoch: 1/100... Training loss: 0.1748
Epoch: 1/100... Training loss: 0.1722
Epoch: 1/100... Training loss: 0.1674
Epoch: 1/100... Training loss: 0.1685
Epoch: 1/100... Training loss: 0.1714
Epoch: 1/100... Training loss: 0.1679






    



---------------------------------------------------------------------------
KeyboardInterrupt                         Traceback (most recent call last)
<ipython-input-20-3f51beac5ee6> in <module>()
     17         # Noisy images as inputs, original images as targets
     18         batch_cost, _ = sess.run([cost, opt], feed_dict={inputs_: noisy_imgs,
---> 19                                                          targets_: imgs})
     20 
     21         print("Epoch: {}/{}...".format(e+1, epochs),

/Users/danielcmresende/miniconda3/envs/dl-env/lib/python3.6/site-packages/tensorflow/python/client/session.py in run(self, fetches, feed_dict, options, run_metadata)
    776     try:
    777       result = self._run(None, fetches, feed_dict, options_ptr,
--> 778                          run_metadata_ptr)
    779       if run_metadata:
    780         proto_data = tf_session.TF_GetBuffer(run_metadata_ptr)

/Users/danielcmresende/miniconda3/envs/dl-env/lib/python3.6/site-packages/tensorflow/python/client/session.py in _run(self, handle, fetches, feed_dict, options, run_metadata)
    980     if final_fetches or final_targets:
    981       results = self._do_run(handle, final_targets, final_fetches,
--> 982                              feed_dict_string, options, run_metadata)
    983     else:
    984       results = []

/Users/danielcmresende/miniconda3/envs/dl-env/lib/python3.6/site-packages/tensorflow/python/client/session.py in _do_run(self, handle, target_list, fetch_list, feed_dict, options, run_metadata)
   1030     if handle is None:
   1031       return self._do_call(_run_fn, self._session, feed_dict, fetch_list,
-> 1032                            target_list, options, run_metadata)
   1033     else:
   1034       return self._do_call(_prun_fn, self._session, handle, feed_dict,

/Users/danielcmresende/miniconda3/envs/dl-env/lib/python3.6/site-packages/tensorflow/python/client/session.py in _do_call(self, fn, *args)
   1037   def _do_call(self, fn, *args):
   1038     try:
-> 1039       return fn(*args)
   1040     except errors.OpError as e:
   1041       message = compat.as_text(e.message)

/Users/danielcmresende/miniconda3/envs/dl-env/lib/python3.6/site-packages/tensorflow/python/client/session.py in _run_fn(session, feed_dict, fetch_list, target_list, options, run_metadata)
   1019         return tf_session.TF_Run(session, options,
   1020                                  feed_dict, fetch_list, target_list,
-> 1021                                  status, run_metadata)
   1022 
   1023     def _prun_fn(session, handle, feed_dict, fetch_list):

KeyboardInterrupt:

Checking out the performance

Here I'm adding noise to the test images and passing them through the autoencoder. It does a suprisingly great job of removing the noise, even though it's sometimes difficult to tell what the original number is.



In [29]:

    
fig, axes = plt.subplots(nrows=2, ncols=10, sharex=True, sharey=True, figsize=(20,4))
in_imgs = mnist.test.images[:10]
noisy_imgs = in_imgs + noise_factor * np.random.randn(*in_imgs.shape)
noisy_imgs = np.clip(noisy_imgs, 0., 1.)

reconstructed = sess.run(decoded, feed_dict={inputs_: noisy_imgs.reshape((10, 28, 28, 1))})

for images, row in zip([noisy_imgs, reconstructed], axes):
    for img, ax in zip(images, row):
        ax.imshow(img.reshape((28, 28)), cmap='Greys_r')
        ax.get_xaxis().set_visible(False)
        ax.get_yaxis().set_visible(False)

fig.tight_layout(pad=0.1)