A Simple Autoencoder

We'll start off by building a simple autoencoder to compress the MNIST dataset. With autoencoders, we pass input data through an encoder that makes a compressed representation of the input. Then, this representation is passed through a decoder to reconstruct the input data. Generally the encoder and decoder will be built with neural networks, then trained on example data.

In this notebook, we'll be build a simple network architecture for the encoder and decoder. Let's get started by importing our libraries and getting the dataset.


In [1]:
%matplotlib inline

import numpy as np
import tensorflow as tf
import matplotlib.pyplot as plt

In [2]:
from tensorflow.examples.tutorials.mnist import input_data
mnist = input_data.read_data_sets('MNIST_data', validation_size=0)


Successfully downloaded train-images-idx3-ubyte.gz 9912422 bytes.
Extracting MNIST_data/train-images-idx3-ubyte.gz
Successfully downloaded train-labels-idx1-ubyte.gz 28881 bytes.
Extracting MNIST_data/train-labels-idx1-ubyte.gz
Successfully downloaded t10k-images-idx3-ubyte.gz 1648877 bytes.
Extracting MNIST_data/t10k-images-idx3-ubyte.gz
Successfully downloaded t10k-labels-idx1-ubyte.gz 4542 bytes.
Extracting MNIST_data/t10k-labels-idx1-ubyte.gz

Below I'm plotting an example image from the MNIST dataset. These are 28x28 grayscale images of handwritten digits.


In [3]:
img = mnist.train.images[2]
plt.imshow(img.reshape((28, 28)), cmap='Greys_r')


Out[3]:
<matplotlib.image.AxesImage at 0x11df76c18>

We'll train an autoencoder with these images by flattening them into 784 length vectors. The images from this dataset are already normalized such that the values are between 0 and 1. Let's start by building basically the simplest autoencoder with a single ReLU hidden layer. This layer will be used as the compressed representation. Then, the encoder is the input layer and the hidden layer. The decoder is the hidden layer and the output layer. Since the images are normalized between 0 and 1, we need to use a sigmoid activation on the output layer to get values matching the input.

Exercise: Build the graph for the autoencoder in the cell below. The input images will be flattened into 784 length vectors. The targets are the same as the inputs. And there should be one hidden layer with a ReLU activation and an output layer with a sigmoid activation. The loss should be calculated with the cross-entropy loss, there is a convenient TensorFlow function for this tf.nn.sigmoid_cross_entropy_with_logits (documentation). You should note that tf.nn.sigmoid_cross_entropy_with_logits takes the logits, but to get the reconstructed images you'll need to pass the logits through the sigmoid function.


In [13]:
# Size of the encoding layer (the hidden layer)
encoding_dim = 32 # feel free to change this value

inputs_ = tf.placeholder(tf.float32, [None, 784])
targets_ = tf.placeholder(tf.float32, [None, 784])

# Output of hidden layer
encoded = tf.layers.dense(inputs_, encoding_dim, tf.nn.relu)

# Output layer logits
logits = tf.layers.dense(inputs_, 784)
# Sigmoid output from logits
decoded = tf.nn.sigmoid(logits)

# Sigmoid cross-entropy loss
loss = tf.nn.sigmoid_cross_entropy_with_logits(labels=targets_, logits=logits)
# Mean of the loss
cost = tf.reduce_mean(loss)

# Adam optimizer
opt = tf.train.AdamOptimizer().minimize(cost)

Training


In [14]:
# Create the session
sess = tf.Session()

Here I'll write a bit of code to train the network. I'm not too interested in validation here, so I'll just monitor the training loss.

Calling mnist.train.next_batch(batch_size) will return a tuple of (images, labels). We're not concerned with the labels here, we just need the images. Otherwise this is pretty straightfoward training with TensorFlow. We initialize the variables with sess.run(tf.global_variables_initializer()). Then, run the optimizer and get the loss with batch_cost, _ = sess.run([cost, opt], feed_dict=feed).


In [15]:
epochs = 20
batch_size = 200
sess.run(tf.global_variables_initializer())
for e in range(epochs):
    for ii in range(mnist.train.num_examples//batch_size):
        batch = mnist.train.next_batch(batch_size)
        feed = {inputs_: batch[0], targets_: batch[0]}
        batch_cost, _ = sess.run([cost, opt], feed_dict=feed)

        print("Epoch: {}/{}...".format(e+1, epochs),
              "Training loss: {:.4f}".format(batch_cost))


Epoch: 1/20... Training loss: 0.7071
Epoch: 1/20... Training loss: 0.6707
Epoch: 1/20... Training loss: 0.6372
Epoch: 1/20... Training loss: 0.6064
Epoch: 1/20... Training loss: 0.5763
Epoch: 1/20... Training loss: 0.5519
Epoch: 1/20... Training loss: 0.5258
Epoch: 1/20... Training loss: 0.4994
Epoch: 1/20... Training loss: 0.4813
Epoch: 1/20... Training loss: 0.4623
Epoch: 1/20... Training loss: 0.4387
Epoch: 1/20... Training loss: 0.4270
Epoch: 1/20... Training loss: 0.4096
Epoch: 1/20... Training loss: 0.4019
Epoch: 1/20... Training loss: 0.3877
Epoch: 1/20... Training loss: 0.3830
Epoch: 1/20... Training loss: 0.3622
Epoch: 1/20... Training loss: 0.3632
Epoch: 1/20... Training loss: 0.3474
Epoch: 1/20... Training loss: 0.3418
Epoch: 1/20... Training loss: 0.3368
Epoch: 1/20... Training loss: 0.3286
Epoch: 1/20... Training loss: 0.3184
Epoch: 1/20... Training loss: 0.3168
Epoch: 1/20... Training loss: 0.3124
Epoch: 1/20... Training loss: 0.3057
Epoch: 1/20... Training loss: 0.3032
Epoch: 1/20... Training loss: 0.3002
Epoch: 1/20... Training loss: 0.2892
Epoch: 1/20... Training loss: 0.2840
Epoch: 1/20... Training loss: 0.2891
Epoch: 1/20... Training loss: 0.2831
Epoch: 1/20... Training loss: 0.2763
Epoch: 1/20... Training loss: 0.2769
Epoch: 1/20... Training loss: 0.2774
Epoch: 1/20... Training loss: 0.2677
Epoch: 1/20... Training loss: 0.2644
Epoch: 1/20... Training loss: 0.2673
Epoch: 1/20... Training loss: 0.2653
Epoch: 1/20... Training loss: 0.2652
Epoch: 1/20... Training loss: 0.2565
Epoch: 1/20... Training loss: 0.2573
Epoch: 1/20... Training loss: 0.2541
Epoch: 1/20... Training loss: 0.2526
Epoch: 1/20... Training loss: 0.2519
Epoch: 1/20... Training loss: 0.2471
Epoch: 1/20... Training loss: 0.2467
Epoch: 1/20... Training loss: 0.2455
Epoch: 1/20... Training loss: 0.2464
Epoch: 1/20... Training loss: 0.2400
Epoch: 1/20... Training loss: 0.2410
Epoch: 1/20... Training loss: 0.2386
Epoch: 1/20... Training loss: 0.2395
Epoch: 1/20... Training loss: 0.2355
Epoch: 1/20... Training loss: 0.2418
Epoch: 1/20... Training loss: 0.2403
Epoch: 1/20... Training loss: 0.2345
Epoch: 1/20... Training loss: 0.2338
Epoch: 1/20... Training loss: 0.2289
Epoch: 1/20... Training loss: 0.2300
Epoch: 1/20... Training loss: 0.2347
Epoch: 1/20... Training loss: 0.2272
Epoch: 1/20... Training loss: 0.2262
Epoch: 1/20... Training loss: 0.2263
Epoch: 1/20... Training loss: 0.2268
Epoch: 1/20... Training loss: 0.2283
Epoch: 1/20... Training loss: 0.2228
Epoch: 1/20... Training loss: 0.2253
Epoch: 1/20... Training loss: 0.2195
Epoch: 1/20... Training loss: 0.2197
Epoch: 1/20... Training loss: 0.2233
Epoch: 1/20... Training loss: 0.2191
Epoch: 1/20... Training loss: 0.2169
Epoch: 1/20... Training loss: 0.2187
Epoch: 1/20... Training loss: 0.2192
Epoch: 1/20... Training loss: 0.2175
Epoch: 1/20... Training loss: 0.2152
Epoch: 1/20... Training loss: 0.2137
Epoch: 1/20... Training loss: 0.2163
Epoch: 1/20... Training loss: 0.2104
Epoch: 1/20... Training loss: 0.2096
Epoch: 1/20... Training loss: 0.2161
Epoch: 1/20... Training loss: 0.2120
Epoch: 1/20... Training loss: 0.2064
Epoch: 1/20... Training loss: 0.2043
Epoch: 1/20... Training loss: 0.2080
Epoch: 1/20... Training loss: 0.2091
Epoch: 1/20... Training loss: 0.2061
Epoch: 1/20... Training loss: 0.2095
Epoch: 1/20... Training loss: 0.2052
Epoch: 1/20... Training loss: 0.2036
Epoch: 1/20... Training loss: 0.2093
Epoch: 1/20... Training loss: 0.2096
Epoch: 1/20... Training loss: 0.2030
Epoch: 1/20... Training loss: 0.2020
Epoch: 1/20... Training loss: 0.2081
Epoch: 1/20... Training loss: 0.1992
Epoch: 1/20... Training loss: 0.2056
Epoch: 1/20... Training loss: 0.2005
Epoch: 1/20... Training loss: 0.2014
Epoch: 1/20... Training loss: 0.2058
Epoch: 1/20... Training loss: 0.1985
Epoch: 1/20... Training loss: 0.1947
Epoch: 1/20... Training loss: 0.1944
Epoch: 1/20... Training loss: 0.1969
Epoch: 1/20... Training loss: 0.1949
Epoch: 1/20... Training loss: 0.2016
Epoch: 1/20... Training loss: 0.1968
Epoch: 1/20... Training loss: 0.1935
Epoch: 1/20... Training loss: 0.1951
Epoch: 1/20... Training loss: 0.1942
Epoch: 1/20... Training loss: 0.1984
Epoch: 1/20... Training loss: 0.1960
Epoch: 1/20... Training loss: 0.1981
Epoch: 1/20... Training loss: 0.1965
Epoch: 1/20... Training loss: 0.1886
Epoch: 1/20... Training loss: 0.1902
Epoch: 1/20... Training loss: 0.1942
Epoch: 1/20... Training loss: 0.1891
Epoch: 1/20... Training loss: 0.1964
Epoch: 1/20... Training loss: 0.1930
Epoch: 1/20... Training loss: 0.1851
Epoch: 1/20... Training loss: 0.1830
Epoch: 1/20... Training loss: 0.1878
Epoch: 1/20... Training loss: 0.1896
Epoch: 1/20... Training loss: 0.1885
Epoch: 1/20... Training loss: 0.1857
Epoch: 1/20... Training loss: 0.1811
Epoch: 1/20... Training loss: 0.1864
Epoch: 1/20... Training loss: 0.1862
Epoch: 1/20... Training loss: 0.1873
Epoch: 1/20... Training loss: 0.1862
Epoch: 1/20... Training loss: 0.1865
Epoch: 1/20... Training loss: 0.1832
Epoch: 1/20... Training loss: 0.1821
Epoch: 1/20... Training loss: 0.1818
Epoch: 1/20... Training loss: 0.1877
Epoch: 1/20... Training loss: 0.1865
Epoch: 1/20... Training loss: 0.1838
Epoch: 1/20... Training loss: 0.1847
Epoch: 1/20... Training loss: 0.1864
Epoch: 1/20... Training loss: 0.1817
Epoch: 1/20... Training loss: 0.1796
Epoch: 1/20... Training loss: 0.1854
Epoch: 1/20... Training loss: 0.1849
Epoch: 1/20... Training loss: 0.1780
Epoch: 1/20... Training loss: 0.1802
Epoch: 1/20... Training loss: 0.1800
Epoch: 1/20... Training loss: 0.1784
Epoch: 1/20... Training loss: 0.1765
Epoch: 1/20... Training loss: 0.1812
Epoch: 1/20... Training loss: 0.1748
Epoch: 1/20... Training loss: 0.1852
Epoch: 1/20... Training loss: 0.1837
Epoch: 1/20... Training loss: 0.1786
Epoch: 1/20... Training loss: 0.1752
Epoch: 1/20... Training loss: 0.1760
Epoch: 1/20... Training loss: 0.1762
Epoch: 1/20... Training loss: 0.1750
Epoch: 1/20... Training loss: 0.1796
Epoch: 1/20... Training loss: 0.1752
Epoch: 1/20... Training loss: 0.1685
Epoch: 1/20... Training loss: 0.1823
Epoch: 1/20... Training loss: 0.1739
Epoch: 1/20... Training loss: 0.1743
Epoch: 1/20... Training loss: 0.1748
Epoch: 1/20... Training loss: 0.1733
Epoch: 1/20... Training loss: 0.1715
Epoch: 1/20... Training loss: 0.1719
Epoch: 1/20... Training loss: 0.1744
Epoch: 1/20... Training loss: 0.1740
Epoch: 1/20... Training loss: 0.1738
Epoch: 1/20... Training loss: 0.1716
Epoch: 1/20... Training loss: 0.1751
Epoch: 1/20... Training loss: 0.1758
Epoch: 1/20... Training loss: 0.1707
Epoch: 1/20... Training loss: 0.1694
Epoch: 1/20... Training loss: 0.1688
Epoch: 1/20... Training loss: 0.1726
Epoch: 1/20... Training loss: 0.1715
Epoch: 1/20... Training loss: 0.1742
Epoch: 1/20... Training loss: 0.1738
Epoch: 1/20... Training loss: 0.1673
Epoch: 1/20... Training loss: 0.1711
Epoch: 1/20... Training loss: 0.1699
Epoch: 1/20... Training loss: 0.1701
Epoch: 1/20... Training loss: 0.1728
Epoch: 1/20... Training loss: 0.1703
Epoch: 1/20... Training loss: 0.1652
Epoch: 1/20... Training loss: 0.1696
Epoch: 1/20... Training loss: 0.1652
Epoch: 1/20... Training loss: 0.1734
Epoch: 1/20... Training loss: 0.1701
Epoch: 1/20... Training loss: 0.1615
Epoch: 1/20... Training loss: 0.1630
Epoch: 1/20... Training loss: 0.1681
Epoch: 1/20... Training loss: 0.1631
Epoch: 1/20... Training loss: 0.1677
Epoch: 1/20... Training loss: 0.1671
Epoch: 1/20... Training loss: 0.1682
Epoch: 1/20... Training loss: 0.1676
Epoch: 1/20... Training loss: 0.1630
Epoch: 1/20... Training loss: 0.1615
Epoch: 1/20... Training loss: 0.1701
Epoch: 1/20... Training loss: 0.1634
Epoch: 1/20... Training loss: 0.1622
Epoch: 1/20... Training loss: 0.1655
Epoch: 1/20... Training loss: 0.1662
Epoch: 1/20... Training loss: 0.1591
Epoch: 1/20... Training loss: 0.1590
Epoch: 1/20... Training loss: 0.1632
Epoch: 1/20... Training loss: 0.1628
Epoch: 1/20... Training loss: 0.1648
Epoch: 1/20... Training loss: 0.1638
Epoch: 1/20... Training loss: 0.1600
Epoch: 1/20... Training loss: 0.1618
Epoch: 1/20... Training loss: 0.1633
Epoch: 1/20... Training loss: 0.1615
Epoch: 1/20... Training loss: 0.1615
Epoch: 1/20... Training loss: 0.1607
Epoch: 1/20... Training loss: 0.1580
Epoch: 1/20... Training loss: 0.1655
Epoch: 1/20... Training loss: 0.1631
Epoch: 1/20... Training loss: 0.1557
Epoch: 1/20... Training loss: 0.1575
Epoch: 1/20... Training loss: 0.1601
Epoch: 1/20... Training loss: 0.1574
Epoch: 1/20... Training loss: 0.1631
Epoch: 1/20... Training loss: 0.1648
Epoch: 1/20... Training loss: 0.1549
Epoch: 1/20... Training loss: 0.1576
Epoch: 1/20... Training loss: 0.1559
Epoch: 1/20... Training loss: 0.1609
Epoch: 1/20... Training loss: 0.1630
Epoch: 1/20... Training loss: 0.1554
Epoch: 1/20... Training loss: 0.1554
Epoch: 1/20... Training loss: 0.1601
Epoch: 1/20... Training loss: 0.1602
Epoch: 1/20... Training loss: 0.1511
Epoch: 1/20... Training loss: 0.1595
Epoch: 1/20... Training loss: 0.1575
Epoch: 1/20... Training loss: 0.1564
Epoch: 1/20... Training loss: 0.1494
Epoch: 1/20... Training loss: 0.1588
Epoch: 1/20... Training loss: 0.1552
Epoch: 1/20... Training loss: 0.1590
Epoch: 1/20... Training loss: 0.1562
Epoch: 1/20... Training loss: 0.1544
Epoch: 1/20... Training loss: 0.1532
Epoch: 1/20... Training loss: 0.1527
Epoch: 1/20... Training loss: 0.1542
Epoch: 1/20... Training loss: 0.1533
Epoch: 1/20... Training loss: 0.1547
Epoch: 1/20... Training loss: 0.1510
Epoch: 1/20... Training loss: 0.1576
Epoch: 1/20... Training loss: 0.1594
Epoch: 1/20... Training loss: 0.1540
Epoch: 1/20... Training loss: 0.1524
Epoch: 1/20... Training loss: 0.1556
Epoch: 1/20... Training loss: 0.1541
Epoch: 1/20... Training loss: 0.1488
Epoch: 1/20... Training loss: 0.1519
Epoch: 1/20... Training loss: 0.1546
Epoch: 1/20... Training loss: 0.1556
Epoch: 1/20... Training loss: 0.1517
Epoch: 1/20... Training loss: 0.1535
Epoch: 1/20... Training loss: 0.1538
Epoch: 1/20... Training loss: 0.1528
Epoch: 1/20... Training loss: 0.1545
Epoch: 1/20... Training loss: 0.1521
Epoch: 1/20... Training loss: 0.1524
Epoch: 1/20... Training loss: 0.1545
Epoch: 1/20... Training loss: 0.1526
Epoch: 1/20... Training loss: 0.1525
Epoch: 1/20... Training loss: 0.1517
Epoch: 1/20... Training loss: 0.1531
Epoch: 1/20... Training loss: 0.1515
Epoch: 1/20... Training loss: 0.1465
Epoch: 1/20... Training loss: 0.1510
Epoch: 1/20... Training loss: 0.1478
Epoch: 1/20... Training loss: 0.1523
Epoch: 1/20... Training loss: 0.1511
Epoch: 1/20... Training loss: 0.1506
Epoch: 1/20... Training loss: 0.1509
Epoch: 1/20... Training loss: 0.1466
Epoch: 1/20... Training loss: 0.1536
Epoch: 1/20... Training loss: 0.1456
Epoch: 1/20... Training loss: 0.1479
Epoch: 1/20... Training loss: 0.1491
Epoch: 1/20... Training loss: 0.1461
Epoch: 1/20... Training loss: 0.1475
Epoch: 1/20... Training loss: 0.1488
Epoch: 1/20... Training loss: 0.1470
Epoch: 1/20... Training loss: 0.1510
Epoch: 1/20... Training loss: 0.1509
Epoch: 1/20... Training loss: 0.1450
Epoch: 1/20... Training loss: 0.1486
Epoch: 1/20... Training loss: 0.1498
Epoch: 1/20... Training loss: 0.1495
Epoch: 1/20... Training loss: 0.1509
Epoch: 2/20... Training loss: 0.1444
Epoch: 2/20... Training loss: 0.1438
Epoch: 2/20... Training loss: 0.1465
Epoch: 2/20... Training loss: 0.1456
Epoch: 2/20... Training loss: 0.1508
Epoch: 2/20... Training loss: 0.1510
Epoch: 2/20... Training loss: 0.1438
Epoch: 2/20... Training loss: 0.1491
Epoch: 2/20... Training loss: 0.1456
Epoch: 2/20... Training loss: 0.1433
Epoch: 2/20... Training loss: 0.1469
Epoch: 2/20... Training loss: 0.1432
Epoch: 2/20... Training loss: 0.1504
Epoch: 2/20... Training loss: 0.1478
Epoch: 2/20... Training loss: 0.1457
Epoch: 2/20... Training loss: 0.1428
Epoch: 2/20... Training loss: 0.1455
Epoch: 2/20... Training loss: 0.1480
Epoch: 2/20... Training loss: 0.1510
Epoch: 2/20... Training loss: 0.1420
Epoch: 2/20... Training loss: 0.1436
Epoch: 2/20... Training loss: 0.1441
Epoch: 2/20... Training loss: 0.1438
Epoch: 2/20... Training loss: 0.1407
Epoch: 2/20... Training loss: 0.1446
Epoch: 2/20... Training loss: 0.1448
Epoch: 2/20... Training loss: 0.1474
Epoch: 2/20... Training loss: 0.1383
Epoch: 2/20... Training loss: 0.1416
Epoch: 2/20... Training loss: 0.1424
Epoch: 2/20... Training loss: 0.1419
Epoch: 2/20... Training loss: 0.1460
Epoch: 2/20... Training loss: 0.1417
Epoch: 2/20... Training loss: 0.1396
Epoch: 2/20... Training loss: 0.1433
Epoch: 2/20... Training loss: 0.1471
Epoch: 2/20... Training loss: 0.1434
Epoch: 2/20... Training loss: 0.1390
Epoch: 2/20... Training loss: 0.1410
Epoch: 2/20... Training loss: 0.1421
Epoch: 2/20... Training loss: 0.1418
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1374
Epoch: 2/20... Training loss: 0.1445
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1377
Epoch: 2/20... Training loss: 0.1384
Epoch: 2/20... Training loss: 0.1404
Epoch: 2/20... Training loss: 0.1426
Epoch: 2/20... Training loss: 0.1397
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1429
Epoch: 2/20... Training loss: 0.1460
Epoch: 2/20... Training loss: 0.1447
Epoch: 2/20... Training loss: 0.1398
Epoch: 2/20... Training loss: 0.1376
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1398
Epoch: 2/20... Training loss: 0.1400
Epoch: 2/20... Training loss: 0.1392
Epoch: 2/20... Training loss: 0.1385
Epoch: 2/20... Training loss: 0.1379
Epoch: 2/20... Training loss: 0.1432
Epoch: 2/20... Training loss: 0.1383
Epoch: 2/20... Training loss: 0.1431
Epoch: 2/20... Training loss: 0.1410
Epoch: 2/20... Training loss: 0.1459
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1373
Epoch: 2/20... Training loss: 0.1362
Epoch: 2/20... Training loss: 0.1400
Epoch: 2/20... Training loss: 0.1394
Epoch: 2/20... Training loss: 0.1351
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1440
Epoch: 2/20... Training loss: 0.1403
Epoch: 2/20... Training loss: 0.1392
Epoch: 2/20... Training loss: 0.1386
Epoch: 2/20... Training loss: 0.1425
Epoch: 2/20... Training loss: 0.1404
Epoch: 2/20... Training loss: 0.1374
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1399
Epoch: 2/20... Training loss: 0.1389
Epoch: 2/20... Training loss: 0.1374
Epoch: 2/20... Training loss: 0.1352
Epoch: 2/20... Training loss: 0.1391
Epoch: 2/20... Training loss: 0.1361
Epoch: 2/20... Training loss: 0.1375
Epoch: 2/20... Training loss: 0.1305
Epoch: 2/20... Training loss: 0.1375
Epoch: 2/20... Training loss: 0.1416
Epoch: 2/20... Training loss: 0.1368
Epoch: 2/20... Training loss: 0.1389
Epoch: 2/20... Training loss: 0.1356
Epoch: 2/20... Training loss: 0.1381
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1360
Epoch: 2/20... Training loss: 0.1387
Epoch: 2/20... Training loss: 0.1359
Epoch: 2/20... Training loss: 0.1384
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1375
Epoch: 2/20... Training loss: 0.1382
Epoch: 2/20... Training loss: 0.1380
Epoch: 2/20... Training loss: 0.1359
Epoch: 2/20... Training loss: 0.1375
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1334
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1385
Epoch: 2/20... Training loss: 0.1374
Epoch: 2/20... Training loss: 0.1343
Epoch: 2/20... Training loss: 0.1337
Epoch: 2/20... Training loss: 0.1331
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1325
Epoch: 2/20... Training loss: 0.1335
Epoch: 2/20... Training loss: 0.1405
Epoch: 2/20... Training loss: 0.1298
Epoch: 2/20... Training loss: 0.1353
Epoch: 2/20... Training loss: 0.1357
Epoch: 2/20... Training loss: 0.1332
Epoch: 2/20... Training loss: 0.1350
Epoch: 2/20... Training loss: 0.1335
Epoch: 2/20... Training loss: 0.1342
Epoch: 2/20... Training loss: 0.1345
Epoch: 2/20... Training loss: 0.1352
Epoch: 2/20... Training loss: 0.1335
Epoch: 2/20... Training loss: 0.1312
Epoch: 2/20... Training loss: 0.1342
Epoch: 2/20... Training loss: 0.1328
Epoch: 2/20... Training loss: 0.1345
Epoch: 2/20... Training loss: 0.1352
Epoch: 2/20... Training loss: 0.1302
Epoch: 2/20... Training loss: 0.1313
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1322
Epoch: 2/20... Training loss: 0.1335
Epoch: 2/20... Training loss: 0.1314
Epoch: 2/20... Training loss: 0.1308
Epoch: 2/20... Training loss: 0.1346
Epoch: 2/20... Training loss: 0.1317
Epoch: 2/20... Training loss: 0.1344
Epoch: 2/20... Training loss: 0.1286
Epoch: 2/20... Training loss: 0.1346
Epoch: 2/20... Training loss: 0.1303
Epoch: 2/20... Training loss: 0.1301
Epoch: 2/20... Training loss: 0.1299
Epoch: 2/20... Training loss: 0.1328
Epoch: 2/20... Training loss: 0.1297
Epoch: 2/20... Training loss: 0.1257
Epoch: 2/20... Training loss: 0.1282
Epoch: 2/20... Training loss: 0.1257
Epoch: 2/20... Training loss: 0.1305
Epoch: 2/20... Training loss: 0.1314
Epoch: 2/20... Training loss: 0.1292
Epoch: 2/20... Training loss: 0.1315
Epoch: 2/20... Training loss: 0.1369
Epoch: 2/20... Training loss: 0.1271
Epoch: 2/20... Training loss: 0.1322
Epoch: 2/20... Training loss: 0.1291
Epoch: 2/20... Training loss: 0.1328
Epoch: 2/20... Training loss: 0.1312
Epoch: 2/20... Training loss: 0.1312
Epoch: 2/20... Training loss: 0.1320
Epoch: 2/20... Training loss: 0.1363
Epoch: 2/20... Training loss: 0.1308
Epoch: 2/20... Training loss: 0.1265
Epoch: 2/20... Training loss: 0.1261
Epoch: 2/20... Training loss: 0.1287
Epoch: 2/20... Training loss: 0.1284
Epoch: 2/20... Training loss: 0.1304
Epoch: 2/20... Training loss: 0.1298
Epoch: 2/20... Training loss: 0.1317
Epoch: 2/20... Training loss: 0.1320
Epoch: 2/20... Training loss: 0.1308
Epoch: 2/20... Training loss: 0.1301
Epoch: 2/20... Training loss: 0.1304
Epoch: 2/20... Training loss: 0.1358
Epoch: 2/20... Training loss: 0.1277
Epoch: 2/20... Training loss: 0.1275
Epoch: 2/20... Training loss: 0.1312
Epoch: 2/20... Training loss: 0.1282
Epoch: 2/20... Training loss: 0.1291
Epoch: 2/20... Training loss: 0.1271
Epoch: 2/20... Training loss: 0.1267
Epoch: 2/20... Training loss: 0.1309
Epoch: 2/20... Training loss: 0.1349
Epoch: 2/20... Training loss: 0.1294
Epoch: 2/20... Training loss: 0.1309
Epoch: 2/20... Training loss: 0.1273
Epoch: 2/20... Training loss: 0.1292
Epoch: 2/20... Training loss: 0.1313
Epoch: 2/20... Training loss: 0.1283
Epoch: 2/20... Training loss: 0.1245
Epoch: 2/20... Training loss: 0.1316
Epoch: 2/20... Training loss: 0.1267
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1307
Epoch: 2/20... Training loss: 0.1301
Epoch: 2/20... Training loss: 0.1264
Epoch: 2/20... Training loss: 0.1266
Epoch: 2/20... Training loss: 0.1255
Epoch: 2/20... Training loss: 0.1302
Epoch: 2/20... Training loss: 0.1232
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1273
Epoch: 2/20... Training loss: 0.1296
Epoch: 2/20... Training loss: 0.1278
Epoch: 2/20... Training loss: 0.1267
Epoch: 2/20... Training loss: 0.1269
Epoch: 2/20... Training loss: 0.1332
Epoch: 2/20... Training loss: 0.1257
Epoch: 2/20... Training loss: 0.1319
Epoch: 2/20... Training loss: 0.1239
Epoch: 2/20... Training loss: 0.1232
Epoch: 2/20... Training loss: 0.1288
Epoch: 2/20... Training loss: 0.1272
Epoch: 2/20... Training loss: 0.1226
Epoch: 2/20... Training loss: 0.1296
Epoch: 2/20... Training loss: 0.1260
Epoch: 2/20... Training loss: 0.1250
Epoch: 2/20... Training loss: 0.1276
Epoch: 2/20... Training loss: 0.1286
Epoch: 2/20... Training loss: 0.1217
Epoch: 2/20... Training loss: 0.1250
Epoch: 2/20... Training loss: 0.1269
Epoch: 2/20... Training loss: 0.1273
Epoch: 2/20... Training loss: 0.1251
Epoch: 2/20... Training loss: 0.1248
Epoch: 2/20... Training loss: 0.1276
Epoch: 2/20... Training loss: 0.1228
Epoch: 2/20... Training loss: 0.1239
Epoch: 2/20... Training loss: 0.1269
Epoch: 2/20... Training loss: 0.1206
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1227
Epoch: 2/20... Training loss: 0.1231
Epoch: 2/20... Training loss: 0.1269
Epoch: 2/20... Training loss: 0.1258
Epoch: 2/20... Training loss: 0.1208
Epoch: 2/20... Training loss: 0.1241
Epoch: 2/20... Training loss: 0.1244
Epoch: 2/20... Training loss: 0.1224
Epoch: 2/20... Training loss: 0.1200
Epoch: 2/20... Training loss: 0.1242
Epoch: 2/20... Training loss: 0.1235
Epoch: 2/20... Training loss: 0.1230
Epoch: 2/20... Training loss: 0.1208
Epoch: 2/20... Training loss: 0.1246
Epoch: 2/20... Training loss: 0.1247
Epoch: 2/20... Training loss: 0.1252
Epoch: 2/20... Training loss: 0.1237
Epoch: 2/20... Training loss: 0.1211
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1262
Epoch: 2/20... Training loss: 0.1255
Epoch: 2/20... Training loss: 0.1236
Epoch: 2/20... Training loss: 0.1279
Epoch: 2/20... Training loss: 0.1221
Epoch: 2/20... Training loss: 0.1226
Epoch: 2/20... Training loss: 0.1223
Epoch: 2/20... Training loss: 0.1232
Epoch: 2/20... Training loss: 0.1252
Epoch: 2/20... Training loss: 0.1206
Epoch: 2/20... Training loss: 0.1197
Epoch: 2/20... Training loss: 0.1221
Epoch: 2/20... Training loss: 0.1219
Epoch: 2/20... Training loss: 0.1256
Epoch: 2/20... Training loss: 0.1199
Epoch: 2/20... Training loss: 0.1204
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1233
Epoch: 2/20... Training loss: 0.1259
Epoch: 2/20... Training loss: 0.1203
Epoch: 2/20... Training loss: 0.1236
Epoch: 2/20... Training loss: 0.1253
Epoch: 2/20... Training loss: 0.1243
Epoch: 2/20... Training loss: 0.1229
Epoch: 2/20... Training loss: 0.1204
Epoch: 2/20... Training loss: 0.1185
Epoch: 2/20... Training loss: 0.1273
Epoch: 2/20... Training loss: 0.1255
Epoch: 2/20... Training loss: 0.1200
Epoch: 2/20... Training loss: 0.1247
Epoch: 2/20... Training loss: 0.1241
Epoch: 2/20... Training loss: 0.1208
Epoch: 2/20... Training loss: 0.1202
Epoch: 2/20... Training loss: 0.1266
Epoch: 2/20... Training loss: 0.1213
Epoch: 2/20... Training loss: 0.1213
Epoch: 2/20... Training loss: 0.1201
Epoch: 2/20... Training loss: 0.1252
Epoch: 2/20... Training loss: 0.1163
Epoch: 2/20... Training loss: 0.1220
Epoch: 2/20... Training loss: 0.1199
Epoch: 2/20... Training loss: 0.1211
Epoch: 2/20... Training loss: 0.1239
Epoch: 3/20... Training loss: 0.1192
Epoch: 3/20... Training loss: 0.1199
Epoch: 3/20... Training loss: 0.1227
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1219
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1206
Epoch: 3/20... Training loss: 0.1175
Epoch: 3/20... Training loss: 0.1198
Epoch: 3/20... Training loss: 0.1191
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1195
Epoch: 3/20... Training loss: 0.1233
Epoch: 3/20... Training loss: 0.1180
Epoch: 3/20... Training loss: 0.1187
Epoch: 3/20... Training loss: 0.1202
Epoch: 3/20... Training loss: 0.1203
Epoch: 3/20... Training loss: 0.1211
Epoch: 3/20... Training loss: 0.1202
Epoch: 3/20... Training loss: 0.1227
Epoch: 3/20... Training loss: 0.1204
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1172
Epoch: 3/20... Training loss: 0.1194
Epoch: 3/20... Training loss: 0.1172
Epoch: 3/20... Training loss: 0.1191
Epoch: 3/20... Training loss: 0.1143
Epoch: 3/20... Training loss: 0.1196
Epoch: 3/20... Training loss: 0.1208
Epoch: 3/20... Training loss: 0.1142
Epoch: 3/20... Training loss: 0.1192
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1209
Epoch: 3/20... Training loss: 0.1151
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1216
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1207
Epoch: 3/20... Training loss: 0.1175
Epoch: 3/20... Training loss: 0.1218
Epoch: 3/20... Training loss: 0.1195
Epoch: 3/20... Training loss: 0.1185
Epoch: 3/20... Training loss: 0.1215
Epoch: 3/20... Training loss: 0.1205
Epoch: 3/20... Training loss: 0.1183
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1218
Epoch: 3/20... Training loss: 0.1199
Epoch: 3/20... Training loss: 0.1185
Epoch: 3/20... Training loss: 0.1170
Epoch: 3/20... Training loss: 0.1211
Epoch: 3/20... Training loss: 0.1139
Epoch: 3/20... Training loss: 0.1141
Epoch: 3/20... Training loss: 0.1183
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1224
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1210
Epoch: 3/20... Training loss: 0.1151
Epoch: 3/20... Training loss: 0.1175
Epoch: 3/20... Training loss: 0.1201
Epoch: 3/20... Training loss: 0.1183
Epoch: 3/20... Training loss: 0.1156
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1166
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1234
Epoch: 3/20... Training loss: 0.1151
Epoch: 3/20... Training loss: 0.1196
Epoch: 3/20... Training loss: 0.1143
Epoch: 3/20... Training loss: 0.1172
Epoch: 3/20... Training loss: 0.1160
Epoch: 3/20... Training loss: 0.1161
Epoch: 3/20... Training loss: 0.1177
Epoch: 3/20... Training loss: 0.1137
Epoch: 3/20... Training loss: 0.1184
Epoch: 3/20... Training loss: 0.1165
Epoch: 3/20... Training loss: 0.1189
Epoch: 3/20... Training loss: 0.1117
Epoch: 3/20... Training loss: 0.1171
Epoch: 3/20... Training loss: 0.1164
Epoch: 3/20... Training loss: 0.1127
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1167
Epoch: 3/20... Training loss: 0.1164
Epoch: 3/20... Training loss: 0.1158
Epoch: 3/20... Training loss: 0.1129
Epoch: 3/20... Training loss: 0.1159
Epoch: 3/20... Training loss: 0.1195
Epoch: 3/20... Training loss: 0.1114
Epoch: 3/20... Training loss: 0.1153
Epoch: 3/20... Training loss: 0.1149
Epoch: 3/20... Training loss: 0.1145
Epoch: 3/20... Training loss: 0.1138
Epoch: 3/20... Training loss: 0.1143
Epoch: 3/20... Training loss: 0.1156
Epoch: 3/20... Training loss: 0.1146
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1166
Epoch: 3/20... Training loss: 0.1158
Epoch: 3/20... Training loss: 0.1145
Epoch: 3/20... Training loss: 0.1182
Epoch: 3/20... Training loss: 0.1113
Epoch: 3/20... Training loss: 0.1129
Epoch: 3/20... Training loss: 0.1169
Epoch: 3/20... Training loss: 0.1102
Epoch: 3/20... Training loss: 0.1181
Epoch: 3/20... Training loss: 0.1152
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1121
Epoch: 3/20... Training loss: 0.1105
Epoch: 3/20... Training loss: 0.1133
Epoch: 3/20... Training loss: 0.1162
Epoch: 3/20... Training loss: 0.1134
Epoch: 3/20... Training loss: 0.1144
Epoch: 3/20... Training loss: 0.1146
Epoch: 3/20... Training loss: 0.1157
Epoch: 3/20... Training loss: 0.1179
Epoch: 3/20... Training loss: 0.1130
Epoch: 3/20... Training loss: 0.1142
Epoch: 3/20... Training loss: 0.1163
Epoch: 3/20... Training loss: 0.1159
Epoch: 3/20... Training loss: 0.1134
Epoch: 3/20... Training loss: 0.1160
Epoch: 3/20... Training loss: 0.1100
Epoch: 3/20... Training loss: 0.1166
Epoch: 3/20... Training loss: 0.1168
Epoch: 3/20... Training loss: 0.1131
Epoch: 3/20... Training loss: 0.1155
Epoch: 3/20... Training loss: 0.1188
Epoch: 3/20... Training loss: 0.1187
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1136
Epoch: 3/20... Training loss: 0.1134
Epoch: 3/20... Training loss: 0.1177
Epoch: 3/20... Training loss: 0.1143
Epoch: 3/20... Training loss: 0.1185
Epoch: 3/20... Training loss: 0.1144
Epoch: 3/20... Training loss: 0.1191
Epoch: 3/20... Training loss: 0.1108
Epoch: 3/20... Training loss: 0.1117
Epoch: 3/20... Training loss: 0.1173
Epoch: 3/20... Training loss: 0.1127
Epoch: 3/20... Training loss: 0.1161
Epoch: 3/20... Training loss: 0.1167
Epoch: 3/20... Training loss: 0.1122
Epoch: 3/20... Training loss: 0.1152
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1152
Epoch: 3/20... Training loss: 0.1130
Epoch: 3/20... Training loss: 0.1136
Epoch: 3/20... Training loss: 0.1127
Epoch: 3/20... Training loss: 0.1118
Epoch: 3/20... Training loss: 0.1106
Epoch: 3/20... Training loss: 0.1140
Epoch: 3/20... Training loss: 0.1173
Epoch: 3/20... Training loss: 0.1184
Epoch: 3/20... Training loss: 0.1146
Epoch: 3/20... Training loss: 0.1138
Epoch: 3/20... Training loss: 0.1150
Epoch: 3/20... Training loss: 0.1108
Epoch: 3/20... Training loss: 0.1152
Epoch: 3/20... Training loss: 0.1079
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1128
Epoch: 3/20... Training loss: 0.1173
Epoch: 3/20... Training loss: 0.1105
Epoch: 3/20... Training loss: 0.1103
Epoch: 3/20... Training loss: 0.1140
Epoch: 3/20... Training loss: 0.1115
Epoch: 3/20... Training loss: 0.1125
Epoch: 3/20... Training loss: 0.1109
Epoch: 3/20... Training loss: 0.1098
Epoch: 3/20... Training loss: 0.1133
Epoch: 3/20... Training loss: 0.1080
Epoch: 3/20... Training loss: 0.1112
Epoch: 3/20... Training loss: 0.1121
Epoch: 3/20... Training loss: 0.1109
Epoch: 3/20... Training loss: 0.1138
Epoch: 3/20... Training loss: 0.1142
Epoch: 3/20... Training loss: 0.1159
Epoch: 3/20... Training loss: 0.1134
Epoch: 3/20... Training loss: 0.1113
Epoch: 3/20... Training loss: 0.1099
Epoch: 3/20... Training loss: 0.1121
Epoch: 3/20... Training loss: 0.1127
Epoch: 3/20... Training loss: 0.1154
Epoch: 3/20... Training loss: 0.1121
Epoch: 3/20... Training loss: 0.1124
Epoch: 3/20... Training loss: 0.1122
Epoch: 3/20... Training loss: 0.1122
Epoch: 3/20... Training loss: 0.1114
Epoch: 3/20... Training loss: 0.1106
Epoch: 3/20... Training loss: 0.1132
Epoch: 3/20... Training loss: 0.1146
Epoch: 3/20... Training loss: 0.1114
Epoch: 3/20... Training loss: 0.1129
Epoch: 3/20... Training loss: 0.1096
Epoch: 3/20... Training loss: 0.1101
Epoch: 3/20... Training loss: 0.1108
Epoch: 3/20... Training loss: 0.1131
Epoch: 3/20... Training loss: 0.1142
Epoch: 3/20... Training loss: 0.1115
Epoch: 3/20... Training loss: 0.1114
Epoch: 3/20... Training loss: 0.1151
Epoch: 3/20... Training loss: 0.1118
Epoch: 3/20... Training loss: 0.1096
Epoch: 3/20... Training loss: 0.1092
Epoch: 3/20... Training loss: 0.1123
Epoch: 3/20... Training loss: 0.1137
Epoch: 3/20... Training loss: 0.1129
Epoch: 3/20... Training loss: 0.1126
Epoch: 3/20... Training loss: 0.1097
Epoch: 3/20... Training loss: 0.1096
Epoch: 3/20... Training loss: 0.1100
Epoch: 3/20... Training loss: 0.1109
Epoch: 3/20... Training loss: 0.1107
Epoch: 3/20... Training loss: 0.1126
Epoch: 3/20... Training loss: 0.1086
Epoch: 3/20... Training loss: 0.1128
Epoch: 3/20... Training loss: 0.1109
Epoch: 3/20... Training loss: 0.1087
Epoch: 3/20... Training loss: 0.1115
Epoch: 3/20... Training loss: 0.1161
Epoch: 3/20... Training loss: 0.1124
Epoch: 3/20... Training loss: 0.1084
Epoch: 3/20... Training loss: 0.1104
Epoch: 3/20... Training loss: 0.1147
Epoch: 3/20... Training loss: 0.1108
Epoch: 3/20... Training loss: 0.1071
Epoch: 3/20... Training loss: 0.1087
Epoch: 3/20... Training loss: 0.1084
Epoch: 3/20... Training loss: 0.1071
Epoch: 3/20... Training loss: 0.1084
Epoch: 3/20... Training loss: 0.1077
Epoch: 3/20... Training loss: 0.1055
Epoch: 3/20... Training loss: 0.1099
Epoch: 3/20... Training loss: 0.1130
Epoch: 3/20... Training loss: 0.1117
Epoch: 3/20... Training loss: 0.1104
Epoch: 3/20... Training loss: 0.1082
Epoch: 3/20... Training loss: 0.1099
Epoch: 3/20... Training loss: 0.1118
Epoch: 3/20... Training loss: 0.1101
Epoch: 3/20... Training loss: 0.1118
Epoch: 3/20... Training loss: 0.1096
Epoch: 3/20... Training loss: 0.1086
Epoch: 3/20... Training loss: 0.1101
Epoch: 3/20... Training loss: 0.1086
Epoch: 3/20... Training loss: 0.1075
Epoch: 3/20... Training loss: 0.1089
Epoch: 3/20... Training loss: 0.1098
Epoch: 3/20... Training loss: 0.1076
Epoch: 3/20... Training loss: 0.1105
Epoch: 3/20... Training loss: 0.1103
Epoch: 3/20... Training loss: 0.1108
Epoch: 3/20... Training loss: 0.1082
Epoch: 3/20... Training loss: 0.1112
Epoch: 3/20... Training loss: 0.1076
Epoch: 3/20... Training loss: 0.1085
Epoch: 3/20... Training loss: 0.1084
Epoch: 3/20... Training loss: 0.1109
Epoch: 3/20... Training loss: 0.1085
Epoch: 3/20... Training loss: 0.1123
Epoch: 3/20... Training loss: 0.1131
Epoch: 3/20... Training loss: 0.1089
Epoch: 3/20... Training loss: 0.1080
Epoch: 3/20... Training loss: 0.1119
Epoch: 3/20... Training loss: 0.1092
Epoch: 3/20... Training loss: 0.1111
Epoch: 3/20... Training loss: 0.1120
Epoch: 3/20... Training loss: 0.1098
Epoch: 3/20... Training loss: 0.1079
Epoch: 3/20... Training loss: 0.1137
Epoch: 3/20... Training loss: 0.1122
Epoch: 3/20... Training loss: 0.1076
Epoch: 3/20... Training loss: 0.1089
Epoch: 3/20... Training loss: 0.1101
Epoch: 3/20... Training loss: 0.1092
Epoch: 3/20... Training loss: 0.1122
Epoch: 3/20... Training loss: 0.1089
Epoch: 3/20... Training loss: 0.1048
Epoch: 3/20... Training loss: 0.1096
Epoch: 3/20... Training loss: 0.1150
Epoch: 3/20... Training loss: 0.1121
Epoch: 3/20... Training loss: 0.1087
Epoch: 3/20... Training loss: 0.1116
Epoch: 3/20... Training loss: 0.1070
Epoch: 3/20... Training loss: 0.1049
Epoch: 3/20... Training loss: 0.1054
Epoch: 3/20... Training loss: 0.1080
Epoch: 3/20... Training loss: 0.1085
Epoch: 3/20... Training loss: 0.1106
Epoch: 3/20... Training loss: 0.1087
Epoch: 3/20... Training loss: 0.1058
Epoch: 3/20... Training loss: 0.1126
Epoch: 3/20... Training loss: 0.1083
Epoch: 3/20... Training loss: 0.1092
Epoch: 3/20... Training loss: 0.1102
Epoch: 4/20... Training loss: 0.1073
Epoch: 4/20... Training loss: 0.1071
Epoch: 4/20... Training loss: 0.1058
Epoch: 4/20... Training loss: 0.1088
Epoch: 4/20... Training loss: 0.1120
Epoch: 4/20... Training loss: 0.1088
Epoch: 4/20... Training loss: 0.1102
Epoch: 4/20... Training loss: 0.1057
Epoch: 4/20... Training loss: 0.1058
Epoch: 4/20... Training loss: 0.1063
Epoch: 4/20... Training loss: 0.1051
Epoch: 4/20... Training loss: 0.1041
Epoch: 4/20... Training loss: 0.1087
Epoch: 4/20... Training loss: 0.1077
Epoch: 4/20... Training loss: 0.1110
Epoch: 4/20... Training loss: 0.1069
Epoch: 4/20... Training loss: 0.1064
Epoch: 4/20... Training loss: 0.1084
Epoch: 4/20... Training loss: 0.1067
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1105
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1057
Epoch: 4/20... Training loss: 0.1064
Epoch: 4/20... Training loss: 0.1056
Epoch: 4/20... Training loss: 0.1062
Epoch: 4/20... Training loss: 0.1050
Epoch: 4/20... Training loss: 0.1071
Epoch: 4/20... Training loss: 0.1052
Epoch: 4/20... Training loss: 0.1068
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1065
Epoch: 4/20... Training loss: 0.1061
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1081
Epoch: 4/20... Training loss: 0.1084
Epoch: 4/20... Training loss: 0.1065
Epoch: 4/20... Training loss: 0.1071
Epoch: 4/20... Training loss: 0.1025
Epoch: 4/20... Training loss: 0.1063
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1082
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1080
Epoch: 4/20... Training loss: 0.1048
Epoch: 4/20... Training loss: 0.1079
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.1064
Epoch: 4/20... Training loss: 0.1031
Epoch: 4/20... Training loss: 0.1057
Epoch: 4/20... Training loss: 0.1058
Epoch: 4/20... Training loss: 0.1042
Epoch: 4/20... Training loss: 0.1061
Epoch: 4/20... Training loss: 0.1034
Epoch: 4/20... Training loss: 0.1076
Epoch: 4/20... Training loss: 0.1044
Epoch: 4/20... Training loss: 0.1068
Epoch: 4/20... Training loss: 0.1054
Epoch: 4/20... Training loss: 0.1066
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1044
Epoch: 4/20... Training loss: 0.1066
Epoch: 4/20... Training loss: 0.1072
Epoch: 4/20... Training loss: 0.1071
Epoch: 4/20... Training loss: 0.1042
Epoch: 4/20... Training loss: 0.1025
Epoch: 4/20... Training loss: 0.1078
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.1034
Epoch: 4/20... Training loss: 0.1000
Epoch: 4/20... Training loss: 0.1106
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1074
Epoch: 4/20... Training loss: 0.1052
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1023
Epoch: 4/20... Training loss: 0.1029
Epoch: 4/20... Training loss: 0.1067
Epoch: 4/20... Training loss: 0.1031
Epoch: 4/20... Training loss: 0.1048
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1047
Epoch: 4/20... Training loss: 0.1052
Epoch: 4/20... Training loss: 0.1065
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.1050
Epoch: 4/20... Training loss: 0.1071
Epoch: 4/20... Training loss: 0.1043
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1091
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1061
Epoch: 4/20... Training loss: 0.1047
Epoch: 4/20... Training loss: 0.1045
Epoch: 4/20... Training loss: 0.1053
Epoch: 4/20... Training loss: 0.1062
Epoch: 4/20... Training loss: 0.1028
Epoch: 4/20... Training loss: 0.1048
Epoch: 4/20... Training loss: 0.1044
Epoch: 4/20... Training loss: 0.1051
Epoch: 4/20... Training loss: 0.1063
Epoch: 4/20... Training loss: 0.1045
Epoch: 4/20... Training loss: 0.1068
Epoch: 4/20... Training loss: 0.1064
Epoch: 4/20... Training loss: 0.1083
Epoch: 4/20... Training loss: 0.1073
Epoch: 4/20... Training loss: 0.1027
Epoch: 4/20... Training loss: 0.1066
Epoch: 4/20... Training loss: 0.1037
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.1047
Epoch: 4/20... Training loss: 0.1033
Epoch: 4/20... Training loss: 0.1079
Epoch: 4/20... Training loss: 0.1019
Epoch: 4/20... Training loss: 0.1038
Epoch: 4/20... Training loss: 0.1060
Epoch: 4/20... Training loss: 0.1048
Epoch: 4/20... Training loss: 0.1050
Epoch: 4/20... Training loss: 0.1054
Epoch: 4/20... Training loss: 0.1053
Epoch: 4/20... Training loss: 0.1035
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1029
Epoch: 4/20... Training loss: 0.1042
Epoch: 4/20... Training loss: 0.1019
Epoch: 4/20... Training loss: 0.1014
Epoch: 4/20... Training loss: 0.1016
Epoch: 4/20... Training loss: 0.1040
Epoch: 4/20... Training loss: 0.1025
Epoch: 4/20... Training loss: 0.1009
Epoch: 4/20... Training loss: 0.1042
Epoch: 4/20... Training loss: 0.1040
Epoch: 4/20... Training loss: 0.1081
Epoch: 4/20... Training loss: 0.1060
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.1051
Epoch: 4/20... Training loss: 0.1033
Epoch: 4/20... Training loss: 0.1028
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.1051
Epoch: 4/20... Training loss: 0.1040
Epoch: 4/20... Training loss: 0.1056
Epoch: 4/20... Training loss: 0.1088
Epoch: 4/20... Training loss: 0.1064
Epoch: 4/20... Training loss: 0.1057
Epoch: 4/20... Training loss: 0.1039
Epoch: 4/20... Training loss: 0.1019
Epoch: 4/20... Training loss: 0.1040
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1027
Epoch: 4/20... Training loss: 0.1018
Epoch: 4/20... Training loss: 0.1049
Epoch: 4/20... Training loss: 0.1018
Epoch: 4/20... Training loss: 0.1006
Epoch: 4/20... Training loss: 0.1036
Epoch: 4/20... Training loss: 0.1090
Epoch: 4/20... Training loss: 0.1036
Epoch: 4/20... Training loss: 0.1045
Epoch: 4/20... Training loss: 0.1034
Epoch: 4/20... Training loss: 0.1052
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1054
Epoch: 4/20... Training loss: 0.1036
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1031
Epoch: 4/20... Training loss: 0.1043
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.1004
Epoch: 4/20... Training loss: 0.1024
Epoch: 4/20... Training loss: 0.1055
Epoch: 4/20... Training loss: 0.1035
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.1039
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.1033
Epoch: 4/20... Training loss: 0.1057
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.1022
Epoch: 4/20... Training loss: 0.1066
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.1028
Epoch: 4/20... Training loss: 0.1033
Epoch: 4/20... Training loss: 0.0992
Epoch: 4/20... Training loss: 0.0995
Epoch: 4/20... Training loss: 0.1013
Epoch: 4/20... Training loss: 0.1059
Epoch: 4/20... Training loss: 0.1011
Epoch: 4/20... Training loss: 0.1077
Epoch: 4/20... Training loss: 0.1017
Epoch: 4/20... Training loss: 0.1044
Epoch: 4/20... Training loss: 0.0997
Epoch: 4/20... Training loss: 0.1021
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1075
Epoch: 4/20... Training loss: 0.1063
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.1018
Epoch: 4/20... Training loss: 0.1032
Epoch: 4/20... Training loss: 0.1039
Epoch: 4/20... Training loss: 0.1004
Epoch: 4/20... Training loss: 0.0985
Epoch: 4/20... Training loss: 0.1033
Epoch: 4/20... Training loss: 0.1013
Epoch: 4/20... Training loss: 0.1025
Epoch: 4/20... Training loss: 0.1016
Epoch: 4/20... Training loss: 0.0996
Epoch: 4/20... Training loss: 0.1050
Epoch: 4/20... Training loss: 0.1030
Epoch: 4/20... Training loss: 0.1005
Epoch: 4/20... Training loss: 0.0978
Epoch: 4/20... Training loss: 0.1028
Epoch: 4/20... Training loss: 0.0952
Epoch: 4/20... Training loss: 0.1025
Epoch: 4/20... Training loss: 0.0995
Epoch: 4/20... Training loss: 0.0987
Epoch: 4/20... Training loss: 0.1010
Epoch: 4/20... Training loss: 0.1003
Epoch: 4/20... Training loss: 0.1000
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.1005
Epoch: 4/20... Training loss: 0.1038
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.1004
Epoch: 4/20... Training loss: 0.1017
Epoch: 4/20... Training loss: 0.1008
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.0968
Epoch: 4/20... Training loss: 0.1049
Epoch: 4/20... Training loss: 0.1010
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.1022
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.1001
Epoch: 4/20... Training loss: 0.1011
Epoch: 4/20... Training loss: 0.0999
Epoch: 4/20... Training loss: 0.0993
Epoch: 4/20... Training loss: 0.1016
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.0987
Epoch: 4/20... Training loss: 0.0982
Epoch: 4/20... Training loss: 0.0990
Epoch: 4/20... Training loss: 0.1017
Epoch: 4/20... Training loss: 0.1010
Epoch: 4/20... Training loss: 0.1004
Epoch: 4/20... Training loss: 0.1012
Epoch: 4/20... Training loss: 0.0984
Epoch: 4/20... Training loss: 0.1011
Epoch: 4/20... Training loss: 0.0993
Epoch: 4/20... Training loss: 0.1002
Epoch: 4/20... Training loss: 0.0967
Epoch: 4/20... Training loss: 0.0988
Epoch: 4/20... Training loss: 0.0965
Epoch: 4/20... Training loss: 0.1000
Epoch: 4/20... Training loss: 0.0992
Epoch: 4/20... Training loss: 0.1015
Epoch: 4/20... Training loss: 0.0994
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.1009
Epoch: 4/20... Training loss: 0.0989
Epoch: 4/20... Training loss: 0.0996
Epoch: 4/20... Training loss: 0.1080
Epoch: 4/20... Training loss: 0.1001
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.0972
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.1022
Epoch: 4/20... Training loss: 0.0999
Epoch: 4/20... Training loss: 0.1009
Epoch: 4/20... Training loss: 0.1035
Epoch: 4/20... Training loss: 0.1020
Epoch: 4/20... Training loss: 0.0971
Epoch: 4/20... Training loss: 0.1009
Epoch: 4/20... Training loss: 0.1026
Epoch: 4/20... Training loss: 0.1008
Epoch: 4/20... Training loss: 0.0990
Epoch: 4/20... Training loss: 0.0973
Epoch: 4/20... Training loss: 0.1014
Epoch: 4/20... Training loss: 0.1009
Epoch: 4/20... Training loss: 0.0985
Epoch: 4/20... Training loss: 0.0968
Epoch: 4/20... Training loss: 0.1008
Epoch: 4/20... Training loss: 0.1032
Epoch: 4/20... Training loss: 0.0976
Epoch: 4/20... Training loss: 0.0966
Epoch: 4/20... Training loss: 0.0998
Epoch: 4/20... Training loss: 0.0983
Epoch: 4/20... Training loss: 0.0997
Epoch: 4/20... Training loss: 0.0947
Epoch: 4/20... Training loss: 0.0996
Epoch: 4/20... Training loss: 0.0969
Epoch: 4/20... Training loss: 0.1014
Epoch: 4/20... Training loss: 0.0976
Epoch: 4/20... Training loss: 0.0991
Epoch: 4/20... Training loss: 0.0997
Epoch: 5/20... Training loss: 0.0964
Epoch: 5/20... Training loss: 0.1014
Epoch: 5/20... Training loss: 0.1005
Epoch: 5/20... Training loss: 0.0974
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0994
Epoch: 5/20... Training loss: 0.0982
Epoch: 5/20... Training loss: 0.0972
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0996
Epoch: 5/20... Training loss: 0.0995
Epoch: 5/20... Training loss: 0.1019
Epoch: 5/20... Training loss: 0.1026
Epoch: 5/20... Training loss: 0.0968
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0978
Epoch: 5/20... Training loss: 0.1008
Epoch: 5/20... Training loss: 0.1001
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0950
Epoch: 5/20... Training loss: 0.0949
Epoch: 5/20... Training loss: 0.0979
Epoch: 5/20... Training loss: 0.1009
Epoch: 5/20... Training loss: 0.0969
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0977
Epoch: 5/20... Training loss: 0.0983
Epoch: 5/20... Training loss: 0.0988
Epoch: 5/20... Training loss: 0.0973
Epoch: 5/20... Training loss: 0.0995
Epoch: 5/20... Training loss: 0.0971
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0956
Epoch: 5/20... Training loss: 0.0988
Epoch: 5/20... Training loss: 0.0986
Epoch: 5/20... Training loss: 0.1011
Epoch: 5/20... Training loss: 0.0984
Epoch: 5/20... Training loss: 0.0975
Epoch: 5/20... Training loss: 0.0990
Epoch: 5/20... Training loss: 0.0984
Epoch: 5/20... Training loss: 0.0996
Epoch: 5/20... Training loss: 0.0945
Epoch: 5/20... Training loss: 0.0970
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.1003
Epoch: 5/20... Training loss: 0.0964
Epoch: 5/20... Training loss: 0.0993
Epoch: 5/20... Training loss: 0.0957
Epoch: 5/20... Training loss: 0.1010
Epoch: 5/20... Training loss: 0.0984
Epoch: 5/20... Training loss: 0.0950
Epoch: 5/20... Training loss: 0.0958
Epoch: 5/20... Training loss: 0.0978
Epoch: 5/20... Training loss: 0.0993
Epoch: 5/20... Training loss: 0.0992
Epoch: 5/20... Training loss: 0.1032
Epoch: 5/20... Training loss: 0.0988
Epoch: 5/20... Training loss: 0.0997
Epoch: 5/20... Training loss: 0.0969
Epoch: 5/20... Training loss: 0.1041
Epoch: 5/20... Training loss: 0.1003
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0977
Epoch: 5/20... Training loss: 0.1014
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0991
Epoch: 5/20... Training loss: 0.0978
Epoch: 5/20... Training loss: 0.0982
Epoch: 5/20... Training loss: 0.0971
Epoch: 5/20... Training loss: 0.0979
Epoch: 5/20... Training loss: 0.1001
Epoch: 5/20... Training loss: 0.0974
Epoch: 5/20... Training loss: 0.0973
Epoch: 5/20... Training loss: 0.0979
Epoch: 5/20... Training loss: 0.1003
Epoch: 5/20... Training loss: 0.0994
Epoch: 5/20... Training loss: 0.1000
Epoch: 5/20... Training loss: 0.0965
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0949
Epoch: 5/20... Training loss: 0.0975
Epoch: 5/20... Training loss: 0.0958
Epoch: 5/20... Training loss: 0.0990
Epoch: 5/20... Training loss: 0.0959
Epoch: 5/20... Training loss: 0.0952
Epoch: 5/20... Training loss: 0.0986
Epoch: 5/20... Training loss: 0.0957
Epoch: 5/20... Training loss: 0.1009
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0955
Epoch: 5/20... Training loss: 0.0975
Epoch: 5/20... Training loss: 0.0966
Epoch: 5/20... Training loss: 0.0982
Epoch: 5/20... Training loss: 0.0950
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0999
Epoch: 5/20... Training loss: 0.0977
Epoch: 5/20... Training loss: 0.0988
Epoch: 5/20... Training loss: 0.0970
Epoch: 5/20... Training loss: 0.0979
Epoch: 5/20... Training loss: 0.0991
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0958
Epoch: 5/20... Training loss: 0.0956
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0990
Epoch: 5/20... Training loss: 0.0975
Epoch: 5/20... Training loss: 0.0964
Epoch: 5/20... Training loss: 0.0935
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0959
Epoch: 5/20... Training loss: 0.0926
Epoch: 5/20... Training loss: 0.0973
Epoch: 5/20... Training loss: 0.0960
Epoch: 5/20... Training loss: 0.0984
Epoch: 5/20... Training loss: 0.1008
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0991
Epoch: 5/20... Training loss: 0.0958
Epoch: 5/20... Training loss: 0.1000
Epoch: 5/20... Training loss: 0.0932
Epoch: 5/20... Training loss: 0.0953
Epoch: 5/20... Training loss: 0.0978
Epoch: 5/20... Training loss: 0.0968
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0942
Epoch: 5/20... Training loss: 0.0965
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0937
Epoch: 5/20... Training loss: 0.0947
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0973
Epoch: 5/20... Training loss: 0.0968
Epoch: 5/20... Training loss: 0.0979
Epoch: 5/20... Training loss: 0.0962
Epoch: 5/20... Training loss: 0.0947
Epoch: 5/20... Training loss: 0.0983
Epoch: 5/20... Training loss: 0.0990
Epoch: 5/20... Training loss: 0.0956
Epoch: 5/20... Training loss: 0.0966
Epoch: 5/20... Training loss: 0.0956
Epoch: 5/20... Training loss: 0.0953
Epoch: 5/20... Training loss: 0.0970
Epoch: 5/20... Training loss: 0.0946
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0990
Epoch: 5/20... Training loss: 0.0937
Epoch: 5/20... Training loss: 0.0977
Epoch: 5/20... Training loss: 0.0948
Epoch: 5/20... Training loss: 0.0946
Epoch: 5/20... Training loss: 0.0940
Epoch: 5/20... Training loss: 0.0917
Epoch: 5/20... Training loss: 0.0938
Epoch: 5/20... Training loss: 0.0980
Epoch: 5/20... Training loss: 0.0966
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0983
Epoch: 5/20... Training loss: 0.0927
Epoch: 5/20... Training loss: 0.0929
Epoch: 5/20... Training loss: 0.0992
Epoch: 5/20... Training loss: 0.0926
Epoch: 5/20... Training loss: 0.0941
Epoch: 5/20... Training loss: 0.0972
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0978
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0953
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0954
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0973
Epoch: 5/20... Training loss: 0.0943
Epoch: 5/20... Training loss: 0.0959
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0953
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0938
Epoch: 5/20... Training loss: 0.0970
Epoch: 5/20... Training loss: 0.0948
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0981
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0956
Epoch: 5/20... Training loss: 0.0974
Epoch: 5/20... Training loss: 0.0970
Epoch: 5/20... Training loss: 0.0960
Epoch: 5/20... Training loss: 0.0950
Epoch: 5/20... Training loss: 0.0962
Epoch: 5/20... Training loss: 0.0931
Epoch: 5/20... Training loss: 0.0943
Epoch: 5/20... Training loss: 0.0954
Epoch: 5/20... Training loss: 0.0972
Epoch: 5/20... Training loss: 0.0933
Epoch: 5/20... Training loss: 0.0947
Epoch: 5/20... Training loss: 0.0927
Epoch: 5/20... Training loss: 0.0953
Epoch: 5/20... Training loss: 0.1001
Epoch: 5/20... Training loss: 0.0944
Epoch: 5/20... Training loss: 0.0948
Epoch: 5/20... Training loss: 0.0937
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0967
Epoch: 5/20... Training loss: 0.0942
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0911
Epoch: 5/20... Training loss: 0.0931
Epoch: 5/20... Training loss: 0.0968
Epoch: 5/20... Training loss: 0.0936
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0928
Epoch: 5/20... Training loss: 0.0955
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0954
Epoch: 5/20... Training loss: 0.0936
Epoch: 5/20... Training loss: 0.0961
Epoch: 5/20... Training loss: 0.0901
Epoch: 5/20... Training loss: 0.0918
Epoch: 5/20... Training loss: 0.0946
Epoch: 5/20... Training loss: 0.1001
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0923
Epoch: 5/20... Training loss: 0.0952
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0976
Epoch: 5/20... Training loss: 0.0920
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0949
Epoch: 5/20... Training loss: 0.0932
Epoch: 5/20... Training loss: 0.0925
Epoch: 5/20... Training loss: 0.0971
Epoch: 5/20... Training loss: 0.0933
Epoch: 5/20... Training loss: 0.0914
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0966
Epoch: 5/20... Training loss: 0.0903
Epoch: 5/20... Training loss: 0.0924
Epoch: 5/20... Training loss: 0.0934
Epoch: 5/20... Training loss: 0.0948
Epoch: 5/20... Training loss: 0.0959
Epoch: 5/20... Training loss: 0.0931
Epoch: 5/20... Training loss: 0.0952
Epoch: 5/20... Training loss: 0.0929
Epoch: 5/20... Training loss: 0.0916
Epoch: 5/20... Training loss: 0.0936
Epoch: 5/20... Training loss: 0.0915
Epoch: 5/20... Training loss: 0.0964
Epoch: 5/20... Training loss: 0.0947
Epoch: 5/20... Training loss: 0.0972
Epoch: 5/20... Training loss: 0.0942
Epoch: 5/20... Training loss: 0.0915
Epoch: 5/20... Training loss: 0.0963
Epoch: 5/20... Training loss: 0.0937
Epoch: 5/20... Training loss: 0.0934
Epoch: 5/20... Training loss: 0.0915
Epoch: 5/20... Training loss: 0.0938
Epoch: 5/20... Training loss: 0.0937
Epoch: 5/20... Training loss: 0.0938
Epoch: 5/20... Training loss: 0.0949
Epoch: 5/20... Training loss: 0.0943
Epoch: 5/20... Training loss: 0.0940
Epoch: 5/20... Training loss: 0.0925
Epoch: 5/20... Training loss: 0.0928
Epoch: 5/20... Training loss: 0.0960
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0920
Epoch: 5/20... Training loss: 0.0964
Epoch: 5/20... Training loss: 0.0939
Epoch: 5/20... Training loss: 0.0935
Epoch: 5/20... Training loss: 0.0933
Epoch: 5/20... Training loss: 0.0943
Epoch: 5/20... Training loss: 0.0954
Epoch: 5/20... Training loss: 0.0947
Epoch: 5/20... Training loss: 0.0951
Epoch: 5/20... Training loss: 0.0959
Epoch: 5/20... Training loss: 0.0918
Epoch: 5/20... Training loss: 0.0923
Epoch: 5/20... Training loss: 0.0933
Epoch: 5/20... Training loss: 0.0942
Epoch: 5/20... Training loss: 0.0930
Epoch: 5/20... Training loss: 0.0972
Epoch: 5/20... Training loss: 0.0931
Epoch: 5/20... Training loss: 0.0911
Epoch: 5/20... Training loss: 0.0920
Epoch: 5/20... Training loss: 0.0916
Epoch: 5/20... Training loss: 0.0921
Epoch: 5/20... Training loss: 0.0941
Epoch: 5/20... Training loss: 0.0926
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0934
Epoch: 6/20... Training loss: 0.0931
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0919
Epoch: 6/20... Training loss: 0.0917
Epoch: 6/20... Training loss: 0.0922
Epoch: 6/20... Training loss: 0.0962
Epoch: 6/20... Training loss: 0.0955
Epoch: 6/20... Training loss: 0.0925
Epoch: 6/20... Training loss: 0.0952
Epoch: 6/20... Training loss: 0.0936
Epoch: 6/20... Training loss: 0.0942
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0955
Epoch: 6/20... Training loss: 0.0906
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0919
Epoch: 6/20... Training loss: 0.0919
Epoch: 6/20... Training loss: 0.0935
Epoch: 6/20... Training loss: 0.0908
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0925
Epoch: 6/20... Training loss: 0.0959
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0962
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0931
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0930
Epoch: 6/20... Training loss: 0.0920
Epoch: 6/20... Training loss: 0.0960
Epoch: 6/20... Training loss: 0.0874
Epoch: 6/20... Training loss: 0.0953
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0910
Epoch: 6/20... Training loss: 0.0945
Epoch: 6/20... Training loss: 0.0910
Epoch: 6/20... Training loss: 0.0920
Epoch: 6/20... Training loss: 0.0925
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0945
Epoch: 6/20... Training loss: 0.0929
Epoch: 6/20... Training loss: 0.0922
Epoch: 6/20... Training loss: 0.0943
Epoch: 6/20... Training loss: 0.0904
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0892
Epoch: 6/20... Training loss: 0.0998
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0934
Epoch: 6/20... Training loss: 0.0926
Epoch: 6/20... Training loss: 0.0943
Epoch: 6/20... Training loss: 0.0927
Epoch: 6/20... Training loss: 0.0943
Epoch: 6/20... Training loss: 0.0917
Epoch: 6/20... Training loss: 0.0934
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0920
Epoch: 6/20... Training loss: 0.0924
Epoch: 6/20... Training loss: 0.0907
Epoch: 6/20... Training loss: 0.0929
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0920
Epoch: 6/20... Training loss: 0.0912
Epoch: 6/20... Training loss: 0.0914
Epoch: 6/20... Training loss: 0.0941
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0933
Epoch: 6/20... Training loss: 0.0917
Epoch: 6/20... Training loss: 0.0930
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0922
Epoch: 6/20... Training loss: 0.0920
Epoch: 6/20... Training loss: 0.0933
Epoch: 6/20... Training loss: 0.0890
Epoch: 6/20... Training loss: 0.0930
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0927
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0906
Epoch: 6/20... Training loss: 0.0906
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0924
Epoch: 6/20... Training loss: 0.0914
Epoch: 6/20... Training loss: 0.0935
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0932
Epoch: 6/20... Training loss: 0.0941
Epoch: 6/20... Training loss: 0.0893
Epoch: 6/20... Training loss: 0.0949
Epoch: 6/20... Training loss: 0.0907
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0890
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0903
Epoch: 6/20... Training loss: 0.0929
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0936
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0936
Epoch: 6/20... Training loss: 0.0943
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0946
Epoch: 6/20... Training loss: 0.0899
Epoch: 6/20... Training loss: 0.0908
Epoch: 6/20... Training loss: 0.0941
Epoch: 6/20... Training loss: 0.0926
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0918
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0889
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0936
Epoch: 6/20... Training loss: 0.0885
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0922
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0928
Epoch: 6/20... Training loss: 0.0904
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0918
Epoch: 6/20... Training loss: 0.0912
Epoch: 6/20... Training loss: 0.0914
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0898
Epoch: 6/20... Training loss: 0.0875
Epoch: 6/20... Training loss: 0.0939
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0928
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0899
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0925
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0910
Epoch: 6/20... Training loss: 0.0930
Epoch: 6/20... Training loss: 0.0930
Epoch: 6/20... Training loss: 0.0914
Epoch: 6/20... Training loss: 0.0887
Epoch: 6/20... Training loss: 0.0897
Epoch: 6/20... Training loss: 0.0913
Epoch: 6/20... Training loss: 0.0928
Epoch: 6/20... Training loss: 0.0904
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0873
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0890
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0879
Epoch: 6/20... Training loss: 0.0882
Epoch: 6/20... Training loss: 0.0931
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0928
Epoch: 6/20... Training loss: 0.0931
Epoch: 6/20... Training loss: 0.0890
Epoch: 6/20... Training loss: 0.0945
Epoch: 6/20... Training loss: 0.0871
Epoch: 6/20... Training loss: 0.0921
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0898
Epoch: 6/20... Training loss: 0.0935
Epoch: 6/20... Training loss: 0.0869
Epoch: 6/20... Training loss: 0.0891
Epoch: 6/20... Training loss: 0.0885
Epoch: 6/20... Training loss: 0.0893
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0898
Epoch: 6/20... Training loss: 0.0896
Epoch: 6/20... Training loss: 0.0929
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0917
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0908
Epoch: 6/20... Training loss: 0.0877
Epoch: 6/20... Training loss: 0.0896
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0897
Epoch: 6/20... Training loss: 0.0938
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0918
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0907
Epoch: 6/20... Training loss: 0.0867
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0876
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0890
Epoch: 6/20... Training loss: 0.0893
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0898
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0927
Epoch: 6/20... Training loss: 0.0891
Epoch: 6/20... Training loss: 0.0888
Epoch: 6/20... Training loss: 0.0918
Epoch: 6/20... Training loss: 0.0888
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0899
Epoch: 6/20... Training loss: 0.0882
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0904
Epoch: 6/20... Training loss: 0.0885
Epoch: 6/20... Training loss: 0.0942
Epoch: 6/20... Training loss: 0.0908
Epoch: 6/20... Training loss: 0.0907
Epoch: 6/20... Training loss: 0.0877
Epoch: 6/20... Training loss: 0.0916
Epoch: 6/20... Training loss: 0.0883
Epoch: 6/20... Training loss: 0.0897
Epoch: 6/20... Training loss: 0.0914
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0862
Epoch: 6/20... Training loss: 0.0850
Epoch: 6/20... Training loss: 0.0923
Epoch: 6/20... Training loss: 0.0878
Epoch: 6/20... Training loss: 0.0911
Epoch: 6/20... Training loss: 0.0869
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0926
Epoch: 6/20... Training loss: 0.0908
Epoch: 6/20... Training loss: 0.0897
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0872
Epoch: 6/20... Training loss: 0.0886
Epoch: 6/20... Training loss: 0.0925
Epoch: 6/20... Training loss: 0.0870
Epoch: 6/20... Training loss: 0.0888
Epoch: 6/20... Training loss: 0.0849
Epoch: 6/20... Training loss: 0.0919
Epoch: 6/20... Training loss: 0.0879
Epoch: 6/20... Training loss: 0.0848
Epoch: 6/20... Training loss: 0.0909
Epoch: 6/20... Training loss: 0.0873
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0897
Epoch: 6/20... Training loss: 0.0882
Epoch: 6/20... Training loss: 0.0919
Epoch: 6/20... Training loss: 0.0935
Epoch: 6/20... Training loss: 0.0878
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0886
Epoch: 6/20... Training loss: 0.0881
Epoch: 6/20... Training loss: 0.0894
Epoch: 6/20... Training loss: 0.0866
Epoch: 6/20... Training loss: 0.0885
Epoch: 6/20... Training loss: 0.0880
Epoch: 6/20... Training loss: 0.0867
Epoch: 6/20... Training loss: 0.0906
Epoch: 6/20... Training loss: 0.0884
Epoch: 6/20... Training loss: 0.0898
Epoch: 6/20... Training loss: 0.0877
Epoch: 6/20... Training loss: 0.0889
Epoch: 6/20... Training loss: 0.0880
Epoch: 6/20... Training loss: 0.0874
Epoch: 6/20... Training loss: 0.0876
Epoch: 6/20... Training loss: 0.0895
Epoch: 6/20... Training loss: 0.0903
Epoch: 6/20... Training loss: 0.0870
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0912
Epoch: 6/20... Training loss: 0.0896
Epoch: 6/20... Training loss: 0.0901
Epoch: 6/20... Training loss: 0.0882
Epoch: 6/20... Training loss: 0.0915
Epoch: 6/20... Training loss: 0.0907
Epoch: 6/20... Training loss: 0.0880
Epoch: 6/20... Training loss: 0.0885
Epoch: 6/20... Training loss: 0.0880
Epoch: 6/20... Training loss: 0.0918
Epoch: 6/20... Training loss: 0.0900
Epoch: 6/20... Training loss: 0.0875
Epoch: 6/20... Training loss: 0.0905
Epoch: 6/20... Training loss: 0.0902
Epoch: 6/20... Training loss: 0.0898
Epoch: 7/20... Training loss: 0.0912
Epoch: 7/20... Training loss: 0.0877
Epoch: 7/20... Training loss: 0.0915
Epoch: 7/20... Training loss: 0.0896
Epoch: 7/20... Training loss: 0.0894
Epoch: 7/20... Training loss: 0.0897
Epoch: 7/20... Training loss: 0.0892
Epoch: 7/20... Training loss: 0.0896
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0897
Epoch: 7/20... Training loss: 0.0891
Epoch: 7/20... Training loss: 0.0895
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0869
Epoch: 7/20... Training loss: 0.0911
Epoch: 7/20... Training loss: 0.0881
Epoch: 7/20... Training loss: 0.0910
Epoch: 7/20... Training loss: 0.0915
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0902
Epoch: 7/20... Training loss: 0.0883
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0897
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0902
Epoch: 7/20... Training loss: 0.0854
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0865
Epoch: 7/20... Training loss: 0.0890
Epoch: 7/20... Training loss: 0.0849
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0852
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0897
Epoch: 7/20... Training loss: 0.0885
Epoch: 7/20... Training loss: 0.0856
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0881
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0874
Epoch: 7/20... Training loss: 0.0875
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0874
Epoch: 7/20... Training loss: 0.0846
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0912
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0888
Epoch: 7/20... Training loss: 0.0890
Epoch: 7/20... Training loss: 0.0905
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0910
Epoch: 7/20... Training loss: 0.0896
Epoch: 7/20... Training loss: 0.0865
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0849
Epoch: 7/20... Training loss: 0.0875
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0899
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0893
Epoch: 7/20... Training loss: 0.0909
Epoch: 7/20... Training loss: 0.0899
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0875
Epoch: 7/20... Training loss: 0.0848
Epoch: 7/20... Training loss: 0.0879
Epoch: 7/20... Training loss: 0.0892
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0901
Epoch: 7/20... Training loss: 0.0846
Epoch: 7/20... Training loss: 0.0886
Epoch: 7/20... Training loss: 0.0899
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0869
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0851
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0871
Epoch: 7/20... Training loss: 0.0873
Epoch: 7/20... Training loss: 0.0848
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0893
Epoch: 7/20... Training loss: 0.0859
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0883
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0869
Epoch: 7/20... Training loss: 0.0879
Epoch: 7/20... Training loss: 0.0836
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0869
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0886
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0874
Epoch: 7/20... Training loss: 0.0856
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0874
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0892
Epoch: 7/20... Training loss: 0.0838
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0902
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0871
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0831
Epoch: 7/20... Training loss: 0.0873
Epoch: 7/20... Training loss: 0.0900
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0837
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0839
Epoch: 7/20... Training loss: 0.0883
Epoch: 7/20... Training loss: 0.0878
Epoch: 7/20... Training loss: 0.0856
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0886
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0871
Epoch: 7/20... Training loss: 0.0877
Epoch: 7/20... Training loss: 0.0893
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0854
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0880
Epoch: 7/20... Training loss: 0.0918
Epoch: 7/20... Training loss: 0.0888
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0846
Epoch: 7/20... Training loss: 0.0842
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0898
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0854
Epoch: 7/20... Training loss: 0.0837
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0865
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0885
Epoch: 7/20... Training loss: 0.0900
Epoch: 7/20... Training loss: 0.0892
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0889
Epoch: 7/20... Training loss: 0.0891
Epoch: 7/20... Training loss: 0.0871
Epoch: 7/20... Training loss: 0.0870
Epoch: 7/20... Training loss: 0.0835
Epoch: 7/20... Training loss: 0.0885
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0874
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0873
Epoch: 7/20... Training loss: 0.0896
Epoch: 7/20... Training loss: 0.0873
Epoch: 7/20... Training loss: 0.0847
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0885
Epoch: 7/20... Training loss: 0.0872
Epoch: 7/20... Training loss: 0.0850
Epoch: 7/20... Training loss: 0.0838
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0841
Epoch: 7/20... Training loss: 0.0828
Epoch: 7/20... Training loss: 0.0842
Epoch: 7/20... Training loss: 0.0859
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0851
Epoch: 7/20... Training loss: 0.0877
Epoch: 7/20... Training loss: 0.0842
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0828
Epoch: 7/20... Training loss: 0.0904
Epoch: 7/20... Training loss: 0.0859
Epoch: 7/20... Training loss: 0.0845
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0887
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0859
Epoch: 7/20... Training loss: 0.0858
Epoch: 7/20... Training loss: 0.0841
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0876
Epoch: 7/20... Training loss: 0.0863
Epoch: 7/20... Training loss: 0.0875
Epoch: 7/20... Training loss: 0.0838
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0827
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0849
Epoch: 7/20... Training loss: 0.0857
Epoch: 7/20... Training loss: 0.0888
Epoch: 7/20... Training loss: 0.0875
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0858
Epoch: 7/20... Training loss: 0.0858
Epoch: 7/20... Training loss: 0.0845
Epoch: 7/20... Training loss: 0.0869
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0866
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0887
Epoch: 7/20... Training loss: 0.0841
Epoch: 7/20... Training loss: 0.0852
Epoch: 7/20... Training loss: 0.0867
Epoch: 7/20... Training loss: 0.0868
Epoch: 7/20... Training loss: 0.0856
Epoch: 7/20... Training loss: 0.0846
Epoch: 7/20... Training loss: 0.0854
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0840
Epoch: 7/20... Training loss: 0.0878
Epoch: 7/20... Training loss: 0.0809
Epoch: 7/20... Training loss: 0.0852
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0865
Epoch: 7/20... Training loss: 0.0871
Epoch: 7/20... Training loss: 0.0877
Epoch: 7/20... Training loss: 0.0851
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0884
Epoch: 7/20... Training loss: 0.0847
Epoch: 7/20... Training loss: 0.0843
Epoch: 7/20... Training loss: 0.0883
Epoch: 7/20... Training loss: 0.0838
Epoch: 7/20... Training loss: 0.0854
Epoch: 7/20... Training loss: 0.0849
Epoch: 7/20... Training loss: 0.0864
Epoch: 7/20... Training loss: 0.0844
Epoch: 7/20... Training loss: 0.0852
Epoch: 7/20... Training loss: 0.0852
Epoch: 7/20... Training loss: 0.0848
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0845
Epoch: 7/20... Training loss: 0.0840
Epoch: 7/20... Training loss: 0.0858
Epoch: 7/20... Training loss: 0.0821
Epoch: 7/20... Training loss: 0.0882
Epoch: 7/20... Training loss: 0.0855
Epoch: 7/20... Training loss: 0.0823
Epoch: 7/20... Training loss: 0.0860
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0830
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0885
Epoch: 7/20... Training loss: 0.0847
Epoch: 7/20... Training loss: 0.0851
Epoch: 7/20... Training loss: 0.0877
Epoch: 7/20... Training loss: 0.0861
Epoch: 7/20... Training loss: 0.0840
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0836
Epoch: 7/20... Training loss: 0.0849
Epoch: 7/20... Training loss: 0.0843
Epoch: 7/20... Training loss: 0.0819
Epoch: 7/20... Training loss: 0.0862
Epoch: 7/20... Training loss: 0.0850
Epoch: 7/20... Training loss: 0.0825
Epoch: 7/20... Training loss: 0.0859
Epoch: 7/20... Training loss: 0.0820
Epoch: 7/20... Training loss: 0.0850
Epoch: 7/20... Training loss: 0.0853
Epoch: 7/20... Training loss: 0.0840
Epoch: 8/20... Training loss: 0.0864
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0852
Epoch: 8/20... Training loss: 0.0862
Epoch: 8/20... Training loss: 0.0824
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0801
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0866
Epoch: 8/20... Training loss: 0.0852
Epoch: 8/20... Training loss: 0.0840
Epoch: 8/20... Training loss: 0.0871
Epoch: 8/20... Training loss: 0.0873
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0864
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0875
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0860
Epoch: 8/20... Training loss: 0.0816
Epoch: 8/20... Training loss: 0.0857
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0857
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0815
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0858
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0853
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0829
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0874
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0842
Epoch: 8/20... Training loss: 0.0848
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0855
Epoch: 8/20... Training loss: 0.0852
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0859
Epoch: 8/20... Training loss: 0.0822
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0857
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0855
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0850
Epoch: 8/20... Training loss: 0.0860
Epoch: 8/20... Training loss: 0.0865
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0815
Epoch: 8/20... Training loss: 0.0850
Epoch: 8/20... Training loss: 0.0887
Epoch: 8/20... Training loss: 0.0826
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0873
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0817
Epoch: 8/20... Training loss: 0.0863
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0875
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0826
Epoch: 8/20... Training loss: 0.0826
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0855
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0852
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0833
Epoch: 8/20... Training loss: 0.0854
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0857
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0833
Epoch: 8/20... Training loss: 0.0808
Epoch: 8/20... Training loss: 0.0827
Epoch: 8/20... Training loss: 0.0859
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0861
Epoch: 8/20... Training loss: 0.0807
Epoch: 8/20... Training loss: 0.0801
Epoch: 8/20... Training loss: 0.0840
Epoch: 8/20... Training loss: 0.0854
Epoch: 8/20... Training loss: 0.0852
Epoch: 8/20... Training loss: 0.0850
Epoch: 8/20... Training loss: 0.0860
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0877
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0875
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0814
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0822
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0871
Epoch: 8/20... Training loss: 0.0863
Epoch: 8/20... Training loss: 0.0816
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0814
Epoch: 8/20... Training loss: 0.0824
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0848
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0822
Epoch: 8/20... Training loss: 0.0800
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0861
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0815
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0804
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0828
Epoch: 8/20... Training loss: 0.0818
Epoch: 8/20... Training loss: 0.0824
Epoch: 8/20... Training loss: 0.0824
Epoch: 8/20... Training loss: 0.0811
Epoch: 8/20... Training loss: 0.0856
Epoch: 8/20... Training loss: 0.0843
Epoch: 8/20... Training loss: 0.0830
Epoch: 8/20... Training loss: 0.0819
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0812
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0842
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0816
Epoch: 8/20... Training loss: 0.0820
Epoch: 8/20... Training loss: 0.0814
Epoch: 8/20... Training loss: 0.0851
Epoch: 8/20... Training loss: 0.0802
Epoch: 8/20... Training loss: 0.0856
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0813
Epoch: 8/20... Training loss: 0.0814
Epoch: 8/20... Training loss: 0.0835
Epoch: 8/20... Training loss: 0.0842
Epoch: 8/20... Training loss: 0.0841
Epoch: 8/20... Training loss: 0.0792
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0805
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0820
Epoch: 8/20... Training loss: 0.0856
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0808
Epoch: 8/20... Training loss: 0.0861
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0810
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0813
Epoch: 8/20... Training loss: 0.0810
Epoch: 8/20... Training loss: 0.0833
Epoch: 8/20... Training loss: 0.0818
Epoch: 8/20... Training loss: 0.0845
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0862
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0809
Epoch: 8/20... Training loss: 0.0809
Epoch: 8/20... Training loss: 0.0817
Epoch: 8/20... Training loss: 0.0799
Epoch: 8/20... Training loss: 0.0802
Epoch: 8/20... Training loss: 0.0822
Epoch: 8/20... Training loss: 0.0803
Epoch: 8/20... Training loss: 0.0830
Epoch: 8/20... Training loss: 0.0813
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0842
Epoch: 8/20... Training loss: 0.0822
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0830
Epoch: 8/20... Training loss: 0.0818
Epoch: 8/20... Training loss: 0.0855
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0794
Epoch: 8/20... Training loss: 0.0815
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0815
Epoch: 8/20... Training loss: 0.0853
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0847
Epoch: 8/20... Training loss: 0.0867
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0849
Epoch: 8/20... Training loss: 0.0813
Epoch: 8/20... Training loss: 0.0820
Epoch: 8/20... Training loss: 0.0829
Epoch: 8/20... Training loss: 0.0797
Epoch: 8/20... Training loss: 0.0813
Epoch: 8/20... Training loss: 0.0819
Epoch: 8/20... Training loss: 0.0846
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0805
Epoch: 8/20... Training loss: 0.0840
Epoch: 8/20... Training loss: 0.0826
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0862
Epoch: 8/20... Training loss: 0.0816
Epoch: 8/20... Training loss: 0.0827
Epoch: 8/20... Training loss: 0.0795
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0831
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0786
Epoch: 8/20... Training loss: 0.0823
Epoch: 8/20... Training loss: 0.0833
Epoch: 8/20... Training loss: 0.0821
Epoch: 8/20... Training loss: 0.0842
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0838
Epoch: 8/20... Training loss: 0.0837
Epoch: 8/20... Training loss: 0.0783
Epoch: 8/20... Training loss: 0.0804
Epoch: 8/20... Training loss: 0.0834
Epoch: 8/20... Training loss: 0.0830
Epoch: 8/20... Training loss: 0.0860
Epoch: 8/20... Training loss: 0.0869
Epoch: 8/20... Training loss: 0.0804
Epoch: 8/20... Training loss: 0.0809
Epoch: 8/20... Training loss: 0.0836
Epoch: 8/20... Training loss: 0.0812
Epoch: 8/20... Training loss: 0.0811
Epoch: 8/20... Training loss: 0.0796
Epoch: 8/20... Training loss: 0.0809
Epoch: 8/20... Training loss: 0.0820
Epoch: 8/20... Training loss: 0.0839
Epoch: 8/20... Training loss: 0.0785
Epoch: 8/20... Training loss: 0.0812
Epoch: 8/20... Training loss: 0.0825
Epoch: 8/20... Training loss: 0.0832
Epoch: 8/20... Training loss: 0.0844
Epoch: 8/20... Training loss: 0.0824
Epoch: 8/20... Training loss: 0.0805
Epoch: 8/20... Training loss: 0.0826
Epoch: 8/20... Training loss: 0.0822
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0787
Epoch: 9/20... Training loss: 0.0825
Epoch: 9/20... Training loss: 0.0829
Epoch: 9/20... Training loss: 0.0817
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0834
Epoch: 9/20... Training loss: 0.0836
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0839
Epoch: 9/20... Training loss: 0.0841
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0853
Epoch: 9/20... Training loss: 0.0821
Epoch: 9/20... Training loss: 0.0811
Epoch: 9/20... Training loss: 0.0834
Epoch: 9/20... Training loss: 0.0822
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0817
Epoch: 9/20... Training loss: 0.0831
Epoch: 9/20... Training loss: 0.0834
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0836
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0799
Epoch: 9/20... Training loss: 0.0805
Epoch: 9/20... Training loss: 0.0795
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0832
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0822
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0837
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0822
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0833
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0817
Epoch: 9/20... Training loss: 0.0835
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0788
Epoch: 9/20... Training loss: 0.0845
Epoch: 9/20... Training loss: 0.0811
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0796
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0799
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0800
Epoch: 9/20... Training loss: 0.0800
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0847
Epoch: 9/20... Training loss: 0.0826
Epoch: 9/20... Training loss: 0.0828
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0838
Epoch: 9/20... Training loss: 0.0781
Epoch: 9/20... Training loss: 0.0839
Epoch: 9/20... Training loss: 0.0830
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0821
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0811
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0799
Epoch: 9/20... Training loss: 0.0828
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0788
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0820
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0805
Epoch: 9/20... Training loss: 0.0829
Epoch: 9/20... Training loss: 0.0826
Epoch: 9/20... Training loss: 0.0832
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0795
Epoch: 9/20... Training loss: 0.0827
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0826
Epoch: 9/20... Training loss: 0.0823
Epoch: 9/20... Training loss: 0.0783
Epoch: 9/20... Training loss: 0.0815
Epoch: 9/20... Training loss: 0.0829
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0800
Epoch: 9/20... Training loss: 0.0822
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0817
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0780
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0839
Epoch: 9/20... Training loss: 0.0780
Epoch: 9/20... Training loss: 0.0823
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0790
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0825
Epoch: 9/20... Training loss: 0.0784
Epoch: 9/20... Training loss: 0.0823
Epoch: 9/20... Training loss: 0.0796
Epoch: 9/20... Training loss: 0.0827
Epoch: 9/20... Training loss: 0.0811
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0771
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0805
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0792
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0812
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0821
Epoch: 9/20... Training loss: 0.0835
Epoch: 9/20... Training loss: 0.0831
Epoch: 9/20... Training loss: 0.0823
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0808
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0827
Epoch: 9/20... Training loss: 0.0826
Epoch: 9/20... Training loss: 0.0844
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0817
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0828
Epoch: 9/20... Training loss: 0.0787
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0831
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0828
Epoch: 9/20... Training loss: 0.0773
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0795
Epoch: 9/20... Training loss: 0.0792
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0777
Epoch: 9/20... Training loss: 0.0779
Epoch: 9/20... Training loss: 0.0781
Epoch: 9/20... Training loss: 0.0809
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0780
Epoch: 9/20... Training loss: 0.0800
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0781
Epoch: 9/20... Training loss: 0.0805
Epoch: 9/20... Training loss: 0.0830
Epoch: 9/20... Training loss: 0.0825
Epoch: 9/20... Training loss: 0.0834
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0813
Epoch: 9/20... Training loss: 0.0788
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0790
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0796
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0823
Epoch: 9/20... Training loss: 0.0788
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0786
Epoch: 9/20... Training loss: 0.0775
Epoch: 9/20... Training loss: 0.0820
Epoch: 9/20... Training loss: 0.0782
Epoch: 9/20... Training loss: 0.0766
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0825
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0782
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0799
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0820
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0825
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0782
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0784
Epoch: 9/20... Training loss: 0.0790
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0783
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0799
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0819
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0777
Epoch: 9/20... Training loss: 0.0784
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0772
Epoch: 9/20... Training loss: 0.0833
Epoch: 9/20... Training loss: 0.0779
Epoch: 9/20... Training loss: 0.0767
Epoch: 9/20... Training loss: 0.0771
Epoch: 9/20... Training loss: 0.0818
Epoch: 9/20... Training loss: 0.0812
Epoch: 9/20... Training loss: 0.0797
Epoch: 9/20... Training loss: 0.0773
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0803
Epoch: 9/20... Training loss: 0.0790
Epoch: 9/20... Training loss: 0.0776
Epoch: 9/20... Training loss: 0.0777
Epoch: 9/20... Training loss: 0.0821
Epoch: 9/20... Training loss: 0.0786
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0806
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0782
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0789
Epoch: 9/20... Training loss: 0.0791
Epoch: 9/20... Training loss: 0.0802
Epoch: 9/20... Training loss: 0.0798
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0804
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0807
Epoch: 9/20... Training loss: 0.0816
Epoch: 9/20... Training loss: 0.0800
Epoch: 9/20... Training loss: 0.0824
Epoch: 9/20... Training loss: 0.0821
Epoch: 9/20... Training loss: 0.0810
Epoch: 9/20... Training loss: 0.0814
Epoch: 9/20... Training loss: 0.0793
Epoch: 9/20... Training loss: 0.0792
Epoch: 9/20... Training loss: 0.0794
Epoch: 9/20... Training loss: 0.0801
Epoch: 9/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0808
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0762
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0811
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0807
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0803
Epoch: 10/20... Training loss: 0.0812
Epoch: 10/20... Training loss: 0.0764
Epoch: 10/20... Training loss: 0.0814
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0797
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0804
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0819
Epoch: 10/20... Training loss: 0.0811
Epoch: 10/20... Training loss: 0.0801
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0799
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0786
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0773
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0794
Epoch: 10/20... Training loss: 0.0810
Epoch: 10/20... Training loss: 0.0778
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0795
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0809
Epoch: 10/20... Training loss: 0.0809
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0815
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0782
Epoch: 10/20... Training loss: 0.0795
Epoch: 10/20... Training loss: 0.0822
Epoch: 10/20... Training loss: 0.0825
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0774
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0808
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0797
Epoch: 10/20... Training loss: 0.0797
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0803
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0795
Epoch: 10/20... Training loss: 0.0820
Epoch: 10/20... Training loss: 0.0808
Epoch: 10/20... Training loss: 0.0803
Epoch: 10/20... Training loss: 0.0778
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0794
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0801
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0802
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0773
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0805
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0767
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0765
Epoch: 10/20... Training loss: 0.0778
Epoch: 10/20... Training loss: 0.0773
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0794
Epoch: 10/20... Training loss: 0.0803
Epoch: 10/20... Training loss: 0.0762
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0811
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0763
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0800
Epoch: 10/20... Training loss: 0.0794
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0800
Epoch: 10/20... Training loss: 0.0759
Epoch: 10/20... Training loss: 0.0772
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0808
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0769
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0757
Epoch: 10/20... Training loss: 0.0782
Epoch: 10/20... Training loss: 0.0759
Epoch: 10/20... Training loss: 0.0774
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0772
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0758
Epoch: 10/20... Training loss: 0.0800
Epoch: 10/20... Training loss: 0.0802
Epoch: 10/20... Training loss: 0.0813
Epoch: 10/20... Training loss: 0.0785
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0801
Epoch: 10/20... Training loss: 0.0799
Epoch: 10/20... Training loss: 0.0766
Epoch: 10/20... Training loss: 0.0766
Epoch: 10/20... Training loss: 0.0759
Epoch: 10/20... Training loss: 0.0786
Epoch: 10/20... Training loss: 0.0797
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0802
Epoch: 10/20... Training loss: 0.0778
Epoch: 10/20... Training loss: 0.0798
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0808
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0760
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0805
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0765
Epoch: 10/20... Training loss: 0.0759
Epoch: 10/20... Training loss: 0.0772
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0750
Epoch: 10/20... Training loss: 0.0806
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0807
Epoch: 10/20... Training loss: 0.0786
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0810
Epoch: 10/20... Training loss: 0.0799
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0771
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0795
Epoch: 10/20... Training loss: 0.0809
Epoch: 10/20... Training loss: 0.0797
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0755
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0755
Epoch: 10/20... Training loss: 0.0802
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0786
Epoch: 10/20... Training loss: 0.0794
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0801
Epoch: 10/20... Training loss: 0.0800
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0801
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0761
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0762
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0814
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0764
Epoch: 10/20... Training loss: 0.0815
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0804
Epoch: 10/20... Training loss: 0.0765
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0759
Epoch: 10/20... Training loss: 0.0767
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0754
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0751
Epoch: 10/20... Training loss: 0.0791
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0802
Epoch: 10/20... Training loss: 0.0766
Epoch: 10/20... Training loss: 0.0767
Epoch: 10/20... Training loss: 0.0800
Epoch: 10/20... Training loss: 0.0765
Epoch: 10/20... Training loss: 0.0774
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0767
Epoch: 10/20... Training loss: 0.0763
Epoch: 10/20... Training loss: 0.0774
Epoch: 10/20... Training loss: 0.0821
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0775
Epoch: 10/20... Training loss: 0.0803
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0758
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0789
Epoch: 10/20... Training loss: 0.0751
Epoch: 10/20... Training loss: 0.0772
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0806
Epoch: 10/20... Training loss: 0.0793
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0758
Epoch: 10/20... Training loss: 0.0790
Epoch: 10/20... Training loss: 0.0782
Epoch: 10/20... Training loss: 0.0776
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0780
Epoch: 10/20... Training loss: 0.0782
Epoch: 10/20... Training loss: 0.0774
Epoch: 10/20... Training loss: 0.0816
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0761
Epoch: 10/20... Training loss: 0.0787
Epoch: 10/20... Training loss: 0.0758
Epoch: 10/20... Training loss: 0.0781
Epoch: 10/20... Training loss: 0.0783
Epoch: 10/20... Training loss: 0.0760
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0769
Epoch: 10/20... Training loss: 0.0767
Epoch: 10/20... Training loss: 0.0763
Epoch: 10/20... Training loss: 0.0764
Epoch: 10/20... Training loss: 0.0792
Epoch: 10/20... Training loss: 0.0788
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0779
Epoch: 10/20... Training loss: 0.0784
Epoch: 10/20... Training loss: 0.0768
Epoch: 10/20... Training loss: 0.0804
Epoch: 10/20... Training loss: 0.0746
Epoch: 10/20... Training loss: 0.0741
Epoch: 10/20... Training loss: 0.0777
Epoch: 10/20... Training loss: 0.0762
Epoch: 10/20... Training loss: 0.0770
Epoch: 10/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0790
Epoch: 11/20... Training loss: 0.0752
Epoch: 11/20... Training loss: 0.0783
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0780
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0753
Epoch: 11/20... Training loss: 0.0784
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0758
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0775
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0803
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0738
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0750
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0753
Epoch: 11/20... Training loss: 0.0780
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0780
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0784
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0741
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0792
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0739
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0785
Epoch: 11/20... Training loss: 0.0785
Epoch: 11/20... Training loss: 0.0784
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0752
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0752
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0750
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0780
Epoch: 11/20... Training loss: 0.0778
Epoch: 11/20... Training loss: 0.0742
Epoch: 11/20... Training loss: 0.0796
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0791
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0775
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0751
Epoch: 11/20... Training loss: 0.0754
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0789
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0787
Epoch: 11/20... Training loss: 0.0782
Epoch: 11/20... Training loss: 0.0789
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0747
Epoch: 11/20... Training loss: 0.0754
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0757
Epoch: 11/20... Training loss: 0.0775
Epoch: 11/20... Training loss: 0.0768
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0808
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0796
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0754
Epoch: 11/20... Training loss: 0.0775
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0798
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0787
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0743
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0746
Epoch: 11/20... Training loss: 0.0790
Epoch: 11/20... Training loss: 0.0778
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0737
Epoch: 11/20... Training loss: 0.0758
Epoch: 11/20... Training loss: 0.0751
Epoch: 11/20... Training loss: 0.0779
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0754
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0746
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0751
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0789
Epoch: 11/20... Training loss: 0.0757
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0789
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0768
Epoch: 11/20... Training loss: 0.0753
Epoch: 11/20... Training loss: 0.0799
Epoch: 11/20... Training loss: 0.0778
Epoch: 11/20... Training loss: 0.0739
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0745
Epoch: 11/20... Training loss: 0.0742
Epoch: 11/20... Training loss: 0.0750
Epoch: 11/20... Training loss: 0.0758
Epoch: 11/20... Training loss: 0.0768
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0747
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0778
Epoch: 11/20... Training loss: 0.0741
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0738
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0785
Epoch: 11/20... Training loss: 0.0768
Epoch: 11/20... Training loss: 0.0751
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0748
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0735
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0752
Epoch: 11/20... Training loss: 0.0773
Epoch: 11/20... Training loss: 0.0748
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0747
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0748
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0774
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0752
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0757
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0746
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0757
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0768
Epoch: 11/20... Training loss: 0.0748
Epoch: 11/20... Training loss: 0.0787
Epoch: 11/20... Training loss: 0.0770
Epoch: 11/20... Training loss: 0.0759
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0781
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0743
Epoch: 11/20... Training loss: 0.0749
Epoch: 11/20... Training loss: 0.0775
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0767
Epoch: 11/20... Training loss: 0.0754
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0750
Epoch: 11/20... Training loss: 0.0745
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0758
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0755
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0747
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0772
Epoch: 11/20... Training loss: 0.0785
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0763
Epoch: 11/20... Training loss: 0.0771
Epoch: 11/20... Training loss: 0.0761
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0780
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0742
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0782
Epoch: 11/20... Training loss: 0.0741
Epoch: 11/20... Training loss: 0.0746
Epoch: 11/20... Training loss: 0.0777
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0776
Epoch: 11/20... Training loss: 0.0760
Epoch: 11/20... Training loss: 0.0764
Epoch: 11/20... Training loss: 0.0765
Epoch: 11/20... Training loss: 0.0762
Epoch: 11/20... Training loss: 0.0748
Epoch: 11/20... Training loss: 0.0743
Epoch: 11/20... Training loss: 0.0745
Epoch: 11/20... Training loss: 0.0786
Epoch: 11/20... Training loss: 0.0734
Epoch: 11/20... Training loss: 0.0766
Epoch: 11/20... Training loss: 0.0756
Epoch: 11/20... Training loss: 0.0740
Epoch: 11/20... Training loss: 0.0769
Epoch: 11/20... Training loss: 0.0750
Epoch: 11/20... Training loss: 0.0739
Epoch: 11/20... Training loss: 0.0764
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0769
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0768
Epoch: 12/20... Training loss: 0.0761
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0769
Epoch: 12/20... Training loss: 0.0763
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0768
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0770
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0761
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0768
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0741
Epoch: 12/20... Training loss: 0.0726
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0769
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0731
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0740
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0736
Epoch: 12/20... Training loss: 0.0731
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0728
Epoch: 12/20... Training loss: 0.0787
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0727
Epoch: 12/20... Training loss: 0.0729
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0737
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0763
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0740
Epoch: 12/20... Training loss: 0.0782
Epoch: 12/20... Training loss: 0.0772
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0764
Epoch: 12/20... Training loss: 0.0743
Epoch: 12/20... Training loss: 0.0779
Epoch: 12/20... Training loss: 0.0783
Epoch: 12/20... Training loss: 0.0763
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0774
Epoch: 12/20... Training loss: 0.0759
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0765
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0747
Epoch: 12/20... Training loss: 0.0759
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0743
Epoch: 12/20... Training loss: 0.0726
Epoch: 12/20... Training loss: 0.0778
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0764
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0737
Epoch: 12/20... Training loss: 0.0771
Epoch: 12/20... Training loss: 0.0765
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0772
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0765
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0717
Epoch: 12/20... Training loss: 0.0777
Epoch: 12/20... Training loss: 0.0728
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0774
Epoch: 12/20... Training loss: 0.0787
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0783
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0759
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0765
Epoch: 12/20... Training loss: 0.0764
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0769
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0747
Epoch: 12/20... Training loss: 0.0768
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0777
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0727
Epoch: 12/20... Training loss: 0.0743
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0763
Epoch: 12/20... Training loss: 0.0729
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0747
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0723
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0759
Epoch: 12/20... Training loss: 0.0778
Epoch: 12/20... Training loss: 0.0729
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0731
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0761
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0741
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0703
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0740
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0727
Epoch: 12/20... Training loss: 0.0723
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0741
Epoch: 12/20... Training loss: 0.0770
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0723
Epoch: 12/20... Training loss: 0.0764
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0769
Epoch: 12/20... Training loss: 0.0733
Epoch: 12/20... Training loss: 0.0733
Epoch: 12/20... Training loss: 0.0728
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0759
Epoch: 12/20... Training loss: 0.0736
Epoch: 12/20... Training loss: 0.0737
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0761
Epoch: 12/20... Training loss: 0.0780
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0752
Epoch: 12/20... Training loss: 0.0700
Epoch: 12/20... Training loss: 0.0724
Epoch: 12/20... Training loss: 0.0720
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0747
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0734
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0731
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0731
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0754
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0766
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0753
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0757
Epoch: 12/20... Training loss: 0.0760
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0720
Epoch: 12/20... Training loss: 0.0735
Epoch: 12/20... Training loss: 0.0741
Epoch: 12/20... Training loss: 0.0755
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0711
Epoch: 12/20... Training loss: 0.0737
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0736
Epoch: 12/20... Training loss: 0.0762
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0736
Epoch: 12/20... Training loss: 0.0758
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0724
Epoch: 12/20... Training loss: 0.0746
Epoch: 12/20... Training loss: 0.0732
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0748
Epoch: 12/20... Training loss: 0.0727
Epoch: 12/20... Training loss: 0.0742
Epoch: 12/20... Training loss: 0.0729
Epoch: 12/20... Training loss: 0.0743
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0723
Epoch: 12/20... Training loss: 0.0756
Epoch: 12/20... Training loss: 0.0719
Epoch: 12/20... Training loss: 0.0745
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0736
Epoch: 12/20... Training loss: 0.0751
Epoch: 12/20... Training loss: 0.0749
Epoch: 12/20... Training loss: 0.0733
Epoch: 12/20... Training loss: 0.0738
Epoch: 12/20... Training loss: 0.0726
Epoch: 12/20... Training loss: 0.0729
Epoch: 12/20... Training loss: 0.0744
Epoch: 12/20... Training loss: 0.0722
Epoch: 12/20... Training loss: 0.0730
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0737
Epoch: 12/20... Training loss: 0.0739
Epoch: 12/20... Training loss: 0.0750
Epoch: 12/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0755
Epoch: 13/20... Training loss: 0.0700
Epoch: 13/20... Training loss: 0.0749
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0767
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0759
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0756
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0717
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0720
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0714
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0749
Epoch: 13/20... Training loss: 0.0722
Epoch: 13/20... Training loss: 0.0712
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0722
Epoch: 13/20... Training loss: 0.0751
Epoch: 13/20... Training loss: 0.0748
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0757
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0745
Epoch: 13/20... Training loss: 0.0721
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0745
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0744
Epoch: 13/20... Training loss: 0.0751
Epoch: 13/20... Training loss: 0.0756
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0752
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0708
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0751
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0765
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0760
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0753
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0760
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0713
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0741
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0720
Epoch: 13/20... Training loss: 0.0741
Epoch: 13/20... Training loss: 0.0732
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0754
Epoch: 13/20... Training loss: 0.0755
Epoch: 13/20... Training loss: 0.0712
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0707
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0775
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0745
Epoch: 13/20... Training loss: 0.0748
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0776
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0716
Epoch: 13/20... Training loss: 0.0754
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0744
Epoch: 13/20... Training loss: 0.0710
Epoch: 13/20... Training loss: 0.0717
Epoch: 13/20... Training loss: 0.0711
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0751
Epoch: 13/20... Training loss: 0.0748
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0745
Epoch: 13/20... Training loss: 0.0745
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0758
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0732
Epoch: 13/20... Training loss: 0.0752
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0721
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0752
Epoch: 13/20... Training loss: 0.0754
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0760
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0716
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0751
Epoch: 13/20... Training loss: 0.0763
Epoch: 13/20... Training loss: 0.0749
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0758
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0714
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0720
Epoch: 13/20... Training loss: 0.0741
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0756
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0757
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0746
Epoch: 13/20... Training loss: 0.0753
Epoch: 13/20... Training loss: 0.0721
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0730
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0708
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0707
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0715
Epoch: 13/20... Training loss: 0.0722
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0741
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0731
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0714
Epoch: 13/20... Training loss: 0.0732
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0742
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0741
Epoch: 13/20... Training loss: 0.0717
Epoch: 13/20... Training loss: 0.0732
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0729
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0737
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0720
Epoch: 13/20... Training loss: 0.0714
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0747
Epoch: 13/20... Training loss: 0.0728
Epoch: 13/20... Training loss: 0.0707
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0718
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0721
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0699
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0711
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0716
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0722
Epoch: 13/20... Training loss: 0.0723
Epoch: 13/20... Training loss: 0.0750
Epoch: 13/20... Training loss: 0.0735
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0727
Epoch: 13/20... Training loss: 0.0725
Epoch: 13/20... Training loss: 0.0758
Epoch: 13/20... Training loss: 0.0732
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0712
Epoch: 13/20... Training loss: 0.0743
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0736
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0695
Epoch: 13/20... Training loss: 0.0719
Epoch: 13/20... Training loss: 0.0726
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0739
Epoch: 13/20... Training loss: 0.0713
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0740
Epoch: 13/20... Training loss: 0.0712
Epoch: 13/20... Training loss: 0.0738
Epoch: 13/20... Training loss: 0.0724
Epoch: 13/20... Training loss: 0.0734
Epoch: 13/20... Training loss: 0.0733
Epoch: 13/20... Training loss: 0.0744
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0737
Epoch: 14/20... Training loss: 0.0717
Epoch: 14/20... Training loss: 0.0705
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0732
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0704
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0708
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0741
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0712
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0738
Epoch: 14/20... Training loss: 0.0745
Epoch: 14/20... Training loss: 0.0713
Epoch: 14/20... Training loss: 0.0746
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0748
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0743
Epoch: 14/20... Training loss: 0.0745
Epoch: 14/20... Training loss: 0.0735
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0744
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0754
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0727
Epoch: 14/20... Training loss: 0.0743
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0751
Epoch: 14/20... Training loss: 0.0739
Epoch: 14/20... Training loss: 0.0746
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0755
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0732
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0738
Epoch: 14/20... Training loss: 0.0700
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0742
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0730
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0737
Epoch: 14/20... Training loss: 0.0747
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0708
Epoch: 14/20... Training loss: 0.0703
Epoch: 14/20... Training loss: 0.0713
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0737
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0730
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0730
Epoch: 14/20... Training loss: 0.0717
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0739
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0712
Epoch: 14/20... Training loss: 0.0732
Epoch: 14/20... Training loss: 0.0741
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0705
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0701
Epoch: 14/20... Training loss: 0.0699
Epoch: 14/20... Training loss: 0.0699
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0713
Epoch: 14/20... Training loss: 0.0749
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0697
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0762
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0703
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0699
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0741
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0740
Epoch: 14/20... Training loss: 0.0699
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0708
Epoch: 14/20... Training loss: 0.0696
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0701
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0702
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0730
Epoch: 14/20... Training loss: 0.0700
Epoch: 14/20... Training loss: 0.0704
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0744
Epoch: 14/20... Training loss: 0.0717
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0726
Epoch: 14/20... Training loss: 0.0699
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0695
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0708
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0749
Epoch: 14/20... Training loss: 0.0727
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0713
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0741
Epoch: 14/20... Training loss: 0.0703
Epoch: 14/20... Training loss: 0.0701
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0724
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0690
Epoch: 14/20... Training loss: 0.0686
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0712
Epoch: 14/20... Training loss: 0.0705
Epoch: 14/20... Training loss: 0.0737
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0736
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0755
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0705
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0717
Epoch: 14/20... Training loss: 0.0727
Epoch: 14/20... Training loss: 0.0712
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0700
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0707
Epoch: 14/20... Training loss: 0.0715
Epoch: 14/20... Training loss: 0.0733
Epoch: 14/20... Training loss: 0.0717
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0706
Epoch: 14/20... Training loss: 0.0703
Epoch: 14/20... Training loss: 0.0710
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0732
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0740
Epoch: 14/20... Training loss: 0.0702
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0704
Epoch: 14/20... Training loss: 0.0729
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0720
Epoch: 14/20... Training loss: 0.0688
Epoch: 14/20... Training loss: 0.0727
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0734
Epoch: 14/20... Training loss: 0.0704
Epoch: 14/20... Training loss: 0.0702
Epoch: 14/20... Training loss: 0.0731
Epoch: 14/20... Training loss: 0.0753
Epoch: 14/20... Training loss: 0.0730
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0703
Epoch: 14/20... Training loss: 0.0713
Epoch: 14/20... Training loss: 0.0711
Epoch: 14/20... Training loss: 0.0701
Epoch: 14/20... Training loss: 0.0719
Epoch: 14/20... Training loss: 0.0709
Epoch: 14/20... Training loss: 0.0714
Epoch: 14/20... Training loss: 0.0740
Epoch: 14/20... Training loss: 0.0738
Epoch: 14/20... Training loss: 0.0708
Epoch: 14/20... Training loss: 0.0722
Epoch: 14/20... Training loss: 0.0721
Epoch: 14/20... Training loss: 0.0728
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0725
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0716
Epoch: 14/20... Training loss: 0.0697
Epoch: 14/20... Training loss: 0.0741
Epoch: 14/20... Training loss: 0.0718
Epoch: 14/20... Training loss: 0.0723
Epoch: 14/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0737
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0720
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0690
Epoch: 15/20... Training loss: 0.0730
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0696
Epoch: 15/20... Training loss: 0.0713
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0725
Epoch: 15/20... Training loss: 0.0728
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0758
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0702
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0692
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0726
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0721
Epoch: 15/20... Training loss: 0.0730
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0720
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0727
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0735
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0731
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0725
Epoch: 15/20... Training loss: 0.0743
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0726
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0729
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0726
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0733
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0720
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0719
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0702
Epoch: 15/20... Training loss: 0.0702
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0728
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0696
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0694
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0720
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0732
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0692
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0687
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0692
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0745
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0721
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0725
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0713
Epoch: 15/20... Training loss: 0.0728
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0730
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0687
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0726
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0725
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0682
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0691
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0723
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0733
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0734
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0696
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0721
Epoch: 15/20... Training loss: 0.0736
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0731
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0713
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0720
Epoch: 15/20... Training loss: 0.0676
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0728
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0715
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0702
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0729
Epoch: 15/20... Training loss: 0.0719
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0698
Epoch: 15/20... Training loss: 0.0691
Epoch: 15/20... Training loss: 0.0695
Epoch: 15/20... Training loss: 0.0719
Epoch: 15/20... Training loss: 0.0699
Epoch: 15/20... Training loss: 0.0688
Epoch: 15/20... Training loss: 0.0713
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0693
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0682
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0692
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0692
Epoch: 15/20... Training loss: 0.0705
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0700
Epoch: 15/20... Training loss: 0.0726
Epoch: 15/20... Training loss: 0.0722
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0696
Epoch: 15/20... Training loss: 0.0706
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0729
Epoch: 15/20... Training loss: 0.0718
Epoch: 15/20... Training loss: 0.0697
Epoch: 15/20... Training loss: 0.0719
Epoch: 15/20... Training loss: 0.0739
Epoch: 15/20... Training loss: 0.0696
Epoch: 15/20... Training loss: 0.0687
Epoch: 15/20... Training loss: 0.0707
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0714
Epoch: 15/20... Training loss: 0.0688
Epoch: 15/20... Training loss: 0.0717
Epoch: 15/20... Training loss: 0.0686
Epoch: 15/20... Training loss: 0.0719
Epoch: 15/20... Training loss: 0.0702
Epoch: 15/20... Training loss: 0.0708
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0711
Epoch: 15/20... Training loss: 0.0724
Epoch: 15/20... Training loss: 0.0693
Epoch: 15/20... Training loss: 0.0712
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0710
Epoch: 15/20... Training loss: 0.0703
Epoch: 15/20... Training loss: 0.0704
Epoch: 15/20... Training loss: 0.0681
Epoch: 15/20... Training loss: 0.0701
Epoch: 15/20... Training loss: 0.0728
Epoch: 15/20... Training loss: 0.0716
Epoch: 15/20... Training loss: 0.0709
Epoch: 15/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0722
Epoch: 16/20... Training loss: 0.0709
Epoch: 16/20... Training loss: 0.0709
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0717
Epoch: 16/20... Training loss: 0.0719
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0719
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0727
Epoch: 16/20... Training loss: 0.0686
Epoch: 16/20... Training loss: 0.0714
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0723
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0680
Epoch: 16/20... Training loss: 0.0718
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0681
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0689
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0689
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0725
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0674
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0721
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0723
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0714
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0690
Epoch: 16/20... Training loss: 0.0683
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0680
Epoch: 16/20... Training loss: 0.0720
Epoch: 16/20... Training loss: 0.0685
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0717
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0683
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0711
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0714
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0727
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0727
Epoch: 16/20... Training loss: 0.0721
Epoch: 16/20... Training loss: 0.0683
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0726
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0677
Epoch: 16/20... Training loss: 0.0711
Epoch: 16/20... Training loss: 0.0683
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0686
Epoch: 16/20... Training loss: 0.0728
Epoch: 16/20... Training loss: 0.0693
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0714
Epoch: 16/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0724
Epoch: 16/20... Training loss: 0.0717
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0682
Epoch: 16/20... Training loss: 0.0689
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0676
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0689
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0693
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0718
Epoch: 16/20... Training loss: 0.0709
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0677
Epoch: 16/20... Training loss: 0.0727
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0717
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0684
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0689
Epoch: 16/20... Training loss: 0.0690
Epoch: 16/20... Training loss: 0.0675
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0690
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0693
Epoch: 16/20... Training loss: 0.0685
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0727
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0682
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0678
Epoch: 16/20... Training loss: 0.0670
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0690
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0718
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0668
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0711
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0692
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0681
Epoch: 16/20... Training loss: 0.0695
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0722
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0719
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0686
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0693
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0682
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0716
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0693
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0710
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0684
Epoch: 16/20... Training loss: 0.0674
Epoch: 16/20... Training loss: 0.0680
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0701
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0680
Epoch: 16/20... Training loss: 0.0712
Epoch: 16/20... Training loss: 0.0707
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0698
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0722
Epoch: 16/20... Training loss: 0.0713
Epoch: 16/20... Training loss: 0.0684
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0715
Epoch: 16/20... Training loss: 0.0688
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0703
Epoch: 16/20... Training loss: 0.0711
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0680
Epoch: 16/20... Training loss: 0.0686
Epoch: 16/20... Training loss: 0.0684
Epoch: 16/20... Training loss: 0.0696
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0691
Epoch: 16/20... Training loss: 0.0700
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0708
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0697
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0718
Epoch: 16/20... Training loss: 0.0694
Epoch: 16/20... Training loss: 0.0705
Epoch: 16/20... Training loss: 0.0728
Epoch: 16/20... Training loss: 0.0702
Epoch: 16/20... Training loss: 0.0730
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0704
Epoch: 16/20... Training loss: 0.0687
Epoch: 16/20... Training loss: 0.0706
Epoch: 16/20... Training loss: 0.0709
Epoch: 16/20... Training loss: 0.0699
Epoch: 16/20... Training loss: 0.0711
Epoch: 16/20... Training loss: 0.0709
Epoch: 16/20... Training loss: 0.0720
Epoch: 16/20... Training loss: 0.0678
Epoch: 17/20... Training loss: 0.0715
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0719
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0682
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0731
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0712
Epoch: 17/20... Training loss: 0.0718
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0682
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0704
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0725
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0715
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0707
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0703
Epoch: 17/20... Training loss: 0.0721
Epoch: 17/20... Training loss: 0.0690
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0673
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0670
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0703
Epoch: 17/20... Training loss: 0.0682
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0703
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0675
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0690
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0700
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0690
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0673
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0707
Epoch: 17/20... Training loss: 0.0663
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0700
Epoch: 17/20... Training loss: 0.0719
Epoch: 17/20... Training loss: 0.0673
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0710
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0678
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0664
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0676
Epoch: 17/20... Training loss: 0.0665
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0706
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0704
Epoch: 17/20... Training loss: 0.0704
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0678
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0722
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0676
Epoch: 17/20... Training loss: 0.0690
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0703
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0678
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0700
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0687
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0677
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0682
Epoch: 17/20... Training loss: 0.0728
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0676
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0708
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0716
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0711
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0675
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0704
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0683
Epoch: 17/20... Training loss: 0.0677
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0689
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0675
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0699
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0690
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0696
Epoch: 17/20... Training loss: 0.0680
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0668
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0691
Epoch: 17/20... Training loss: 0.0679
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0709
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0700
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0694
Epoch: 17/20... Training loss: 0.0702
Epoch: 17/20... Training loss: 0.0701
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0705
Epoch: 17/20... Training loss: 0.0695
Epoch: 17/20... Training loss: 0.0686
Epoch: 17/20... Training loss: 0.0684
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0700
Epoch: 17/20... Training loss: 0.0703
Epoch: 17/20... Training loss: 0.0682
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0698
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0697
Epoch: 17/20... Training loss: 0.0674
Epoch: 17/20... Training loss: 0.0688
Epoch: 17/20... Training loss: 0.0707
Epoch: 17/20... Training loss: 0.0685
Epoch: 17/20... Training loss: 0.0671
Epoch: 17/20... Training loss: 0.0662
Epoch: 17/20... Training loss: 0.0681
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0693
Epoch: 17/20... Training loss: 0.0677
Epoch: 17/20... Training loss: 0.0692
Epoch: 17/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0703
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0704
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0674
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0661
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0705
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0671
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0673
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0703
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0701
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0667
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0701
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0698
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0707
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0706
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0698
Epoch: 18/20... Training loss: 0.0683
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0701
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0694
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0703
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0695
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0705
Epoch: 18/20... Training loss: 0.0710
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0672
Epoch: 18/20... Training loss: 0.0673
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0706
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0661
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0713
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0701
Epoch: 18/20... Training loss: 0.0664
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0695
Epoch: 18/20... Training loss: 0.0694
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0708
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0672
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0673
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0672
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0669
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0675
Epoch: 18/20... Training loss: 0.0675
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0714
Epoch: 18/20... Training loss: 0.0672
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0698
Epoch: 18/20... Training loss: 0.0694
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0706
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0675
Epoch: 18/20... Training loss: 0.0708
Epoch: 18/20... Training loss: 0.0683
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0683
Epoch: 18/20... Training loss: 0.0669
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0666
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0685
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0674
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0669
Epoch: 18/20... Training loss: 0.0664
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0707
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0669
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0666
Epoch: 18/20... Training loss: 0.0660
Epoch: 18/20... Training loss: 0.0698
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0653
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0665
Epoch: 18/20... Training loss: 0.0679
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0659
Epoch: 18/20... Training loss: 0.0669
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0672
Epoch: 18/20... Training loss: 0.0718
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0670
Epoch: 18/20... Training loss: 0.0663
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0662
Epoch: 18/20... Training loss: 0.0653
Epoch: 18/20... Training loss: 0.0671
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0666
Epoch: 18/20... Training loss: 0.0681
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0666
Epoch: 18/20... Training loss: 0.0690
Epoch: 18/20... Training loss: 0.0696
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0664
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0675
Epoch: 18/20... Training loss: 0.0674
Epoch: 18/20... Training loss: 0.0671
Epoch: 18/20... Training loss: 0.0650
Epoch: 18/20... Training loss: 0.0687
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0686
Epoch: 18/20... Training loss: 0.0693
Epoch: 18/20... Training loss: 0.0692
Epoch: 18/20... Training loss: 0.0683
Epoch: 18/20... Training loss: 0.0682
Epoch: 18/20... Training loss: 0.0680
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0676
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0655
Epoch: 18/20... Training loss: 0.0702
Epoch: 18/20... Training loss: 0.0678
Epoch: 18/20... Training loss: 0.0677
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0668
Epoch: 18/20... Training loss: 0.0688
Epoch: 18/20... Training loss: 0.0671
Epoch: 18/20... Training loss: 0.0673
Epoch: 18/20... Training loss: 0.0684
Epoch: 18/20... Training loss: 0.0697
Epoch: 18/20... Training loss: 0.0674
Epoch: 18/20... Training loss: 0.0699
Epoch: 18/20... Training loss: 0.0689
Epoch: 18/20... Training loss: 0.0700
Epoch: 18/20... Training loss: 0.0667
Epoch: 18/20... Training loss: 0.0698
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0675
Epoch: 18/20... Training loss: 0.0691
Epoch: 18/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0681
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0670
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0694
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0678
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0691
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0657
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0708
Epoch: 19/20... Training loss: 0.0694
Epoch: 19/20... Training loss: 0.0678
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0691
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0678
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0653
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0640
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0678
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0698
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0694
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0659
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0701
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0701
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0652
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0698
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0692
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0668
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0688
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0694
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0665
Epoch: 19/20... Training loss: 0.0703
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0692
Epoch: 19/20... Training loss: 0.0668
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0662
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0654
Epoch: 19/20... Training loss: 0.0692
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0670
Epoch: 19/20... Training loss: 0.0688
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0692
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0665
Epoch: 19/20... Training loss: 0.0658
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0681
Epoch: 19/20... Training loss: 0.0681
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0666
Epoch: 19/20... Training loss: 0.0661
Epoch: 19/20... Training loss: 0.0694
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0688
Epoch: 19/20... Training loss: 0.0661
Epoch: 19/20... Training loss: 0.0718
Epoch: 19/20... Training loss: 0.0691
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0665
Epoch: 19/20... Training loss: 0.0668
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0691
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0700
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0655
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0692
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0663
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0661
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0659
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0665
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0656
Epoch: 19/20... Training loss: 0.0703
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0666
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0697
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0688
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0663
Epoch: 19/20... Training loss: 0.0668
Epoch: 19/20... Training loss: 0.0656
Epoch: 19/20... Training loss: 0.0701
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0681
Epoch: 19/20... Training loss: 0.0654
Epoch: 19/20... Training loss: 0.0655
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0664
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0660
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0664
Epoch: 19/20... Training loss: 0.0670
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0677
Epoch: 19/20... Training loss: 0.0695
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0678
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0688
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0698
Epoch: 19/20... Training loss: 0.0682
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0693
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0689
Epoch: 19/20... Training loss: 0.0652
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0656
Epoch: 19/20... Training loss: 0.0666
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0691
Epoch: 19/20... Training loss: 0.0659
Epoch: 19/20... Training loss: 0.0680
Epoch: 19/20... Training loss: 0.0661
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0660
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0686
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0659
Epoch: 19/20... Training loss: 0.0681
Epoch: 19/20... Training loss: 0.0667
Epoch: 19/20... Training loss: 0.0650
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0669
Epoch: 19/20... Training loss: 0.0679
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0673
Epoch: 19/20... Training loss: 0.0690
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0696
Epoch: 19/20... Training loss: 0.0675
Epoch: 19/20... Training loss: 0.0651
Epoch: 19/20... Training loss: 0.0684
Epoch: 19/20... Training loss: 0.0676
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0668
Epoch: 19/20... Training loss: 0.0687
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0671
Epoch: 19/20... Training loss: 0.0683
Epoch: 19/20... Training loss: 0.0674
Epoch: 19/20... Training loss: 0.0685
Epoch: 19/20... Training loss: 0.0672
Epoch: 19/20... Training loss: 0.0653
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0694
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0661
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0698
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0698
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0684
Epoch: 20/20... Training loss: 0.0695
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0663
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0690
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0697
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0695
Epoch: 20/20... Training loss: 0.0661
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0697
Epoch: 20/20... Training loss: 0.0657
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0661
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0690
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0654
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0691
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0692
Epoch: 20/20... Training loss: 0.0686
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0702
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0691
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0701
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0692
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0688
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0690
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0690
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0649
Epoch: 20/20... Training loss: 0.0652
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0699
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0700
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0685
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0685
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0698
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0656
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0698
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0691
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0654
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0648
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0647
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0696
Epoch: 20/20... Training loss: 0.0686
Epoch: 20/20... Training loss: 0.0656
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0684
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0693
Epoch: 20/20... Training loss: 0.0650
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0697
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0696
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0691
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0654
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0650
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0686
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0689
Epoch: 20/20... Training loss: 0.0663
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0705
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0651
Epoch: 20/20... Training loss: 0.0687
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0691
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0661
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0693
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0644
Epoch: 20/20... Training loss: 0.0663
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0707
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0669
Epoch: 20/20... Training loss: 0.0662
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0650
Epoch: 20/20... Training loss: 0.0650
Epoch: 20/20... Training loss: 0.0677
Epoch: 20/20... Training loss: 0.0653
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0648
Epoch: 20/20... Training loss: 0.0657
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0650
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0659
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0671
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0667
Epoch: 20/20... Training loss: 0.0682
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0679
Epoch: 20/20... Training loss: 0.0663
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0678
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0692
Epoch: 20/20... Training loss: 0.0676
Epoch: 20/20... Training loss: 0.0675
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0687
Epoch: 20/20... Training loss: 0.0672
Epoch: 20/20... Training loss: 0.0665
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0670
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0661
Epoch: 20/20... Training loss: 0.0660
Epoch: 20/20... Training loss: 0.0654
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0683
Epoch: 20/20... Training loss: 0.0643
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0664
Epoch: 20/20... Training loss: 0.0656
Epoch: 20/20... Training loss: 0.0680
Epoch: 20/20... Training loss: 0.0658
Epoch: 20/20... Training loss: 0.0681
Epoch: 20/20... Training loss: 0.0646
Epoch: 20/20... Training loss: 0.0666
Epoch: 20/20... Training loss: 0.0673
Epoch: 20/20... Training loss: 0.0674
Epoch: 20/20... Training loss: 0.0668
Epoch: 20/20... Training loss: 0.0690

Checking out the results

Below I've plotted some of the test images along with their reconstructions. For the most part these look pretty good except for some blurriness in some parts.


In [16]:
fig, axes = plt.subplots(nrows=2, ncols=10, sharex=True, sharey=True, figsize=(20,4))
in_imgs = mnist.test.images[:10]
reconstructed, compressed = sess.run([decoded, encoded], feed_dict={inputs_: in_imgs})

for images, row in zip([in_imgs, reconstructed], axes):
    for img, ax in zip(images, row):
        ax.imshow(img.reshape((28, 28)), cmap='Greys_r')
        ax.get_xaxis().set_visible(False)
        ax.get_yaxis().set_visible(False)

fig.tight_layout(pad=0.1)



In [17]:
sess.close()

Up Next

We're dealing with images here, so we can (usually) get better performance using convolution layers. So, next we'll build a better autoencoder with convolutional layers.

In practice, autoencoders aren't actually better at compression compared to typical methods like JPEGs and MP3s. But, they are being used for noise reduction, which you'll also build.