Review of "Generating 3 qubit quantum circuits with neural networks"

Chris Ferrie

This is an open peer review of arxiv:1703.10743, Generating 3 qubit quantum circuits with neural networks by Michael Swaddle et al.

TO JOURNAL EDITORS: You are free to use the contents of the repository as you see fit.

DISCLAIMER: A referee necessarily spends far less time than the authors on the paper. As such, this report surely contains errors. I would love for you to point them out so I can correct them. Otherwise, this report is provided without warranty of any kind, including its suitability as a resource for making decisions affecting the career of the authors of the paper.

Tweetable summary of my report

Highly recommended read for its accessibility and reproducibility, but lacks the analysis to live up to its claims. #workinprogress

Summary of claims and results

The authors seem to define quantum compilation the same way I would define quantum control. Namely, given a set of control Hamiltonians, design the interaction strength to generate a target unitary. The standard approach—as far as I understand—is a numerical gradient-based optimization using classical simulation to evaluate the objective function. The authors propose the following two-step alternative:

  • First break up the path from the the initial gate to the target into sequence of unitaries which approximate a geodesic curve in $SU(d)$;
  • Second, for each of those unitaries, find the set of controls to achieve those, with the idea that—given they are "close" together—it should be easier than traditional approaches.

The authors achieve this to some extend by training a neural network with simulated trajectories. Though, as I outline below, much more analysis is required to warrant suggesting this as a viable alternative to traditional methods. Though they did not emphasize it, I see the provided code and data as the most valuable research output.

Correctness

Given I was able to reproduce the results, I have no doubt the results obtained are correct. I do have some concerns, though, in the relevance of the result to quantum control:

  • The authors seem to truncate the unitaries to the real part of each entry. Are two unitaries that are close in their real part actually close? I don't think they are.
  • The training data for the second stage control problem does not use the the gates generated from the first part. They simply generate random controls to define a target. It would be far more convincing if the gates used in the first stage where used in the second stage. After all, this is how it would necessarily be done in practice.

Accessibility

The paper is quite short, but not necessarily dense. I am neither an expert in geometric quantum nor the architecture of neural networks—yet, I was able to quickly grasp the main idea of the paper. That being said, there were a few points which I got hung up on.

  • The discussion of the problem of quantum compilation, or control, lacks context. It attempts to be broad, but would leave a non-expert thinking: a good approximation to $U$ is of course $U$. It should be discussed earlier—and made explicit—hat the basis for the sub-algebra is somehow an experimental constraint or set of available controls.
  • The crucial part of the geodesic equation seems to be the projection onto the sub-algebra. This should be explicitly defined.
  • The network design is lacking everything but a bare description—why this rather than something else? Is there some intuition at least?
  • Fidelity is the standard metric used in quantum control (and something like diamond norm is the ultimate figure of merit for quantum gate comparisons). The real part of the individual entries seems to be quite difficult to justify from an operational perspective. Such choices need to be explained and defended.

Reproducibility

Relative to other research in quantum information theory, this work gets top marks for reproducibility. However... given the author's eagerness to go above and beyond what is expected in a physics paper, I'm going to make some further suggestions for improvement in the hopes that the reproducibility aspect is more transparent.

The code is not well organized or documented. Since it is quite minimal and I had some basic knowledge in the software used, I was able to figure out how it works. But, I doubt most of the target audience of this paper could make use of it. Indeed, I immediately ran into errors when attempting to run the code, making the saved trained model useless to me. To be fair, I did not attempt to contact the authors about this since—as the authors themselves point out—the model can be trained quite quickly on a reasonable GPU (as you will see below).

The data was generated with separate software—Mathematica. I do not have a Mathematica license so did not attempt to reproduce the data. Given the authors were already using numpy, it would have been straightforward to generate the data in python as well.

Methodology

I think here is where the paper falls short. The analysis of the results of the network training are not subjected to any anaylsis beyond plotting the results. Crucially(!):

  • How does this method compare to existing methods for:
    • The geodesic approach?
    • The local decomposition?
  • Further to that, does the claim that the lack of redundancy using the geodesic provides an effective alternative hold up to numerical tests? (It would be straightforward given the infrastructure the authors have build to test the claims of their own paper!)
  • (Even for the small examples) How do the results depend on the parameters of the neural network?

Final verdict

The authors provided the code to generate the data, the data themselves, the code to train the network, and the trained network! Indeed, if I was so inclined, I could immediately build on their work without any uncertainty and this is far more than I can say for anything else I've read recently on quant-ph. This is an immensely impressive effort in a field which neither rewards or encourages it. The standard approach to publishing is to obscure your result to the point of either not being about to reproduce it, or give yourself plausible deniability should it be wrong. I applaud the authors for their bravery in exposing their work for detailed criticism.

I see this as a (very useful!) set of lab notes rather than a complete scientific result because of the lack of comparisons to existing methods and variations in the proposed method. More analysis and discussion of the results is required.

Reproducibility analysis

The code here is derived from the source provided by the authors at https://github.com/Swaddle/nnQcompiler.

I have also used the data provided by the authors at https://github.com/Swaddle/nnQcompiler.

I had a bit of trouble with various versions and their respective compatability under Python 3:

Python 3.5.2 |Anaconda custom (64-bit)| (default, Jul  2 2016, 17:53:06) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux

With the Anaconda distribution above, I download Keras version 1.2.2 and ran:

pip install tensorflow
pip install Keras-1.2.2.tar.gz

I hacked up some minimal changes and moved most of the code into this single notebook for convenience.


In [1]:
%matplotlib inline
import matplotlib.pyplot as plt
plt.style.use('ggplot')

from data_utils import load_data_lstm, load_data_ss

from keras.models import Sequential
from keras.metrics import mean_squared_error
from keras.layers import Dense, Dropout, Flatten
from keras.layers.recurrent import GRU
from keras.layers.convolutional import Conv1D
from keras.layers.convolutional import ZeroPadding1D
from keras.callbacks import CSVLogger
from tensorflow.python.ops import control_flow_ops
from keras.callbacks import ModelCheckpoint, EarlyStopping
import tensorflow as tf


Using TensorFlow backend.

The authors use the squared error as an objective. While standard in many network training problems, it is unclear what it's operational meaning is here.


In [2]:
def custom_objective(y_true, y_pred):
    tensor = y_true - y_pred 
    squares = tf.square(tensor)
    norm = tf.reduce_sum(squares)
    return norm

The authors already nicely split the training and validation data, so we just load that up.


In [3]:
training_data_path = 'data/lstm_data_training.csv'
valid_data_path = 'data/lstm_data_valid.csv'

train_input, train_output = load_data_lstm(training_data_path)
valid_input, valid_output = load_data_lstm(valid_data_path)

This seems like black magic to me and is worth playing with, but it defines the architecture of the network.


In [4]:
model = Sequential()

model.add(GRU(80, return_sequences=True, input_shape=(8,8)))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(Flatten())
model.add(Dense(input_dim=640,output_dim=640))

#model.summary()

Now we train that sucker!


In [5]:
%%time

model.compile(optimizer='Nadam',loss=custom_objective)
history = model.fit(train_input, train_output, validation_data=(valid_input,valid_output), nb_epoch=1000, batch_size=64)


Train on 1000 samples, validate on 100 samples
Epoch 1/1000
1000/1000 [==============================] - 1s - loss: 1655.0847 - val_loss: 34.2073
Epoch 2/1000
1000/1000 [==============================] - 0s - loss: 316.0393 - val_loss: 18.3714
Epoch 3/1000
1000/1000 [==============================] - 0s - loss: 169.6186 - val_loss: 16.4331
Epoch 4/1000
1000/1000 [==============================] - 0s - loss: 93.3592 - val_loss: 10.5343
Epoch 5/1000
1000/1000 [==============================] - 0s - loss: 108.5998 - val_loss: 11.2147
Epoch 6/1000
1000/1000 [==============================] - 0s - loss: 62.0827 - val_loss: 10.4611
Epoch 7/1000
1000/1000 [==============================] - 0s - loss: 52.4477 - val_loss: 9.0723
Epoch 8/1000
1000/1000 [==============================] - 0s - loss: 77.2306 - val_loss: 12.8944
Epoch 9/1000
1000/1000 [==============================] - 0s - loss: 42.5482 - val_loss: 8.8110
Epoch 10/1000
1000/1000 [==============================] - 0s - loss: 45.2898 - val_loss: 9.0821
Epoch 11/1000
1000/1000 [==============================] - 0s - loss: 35.5967 - val_loss: 8.2457
Epoch 12/1000
1000/1000 [==============================] - 0s - loss: 46.2576 - val_loss: 8.5135
Epoch 13/1000
1000/1000 [==============================] - 0s - loss: 31.4348 - val_loss: 8.2321
Epoch 14/1000
1000/1000 [==============================] - 0s - loss: 28.9892 - val_loss: 8.0690
Epoch 15/1000
1000/1000 [==============================] - 0s - loss: 29.3194 - val_loss: 8.7529
Epoch 16/1000
1000/1000 [==============================] - 0s - loss: 26.0391 - val_loss: 7.7710
Epoch 17/1000
1000/1000 [==============================] - 0s - loss: 25.8025 - val_loss: 8.8804
Epoch 18/1000
1000/1000 [==============================] - 0s - loss: 51.3100 - val_loss: 7.3290
Epoch 19/1000
1000/1000 [==============================] - 0s - loss: 23.0907 - val_loss: 7.4554
Epoch 20/1000
1000/1000 [==============================] - 0s - loss: 21.8436 - val_loss: 6.9894
Epoch 21/1000
1000/1000 [==============================] - 0s - loss: 23.8127 - val_loss: 7.3371
Epoch 22/1000
1000/1000 [==============================] - 0s - loss: 20.6293 - val_loss: 7.0844
Epoch 23/1000
1000/1000 [==============================] - 0s - loss: 21.2581 - val_loss: 7.1833
Epoch 24/1000
1000/1000 [==============================] - 0s - loss: 21.8342 - val_loss: 7.2273
Epoch 25/1000
1000/1000 [==============================] - 0s - loss: 23.4267 - val_loss: 7.1940
Epoch 26/1000
1000/1000 [==============================] - 0s - loss: 24.7397 - val_loss: 6.7745
Epoch 27/1000
1000/1000 [==============================] - 0s - loss: 17.8136 - val_loss: 6.6896
Epoch 28/1000
1000/1000 [==============================] - 0s - loss: 19.7745 - val_loss: 6.5086
Epoch 29/1000
1000/1000 [==============================] - 0s - loss: 17.7195 - val_loss: 6.2366
Epoch 30/1000
1000/1000 [==============================] - 0s - loss: 18.8222 - val_loss: 6.3709
Epoch 31/1000
1000/1000 [==============================] - 0s - loss: 16.8897 - val_loss: 6.5695
Epoch 32/1000
1000/1000 [==============================] - 0s - loss: 18.6408 - val_loss: 6.4200
Epoch 33/1000
1000/1000 [==============================] - 0s - loss: 16.2138 - val_loss: 6.0732
Epoch 34/1000
1000/1000 [==============================] - 0s - loss: 15.6626 - val_loss: 5.9461
Epoch 35/1000
1000/1000 [==============================] - 0s - loss: 16.1931 - val_loss: 6.1901
Epoch 36/1000
1000/1000 [==============================] - 0s - loss: 19.7903 - val_loss: 6.0741
Epoch 37/1000
1000/1000 [==============================] - 0s - loss: 19.6402 - val_loss: 5.9941
Epoch 38/1000
1000/1000 [==============================] - 0s - loss: 14.7746 - val_loss: 5.8172
Epoch 39/1000
1000/1000 [==============================] - 0s - loss: 14.3934 - val_loss: 5.7385
Epoch 40/1000
1000/1000 [==============================] - 0s - loss: 20.1974 - val_loss: 6.0071
Epoch 41/1000
1000/1000 [==============================] - 0s - loss: 14.9444 - val_loss: 6.2999
Epoch 42/1000
1000/1000 [==============================] - 0s - loss: 13.6593 - val_loss: 5.6227
Epoch 43/1000
1000/1000 [==============================] - 0s - loss: 14.2644 - val_loss: 5.7975
Epoch 44/1000
1000/1000 [==============================] - 0s - loss: 15.8589 - val_loss: 6.4562
Epoch 45/1000
1000/1000 [==============================] - 0s - loss: 13.7538 - val_loss: 5.5583
Epoch 46/1000
1000/1000 [==============================] - 0s - loss: 16.9502 - val_loss: 6.1578
Epoch 47/1000
1000/1000 [==============================] - 0s - loss: 13.3041 - val_loss: 5.3534
Epoch 48/1000
1000/1000 [==============================] - 0s - loss: 15.2560 - val_loss: 5.6836
Epoch 49/1000
1000/1000 [==============================] - 0s - loss: 13.5695 - val_loss: 5.2710
Epoch 50/1000
1000/1000 [==============================] - 0s - loss: 13.0860 - val_loss: 5.2635
Epoch 51/1000
1000/1000 [==============================] - 0s - loss: 15.1462 - val_loss: 5.2328
Epoch 52/1000
1000/1000 [==============================] - 0s - loss: 13.6565 - val_loss: 5.3323
Epoch 53/1000
1000/1000 [==============================] - 0s - loss: 14.1215 - val_loss: 5.1675
Epoch 54/1000
1000/1000 [==============================] - 0s - loss: 12.0265 - val_loss: 4.9756
Epoch 55/1000
1000/1000 [==============================] - 0s - loss: 12.4859 - val_loss: 5.0503
Epoch 56/1000
1000/1000 [==============================] - 0s - loss: 11.9864 - val_loss: 4.9412
Epoch 57/1000
1000/1000 [==============================] - 0s - loss: 11.7923 - val_loss: 4.9105
Epoch 58/1000
1000/1000 [==============================] - 0s - loss: 12.6661 - val_loss: 4.8659
Epoch 59/1000
1000/1000 [==============================] - 0s - loss: 11.8572 - val_loss: 4.9905
Epoch 60/1000
1000/1000 [==============================] - 0s - loss: 13.1981 - val_loss: 5.1625
Epoch 61/1000
1000/1000 [==============================] - 0s - loss: 14.4236 - val_loss: 4.9859
Epoch 62/1000
1000/1000 [==============================] - 0s - loss: 11.4187 - val_loss: 5.0602
Epoch 63/1000
1000/1000 [==============================] - 0s - loss: 13.2030 - val_loss: 4.8664
Epoch 64/1000
1000/1000 [==============================] - 0s - loss: 12.3580 - val_loss: 4.7044
Epoch 65/1000
1000/1000 [==============================] - 0s - loss: 11.7380 - val_loss: 4.5651
Epoch 66/1000
1000/1000 [==============================] - 0s - loss: 13.3998 - val_loss: 4.8031
Epoch 67/1000
1000/1000 [==============================] - 0s - loss: 12.8522 - val_loss: 4.5214
Epoch 68/1000
1000/1000 [==============================] - 0s - loss: 10.7382 - val_loss: 4.5601
Epoch 69/1000
1000/1000 [==============================] - 0s - loss: 12.3455 - val_loss: 4.5410
Epoch 70/1000
1000/1000 [==============================] - 0s - loss: 11.8252 - val_loss: 4.5446
Epoch 71/1000
1000/1000 [==============================] - 0s - loss: 11.1937 - val_loss: 4.5946
Epoch 72/1000
1000/1000 [==============================] - 0s - loss: 10.6099 - val_loss: 4.5330
Epoch 73/1000
1000/1000 [==============================] - 0s - loss: 10.8846 - val_loss: 4.4979
Epoch 74/1000
1000/1000 [==============================] - 0s - loss: 10.4041 - val_loss: 4.4830
Epoch 75/1000
1000/1000 [==============================] - 0s - loss: 11.5117 - val_loss: 4.5468
Epoch 76/1000
1000/1000 [==============================] - 0s - loss: 11.3887 - val_loss: 4.8771
Epoch 77/1000
1000/1000 [==============================] - 0s - loss: 10.8172 - val_loss: 5.7137
Epoch 78/1000
1000/1000 [==============================] - 0s - loss: 10.7837 - val_loss: 4.1909
Epoch 79/1000
1000/1000 [==============================] - 0s - loss: 12.2569 - val_loss: 5.9973
Epoch 80/1000
1000/1000 [==============================] - 0s - loss: 12.9323 - val_loss: 4.3936
Epoch 81/1000
1000/1000 [==============================] - 0s - loss: 11.2098 - val_loss: 4.1748
Epoch 82/1000
1000/1000 [==============================] - 0s - loss: 10.3625 - val_loss: 4.2554
Epoch 83/1000
1000/1000 [==============================] - 0s - loss: 11.0963 - val_loss: 4.2596
Epoch 84/1000
1000/1000 [==============================] - 0s - loss: 10.0053 - val_loss: 4.1061
Epoch 85/1000
1000/1000 [==============================] - 0s - loss: 11.0152 - val_loss: 4.5238
Epoch 86/1000
1000/1000 [==============================] - 0s - loss: 11.0763 - val_loss: 3.9531
Epoch 87/1000
1000/1000 [==============================] - 0s - loss: 9.9096 - val_loss: 4.1221
Epoch 88/1000
1000/1000 [==============================] - 0s - loss: 10.2488 - val_loss: 3.9117
Epoch 89/1000
1000/1000 [==============================] - 0s - loss: 10.5618 - val_loss: 3.9093
Epoch 90/1000
1000/1000 [==============================] - 0s - loss: 10.1431 - val_loss: 4.1418
Epoch 91/1000
1000/1000 [==============================] - 0s - loss: 10.0329 - val_loss: 3.8906
Epoch 92/1000
1000/1000 [==============================] - 0s - loss: 9.6519 - val_loss: 4.2325
Epoch 93/1000
1000/1000 [==============================] - 0s - loss: 9.8501 - val_loss: 3.8506
Epoch 94/1000
1000/1000 [==============================] - 0s - loss: 10.5886 - val_loss: 4.0437
Epoch 95/1000
1000/1000 [==============================] - 0s - loss: 10.4563 - val_loss: 3.9303
Epoch 96/1000
1000/1000 [==============================] - 0s - loss: 10.4780 - val_loss: 3.7307
Epoch 97/1000
1000/1000 [==============================] - 0s - loss: 10.3165 - val_loss: 3.7491
Epoch 98/1000
1000/1000 [==============================] - 0s - loss: 10.4377 - val_loss: 3.7697
Epoch 99/1000
1000/1000 [==============================] - 0s - loss: 9.6351 - val_loss: 3.8461
Epoch 100/1000
1000/1000 [==============================] - 0s - loss: 8.9137 - val_loss: 3.6934
Epoch 101/1000
1000/1000 [==============================] - 0s - loss: 9.4236 - val_loss: 3.9148
Epoch 102/1000
1000/1000 [==============================] - 0s - loss: 9.3758 - val_loss: 3.5260
Epoch 103/1000
1000/1000 [==============================] - 0s - loss: 9.9851 - val_loss: 3.6144
Epoch 104/1000
1000/1000 [==============================] - 0s - loss: 9.8013 - val_loss: 3.7855
Epoch 105/1000
1000/1000 [==============================] - 0s - loss: 10.5989 - val_loss: 3.5723
Epoch 106/1000
1000/1000 [==============================] - 0s - loss: 8.4604 - val_loss: 3.4867
Epoch 107/1000
1000/1000 [==============================] - 0s - loss: 9.1778 - val_loss: 3.5283
Epoch 108/1000
1000/1000 [==============================] - 0s - loss: 8.8627 - val_loss: 3.5240
Epoch 109/1000
1000/1000 [==============================] - 0s - loss: 8.8417 - val_loss: 3.4189
Epoch 110/1000
1000/1000 [==============================] - 0s - loss: 9.6607 - val_loss: 3.5599
Epoch 111/1000
1000/1000 [==============================] - 0s - loss: 9.0176 - val_loss: 3.2983
Epoch 112/1000
1000/1000 [==============================] - 0s - loss: 11.3471 - val_loss: 3.2506
Epoch 113/1000
1000/1000 [==============================] - 0s - loss: 8.5091 - val_loss: 3.6389
Epoch 114/1000
1000/1000 [==============================] - 0s - loss: 9.9849 - val_loss: 3.2931
Epoch 115/1000
1000/1000 [==============================] - 0s - loss: 8.2165 - val_loss: 3.2461
Epoch 116/1000
1000/1000 [==============================] - 0s - loss: 8.1490 - val_loss: 3.2328
Epoch 117/1000
1000/1000 [==============================] - 0s - loss: 8.7013 - val_loss: 3.2242
Epoch 118/1000
1000/1000 [==============================] - 0s - loss: 8.1500 - val_loss: 3.2025
Epoch 119/1000
1000/1000 [==============================] - 0s - loss: 8.6589 - val_loss: 3.1866
Epoch 120/1000
1000/1000 [==============================] - 0s - loss: 8.0517 - val_loss: 3.2678
Epoch 121/1000
1000/1000 [==============================] - 0s - loss: 9.9382 - val_loss: 3.0484
Epoch 122/1000
1000/1000 [==============================] - 0s - loss: 8.1925 - val_loss: 3.6015
Epoch 123/1000
1000/1000 [==============================] - 0s - loss: 7.8880 - val_loss: 3.0268
Epoch 124/1000
1000/1000 [==============================] - 0s - loss: 7.7847 - val_loss: 2.9976
Epoch 125/1000
1000/1000 [==============================] - 0s - loss: 8.0426 - val_loss: 3.0957
Epoch 126/1000
1000/1000 [==============================] - 0s - loss: 9.6018 - val_loss: 3.3405
Epoch 127/1000
1000/1000 [==============================] - 0s - loss: 10.0551 - val_loss: 2.9933
Epoch 128/1000
1000/1000 [==============================] - 0s - loss: 8.9692 - val_loss: 3.0649
Epoch 129/1000
1000/1000 [==============================] - 0s - loss: 7.8450 - val_loss: 3.2537
Epoch 130/1000
1000/1000 [==============================] - 0s - loss: 7.8751 - val_loss: 3.0356
Epoch 131/1000
1000/1000 [==============================] - 0s - loss: 7.7737 - val_loss: 2.8974
Epoch 132/1000
1000/1000 [==============================] - 0s - loss: 7.4117 - val_loss: 3.0712
Epoch 133/1000
1000/1000 [==============================] - 0s - loss: 7.4516 - val_loss: 2.8255
Epoch 134/1000
1000/1000 [==============================] - 0s - loss: 7.3018 - val_loss: 2.7697
Epoch 135/1000
1000/1000 [==============================] - 0s - loss: 8.1295 - val_loss: 2.8746
Epoch 136/1000
1000/1000 [==============================] - 0s - loss: 7.3559 - val_loss: 3.1144
Epoch 137/1000
1000/1000 [==============================] - 0s - loss: 10.0260 - val_loss: 2.7372
Epoch 138/1000
1000/1000 [==============================] - 0s - loss: 7.3145 - val_loss: 2.7843
Epoch 139/1000
1000/1000 [==============================] - 0s - loss: 7.2526 - val_loss: 2.7655
Epoch 140/1000
1000/1000 [==============================] - 0s - loss: 8.5104 - val_loss: 3.1060
Epoch 141/1000
1000/1000 [==============================] - 0s - loss: 9.8544 - val_loss: 2.8281
Epoch 142/1000
1000/1000 [==============================] - 0s - loss: 8.0390 - val_loss: 3.1103
Epoch 143/1000
1000/1000 [==============================] - 0s - loss: 7.3997 - val_loss: 2.7757
Epoch 144/1000
1000/1000 [==============================] - 0s - loss: 9.0054 - val_loss: 2.6026
Epoch 145/1000
1000/1000 [==============================] - 0s - loss: 7.8805 - val_loss: 2.6176
Epoch 146/1000
1000/1000 [==============================] - 0s - loss: 7.4475 - val_loss: 2.6153
Epoch 147/1000
1000/1000 [==============================] - 0s - loss: 7.5694 - val_loss: 2.6343
Epoch 148/1000
1000/1000 [==============================] - 0s - loss: 7.4845 - val_loss: 2.9744
Epoch 149/1000
1000/1000 [==============================] - 0s - loss: 7.7331 - val_loss: 3.3107
Epoch 150/1000
1000/1000 [==============================] - 0s - loss: 7.8300 - val_loss: 2.5236
Epoch 151/1000
1000/1000 [==============================] - 0s - loss: 6.9689 - val_loss: 2.7710
Epoch 152/1000
1000/1000 [==============================] - 0s - loss: 7.3094 - val_loss: 2.5098
Epoch 153/1000
1000/1000 [==============================] - 0s - loss: 7.0811 - val_loss: 2.4889
Epoch 154/1000
1000/1000 [==============================] - 0s - loss: 7.2483 - val_loss: 2.9621
Epoch 155/1000
1000/1000 [==============================] - 0s - loss: 7.5195 - val_loss: 2.6031
Epoch 156/1000
1000/1000 [==============================] - 0s - loss: 7.8160 - val_loss: 2.6751
Epoch 157/1000
1000/1000 [==============================] - 0s - loss: 7.1482 - val_loss: 2.4909
Epoch 158/1000
1000/1000 [==============================] - 0s - loss: 6.8342 - val_loss: 2.4545
Epoch 159/1000
1000/1000 [==============================] - 0s - loss: 6.6638 - val_loss: 2.7457
Epoch 160/1000
1000/1000 [==============================] - 0s - loss: 6.6214 - val_loss: 2.4069
Epoch 161/1000
1000/1000 [==============================] - 0s - loss: 6.9068 - val_loss: 2.4132
Epoch 162/1000
1000/1000 [==============================] - 0s - loss: 7.1494 - val_loss: 2.5891
Epoch 163/1000
1000/1000 [==============================] - 0s - loss: 7.0298 - val_loss: 2.4025
Epoch 164/1000
1000/1000 [==============================] - 0s - loss: 6.5123 - val_loss: 2.4034
Epoch 165/1000
1000/1000 [==============================] - 0s - loss: 7.0316 - val_loss: 2.4386
Epoch 166/1000
1000/1000 [==============================] - 0s - loss: 6.7394 - val_loss: 2.4985
Epoch 167/1000
1000/1000 [==============================] - 0s - loss: 7.5645 - val_loss: 2.6433
Epoch 168/1000
1000/1000 [==============================] - 0s - loss: 6.3952 - val_loss: 2.3639
Epoch 169/1000
1000/1000 [==============================] - 0s - loss: 8.1023 - val_loss: 2.3782
Epoch 170/1000
1000/1000 [==============================] - 0s - loss: 7.2586 - val_loss: 2.3079
Epoch 171/1000
1000/1000 [==============================] - 0s - loss: 6.2499 - val_loss: 2.3738
Epoch 172/1000
1000/1000 [==============================] - 0s - loss: 6.4738 - val_loss: 2.3307
Epoch 173/1000
1000/1000 [==============================] - 0s - loss: 7.8482 - val_loss: 2.2793
Epoch 174/1000
1000/1000 [==============================] - 0s - loss: 6.6046 - val_loss: 2.3429
Epoch 175/1000
1000/1000 [==============================] - 0s - loss: 6.7245 - val_loss: 2.5309
Epoch 176/1000
1000/1000 [==============================] - 0s - loss: 6.8677 - val_loss: 2.5061
Epoch 177/1000
1000/1000 [==============================] - 0s - loss: 6.6059 - val_loss: 2.4307
Epoch 178/1000
1000/1000 [==============================] - 0s - loss: 7.4489 - val_loss: 2.3128
Epoch 179/1000
1000/1000 [==============================] - 0s - loss: 6.5029 - val_loss: 2.2662
Epoch 180/1000
1000/1000 [==============================] - 0s - loss: 6.8496 - val_loss: 2.2336
Epoch 181/1000
1000/1000 [==============================] - 0s - loss: 7.1255 - val_loss: 2.4665
Epoch 182/1000
1000/1000 [==============================] - 0s - loss: 7.3895 - val_loss: 2.3385
Epoch 183/1000
1000/1000 [==============================] - 0s - loss: 6.3442 - val_loss: 2.1800
Epoch 184/1000
1000/1000 [==============================] - 0s - loss: 8.0593 - val_loss: 2.3639
Epoch 185/1000
1000/1000 [==============================] - 0s - loss: 6.3882 - val_loss: 2.4444
Epoch 186/1000
1000/1000 [==============================] - 0s - loss: 6.0669 - val_loss: 2.1786
Epoch 187/1000
1000/1000 [==============================] - 0s - loss: 7.0835 - val_loss: 2.2344
Epoch 188/1000
1000/1000 [==============================] - 0s - loss: 6.2458 - val_loss: 2.2061
Epoch 189/1000
1000/1000 [==============================] - 0s - loss: 6.3769 - val_loss: 2.1706
Epoch 190/1000
1000/1000 [==============================] - 0s - loss: 6.2216 - val_loss: 2.3522
Epoch 191/1000
1000/1000 [==============================] - 0s - loss: 8.3435 - val_loss: 2.1435
Epoch 192/1000
1000/1000 [==============================] - 0s - loss: 6.4731 - val_loss: 2.1934
Epoch 193/1000
1000/1000 [==============================] - 0s - loss: 6.5095 - val_loss: 2.1055
Epoch 194/1000
1000/1000 [==============================] - 0s - loss: 6.1363 - val_loss: 2.1520
Epoch 195/1000
1000/1000 [==============================] - 0s - loss: 6.5666 - val_loss: 2.0857
Epoch 196/1000
1000/1000 [==============================] - 0s - loss: 6.3837 - val_loss: 2.1154
Epoch 197/1000
1000/1000 [==============================] - 0s - loss: 6.2844 - val_loss: 2.1702
Epoch 198/1000
1000/1000 [==============================] - 0s - loss: 6.1259 - val_loss: 2.1339
Epoch 199/1000
1000/1000 [==============================] - 0s - loss: 6.1919 - val_loss: 2.4377
Epoch 200/1000
1000/1000 [==============================] - 0s - loss: 5.9413 - val_loss: 2.1181
Epoch 201/1000
1000/1000 [==============================] - 0s - loss: 6.0681 - val_loss: 2.0634
Epoch 202/1000
1000/1000 [==============================] - 0s - loss: 6.6244 - val_loss: 2.1205
Epoch 203/1000
1000/1000 [==============================] - 0s - loss: 6.9179 - val_loss: 2.0735
Epoch 204/1000
1000/1000 [==============================] - 0s - loss: 5.6048 - val_loss: 2.0652
Epoch 205/1000
1000/1000 [==============================] - 0s - loss: 5.7305 - val_loss: 2.2187
Epoch 206/1000
1000/1000 [==============================] - 0s - loss: 5.6804 - val_loss: 2.2179
Epoch 207/1000
1000/1000 [==============================] - 0s - loss: 7.6614 - val_loss: 1.9880
Epoch 208/1000
1000/1000 [==============================] - 0s - loss: 5.8762 - val_loss: 2.0525
Epoch 209/1000
1000/1000 [==============================] - 0s - loss: 6.6974 - val_loss: 2.3841
Epoch 210/1000
1000/1000 [==============================] - 0s - loss: 5.9831 - val_loss: 2.0043
Epoch 211/1000
1000/1000 [==============================] - 0s - loss: 5.6536 - val_loss: 2.0169
Epoch 212/1000
1000/1000 [==============================] - 0s - loss: 5.6771 - val_loss: 2.0057
Epoch 213/1000
1000/1000 [==============================] - 0s - loss: 5.6785 - val_loss: 2.0814
Epoch 214/1000
1000/1000 [==============================] - 0s - loss: 5.7123 - val_loss: 2.0297
Epoch 215/1000
1000/1000 [==============================] - 0s - loss: 5.6266 - val_loss: 1.9371
Epoch 216/1000
1000/1000 [==============================] - 0s - loss: 6.7549 - val_loss: 2.1114
Epoch 217/1000
1000/1000 [==============================] - 0s - loss: 6.2603 - val_loss: 2.1500
Epoch 218/1000
1000/1000 [==============================] - 0s - loss: 5.2277 - val_loss: 2.1217
Epoch 219/1000
1000/1000 [==============================] - 0s - loss: 6.1739 - val_loss: 2.0610
Epoch 220/1000
1000/1000 [==============================] - 0s - loss: 5.7409 - val_loss: 1.9607
Epoch 221/1000
1000/1000 [==============================] - 0s - loss: 5.9125 - val_loss: 2.0878
Epoch 222/1000
1000/1000 [==============================] - 0s - loss: 5.8615 - val_loss: 1.8960
Epoch 223/1000
1000/1000 [==============================] - 0s - loss: 5.6380 - val_loss: 1.9474
Epoch 224/1000
1000/1000 [==============================] - 0s - loss: 5.3909 - val_loss: 2.0236
Epoch 225/1000
1000/1000 [==============================] - 0s - loss: 6.2307 - val_loss: 2.0363
Epoch 226/1000
1000/1000 [==============================] - 0s - loss: 5.5323 - val_loss: 1.9243
Epoch 227/1000
1000/1000 [==============================] - 0s - loss: 5.2446 - val_loss: 2.0454
Epoch 228/1000
1000/1000 [==============================] - 0s - loss: 5.2465 - val_loss: 1.9682
Epoch 229/1000
1000/1000 [==============================] - 0s - loss: 5.6833 - val_loss: 1.9508
Epoch 230/1000
1000/1000 [==============================] - 0s - loss: 5.6755 - val_loss: 1.9418
Epoch 231/1000
1000/1000 [==============================] - 0s - loss: 5.2985 - val_loss: 1.8312
Epoch 232/1000
1000/1000 [==============================] - 0s - loss: 6.3471 - val_loss: 2.1082
Epoch 233/1000
1000/1000 [==============================] - 0s - loss: 5.5699 - val_loss: 2.1104
Epoch 234/1000
1000/1000 [==============================] - 0s - loss: 5.5562 - val_loss: 1.9223
Epoch 235/1000
1000/1000 [==============================] - 0s - loss: 5.9781 - val_loss: 1.9168
Epoch 236/1000
1000/1000 [==============================] - 0s - loss: 5.6107 - val_loss: 1.9031
Epoch 237/1000
1000/1000 [==============================] - 0s - loss: 5.3896 - val_loss: 1.9107
Epoch 238/1000
1000/1000 [==============================] - 0s - loss: 5.6402 - val_loss: 1.8551
Epoch 239/1000
1000/1000 [==============================] - 0s - loss: 5.1569 - val_loss: 1.7963
Epoch 240/1000
1000/1000 [==============================] - 0s - loss: 5.7049 - val_loss: 2.1162
Epoch 241/1000
1000/1000 [==============================] - 0s - loss: 5.1619 - val_loss: 1.9521
Epoch 242/1000
1000/1000 [==============================] - 0s - loss: 5.2456 - val_loss: 2.0414
Epoch 243/1000
1000/1000 [==============================] - 0s - loss: 5.9072 - val_loss: 2.0580
Epoch 244/1000
1000/1000 [==============================] - 0s - loss: 5.1494 - val_loss: 2.0610
Epoch 245/1000
1000/1000 [==============================] - 0s - loss: 5.0562 - val_loss: 1.8547
Epoch 246/1000
1000/1000 [==============================] - 0s - loss: 5.8364 - val_loss: 1.8358
Epoch 247/1000
1000/1000 [==============================] - 0s - loss: 4.9335 - val_loss: 1.8223
Epoch 248/1000
1000/1000 [==============================] - 0s - loss: 7.4502 - val_loss: 1.9656
Epoch 249/1000
1000/1000 [==============================] - 0s - loss: 4.8748 - val_loss: 1.7496
Epoch 250/1000
1000/1000 [==============================] - 0s - loss: 4.8132 - val_loss: 1.8237
Epoch 251/1000
1000/1000 [==============================] - 0s - loss: 4.9389 - val_loss: 1.7756
Epoch 252/1000
1000/1000 [==============================] - 0s - loss: 5.1955 - val_loss: 1.8212
Epoch 253/1000
1000/1000 [==============================] - 0s - loss: 5.0690 - val_loss: 1.8822
Epoch 254/1000
1000/1000 [==============================] - 0s - loss: 4.8552 - val_loss: 1.7645
Epoch 255/1000
1000/1000 [==============================] - 0s - loss: 5.2078 - val_loss: 1.7511
Epoch 256/1000
1000/1000 [==============================] - 0s - loss: 4.8711 - val_loss: 1.8794
Epoch 257/1000
1000/1000 [==============================] - 0s - loss: 5.6251 - val_loss: 1.9501
Epoch 258/1000
1000/1000 [==============================] - 0s - loss: 4.8966 - val_loss: 1.8802
Epoch 259/1000
1000/1000 [==============================] - 0s - loss: 5.1593 - val_loss: 1.8005
Epoch 260/1000
1000/1000 [==============================] - 0s - loss: 4.7745 - val_loss: 1.8009
Epoch 261/1000
1000/1000 [==============================] - 0s - loss: 5.0862 - val_loss: 1.7933
Epoch 262/1000
1000/1000 [==============================] - 0s - loss: 5.0474 - val_loss: 1.8494
Epoch 263/1000
1000/1000 [==============================] - 0s - loss: 4.7612 - val_loss: 1.6773
Epoch 264/1000
1000/1000 [==============================] - 0s - loss: 4.7505 - val_loss: 1.7475
Epoch 265/1000
1000/1000 [==============================] - 0s - loss: 5.3794 - val_loss: 1.6749
Epoch 266/1000
1000/1000 [==============================] - 0s - loss: 5.0416 - val_loss: 1.7070
Epoch 267/1000
1000/1000 [==============================] - 0s - loss: 5.4166 - val_loss: 1.6760
Epoch 268/1000
1000/1000 [==============================] - 0s - loss: 4.9895 - val_loss: 1.7043
Epoch 269/1000
1000/1000 [==============================] - 0s - loss: 5.0753 - val_loss: 1.6818
Epoch 270/1000
1000/1000 [==============================] - 0s - loss: 4.9247 - val_loss: 1.6460
Epoch 271/1000
1000/1000 [==============================] - 0s - loss: 4.4932 - val_loss: 1.6879
Epoch 272/1000
1000/1000 [==============================] - 0s - loss: 4.9594 - val_loss: 1.7169
Epoch 273/1000
1000/1000 [==============================] - 0s - loss: 5.1647 - val_loss: 1.7414
Epoch 274/1000
1000/1000 [==============================] - 0s - loss: 4.7437 - val_loss: 1.7012
Epoch 275/1000
1000/1000 [==============================] - 0s - loss: 4.6980 - val_loss: 1.7774
Epoch 276/1000
1000/1000 [==============================] - 0s - loss: 4.7067 - val_loss: 1.6650
Epoch 277/1000
1000/1000 [==============================] - 0s - loss: 5.5052 - val_loss: 1.6868
Epoch 278/1000
1000/1000 [==============================] - 0s - loss: 5.3209 - val_loss: 1.7320
Epoch 279/1000
1000/1000 [==============================] - 0s - loss: 4.7842 - val_loss: 1.8526
Epoch 280/1000
1000/1000 [==============================] - 0s - loss: 5.1266 - val_loss: 1.6980
Epoch 281/1000
1000/1000 [==============================] - 0s - loss: 4.8226 - val_loss: 1.7242
Epoch 282/1000
1000/1000 [==============================] - 0s - loss: 4.7843 - val_loss: 2.1063
Epoch 283/1000
1000/1000 [==============================] - 0s - loss: 4.7163 - val_loss: 1.6538
Epoch 284/1000
1000/1000 [==============================] - 0s - loss: 4.6420 - val_loss: 1.6615
Epoch 285/1000
1000/1000 [==============================] - 0s - loss: 4.3938 - val_loss: 1.6032
Epoch 286/1000
1000/1000 [==============================] - 0s - loss: 4.3345 - val_loss: 1.7813
Epoch 287/1000
1000/1000 [==============================] - 0s - loss: 5.2474 - val_loss: 1.5851
Epoch 288/1000
1000/1000 [==============================] - 0s - loss: 4.3427 - val_loss: 1.5918
Epoch 289/1000
1000/1000 [==============================] - 0s - loss: 4.6263 - val_loss: 1.6451
Epoch 290/1000
1000/1000 [==============================] - 0s - loss: 4.4756 - val_loss: 1.6702
Epoch 291/1000
1000/1000 [==============================] - 0s - loss: 4.5055 - val_loss: 1.6083
Epoch 292/1000
1000/1000 [==============================] - 0s - loss: 4.2342 - val_loss: 1.5477
Epoch 293/1000
1000/1000 [==============================] - 0s - loss: 4.5968 - val_loss: 1.6296
Epoch 294/1000
1000/1000 [==============================] - 0s - loss: 4.2356 - val_loss: 1.5457
Epoch 295/1000
1000/1000 [==============================] - 0s - loss: 4.3566 - val_loss: 1.6291
Epoch 296/1000
1000/1000 [==============================] - 0s - loss: 5.4404 - val_loss: 1.5963
Epoch 297/1000
1000/1000 [==============================] - 0s - loss: 4.8631 - val_loss: 1.5646
Epoch 298/1000
1000/1000 [==============================] - 0s - loss: 4.2691 - val_loss: 1.5692
Epoch 299/1000
1000/1000 [==============================] - 0s - loss: 4.3184 - val_loss: 1.5635
Epoch 300/1000
1000/1000 [==============================] - 0s - loss: 4.4139 - val_loss: 1.5934
Epoch 301/1000
1000/1000 [==============================] - 0s - loss: 5.1752 - val_loss: 1.7112
Epoch 302/1000
1000/1000 [==============================] - 0s - loss: 4.4361 - val_loss: 1.5276
Epoch 303/1000
1000/1000 [==============================] - 0s - loss: 4.4239 - val_loss: 1.6038
Epoch 304/1000
1000/1000 [==============================] - 0s - loss: 4.4984 - val_loss: 1.6551
Epoch 305/1000
1000/1000 [==============================] - 0s - loss: 4.5287 - val_loss: 1.5866
Epoch 306/1000
1000/1000 [==============================] - 0s - loss: 4.3814 - val_loss: 1.5505
Epoch 307/1000
1000/1000 [==============================] - 0s - loss: 4.4361 - val_loss: 1.5174
Epoch 308/1000
1000/1000 [==============================] - 0s - loss: 4.2072 - val_loss: 1.6701
Epoch 309/1000
1000/1000 [==============================] - 0s - loss: 4.5587 - val_loss: 1.8835
Epoch 310/1000
1000/1000 [==============================] - 0s - loss: 4.2399 - val_loss: 1.5188
Epoch 311/1000
1000/1000 [==============================] - 0s - loss: 4.2844 - val_loss: 1.5002
Epoch 312/1000
1000/1000 [==============================] - 0s - loss: 4.1416 - val_loss: 1.4664
Epoch 313/1000
1000/1000 [==============================] - 0s - loss: 4.0652 - val_loss: 1.4843
Epoch 314/1000
1000/1000 [==============================] - 0s - loss: 4.0993 - val_loss: 1.4815
Epoch 315/1000
1000/1000 [==============================] - 0s - loss: 4.6183 - val_loss: 1.5138
Epoch 316/1000
1000/1000 [==============================] - 0s - loss: 4.2764 - val_loss: 1.5214
Epoch 317/1000
1000/1000 [==============================] - 0s - loss: 4.1352 - val_loss: 1.5135
Epoch 318/1000
1000/1000 [==============================] - 0s - loss: 4.3088 - val_loss: 1.4791
Epoch 319/1000
1000/1000 [==============================] - 0s - loss: 4.3150 - val_loss: 1.4450
Epoch 320/1000
1000/1000 [==============================] - 0s - loss: 4.3982 - val_loss: 1.4721
Epoch 321/1000
1000/1000 [==============================] - 0s - loss: 4.4248 - val_loss: 1.4721
Epoch 322/1000
1000/1000 [==============================] - 0s - loss: 4.0368 - val_loss: 1.5449
Epoch 323/1000
1000/1000 [==============================] - 0s - loss: 4.5626 - val_loss: 1.4728
Epoch 324/1000
1000/1000 [==============================] - 0s - loss: 4.4107 - val_loss: 1.5371
Epoch 325/1000
1000/1000 [==============================] - 0s - loss: 3.9914 - val_loss: 1.6037
Epoch 326/1000
1000/1000 [==============================] - 0s - loss: 4.2241 - val_loss: 1.4403
Epoch 327/1000
1000/1000 [==============================] - 0s - loss: 3.9380 - val_loss: 1.4779
Epoch 328/1000
1000/1000 [==============================] - 0s - loss: 3.9654 - val_loss: 1.5436
Epoch 329/1000
1000/1000 [==============================] - 0s - loss: 4.0526 - val_loss: 1.4452
Epoch 330/1000
1000/1000 [==============================] - 0s - loss: 4.5945 - val_loss: 1.4740
Epoch 331/1000
1000/1000 [==============================] - 0s - loss: 4.0486 - val_loss: 1.4581
Epoch 332/1000
1000/1000 [==============================] - 0s - loss: 4.0772 - val_loss: 1.4331
Epoch 333/1000
1000/1000 [==============================] - 0s - loss: 4.1690 - val_loss: 1.4559
Epoch 334/1000
1000/1000 [==============================] - 0s - loss: 3.9304 - val_loss: 1.5141
Epoch 335/1000
1000/1000 [==============================] - 0s - loss: 3.9179 - val_loss: 1.4685
Epoch 336/1000
1000/1000 [==============================] - 0s - loss: 3.9820 - val_loss: 1.4568
Epoch 337/1000
1000/1000 [==============================] - 0s - loss: 3.9058 - val_loss: 1.4708
Epoch 338/1000
1000/1000 [==============================] - 0s - loss: 3.9854 - val_loss: 1.5246
Epoch 339/1000
1000/1000 [==============================] - 0s - loss: 3.9531 - val_loss: 1.4273
Epoch 340/1000
1000/1000 [==============================] - 0s - loss: 4.1978 - val_loss: 1.4683
Epoch 341/1000
1000/1000 [==============================] - 0s - loss: 3.7256 - val_loss: 1.4025
Epoch 342/1000
1000/1000 [==============================] - 0s - loss: 3.7908 - val_loss: 1.6222
Epoch 343/1000
1000/1000 [==============================] - 0s - loss: 3.8527 - val_loss: 1.3715
Epoch 344/1000
1000/1000 [==============================] - 0s - loss: 3.8249 - val_loss: 1.4248
Epoch 345/1000
1000/1000 [==============================] - 0s - loss: 4.0525 - val_loss: 1.5124
Epoch 346/1000
1000/1000 [==============================] - 0s - loss: 4.0610 - val_loss: 1.4030
Epoch 347/1000
1000/1000 [==============================] - 0s - loss: 3.8029 - val_loss: 1.3972
Epoch 348/1000
1000/1000 [==============================] - 0s - loss: 3.8701 - val_loss: 1.3936
Epoch 349/1000
1000/1000 [==============================] - 0s - loss: 3.8329 - val_loss: 1.4767
Epoch 350/1000
1000/1000 [==============================] - 0s - loss: 3.6555 - val_loss: 1.4410
Epoch 351/1000
1000/1000 [==============================] - 0s - loss: 3.7998 - val_loss: 1.4086
Epoch 352/1000
1000/1000 [==============================] - 0s - loss: 3.7985 - val_loss: 1.5960
Epoch 353/1000
1000/1000 [==============================] - 0s - loss: 3.8635 - val_loss: 1.4156
Epoch 354/1000
1000/1000 [==============================] - 0s - loss: 3.6989 - val_loss: 1.5499
Epoch 355/1000
1000/1000 [==============================] - 0s - loss: 3.7531 - val_loss: 1.4220
Epoch 356/1000
1000/1000 [==============================] - 0s - loss: 3.7418 - val_loss: 1.4860
Epoch 357/1000
1000/1000 [==============================] - 0s - loss: 4.0641 - val_loss: 1.3936
Epoch 358/1000
1000/1000 [==============================] - 0s - loss: 3.8017 - val_loss: 1.4165
Epoch 359/1000
1000/1000 [==============================] - 0s - loss: 3.9504 - val_loss: 1.4143
Epoch 360/1000
1000/1000 [==============================] - 0s - loss: 3.9387 - val_loss: 1.4019
Epoch 361/1000
1000/1000 [==============================] - 0s - loss: 3.7198 - val_loss: 1.3621
Epoch 362/1000
1000/1000 [==============================] - 0s - loss: 3.5907 - val_loss: 1.4138
Epoch 363/1000
1000/1000 [==============================] - 0s - loss: 3.8930 - val_loss: 1.3453
Epoch 364/1000
1000/1000 [==============================] - 0s - loss: 4.1985 - val_loss: 1.3463
Epoch 365/1000
1000/1000 [==============================] - 0s - loss: 3.6845 - val_loss: 1.4281
Epoch 366/1000
1000/1000 [==============================] - 0s - loss: 3.5891 - val_loss: 1.3461
Epoch 367/1000
1000/1000 [==============================] - 0s - loss: 3.7422 - val_loss: 1.3962
Epoch 368/1000
1000/1000 [==============================] - 0s - loss: 3.8173 - val_loss: 1.3250
Epoch 369/1000
1000/1000 [==============================] - 0s - loss: 3.7576 - val_loss: 1.4080
Epoch 370/1000
1000/1000 [==============================] - 0s - loss: 3.6743 - val_loss: 1.3031
Epoch 371/1000
1000/1000 [==============================] - 0s - loss: 3.5999 - val_loss: 1.3520
Epoch 372/1000
1000/1000 [==============================] - 0s - loss: 3.7122 - val_loss: 1.3753
Epoch 373/1000
1000/1000 [==============================] - 0s - loss: 3.5977 - val_loss: 1.3434
Epoch 374/1000
1000/1000 [==============================] - 0s - loss: 3.3632 - val_loss: 1.3463
Epoch 375/1000
1000/1000 [==============================] - 0s - loss: 3.6891 - val_loss: 1.3544
Epoch 376/1000
1000/1000 [==============================] - 0s - loss: 3.8055 - val_loss: 1.4010
Epoch 377/1000
1000/1000 [==============================] - 0s - loss: 3.5171 - val_loss: 1.3423
Epoch 378/1000
1000/1000 [==============================] - 0s - loss: 3.5057 - val_loss: 1.3340
Epoch 379/1000
1000/1000 [==============================] - 0s - loss: 3.5141 - val_loss: 1.3199
Epoch 380/1000
1000/1000 [==============================] - 0s - loss: 3.3356 - val_loss: 1.2895
Epoch 381/1000
1000/1000 [==============================] - 0s - loss: 3.4462 - val_loss: 1.3746
Epoch 382/1000
1000/1000 [==============================] - 0s - loss: 3.7217 - val_loss: 1.3450
Epoch 383/1000
1000/1000 [==============================] - 0s - loss: 3.3330 - val_loss: 1.2722
Epoch 384/1000
1000/1000 [==============================] - 0s - loss: 3.4329 - val_loss: 1.3198
Epoch 385/1000
1000/1000 [==============================] - 0s - loss: 3.4734 - val_loss: 1.4865
Epoch 386/1000
1000/1000 [==============================] - 0s - loss: 3.3372 - val_loss: 1.3577
Epoch 387/1000
1000/1000 [==============================] - 0s - loss: 3.3525 - val_loss: 1.2888
Epoch 388/1000
1000/1000 [==============================] - 0s - loss: 3.6556 - val_loss: 1.3492
Epoch 389/1000
1000/1000 [==============================] - 0s - loss: 3.5405 - val_loss: 1.4373
Epoch 390/1000
1000/1000 [==============================] - 0s - loss: 3.4748 - val_loss: 1.2724
Epoch 391/1000
1000/1000 [==============================] - 0s - loss: 3.4686 - val_loss: 1.3646
Epoch 392/1000
1000/1000 [==============================] - 0s - loss: 3.3313 - val_loss: 1.3004
Epoch 393/1000
1000/1000 [==============================] - 0s - loss: 3.4369 - val_loss: 1.2942
Epoch 394/1000
1000/1000 [==============================] - 0s - loss: 3.4265 - val_loss: 1.3331
Epoch 395/1000
1000/1000 [==============================] - 0s - loss: 3.7890 - val_loss: 1.3160
Epoch 396/1000
1000/1000 [==============================] - 0s - loss: 3.3242 - val_loss: 1.3032
Epoch 397/1000
1000/1000 [==============================] - 0s - loss: 3.3978 - val_loss: 1.2830
Epoch 398/1000
1000/1000 [==============================] - 0s - loss: 3.2636 - val_loss: 1.3109
Epoch 399/1000
1000/1000 [==============================] - 0s - loss: 3.4246 - val_loss: 1.3103
Epoch 400/1000
1000/1000 [==============================] - 0s - loss: 3.4630 - val_loss: 1.2256
Epoch 401/1000
1000/1000 [==============================] - 0s - loss: 3.1528 - val_loss: 1.5458
Epoch 402/1000
1000/1000 [==============================] - 0s - loss: 3.5376 - val_loss: 1.3038
Epoch 403/1000
1000/1000 [==============================] - 0s - loss: 3.1854 - val_loss: 1.3035
Epoch 404/1000
1000/1000 [==============================] - 0s - loss: 3.4468 - val_loss: 1.3616
Epoch 405/1000
1000/1000 [==============================] - 0s - loss: 3.1716 - val_loss: 1.2360
Epoch 406/1000
1000/1000 [==============================] - 0s - loss: 3.1606 - val_loss: 1.2405
Epoch 407/1000
1000/1000 [==============================] - 0s - loss: 3.2123 - val_loss: 1.3198
Epoch 408/1000
1000/1000 [==============================] - 0s - loss: 3.5628 - val_loss: 1.2907
Epoch 409/1000
1000/1000 [==============================] - 0s - loss: 3.1516 - val_loss: 1.2468
Epoch 410/1000
1000/1000 [==============================] - 0s - loss: 3.2502 - val_loss: 1.2643
Epoch 411/1000
1000/1000 [==============================] - 0s - loss: 3.4081 - val_loss: 1.3621
Epoch 412/1000
1000/1000 [==============================] - 0s - loss: 3.1152 - val_loss: 1.2514
Epoch 413/1000
1000/1000 [==============================] - 0s - loss: 3.1616 - val_loss: 1.2453
Epoch 414/1000
1000/1000 [==============================] - 0s - loss: 3.1605 - val_loss: 1.3045
Epoch 415/1000
1000/1000 [==============================] - 0s - loss: 3.3035 - val_loss: 1.2320
Epoch 416/1000
1000/1000 [==============================] - 0s - loss: 3.1016 - val_loss: 1.2576
Epoch 417/1000
1000/1000 [==============================] - 0s - loss: 3.3995 - val_loss: 1.2330
Epoch 418/1000
1000/1000 [==============================] - 0s - loss: 3.1856 - val_loss: 1.2254
Epoch 419/1000
1000/1000 [==============================] - 0s - loss: 3.1210 - val_loss: 1.2400
Epoch 420/1000
1000/1000 [==============================] - 0s - loss: 3.0865 - val_loss: 1.2711
Epoch 421/1000
1000/1000 [==============================] - 0s - loss: 3.0854 - val_loss: 1.2306
Epoch 422/1000
1000/1000 [==============================] - 0s - loss: 3.0749 - val_loss: 1.2509
Epoch 423/1000
1000/1000 [==============================] - 0s - loss: 2.9816 - val_loss: 1.2313
Epoch 424/1000
1000/1000 [==============================] - 0s - loss: 3.1901 - val_loss: 1.2360
Epoch 425/1000
1000/1000 [==============================] - 0s - loss: 3.0176 - val_loss: 1.2494
Epoch 426/1000
1000/1000 [==============================] - 0s - loss: 3.1368 - val_loss: 1.3387
Epoch 427/1000
1000/1000 [==============================] - 0s - loss: 3.4224 - val_loss: 1.2553
Epoch 428/1000
1000/1000 [==============================] - 0s - loss: 3.1288 - val_loss: 1.3322
Epoch 429/1000
1000/1000 [==============================] - 0s - loss: 3.0693 - val_loss: 1.2097
Epoch 430/1000
1000/1000 [==============================] - 0s - loss: 3.0662 - val_loss: 1.2320
Epoch 431/1000
1000/1000 [==============================] - 0s - loss: 3.0169 - val_loss: 1.2011
Epoch 432/1000
1000/1000 [==============================] - 0s - loss: 2.9856 - val_loss: 1.2156
Epoch 433/1000
1000/1000 [==============================] - 0s - loss: 3.0965 - val_loss: 1.2015
Epoch 434/1000
1000/1000 [==============================] - 0s - loss: 3.1524 - val_loss: 1.1974
Epoch 435/1000
1000/1000 [==============================] - 0s - loss: 2.8962 - val_loss: 1.3365
Epoch 436/1000
1000/1000 [==============================] - 0s - loss: 3.0729 - val_loss: 1.2129
Epoch 437/1000
1000/1000 [==============================] - 0s - loss: 3.0742 - val_loss: 1.1555
Epoch 438/1000
1000/1000 [==============================] - 0s - loss: 3.1804 - val_loss: 1.1451
Epoch 439/1000
1000/1000 [==============================] - 0s - loss: 3.0216 - val_loss: 1.1788
Epoch 440/1000
1000/1000 [==============================] - 0s - loss: 3.1646 - val_loss: 1.1765
Epoch 441/1000
1000/1000 [==============================] - 0s - loss: 2.9585 - val_loss: 1.1860
Epoch 442/1000
1000/1000 [==============================] - 0s - loss: 2.9413 - val_loss: 1.1641
Epoch 443/1000
1000/1000 [==============================] - 0s - loss: 3.0217 - val_loss: 1.2214
Epoch 444/1000
1000/1000 [==============================] - 0s - loss: 2.9857 - val_loss: 1.1852
Epoch 445/1000
1000/1000 [==============================] - 0s - loss: 2.9178 - val_loss: 1.1918
Epoch 446/1000
1000/1000 [==============================] - 0s - loss: 2.8830 - val_loss: 1.1650
Epoch 447/1000
1000/1000 [==============================] - 0s - loss: 2.9957 - val_loss: 1.2156
Epoch 448/1000
1000/1000 [==============================] - 0s - loss: 2.9591 - val_loss: 1.2448
Epoch 449/1000
1000/1000 [==============================] - 0s - loss: 2.8875 - val_loss: 1.2241
Epoch 450/1000
1000/1000 [==============================] - 0s - loss: 3.1132 - val_loss: 1.1950
Epoch 451/1000
1000/1000 [==============================] - 0s - loss: 2.9023 - val_loss: 1.2047
Epoch 452/1000
1000/1000 [==============================] - 0s - loss: 3.0850 - val_loss: 1.1992
Epoch 453/1000
1000/1000 [==============================] - 0s - loss: 2.8020 - val_loss: 1.1576
Epoch 454/1000
1000/1000 [==============================] - 0s - loss: 2.9174 - val_loss: 1.1966
Epoch 455/1000
1000/1000 [==============================] - 0s - loss: 2.8493 - val_loss: 1.2833
Epoch 456/1000
1000/1000 [==============================] - 0s - loss: 2.9748 - val_loss: 1.1772
Epoch 457/1000
1000/1000 [==============================] - 0s - loss: 2.8099 - val_loss: 1.1516
Epoch 458/1000
1000/1000 [==============================] - 0s - loss: 2.8399 - val_loss: 1.1386
Epoch 459/1000
1000/1000 [==============================] - 0s - loss: 2.7897 - val_loss: 1.1393
Epoch 460/1000
1000/1000 [==============================] - 0s - loss: 2.7688 - val_loss: 1.2351
Epoch 461/1000
1000/1000 [==============================] - 0s - loss: 2.8065 - val_loss: 1.2175
Epoch 462/1000
1000/1000 [==============================] - 0s - loss: 2.7956 - val_loss: 1.2051
Epoch 463/1000
1000/1000 [==============================] - 0s - loss: 2.8266 - val_loss: 1.1439
Epoch 464/1000
1000/1000 [==============================] - 0s - loss: 2.7337 - val_loss: 1.1556
Epoch 465/1000
1000/1000 [==============================] - 0s - loss: 2.7019 - val_loss: 1.1301
Epoch 466/1000
1000/1000 [==============================] - 0s - loss: 2.8598 - val_loss: 1.1581
Epoch 467/1000
1000/1000 [==============================] - 0s - loss: 2.9306 - val_loss: 1.1465
Epoch 468/1000
1000/1000 [==============================] - 0s - loss: 2.7184 - val_loss: 1.1159
Epoch 469/1000
1000/1000 [==============================] - 0s - loss: 2.8028 - val_loss: 1.1306
Epoch 470/1000
1000/1000 [==============================] - 0s - loss: 2.8081 - val_loss: 1.1470
Epoch 471/1000
1000/1000 [==============================] - 0s - loss: 2.7909 - val_loss: 1.1723
Epoch 472/1000
1000/1000 [==============================] - 0s - loss: 2.7085 - val_loss: 1.1230
Epoch 473/1000
1000/1000 [==============================] - 0s - loss: 2.7357 - val_loss: 1.2527
Epoch 474/1000
1000/1000 [==============================] - 0s - loss: 2.6820 - val_loss: 1.1513
Epoch 475/1000
1000/1000 [==============================] - 0s - loss: 2.7039 - val_loss: 1.2557
Epoch 476/1000
1000/1000 [==============================] - 0s - loss: 2.6805 - val_loss: 1.1363
Epoch 477/1000
1000/1000 [==============================] - 0s - loss: 2.6377 - val_loss: 1.1292
Epoch 478/1000
1000/1000 [==============================] - 0s - loss: 2.6816 - val_loss: 1.1742
Epoch 479/1000
1000/1000 [==============================] - 0s - loss: 2.6793 - val_loss: 1.1378
Epoch 480/1000
1000/1000 [==============================] - 0s - loss: 2.5900 - val_loss: 1.1523
Epoch 481/1000
1000/1000 [==============================] - 0s - loss: 2.6551 - val_loss: 1.2817
Epoch 482/1000
1000/1000 [==============================] - 0s - loss: 3.0076 - val_loss: 1.1451
Epoch 483/1000
1000/1000 [==============================] - 0s - loss: 2.5452 - val_loss: 1.1119
Epoch 484/1000
1000/1000 [==============================] - 0s - loss: 2.5741 - val_loss: 1.1191
Epoch 485/1000
1000/1000 [==============================] - 0s - loss: 2.5944 - val_loss: 1.1668
Epoch 486/1000
1000/1000 [==============================] - 0s - loss: 2.6158 - val_loss: 1.1653
Epoch 487/1000
1000/1000 [==============================] - 0s - loss: 2.5927 - val_loss: 1.1492
Epoch 488/1000
1000/1000 [==============================] - 0s - loss: 2.5905 - val_loss: 1.1450
Epoch 489/1000
1000/1000 [==============================] - 0s - loss: 2.7158 - val_loss: 1.1482
Epoch 490/1000
1000/1000 [==============================] - 0s - loss: 2.5416 - val_loss: 1.1397
Epoch 491/1000
1000/1000 [==============================] - 0s - loss: 2.6483 - val_loss: 1.1114
Epoch 492/1000
1000/1000 [==============================] - 0s - loss: 2.5876 - val_loss: 1.1885
Epoch 493/1000
1000/1000 [==============================] - 0s - loss: 2.4975 - val_loss: 1.1736
Epoch 494/1000
1000/1000 [==============================] - 0s - loss: 2.7264 - val_loss: 1.1034
Epoch 495/1000
1000/1000 [==============================] - 0s - loss: 2.6085 - val_loss: 1.1054
Epoch 496/1000
1000/1000 [==============================] - 0s - loss: 2.5812 - val_loss: 1.0697
Epoch 497/1000
1000/1000 [==============================] - 0s - loss: 2.5497 - val_loss: 1.0949
Epoch 498/1000
1000/1000 [==============================] - 0s - loss: 2.5118 - val_loss: 1.1316
Epoch 499/1000
1000/1000 [==============================] - 0s - loss: 2.5126 - val_loss: 1.1171
Epoch 500/1000
1000/1000 [==============================] - 0s - loss: 2.5302 - val_loss: 1.1454
Epoch 501/1000
1000/1000 [==============================] - 0s - loss: 2.6670 - val_loss: 1.1368
Epoch 502/1000
1000/1000 [==============================] - 0s - loss: 2.5230 - val_loss: 1.0802
Epoch 503/1000
1000/1000 [==============================] - 0s - loss: 2.5407 - val_loss: 1.1406
Epoch 504/1000
1000/1000 [==============================] - 0s - loss: 2.5033 - val_loss: 1.1063
Epoch 505/1000
1000/1000 [==============================] - 0s - loss: 2.4372 - val_loss: 1.0746
Epoch 506/1000
1000/1000 [==============================] - 0s - loss: 2.8048 - val_loss: 1.1215
Epoch 507/1000
1000/1000 [==============================] - 0s - loss: 2.5310 - val_loss: 1.1476
Epoch 508/1000
1000/1000 [==============================] - 0s - loss: 2.6959 - val_loss: 1.1008
Epoch 509/1000
1000/1000 [==============================] - 0s - loss: 2.4694 - val_loss: 1.1173
Epoch 510/1000
1000/1000 [==============================] - 0s - loss: 2.4363 - val_loss: 1.1139
Epoch 511/1000
1000/1000 [==============================] - 0s - loss: 2.4304 - val_loss: 1.0867
Epoch 512/1000
1000/1000 [==============================] - 0s - loss: 2.5050 - val_loss: 1.0961
Epoch 513/1000
1000/1000 [==============================] - 0s - loss: 2.6045 - val_loss: 1.0606
Epoch 514/1000
1000/1000 [==============================] - 0s - loss: 2.4590 - val_loss: 1.1199
Epoch 515/1000
1000/1000 [==============================] - 0s - loss: 2.4577 - val_loss: 1.0537
Epoch 516/1000
1000/1000 [==============================] - 0s - loss: 2.4802 - val_loss: 1.0955
Epoch 517/1000
1000/1000 [==============================] - 0s - loss: 2.3618 - val_loss: 1.0565
Epoch 518/1000
1000/1000 [==============================] - 0s - loss: 2.3547 - val_loss: 1.0874
Epoch 519/1000
1000/1000 [==============================] - 0s - loss: 2.3889 - val_loss: 1.0919
Epoch 520/1000
1000/1000 [==============================] - 0s - loss: 2.3782 - val_loss: 1.0548
Epoch 521/1000
1000/1000 [==============================] - 0s - loss: 2.3856 - val_loss: 1.0751
Epoch 522/1000
1000/1000 [==============================] - 0s - loss: 2.3699 - val_loss: 1.0703
Epoch 523/1000
1000/1000 [==============================] - 0s - loss: 2.3018 - val_loss: 1.0697
Epoch 524/1000
1000/1000 [==============================] - 0s - loss: 2.3426 - val_loss: 1.0832
Epoch 525/1000
1000/1000 [==============================] - 0s - loss: 2.3445 - val_loss: 1.1067
Epoch 526/1000
1000/1000 [==============================] - 0s - loss: 2.4015 - val_loss: 1.0699
Epoch 527/1000
1000/1000 [==============================] - 0s - loss: 2.3245 - val_loss: 1.0796
Epoch 528/1000
1000/1000 [==============================] - 0s - loss: 2.3811 - val_loss: 1.0650
Epoch 529/1000
1000/1000 [==============================] - 0s - loss: 2.3500 - val_loss: 1.0867
Epoch 530/1000
1000/1000 [==============================] - 0s - loss: 2.2619 - val_loss: 1.0673
Epoch 531/1000
1000/1000 [==============================] - 0s - loss: 2.3369 - val_loss: 1.0956
Epoch 532/1000
1000/1000 [==============================] - 0s - loss: 2.2610 - val_loss: 1.0784
Epoch 533/1000
1000/1000 [==============================] - 0s - loss: 2.3140 - val_loss: 1.0765
Epoch 534/1000
1000/1000 [==============================] - 0s - loss: 2.3029 - val_loss: 1.0812
Epoch 535/1000
1000/1000 [==============================] - 0s - loss: 2.3277 - val_loss: 1.0800
Epoch 536/1000
1000/1000 [==============================] - 0s - loss: 2.3304 - val_loss: 1.0620
Epoch 537/1000
1000/1000 [==============================] - 0s - loss: 2.3067 - val_loss: 1.0624
Epoch 538/1000
1000/1000 [==============================] - 0s - loss: 2.3246 - val_loss: 1.1249
Epoch 539/1000
1000/1000 [==============================] - 0s - loss: 2.2427 - val_loss: 1.0140
Epoch 540/1000
1000/1000 [==============================] - 0s - loss: 2.2458 - val_loss: 1.0500
Epoch 541/1000
1000/1000 [==============================] - 0s - loss: 2.2777 - val_loss: 1.1070
Epoch 542/1000
1000/1000 [==============================] - 0s - loss: 2.2328 - val_loss: 1.0822
Epoch 543/1000
1000/1000 [==============================] - 0s - loss: 2.2284 - val_loss: 1.0575
Epoch 544/1000
1000/1000 [==============================] - 0s - loss: 2.3304 - val_loss: 1.1047
Epoch 545/1000
1000/1000 [==============================] - 0s - loss: 2.2135 - val_loss: 1.0404
Epoch 546/1000
1000/1000 [==============================] - 0s - loss: 2.2131 - val_loss: 1.1252
Epoch 547/1000
1000/1000 [==============================] - 0s - loss: 2.2372 - val_loss: 1.0617
Epoch 548/1000
1000/1000 [==============================] - 0s - loss: 2.2139 - val_loss: 1.0418
Epoch 549/1000
1000/1000 [==============================] - 0s - loss: 2.2034 - val_loss: 1.0868
Epoch 550/1000
1000/1000 [==============================] - 0s - loss: 2.2416 - val_loss: 1.0971
Epoch 551/1000
1000/1000 [==============================] - 0s - loss: 2.1991 - val_loss: 1.0807
Epoch 552/1000
1000/1000 [==============================] - 0s - loss: 2.2303 - val_loss: 1.0338
Epoch 553/1000
1000/1000 [==============================] - 0s - loss: 2.1963 - val_loss: 1.0546
Epoch 554/1000
1000/1000 [==============================] - 0s - loss: 2.1680 - val_loss: 1.0571
Epoch 555/1000
1000/1000 [==============================] - 0s - loss: 2.1757 - val_loss: 1.0145
Epoch 556/1000
1000/1000 [==============================] - 0s - loss: 2.1041 - val_loss: 1.0709
Epoch 557/1000
1000/1000 [==============================] - 0s - loss: 2.1484 - val_loss: 1.0529
Epoch 558/1000
1000/1000 [==============================] - 0s - loss: 2.1420 - val_loss: 1.0439
Epoch 559/1000
1000/1000 [==============================] - 0s - loss: 2.1781 - val_loss: 1.0379
Epoch 560/1000
1000/1000 [==============================] - 0s - loss: 2.1409 - val_loss: 1.0377
Epoch 561/1000
1000/1000 [==============================] - 0s - loss: 2.1260 - val_loss: 1.0656
Epoch 562/1000
1000/1000 [==============================] - 0s - loss: 2.1483 - val_loss: 1.0372
Epoch 563/1000
1000/1000 [==============================] - 0s - loss: 2.1488 - val_loss: 1.1455
Epoch 564/1000
1000/1000 [==============================] - 0s - loss: 2.1697 - val_loss: 1.0341
Epoch 565/1000
1000/1000 [==============================] - 0s - loss: 2.1633 - val_loss: 1.0140
Epoch 566/1000
1000/1000 [==============================] - 0s - loss: 2.0734 - val_loss: 1.0411
Epoch 567/1000
1000/1000 [==============================] - 0s - loss: 2.1073 - val_loss: 1.0327
Epoch 568/1000
1000/1000 [==============================] - 0s - loss: 2.1147 - val_loss: 1.0674
Epoch 569/1000
1000/1000 [==============================] - 0s - loss: 2.1226 - val_loss: 1.0694
Epoch 570/1000
1000/1000 [==============================] - 0s - loss: 2.1035 - val_loss: 1.0311
Epoch 571/1000
1000/1000 [==============================] - 0s - loss: 2.0905 - val_loss: 1.0627
Epoch 572/1000
1000/1000 [==============================] - 0s - loss: 2.1011 - val_loss: 1.0454
Epoch 573/1000
1000/1000 [==============================] - 0s - loss: 2.1024 - val_loss: 1.0497
Epoch 574/1000
1000/1000 [==============================] - 0s - loss: 2.0798 - val_loss: 1.0207
Epoch 575/1000
1000/1000 [==============================] - 0s - loss: 2.0158 - val_loss: 1.0562
Epoch 576/1000
1000/1000 [==============================] - 0s - loss: 2.0750 - val_loss: 1.0354
Epoch 577/1000
1000/1000 [==============================] - 0s - loss: 2.0301 - val_loss: 1.0176
Epoch 578/1000
1000/1000 [==============================] - 0s - loss: 2.0393 - val_loss: 1.0354
Epoch 579/1000
1000/1000 [==============================] - 0s - loss: 2.0453 - val_loss: 1.0520
Epoch 580/1000
1000/1000 [==============================] - 0s - loss: 2.0574 - val_loss: 1.0388
Epoch 581/1000
1000/1000 [==============================] - 0s - loss: 1.9956 - val_loss: 1.0173
Epoch 582/1000
1000/1000 [==============================] - 0s - loss: 1.9903 - val_loss: 1.0204
Epoch 583/1000
1000/1000 [==============================] - 0s - loss: 1.9995 - val_loss: 1.0449
Epoch 584/1000
1000/1000 [==============================] - 0s - loss: 1.9998 - val_loss: 1.0081
Epoch 585/1000
1000/1000 [==============================] - 0s - loss: 2.0703 - val_loss: 1.0106
Epoch 586/1000
1000/1000 [==============================] - 0s - loss: 2.0180 - val_loss: 1.0404
Epoch 587/1000
1000/1000 [==============================] - 0s - loss: 2.0087 - val_loss: 1.0387
Epoch 588/1000
1000/1000 [==============================] - 0s - loss: 1.9972 - val_loss: 1.0420
Epoch 589/1000
1000/1000 [==============================] - 0s - loss: 2.0276 - val_loss: 1.0096
Epoch 590/1000
1000/1000 [==============================] - 0s - loss: 1.9768 - val_loss: 1.0235
Epoch 591/1000
1000/1000 [==============================] - 0s - loss: 1.9792 - val_loss: 0.9913
Epoch 592/1000
1000/1000 [==============================] - 0s - loss: 1.9667 - val_loss: 1.0316
Epoch 593/1000
1000/1000 [==============================] - 0s - loss: 1.9429 - val_loss: 0.9999
Epoch 594/1000
1000/1000 [==============================] - 0s - loss: 1.9983 - val_loss: 1.0042
Epoch 595/1000
1000/1000 [==============================] - 0s - loss: 1.9688 - val_loss: 1.0139
Epoch 596/1000
1000/1000 [==============================] - 0s - loss: 1.9244 - val_loss: 1.0140
Epoch 597/1000
1000/1000 [==============================] - 0s - loss: 1.9763 - val_loss: 0.9972
Epoch 598/1000
1000/1000 [==============================] - 0s - loss: 2.0020 - val_loss: 0.9985
Epoch 599/1000
1000/1000 [==============================] - 0s - loss: 1.9658 - val_loss: 1.0136
Epoch 600/1000
1000/1000 [==============================] - 0s - loss: 1.9730 - val_loss: 1.0554
Epoch 601/1000
1000/1000 [==============================] - 0s - loss: 1.9558 - val_loss: 1.0230
Epoch 602/1000
1000/1000 [==============================] - 0s - loss: 1.9409 - val_loss: 1.0121
Epoch 603/1000
1000/1000 [==============================] - 0s - loss: 1.9591 - val_loss: 1.0160
Epoch 604/1000
1000/1000 [==============================] - 0s - loss: 1.9264 - val_loss: 0.9973
Epoch 605/1000
1000/1000 [==============================] - 0s - loss: 1.8868 - val_loss: 1.0220
Epoch 606/1000
1000/1000 [==============================] - 0s - loss: 1.8714 - val_loss: 1.0012
Epoch 607/1000
1000/1000 [==============================] - 0s - loss: 1.9089 - val_loss: 1.0358
Epoch 608/1000
1000/1000 [==============================] - 0s - loss: 1.9080 - val_loss: 1.0182
Epoch 609/1000
1000/1000 [==============================] - 0s - loss: 1.8659 - val_loss: 1.0170
Epoch 610/1000
1000/1000 [==============================] - 0s - loss: 1.8979 - val_loss: 1.0024
Epoch 611/1000
1000/1000 [==============================] - 0s - loss: 1.8584 - val_loss: 1.0346
Epoch 612/1000
1000/1000 [==============================] - 0s - loss: 1.9113 - val_loss: 0.9852
Epoch 613/1000
1000/1000 [==============================] - 0s - loss: 1.8779 - val_loss: 0.9722
Epoch 614/1000
1000/1000 [==============================] - 0s - loss: 1.8638 - val_loss: 1.0219
Epoch 615/1000
1000/1000 [==============================] - 0s - loss: 1.8655 - val_loss: 1.0039
Epoch 616/1000
1000/1000 [==============================] - 0s - loss: 1.8953 - val_loss: 1.0224
Epoch 617/1000
1000/1000 [==============================] - 0s - loss: 1.8269 - val_loss: 0.9912
Epoch 618/1000
1000/1000 [==============================] - 0s - loss: 1.8578 - val_loss: 1.0184
Epoch 619/1000
1000/1000 [==============================] - 0s - loss: 1.8590 - val_loss: 0.9922
Epoch 620/1000
1000/1000 [==============================] - 0s - loss: 1.8310 - val_loss: 1.0156
Epoch 621/1000
1000/1000 [==============================] - 0s - loss: 1.8498 - val_loss: 0.9779
Epoch 622/1000
1000/1000 [==============================] - 0s - loss: 1.8453 - val_loss: 0.9875
Epoch 623/1000
1000/1000 [==============================] - 0s - loss: 1.8414 - val_loss: 0.9779
Epoch 624/1000
1000/1000 [==============================] - 0s - loss: 1.8414 - val_loss: 1.0015
Epoch 625/1000
1000/1000 [==============================] - 0s - loss: 1.8278 - val_loss: 1.0190
Epoch 626/1000
1000/1000 [==============================] - 0s - loss: 1.8070 - val_loss: 0.9867
Epoch 627/1000
1000/1000 [==============================] - 0s - loss: 1.8107 - val_loss: 0.9868
Epoch 628/1000
1000/1000 [==============================] - 0s - loss: 1.8100 - val_loss: 0.9647
Epoch 629/1000
1000/1000 [==============================] - 0s - loss: 1.7913 - val_loss: 0.9887
Epoch 630/1000
1000/1000 [==============================] - 0s - loss: 1.8140 - val_loss: 1.0041
Epoch 631/1000
1000/1000 [==============================] - 0s - loss: 1.7628 - val_loss: 0.9987
Epoch 632/1000
1000/1000 [==============================] - 0s - loss: 1.8529 - val_loss: 0.9623
Epoch 633/1000
1000/1000 [==============================] - 0s - loss: 1.7716 - val_loss: 0.9811
Epoch 634/1000
1000/1000 [==============================] - 0s - loss: 1.7625 - val_loss: 0.9896
Epoch 635/1000
1000/1000 [==============================] - 0s - loss: 1.7857 - val_loss: 0.9788
Epoch 636/1000
1000/1000 [==============================] - 0s - loss: 1.7422 - val_loss: 0.9909
Epoch 637/1000
1000/1000 [==============================] - 0s - loss: 1.7459 - val_loss: 0.9865
Epoch 638/1000
1000/1000 [==============================] - 0s - loss: 1.7683 - val_loss: 0.9919
Epoch 639/1000
1000/1000 [==============================] - 0s - loss: 1.7794 - val_loss: 0.9671
Epoch 640/1000
1000/1000 [==============================] - 0s - loss: 1.7514 - val_loss: 1.0198
Epoch 641/1000
1000/1000 [==============================] - 0s - loss: 1.7370 - val_loss: 0.9751
Epoch 642/1000
1000/1000 [==============================] - 0s - loss: 1.7237 - val_loss: 1.0063
Epoch 643/1000
1000/1000 [==============================] - 0s - loss: 1.7309 - val_loss: 1.0039
Epoch 644/1000
1000/1000 [==============================] - 0s - loss: 1.7135 - val_loss: 1.0007
Epoch 645/1000
1000/1000 [==============================] - 0s - loss: 1.7335 - val_loss: 0.9707
Epoch 646/1000
1000/1000 [==============================] - 0s - loss: 1.7401 - val_loss: 1.0034
Epoch 647/1000
1000/1000 [==============================] - 0s - loss: 1.7044 - val_loss: 0.9977
Epoch 648/1000
1000/1000 [==============================] - 0s - loss: 1.7322 - val_loss: 1.0234
Epoch 649/1000
1000/1000 [==============================] - 0s - loss: 1.7104 - val_loss: 0.9989
Epoch 650/1000
1000/1000 [==============================] - 0s - loss: 1.7333 - val_loss: 0.9960
Epoch 651/1000
1000/1000 [==============================] - 0s - loss: 1.7204 - val_loss: 0.9672
Epoch 652/1000
1000/1000 [==============================] - 0s - loss: 1.7204 - val_loss: 0.9729
Epoch 653/1000
1000/1000 [==============================] - 0s - loss: 1.7149 - val_loss: 0.9828
Epoch 654/1000
1000/1000 [==============================] - 0s - loss: 1.6889 - val_loss: 0.9728
Epoch 655/1000
1000/1000 [==============================] - 0s - loss: 1.6887 - val_loss: 0.9522
Epoch 656/1000
1000/1000 [==============================] - 0s - loss: 1.6883 - val_loss: 0.9790
Epoch 657/1000
1000/1000 [==============================] - 0s - loss: 1.6747 - val_loss: 1.0013
Epoch 658/1000
1000/1000 [==============================] - 0s - loss: 1.6666 - val_loss: 0.9945
Epoch 659/1000
1000/1000 [==============================] - 0s - loss: 1.6913 - val_loss: 1.0010
Epoch 660/1000
1000/1000 [==============================] - 0s - loss: 1.6768 - val_loss: 0.9871
Epoch 661/1000
1000/1000 [==============================] - 0s - loss: 1.6638 - val_loss: 0.9700
Epoch 662/1000
1000/1000 [==============================] - 0s - loss: 1.6747 - val_loss: 0.9677
Epoch 663/1000
1000/1000 [==============================] - 0s - loss: 1.6466 - val_loss: 0.9523
Epoch 664/1000
1000/1000 [==============================] - 0s - loss: 1.6839 - val_loss: 0.9745
Epoch 665/1000
1000/1000 [==============================] - 0s - loss: 1.6386 - val_loss: 1.0013
Epoch 666/1000
1000/1000 [==============================] - 0s - loss: 1.6618 - val_loss: 0.9561
Epoch 667/1000
1000/1000 [==============================] - 0s - loss: 1.6378 - val_loss: 0.9678
Epoch 668/1000
1000/1000 [==============================] - 0s - loss: 1.6251 - val_loss: 0.9817
Epoch 669/1000
1000/1000 [==============================] - 0s - loss: 1.6573 - val_loss: 0.9811
Epoch 670/1000
1000/1000 [==============================] - 0s - loss: 1.6330 - val_loss: 1.0016
Epoch 671/1000
1000/1000 [==============================] - 0s - loss: 1.6594 - val_loss: 0.9494
Epoch 672/1000
1000/1000 [==============================] - 0s - loss: 1.5964 - val_loss: 0.9608
Epoch 673/1000
1000/1000 [==============================] - 0s - loss: 1.6279 - val_loss: 0.9732
Epoch 674/1000
1000/1000 [==============================] - 0s - loss: 1.6385 - val_loss: 0.9121
Epoch 675/1000
1000/1000 [==============================] - 0s - loss: 1.6088 - val_loss: 0.9732
Epoch 676/1000
1000/1000 [==============================] - 0s - loss: 1.5953 - val_loss: 0.9693
Epoch 677/1000
1000/1000 [==============================] - 0s - loss: 1.5956 - val_loss: 0.9729
Epoch 678/1000
1000/1000 [==============================] - 0s - loss: 1.6139 - val_loss: 0.9883
Epoch 679/1000
1000/1000 [==============================] - 0s - loss: 1.5953 - val_loss: 0.9570
Epoch 680/1000
1000/1000 [==============================] - 0s - loss: 1.6172 - val_loss: 0.9936
Epoch 681/1000
1000/1000 [==============================] - 0s - loss: 1.6145 - val_loss: 0.9695
Epoch 682/1000
1000/1000 [==============================] - 0s - loss: 1.5989 - val_loss: 0.9675
Epoch 683/1000
1000/1000 [==============================] - 0s - loss: 1.5980 - val_loss: 0.9522
Epoch 684/1000
1000/1000 [==============================] - 0s - loss: 1.5935 - val_loss: 0.9448
Epoch 685/1000
1000/1000 [==============================] - 0s - loss: 1.5834 - val_loss: 0.9738
Epoch 686/1000
1000/1000 [==============================] - 0s - loss: 1.5949 - val_loss: 0.9813
Epoch 687/1000
1000/1000 [==============================] - 0s - loss: 1.5625 - val_loss: 0.9761
Epoch 688/1000
1000/1000 [==============================] - 0s - loss: 1.5909 - val_loss: 0.9546
Epoch 689/1000
1000/1000 [==============================] - 0s - loss: 1.5741 - val_loss: 0.9712
Epoch 690/1000
1000/1000 [==============================] - 0s - loss: 1.5515 - val_loss: 0.9655
Epoch 691/1000
1000/1000 [==============================] - 0s - loss: 1.5700 - val_loss: 0.9581
Epoch 692/1000
1000/1000 [==============================] - 0s - loss: 1.5775 - val_loss: 0.9728
Epoch 693/1000
1000/1000 [==============================] - 0s - loss: 1.5517 - val_loss: 0.9923
Epoch 694/1000
1000/1000 [==============================] - 0s - loss: 1.5772 - val_loss: 0.9755
Epoch 695/1000
1000/1000 [==============================] - 0s - loss: 1.5371 - val_loss: 0.9441
Epoch 696/1000
1000/1000 [==============================] - 0s - loss: 1.5574 - val_loss: 0.9604
Epoch 697/1000
1000/1000 [==============================] - 0s - loss: 1.5552 - val_loss: 0.9474
Epoch 698/1000
1000/1000 [==============================] - 0s - loss: 1.5636 - val_loss: 0.9910
Epoch 699/1000
1000/1000 [==============================] - 0s - loss: 1.5357 - val_loss: 0.9849
Epoch 700/1000
1000/1000 [==============================] - 0s - loss: 1.5412 - val_loss: 0.9549
Epoch 701/1000
1000/1000 [==============================] - 0s - loss: 1.5316 - val_loss: 0.9680
Epoch 702/1000
1000/1000 [==============================] - 0s - loss: 1.5424 - val_loss: 0.9904
Epoch 703/1000
1000/1000 [==============================] - 0s - loss: 1.5219 - val_loss: 0.9570
Epoch 704/1000
1000/1000 [==============================] - 0s - loss: 1.5114 - val_loss: 0.9453
Epoch 705/1000
1000/1000 [==============================] - 0s - loss: 1.5206 - val_loss: 0.9490
Epoch 706/1000
1000/1000 [==============================] - 0s - loss: 1.5325 - val_loss: 0.9617
Epoch 707/1000
1000/1000 [==============================] - 0s - loss: 1.5324 - val_loss: 0.9737
Epoch 708/1000
1000/1000 [==============================] - 0s - loss: 1.5176 - val_loss: 0.9383
Epoch 709/1000
1000/1000 [==============================] - 0s - loss: 1.5298 - val_loss: 0.9487
Epoch 710/1000
1000/1000 [==============================] - 0s - loss: 1.5068 - val_loss: 0.9379
Epoch 711/1000
1000/1000 [==============================] - 0s - loss: 1.5169 - val_loss: 0.9691
Epoch 712/1000
1000/1000 [==============================] - 0s - loss: 1.5185 - val_loss: 0.9618
Epoch 713/1000
1000/1000 [==============================] - 0s - loss: 1.5073 - val_loss: 0.9630
Epoch 714/1000
1000/1000 [==============================] - 0s - loss: 1.5108 - val_loss: 0.9291
Epoch 715/1000
1000/1000 [==============================] - 0s - loss: 1.5210 - val_loss: 0.9812
Epoch 716/1000
1000/1000 [==============================] - 0s - loss: 1.5182 - val_loss: 0.9459
Epoch 717/1000
1000/1000 [==============================] - 0s - loss: 1.5216 - val_loss: 0.9493
Epoch 718/1000
1000/1000 [==============================] - 0s - loss: 1.5155 - val_loss: 0.9693
Epoch 719/1000
1000/1000 [==============================] - 0s - loss: 1.4846 - val_loss: 0.9523
Epoch 720/1000
1000/1000 [==============================] - 0s - loss: 1.4783 - val_loss: 0.9827
Epoch 721/1000
1000/1000 [==============================] - 0s - loss: 1.4876 - val_loss: 0.9554
Epoch 722/1000
1000/1000 [==============================] - 0s - loss: 1.4972 - val_loss: 0.9545
Epoch 723/1000
1000/1000 [==============================] - 0s - loss: 1.4830 - val_loss: 0.9816
Epoch 724/1000
1000/1000 [==============================] - 0s - loss: 1.4942 - val_loss: 0.9471
Epoch 725/1000
1000/1000 [==============================] - 0s - loss: 1.4775 - val_loss: 0.9413
Epoch 726/1000
1000/1000 [==============================] - 0s - loss: 1.4624 - val_loss: 0.9542
Epoch 727/1000
1000/1000 [==============================] - 0s - loss: 1.4730 - val_loss: 0.9640
Epoch 728/1000
1000/1000 [==============================] - 0s - loss: 1.4833 - val_loss: 0.9788
Epoch 729/1000
1000/1000 [==============================] - 0s - loss: 1.4506 - val_loss: 0.9429
Epoch 730/1000
1000/1000 [==============================] - 0s - loss: 1.4458 - val_loss: 0.9435
Epoch 731/1000
1000/1000 [==============================] - 0s - loss: 1.4539 - val_loss: 0.9713
Epoch 732/1000
1000/1000 [==============================] - 0s - loss: 1.4712 - val_loss: 0.9612
Epoch 733/1000
1000/1000 [==============================] - 0s - loss: 1.4311 - val_loss: 0.9410
Epoch 734/1000
1000/1000 [==============================] - 0s - loss: 1.4381 - val_loss: 0.9885
Epoch 735/1000
1000/1000 [==============================] - 0s - loss: 1.4679 - val_loss: 0.9641
Epoch 736/1000
1000/1000 [==============================] - 0s - loss: 1.4495 - val_loss: 0.9617
Epoch 737/1000
1000/1000 [==============================] - 0s - loss: 1.4629 - val_loss: 0.9306
Epoch 738/1000
1000/1000 [==============================] - 0s - loss: 1.4739 - val_loss: 0.9895
Epoch 739/1000
1000/1000 [==============================] - 0s - loss: 1.4836 - val_loss: 0.9594
Epoch 740/1000
1000/1000 [==============================] - 0s - loss: 1.4549 - val_loss: 0.9531
Epoch 741/1000
1000/1000 [==============================] - 0s - loss: 1.4531 - val_loss: 0.9359
Epoch 742/1000
1000/1000 [==============================] - 0s - loss: 1.4539 - val_loss: 0.9618
Epoch 743/1000
1000/1000 [==============================] - 0s - loss: 1.4553 - val_loss: 0.9521
Epoch 744/1000
1000/1000 [==============================] - 0s - loss: 1.4298 - val_loss: 0.9887
Epoch 745/1000
1000/1000 [==============================] - 0s - loss: 1.4420 - val_loss: 0.9660
Epoch 746/1000
1000/1000 [==============================] - 0s - loss: 1.4485 - val_loss: 0.9537
Epoch 747/1000
1000/1000 [==============================] - 0s - loss: 1.4499 - val_loss: 0.9795
Epoch 748/1000
1000/1000 [==============================] - 0s - loss: 1.4200 - val_loss: 0.9649
Epoch 749/1000
1000/1000 [==============================] - 0s - loss: 1.4411 - val_loss: 0.9784
Epoch 750/1000
1000/1000 [==============================] - 0s - loss: 1.4192 - val_loss: 0.9829
Epoch 751/1000
1000/1000 [==============================] - 0s - loss: 1.4382 - val_loss: 0.9574
Epoch 752/1000
1000/1000 [==============================] - 0s - loss: 1.4221 - val_loss: 0.9807
Epoch 753/1000
1000/1000 [==============================] - 0s - loss: 1.4175 - val_loss: 0.9441
Epoch 754/1000
1000/1000 [==============================] - 0s - loss: 1.4355 - val_loss: 0.9460
Epoch 755/1000
1000/1000 [==============================] - 0s - loss: 1.4324 - val_loss: 0.9713
Epoch 756/1000
1000/1000 [==============================] - 0s - loss: 1.4377 - val_loss: 0.9322
Epoch 757/1000
1000/1000 [==============================] - 0s - loss: 1.3978 - val_loss: 0.9591
Epoch 758/1000
1000/1000 [==============================] - 0s - loss: 1.3998 - val_loss: 0.9542
Epoch 759/1000
1000/1000 [==============================] - 0s - loss: 1.4101 - val_loss: 0.9495
Epoch 760/1000
1000/1000 [==============================] - 0s - loss: 1.3990 - val_loss: 0.9512
Epoch 761/1000
1000/1000 [==============================] - 0s - loss: 1.4126 - val_loss: 0.9483
Epoch 762/1000
1000/1000 [==============================] - 0s - loss: 1.4103 - val_loss: 0.9598
Epoch 763/1000
1000/1000 [==============================] - 0s - loss: 1.4000 - val_loss: 0.9705
Epoch 764/1000
1000/1000 [==============================] - 0s - loss: 1.4129 - val_loss: 0.9633
Epoch 765/1000
1000/1000 [==============================] - 0s - loss: 1.4307 - val_loss: 0.9930
Epoch 766/1000
1000/1000 [==============================] - 0s - loss: 1.4202 - val_loss: 0.9403
Epoch 767/1000
1000/1000 [==============================] - 0s - loss: 1.4161 - val_loss: 0.9454
Epoch 768/1000
1000/1000 [==============================] - 0s - loss: 1.3996 - val_loss: 0.9266
Epoch 769/1000
1000/1000 [==============================] - 0s - loss: 1.4259 - val_loss: 0.9398
Epoch 770/1000
1000/1000 [==============================] - 0s - loss: 1.4021 - val_loss: 0.9346
Epoch 771/1000
1000/1000 [==============================] - 0s - loss: 1.4384 - val_loss: 0.9384
Epoch 772/1000
1000/1000 [==============================] - 0s - loss: 1.4179 - val_loss: 0.9336
Epoch 773/1000
1000/1000 [==============================] - 0s - loss: 1.4100 - val_loss: 0.9760
Epoch 774/1000
1000/1000 [==============================] - 0s - loss: 1.4006 - val_loss: 0.9285
Epoch 775/1000
1000/1000 [==============================] - 0s - loss: 1.3949 - val_loss: 0.9250
Epoch 776/1000
1000/1000 [==============================] - 0s - loss: 1.4114 - val_loss: 0.9666
Epoch 777/1000
1000/1000 [==============================] - 0s - loss: 1.3779 - val_loss: 0.9401
Epoch 778/1000
1000/1000 [==============================] - 0s - loss: 1.4199 - val_loss: 0.9594
Epoch 779/1000
1000/1000 [==============================] - 0s - loss: 1.3919 - val_loss: 0.9546
Epoch 780/1000
1000/1000 [==============================] - 0s - loss: 1.3914 - val_loss: 0.9478
Epoch 781/1000
1000/1000 [==============================] - 0s - loss: 1.3828 - val_loss: 0.9521
Epoch 782/1000
1000/1000 [==============================] - 0s - loss: 1.3812 - val_loss: 0.9664
Epoch 783/1000
1000/1000 [==============================] - 0s - loss: 1.3817 - val_loss: 0.9362
Epoch 784/1000
1000/1000 [==============================] - 0s - loss: 1.3861 - val_loss: 0.9791
Epoch 785/1000
1000/1000 [==============================] - 0s - loss: 1.3904 - val_loss: 0.9428
Epoch 786/1000
1000/1000 [==============================] - 0s - loss: 1.3838 - val_loss: 0.9288
Epoch 787/1000
1000/1000 [==============================] - 0s - loss: 1.3714 - val_loss: 0.9693
Epoch 788/1000
1000/1000 [==============================] - 0s - loss: 1.3986 - val_loss: 0.9659
Epoch 789/1000
1000/1000 [==============================] - 0s - loss: 1.3995 - val_loss: 0.9588
Epoch 790/1000
1000/1000 [==============================] - 0s - loss: 1.3907 - val_loss: 0.9664
Epoch 791/1000
1000/1000 [==============================] - 0s - loss: 1.3990 - val_loss: 0.9530
Epoch 792/1000
1000/1000 [==============================] - 0s - loss: 1.3952 - val_loss: 0.9640
Epoch 793/1000
1000/1000 [==============================] - 0s - loss: 1.3764 - val_loss: 0.9559
Epoch 794/1000
1000/1000 [==============================] - 0s - loss: 1.3807 - val_loss: 0.9708
Epoch 795/1000
1000/1000 [==============================] - 0s - loss: 1.3811 - val_loss: 0.9729
Epoch 796/1000
1000/1000 [==============================] - 0s - loss: 1.3805 - val_loss: 0.9389
Epoch 797/1000
1000/1000 [==============================] - 0s - loss: 1.3973 - val_loss: 0.9786
Epoch 798/1000
1000/1000 [==============================] - 0s - loss: 1.3710 - val_loss: 0.9686
Epoch 799/1000
1000/1000 [==============================] - 0s - loss: 1.3790 - val_loss: 0.9736
Epoch 800/1000
1000/1000 [==============================] - 0s - loss: 1.3912 - val_loss: 0.9444
Epoch 801/1000
1000/1000 [==============================] - 0s - loss: 1.3738 - val_loss: 0.9480
Epoch 802/1000
1000/1000 [==============================] - 0s - loss: 1.3556 - val_loss: 0.9651
Epoch 803/1000
1000/1000 [==============================] - 0s - loss: 1.3595 - val_loss: 0.9730
Epoch 804/1000
1000/1000 [==============================] - 0s - loss: 1.3653 - val_loss: 0.9921
Epoch 805/1000
1000/1000 [==============================] - 0s - loss: 1.3753 - val_loss: 0.9846
Epoch 806/1000
1000/1000 [==============================] - 0s - loss: 1.3647 - val_loss: 0.9669
Epoch 807/1000
1000/1000 [==============================] - 0s - loss: 1.3570 - val_loss: 0.9483
Epoch 808/1000
1000/1000 [==============================] - 0s - loss: 1.3389 - val_loss: 0.9665
Epoch 809/1000
1000/1000 [==============================] - 0s - loss: 1.3679 - val_loss: 0.9564
Epoch 810/1000
1000/1000 [==============================] - 0s - loss: 1.3651 - val_loss: 1.0131
Epoch 811/1000
1000/1000 [==============================] - 0s - loss: 1.3815 - val_loss: 0.9533
Epoch 812/1000
1000/1000 [==============================] - 0s - loss: 1.3607 - val_loss: 0.9526
Epoch 813/1000
1000/1000 [==============================] - 0s - loss: 1.3606 - val_loss: 0.9335
Epoch 814/1000
1000/1000 [==============================] - 0s - loss: 1.3394 - val_loss: 0.9460
Epoch 815/1000
1000/1000 [==============================] - 0s - loss: 1.3468 - val_loss: 0.9643
Epoch 816/1000
1000/1000 [==============================] - 0s - loss: 1.3538 - val_loss: 0.9843
Epoch 817/1000
1000/1000 [==============================] - 0s - loss: 1.3588 - val_loss: 0.9640
Epoch 818/1000
1000/1000 [==============================] - 0s - loss: 1.3606 - val_loss: 0.9551
Epoch 819/1000
1000/1000 [==============================] - 0s - loss: 1.3660 - val_loss: 0.9995
Epoch 820/1000
1000/1000 [==============================] - 0s - loss: 1.3604 - val_loss: 0.9736
Epoch 821/1000
1000/1000 [==============================] - 0s - loss: 1.3637 - val_loss: 0.9900
Epoch 822/1000
1000/1000 [==============================] - 0s - loss: 1.3495 - val_loss: 0.9932
Epoch 823/1000
1000/1000 [==============================] - 0s - loss: 1.3337 - val_loss: 0.9697
Epoch 824/1000
1000/1000 [==============================] - 0s - loss: 1.3519 - val_loss: 0.9933
Epoch 825/1000
1000/1000 [==============================] - 0s - loss: 1.3436 - val_loss: 0.9548
Epoch 826/1000
1000/1000 [==============================] - 0s - loss: 1.3781 - val_loss: 0.9396
Epoch 827/1000
1000/1000 [==============================] - 0s - loss: 1.3481 - val_loss: 0.9607
Epoch 828/1000
1000/1000 [==============================] - 0s - loss: 1.3622 - val_loss: 0.9675
Epoch 829/1000
1000/1000 [==============================] - 0s - loss: 1.3738 - val_loss: 0.9697
Epoch 830/1000
1000/1000 [==============================] - 0s - loss: 1.3647 - val_loss: 0.9848
Epoch 831/1000
1000/1000 [==============================] - 0s - loss: 1.3327 - val_loss: 0.9585
Epoch 832/1000
1000/1000 [==============================] - 0s - loss: 1.3465 - val_loss: 0.9429
Epoch 833/1000
1000/1000 [==============================] - 0s - loss: 1.3376 - val_loss: 0.9766
Epoch 834/1000
1000/1000 [==============================] - 0s - loss: 1.3392 - val_loss: 0.9698
Epoch 835/1000
1000/1000 [==============================] - 0s - loss: 1.3694 - val_loss: 0.9582
Epoch 836/1000
1000/1000 [==============================] - 0s - loss: 1.3354 - val_loss: 0.9779
Epoch 837/1000
1000/1000 [==============================] - 0s - loss: 1.3406 - val_loss: 0.9596
Epoch 838/1000
1000/1000 [==============================] - 0s - loss: 1.3467 - val_loss: 0.9818
Epoch 839/1000
1000/1000 [==============================] - 0s - loss: 1.3727 - val_loss: 0.9659
Epoch 840/1000
1000/1000 [==============================] - 0s - loss: 1.3415 - val_loss: 0.9822
Epoch 841/1000
1000/1000 [==============================] - 0s - loss: 1.3571 - val_loss: 0.9603
Epoch 842/1000
1000/1000 [==============================] - 0s - loss: 1.3333 - val_loss: 0.9520
Epoch 843/1000
1000/1000 [==============================] - 0s - loss: 1.3604 - val_loss: 0.9892
Epoch 844/1000
1000/1000 [==============================] - 0s - loss: 1.3420 - val_loss: 0.9886
Epoch 845/1000
1000/1000 [==============================] - 0s - loss: 1.3482 - val_loss: 0.9831
Epoch 846/1000
1000/1000 [==============================] - 0s - loss: 1.3488 - val_loss: 0.9534
Epoch 847/1000
1000/1000 [==============================] - 0s - loss: 1.3406 - val_loss: 0.9392
Epoch 848/1000
1000/1000 [==============================] - 0s - loss: 1.3379 - val_loss: 0.9990
Epoch 849/1000
1000/1000 [==============================] - 0s - loss: 1.3350 - val_loss: 0.9542
Epoch 850/1000
1000/1000 [==============================] - 0s - loss: 1.3345 - val_loss: 0.9894
Epoch 851/1000
1000/1000 [==============================] - 0s - loss: 1.3391 - val_loss: 0.9751
Epoch 852/1000
1000/1000 [==============================] - 0s - loss: 1.3316 - val_loss: 0.9530
Epoch 853/1000
1000/1000 [==============================] - 0s - loss: 1.3072 - val_loss: 0.9862
Epoch 854/1000
1000/1000 [==============================] - 0s - loss: 1.3382 - val_loss: 1.0235
Epoch 855/1000
1000/1000 [==============================] - 0s - loss: 1.3290 - val_loss: 0.9586
Epoch 856/1000
1000/1000 [==============================] - 0s - loss: 1.3347 - val_loss: 0.9868
Epoch 857/1000
1000/1000 [==============================] - 0s - loss: 1.3321 - val_loss: 0.9741
Epoch 858/1000
1000/1000 [==============================] - 0s - loss: 1.3275 - val_loss: 0.9865
Epoch 859/1000
1000/1000 [==============================] - 0s - loss: 1.3382 - val_loss: 0.9672
Epoch 860/1000
1000/1000 [==============================] - 0s - loss: 1.3257 - val_loss: 0.9587
Epoch 861/1000
1000/1000 [==============================] - 0s - loss: 1.3131 - val_loss: 0.9759
Epoch 862/1000
1000/1000 [==============================] - 0s - loss: 1.3215 - val_loss: 0.9754
Epoch 863/1000
1000/1000 [==============================] - 0s - loss: 1.3321 - val_loss: 0.9992
Epoch 864/1000
1000/1000 [==============================] - 0s - loss: 1.3150 - val_loss: 0.9658
Epoch 865/1000
1000/1000 [==============================] - 0s - loss: 1.3235 - val_loss: 1.0093
Epoch 866/1000
1000/1000 [==============================] - 0s - loss: 1.2998 - val_loss: 0.9764
Epoch 867/1000
1000/1000 [==============================] - 0s - loss: 1.2976 - val_loss: 0.9940
Epoch 868/1000
1000/1000 [==============================] - 0s - loss: 1.3249 - val_loss: 0.9870
Epoch 869/1000
1000/1000 [==============================] - 0s - loss: 1.3055 - val_loss: 0.9739
Epoch 870/1000
1000/1000 [==============================] - 0s - loss: 1.3057 - val_loss: 0.9887
Epoch 871/1000
1000/1000 [==============================] - 0s - loss: 1.2919 - val_loss: 0.9749
Epoch 872/1000
1000/1000 [==============================] - 0s - loss: 1.3195 - val_loss: 0.9944
Epoch 873/1000
1000/1000 [==============================] - 0s - loss: 1.3113 - val_loss: 0.9896
Epoch 874/1000
1000/1000 [==============================] - 0s - loss: 1.3278 - val_loss: 0.9958
Epoch 875/1000
1000/1000 [==============================] - 0s - loss: 1.3151 - val_loss: 1.0322
Epoch 876/1000
1000/1000 [==============================] - 0s - loss: 1.3009 - val_loss: 0.9924
Epoch 877/1000
1000/1000 [==============================] - 0s - loss: 1.3268 - val_loss: 0.9887
Epoch 878/1000
1000/1000 [==============================] - 0s - loss: 1.3270 - val_loss: 0.9959
Epoch 879/1000
1000/1000 [==============================] - 0s - loss: 1.3043 - val_loss: 0.9732
Epoch 880/1000
1000/1000 [==============================] - 0s - loss: 1.3116 - val_loss: 0.9783
Epoch 881/1000
1000/1000 [==============================] - 0s - loss: 1.3113 - val_loss: 0.9670
Epoch 882/1000
1000/1000 [==============================] - 0s - loss: 1.3097 - val_loss: 0.9810
Epoch 883/1000
1000/1000 [==============================] - 0s - loss: 1.3240 - val_loss: 0.9643
Epoch 884/1000
1000/1000 [==============================] - 0s - loss: 1.3169 - val_loss: 0.9653
Epoch 885/1000
1000/1000 [==============================] - 0s - loss: 1.2994 - val_loss: 0.9707
Epoch 886/1000
1000/1000 [==============================] - 0s - loss: 1.3073 - val_loss: 0.9862
Epoch 887/1000
1000/1000 [==============================] - 0s - loss: 1.3118 - val_loss: 0.9961
Epoch 888/1000
1000/1000 [==============================] - 0s - loss: 1.2957 - val_loss: 0.9950
Epoch 889/1000
1000/1000 [==============================] - 0s - loss: 1.3078 - val_loss: 0.9896
Epoch 890/1000
1000/1000 [==============================] - 0s - loss: 1.3138 - val_loss: 0.9969
Epoch 891/1000
1000/1000 [==============================] - 0s - loss: 1.2893 - val_loss: 0.9612
Epoch 892/1000
1000/1000 [==============================] - 0s - loss: 1.3018 - val_loss: 0.9832
Epoch 893/1000
1000/1000 [==============================] - 0s - loss: 1.2957 - val_loss: 0.9726
Epoch 894/1000
1000/1000 [==============================] - 0s - loss: 1.2849 - val_loss: 0.9745
Epoch 895/1000
1000/1000 [==============================] - 0s - loss: 1.3144 - val_loss: 1.0036
Epoch 896/1000
1000/1000 [==============================] - 0s - loss: 1.2877 - val_loss: 1.0262
Epoch 897/1000
1000/1000 [==============================] - 0s - loss: 1.3065 - val_loss: 0.9948
Epoch 898/1000
1000/1000 [==============================] - 0s - loss: 1.3124 - val_loss: 0.9948
Epoch 899/1000
1000/1000 [==============================] - 0s - loss: 1.2744 - val_loss: 1.0092
Epoch 900/1000
1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 0.9860
Epoch 901/1000
1000/1000 [==============================] - 0s - loss: 1.2857 - val_loss: 1.0018
Epoch 902/1000
1000/1000 [==============================] - 0s - loss: 1.3014 - val_loss: 0.9861
Epoch 903/1000
1000/1000 [==============================] - 0s - loss: 1.2985 - val_loss: 0.9980
Epoch 904/1000
1000/1000 [==============================] - 0s - loss: 1.2789 - val_loss: 1.0026
Epoch 905/1000
1000/1000 [==============================] - 0s - loss: 1.2925 - val_loss: 0.9882
Epoch 906/1000
1000/1000 [==============================] - 0s - loss: 1.2803 - val_loss: 1.0041
Epoch 907/1000
1000/1000 [==============================] - 0s - loss: 1.2835 - val_loss: 0.9718
Epoch 908/1000
1000/1000 [==============================] - 0s - loss: 1.2808 - val_loss: 0.9985
Epoch 909/1000
1000/1000 [==============================] - 0s - loss: 1.3004 - val_loss: 1.0101
Epoch 910/1000
1000/1000 [==============================] - 0s - loss: 1.2970 - val_loss: 1.0243
Epoch 911/1000
1000/1000 [==============================] - 0s - loss: 1.2844 - val_loss: 0.9928
Epoch 912/1000
1000/1000 [==============================] - 0s - loss: 1.2857 - val_loss: 0.9811
Epoch 913/1000
1000/1000 [==============================] - 0s - loss: 1.2795 - val_loss: 0.9890
Epoch 914/1000
1000/1000 [==============================] - 0s - loss: 1.3080 - val_loss: 1.0026
Epoch 915/1000
1000/1000 [==============================] - 0s - loss: 1.2976 - val_loss: 0.9926
Epoch 916/1000
1000/1000 [==============================] - 0s - loss: 1.2908 - val_loss: 0.9886
Epoch 917/1000
1000/1000 [==============================] - 0s - loss: 1.2912 - val_loss: 0.9874
Epoch 918/1000
1000/1000 [==============================] - 0s - loss: 1.2883 - val_loss: 0.9878
Epoch 919/1000
1000/1000 [==============================] - 0s - loss: 1.2798 - val_loss: 0.9909
Epoch 920/1000
1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 0.9914
Epoch 921/1000
1000/1000 [==============================] - 0s - loss: 1.2883 - val_loss: 1.0011
Epoch 922/1000
1000/1000 [==============================] - 0s - loss: 1.2959 - val_loss: 1.0093
Epoch 923/1000
1000/1000 [==============================] - 0s - loss: 1.2890 - val_loss: 0.9862
Epoch 924/1000
1000/1000 [==============================] - 0s - loss: 1.2855 - val_loss: 0.9988
Epoch 925/1000
1000/1000 [==============================] - 0s - loss: 1.2899 - val_loss: 1.0216
Epoch 926/1000
1000/1000 [==============================] - 0s - loss: 1.2698 - val_loss: 1.0031
Epoch 927/1000
1000/1000 [==============================] - 0s - loss: 1.2637 - val_loss: 0.9964
Epoch 928/1000
1000/1000 [==============================] - 0s - loss: 1.2799 - val_loss: 1.0018
Epoch 929/1000
1000/1000 [==============================] - 0s - loss: 1.2778 - val_loss: 0.9887
Epoch 930/1000
1000/1000 [==============================] - 0s - loss: 1.2810 - val_loss: 0.9871
Epoch 931/1000
1000/1000 [==============================] - 0s - loss: 1.2656 - val_loss: 0.9877
Epoch 932/1000
1000/1000 [==============================] - 0s - loss: 1.2630 - val_loss: 0.9925
Epoch 933/1000
1000/1000 [==============================] - 0s - loss: 1.2710 - val_loss: 0.9920
Epoch 934/1000
1000/1000 [==============================] - 0s - loss: 1.2682 - val_loss: 1.0518
Epoch 935/1000
1000/1000 [==============================] - 0s - loss: 1.2796 - val_loss: 1.0078
Epoch 936/1000
1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 1.0137
Epoch 937/1000
1000/1000 [==============================] - 0s - loss: 1.2527 - val_loss: 0.9952
Epoch 938/1000
1000/1000 [==============================] - 0s - loss: 1.2719 - val_loss: 1.0135
Epoch 939/1000
1000/1000 [==============================] - 0s - loss: 1.2664 - val_loss: 1.0124
Epoch 940/1000
1000/1000 [==============================] - 0s - loss: 1.2626 - val_loss: 1.0120
Epoch 941/1000
1000/1000 [==============================] - 0s - loss: 1.2727 - val_loss: 1.0004
Epoch 942/1000
1000/1000 [==============================] - 0s - loss: 1.2598 - val_loss: 0.9993
Epoch 943/1000
1000/1000 [==============================] - 0s - loss: 1.2649 - val_loss: 0.9913
Epoch 944/1000
1000/1000 [==============================] - 0s - loss: 1.2658 - val_loss: 0.9968
Epoch 945/1000
1000/1000 [==============================] - 0s - loss: 1.2721 - val_loss: 1.0100
Epoch 946/1000
1000/1000 [==============================] - 0s - loss: 1.2871 - val_loss: 0.9731
Epoch 947/1000
1000/1000 [==============================] - 0s - loss: 1.2455 - val_loss: 0.9892
Epoch 948/1000
1000/1000 [==============================] - 0s - loss: 1.2634 - val_loss: 1.0105
Epoch 949/1000
1000/1000 [==============================] - 0s - loss: 1.2764 - val_loss: 1.0050
Epoch 950/1000
1000/1000 [==============================] - 0s - loss: 1.2702 - val_loss: 0.9827
Epoch 951/1000
1000/1000 [==============================] - 0s - loss: 1.2683 - val_loss: 1.0109
Epoch 952/1000
1000/1000 [==============================] - 0s - loss: 1.2576 - val_loss: 0.9847
Epoch 953/1000
1000/1000 [==============================] - 0s - loss: 1.2583 - val_loss: 1.0223
Epoch 954/1000
1000/1000 [==============================] - 0s - loss: 1.2678 - val_loss: 0.9782
Epoch 955/1000
1000/1000 [==============================] - 0s - loss: 1.2432 - val_loss: 1.0090
Epoch 956/1000
1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 0.9923
Epoch 957/1000
1000/1000 [==============================] - 0s - loss: 1.2404 - val_loss: 0.9838
Epoch 958/1000
1000/1000 [==============================] - 0s - loss: 1.2634 - val_loss: 1.0103
Epoch 959/1000
1000/1000 [==============================] - 0s - loss: 1.2618 - val_loss: 1.0084
Epoch 960/1000
1000/1000 [==============================] - 0s - loss: 1.2572 - val_loss: 0.9778
Epoch 961/1000
1000/1000 [==============================] - 0s - loss: 1.2520 - val_loss: 0.9904
Epoch 962/1000
1000/1000 [==============================] - 0s - loss: 1.2844 - val_loss: 0.9946
Epoch 963/1000
1000/1000 [==============================] - 0s - loss: 1.2590 - val_loss: 1.0358
Epoch 964/1000
1000/1000 [==============================] - 0s - loss: 1.2660 - val_loss: 1.0090
Epoch 965/1000
1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 0.9980
Epoch 966/1000
1000/1000 [==============================] - 0s - loss: 1.2283 - val_loss: 0.9996
Epoch 967/1000
1000/1000 [==============================] - 0s - loss: 1.2376 - val_loss: 1.0249
Epoch 968/1000
1000/1000 [==============================] - 0s - loss: 1.2449 - val_loss: 0.9915
Epoch 969/1000
1000/1000 [==============================] - 0s - loss: 1.2430 - val_loss: 1.0158
Epoch 970/1000
1000/1000 [==============================] - 0s - loss: 1.2666 - val_loss: 0.9815
Epoch 971/1000
1000/1000 [==============================] - 0s - loss: 1.2496 - val_loss: 1.0140
Epoch 972/1000
1000/1000 [==============================] - 0s - loss: 1.2391 - val_loss: 1.0208
Epoch 973/1000
1000/1000 [==============================] - 0s - loss: 1.2297 - val_loss: 0.9948
Epoch 974/1000
1000/1000 [==============================] - 0s - loss: 1.2554 - val_loss: 1.0094
Epoch 975/1000
1000/1000 [==============================] - 0s - loss: 1.2425 - val_loss: 1.0068
Epoch 976/1000
1000/1000 [==============================] - 0s - loss: 1.2420 - val_loss: 0.9999
Epoch 977/1000
1000/1000 [==============================] - 0s - loss: 1.2388 - val_loss: 0.9971
Epoch 978/1000
1000/1000 [==============================] - 0s - loss: 1.2405 - val_loss: 1.0143
Epoch 979/1000
1000/1000 [==============================] - 0s - loss: 1.2557 - val_loss: 1.0249
Epoch 980/1000
1000/1000 [==============================] - 0s - loss: 1.2579 - val_loss: 0.9988
Epoch 981/1000
1000/1000 [==============================] - 0s - loss: 1.2512 - val_loss: 0.9910
Epoch 982/1000
1000/1000 [==============================] - 0s - loss: 1.2434 - val_loss: 0.9941
Epoch 983/1000
1000/1000 [==============================] - 0s - loss: 1.2354 - val_loss: 1.0024
Epoch 984/1000
1000/1000 [==============================] - 0s - loss: 1.2498 - val_loss: 1.0029
Epoch 985/1000
1000/1000 [==============================] - 0s - loss: 1.2345 - val_loss: 0.9968
Epoch 986/1000
1000/1000 [==============================] - 0s - loss: 1.2368 - val_loss: 0.9903
Epoch 987/1000
1000/1000 [==============================] - 0s - loss: 1.2342 - val_loss: 1.0094
Epoch 988/1000
1000/1000 [==============================] - 0s - loss: 1.2460 - val_loss: 1.0223
Epoch 989/1000
1000/1000 [==============================] - 0s - loss: 1.2346 - val_loss: 1.0397
Epoch 990/1000
1000/1000 [==============================] - 0s - loss: 1.2447 - val_loss: 1.0458
Epoch 991/1000
1000/1000 [==============================] - 0s - loss: 1.2323 - val_loss: 1.0271
Epoch 992/1000
1000/1000 [==============================] - 0s - loss: 1.2474 - val_loss: 1.0172
Epoch 993/1000
1000/1000 [==============================] - 0s - loss: 1.2362 - val_loss: 1.0163
Epoch 994/1000
1000/1000 [==============================] - 0s - loss: 1.2293 - val_loss: 1.0224
Epoch 995/1000
1000/1000 [==============================] - 0s - loss: 1.2309 - val_loss: 1.0242
Epoch 996/1000
1000/1000 [==============================] - 0s - loss: 1.2322 - val_loss: 0.9872
Epoch 997/1000
1000/1000 [==============================] - 0s - loss: 1.2435 - val_loss: 1.0042
Epoch 998/1000
1000/1000 [==============================] - 0s - loss: 1.2268 - val_loss: 1.0263
Epoch 999/1000
1000/1000 [==============================] - 0s - loss: 1.2341 - val_loss: 0.9958
Epoch 1000/1000
1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 1.0211
CPU times: user 58min 9s, sys: 7min 6s, total: 1h 5min 16s
Wall time: 11min 12s

In [6]:
plt.plot(history.history['val_loss'], label = 'Validation loss')
plt.plot(history.history['loss'], label = 'Training loss')

plt.ylabel("Squared error")
plt.xlabel("Epoch")

plt.ylim([0,7])
plt.legend();


Out[6]:
<matplotlib.legend.Legend at 0x7f7d384e0438>

That looks nearly identical to Fig. 1 of the paper. Next, the "local decomposition."


In [7]:
training_data_path = 'data/ss_data_training.csv'
valid_data_path = 'data/ss_data_valid.csv'

train_input, train_output = load_data_ss(training_data_path)
valid_input, valid_output = load_data_ss(valid_data_path)

In [8]:
model = Sequential()

model.add(Dense(output_dim=2000,input_dim=64))

model.add(Dense(4000,activation='relu'))
model.add(Dropout(0.2))

model.add(Dense(4000,activation='relu'))
model.add(Dropout(0.2))

model.add(Dense(input_dim=4000,output_dim=36))

#model.summary()

In [9]:
%%time

model.compile(optimizer='adam',loss=custom_objective)

history = model.fit(train_input, train_output, validation_data=(valid_input,valid_output), nb_epoch=500, batch_size=64)


Train on 500 samples, validate on 500 samples
Epoch 1/500
500/500 [==============================] - 2s - loss: 1928.0432 - val_loss: 58.7284
Epoch 2/500
500/500 [==============================] - 1s - loss: 83.0015 - val_loss: 56.8443
Epoch 3/500
500/500 [==============================] - 1s - loss: 57.4910 - val_loss: 48.1649
Epoch 4/500
500/500 [==============================] - 1s - loss: 51.7076 - val_loss: 47.2014
Epoch 5/500
500/500 [==============================] - 1s - loss: 49.7511 - val_loss: 47.0593
Epoch 6/500
500/500 [==============================] - 1s - loss: 49.4571 - val_loss: 46.9361
Epoch 7/500
500/500 [==============================] - 1s - loss: 48.8565 - val_loss: 46.5122
Epoch 8/500
500/500 [==============================] - 1s - loss: 48.1984 - val_loss: 46.0242
Epoch 9/500
500/500 [==============================] - 1s - loss: 47.9599 - val_loss: 45.4773
Epoch 10/500
500/500 [==============================] - 1s - loss: 47.1162 - val_loss: 45.5617
Epoch 11/500
500/500 [==============================] - 1s - loss: 47.5879 - val_loss: 44.9578
Epoch 12/500
500/500 [==============================] - 1s - loss: 46.9787 - val_loss: 45.3351
Epoch 13/500
500/500 [==============================] - 1s - loss: 46.7124 - val_loss: 44.6159
Epoch 14/500
500/500 [==============================] - 1s - loss: 45.8505 - val_loss: 43.7878
Epoch 15/500
500/500 [==============================] - 1s - loss: 45.1820 - val_loss: 43.5011
Epoch 16/500
500/500 [==============================] - 1s - loss: 44.6850 - val_loss: 43.1022
Epoch 17/500
500/500 [==============================] - 1s - loss: 44.2769 - val_loss: 43.3106
Epoch 18/500
500/500 [==============================] - 1s - loss: 45.6469 - val_loss: 46.3445
Epoch 19/500
500/500 [==============================] - 1s - loss: 45.9416 - val_loss: 43.2778
Epoch 20/500
500/500 [==============================] - 1s - loss: 43.7875 - val_loss: 41.2507
Epoch 21/500
500/500 [==============================] - 1s - loss: 42.4273 - val_loss: 40.4794
Epoch 22/500
500/500 [==============================] - 1s - loss: 41.5514 - val_loss: 39.6212
Epoch 23/500
500/500 [==============================] - 1s - loss: 41.3061 - val_loss: 39.5961
Epoch 24/500
500/500 [==============================] - 1s - loss: 41.2355 - val_loss: 39.4855
Epoch 25/500
500/500 [==============================] - 1s - loss: 39.9226 - val_loss: 38.0519
Epoch 26/500
500/500 [==============================] - 1s - loss: 38.5709 - val_loss: 36.1625
Epoch 27/500
500/500 [==============================] - 1s - loss: 38.5727 - val_loss: 37.6131
Epoch 28/500
500/500 [==============================] - 1s - loss: 37.8976 - val_loss: 34.6365
Epoch 29/500
500/500 [==============================] - 1s - loss: 37.1208 - val_loss: 35.1463
Epoch 30/500
500/500 [==============================] - 1s - loss: 36.6890 - val_loss: 33.6481
Epoch 31/500
500/500 [==============================] - 1s - loss: 35.6755 - val_loss: 33.2816
Epoch 32/500
500/500 [==============================] - 1s - loss: 34.9731 - val_loss: 32.5114
Epoch 33/500
500/500 [==============================] - 1s - loss: 34.5225 - val_loss: 32.0806
Epoch 34/500
500/500 [==============================] - 1s - loss: 34.0801 - val_loss: 31.1134
Epoch 35/500
500/500 [==============================] - 1s - loss: 33.5336 - val_loss: 30.7787
Epoch 36/500
500/500 [==============================] - 1s - loss: 33.0177 - val_loss: 30.5774
Epoch 37/500
500/500 [==============================] - 1s - loss: 33.0489 - val_loss: 30.3603
Epoch 38/500
500/500 [==============================] - 1s - loss: 32.5370 - val_loss: 29.1842
Epoch 39/500
500/500 [==============================] - 1s - loss: 31.9061 - val_loss: 29.2739
Epoch 40/500
500/500 [==============================] - 1s - loss: 32.3620 - val_loss: 29.7957
Epoch 41/500
500/500 [==============================] - 1s - loss: 31.4147 - val_loss: 28.6334
Epoch 42/500
500/500 [==============================] - 1s - loss: 31.0300 - val_loss: 29.8735
Epoch 43/500
500/500 [==============================] - 1s - loss: 31.8526 - val_loss: 28.9440
Epoch 44/500
500/500 [==============================] - 1s - loss: 31.0116 - val_loss: 29.2483
Epoch 45/500
500/500 [==============================] - 1s - loss: 30.5171 - val_loss: 27.3801
Epoch 46/500
500/500 [==============================] - 1s - loss: 30.2832 - val_loss: 28.1007
Epoch 47/500
500/500 [==============================] - 1s - loss: 30.3353 - val_loss: 27.4352
Epoch 48/500
500/500 [==============================] - 1s - loss: 29.8938 - val_loss: 27.6298
Epoch 49/500
500/500 [==============================] - 1s - loss: 29.8872 - val_loss: 27.3145
Epoch 50/500
500/500 [==============================] - 1s - loss: 29.7929 - val_loss: 28.0647
Epoch 51/500
500/500 [==============================] - 1s - loss: 29.6782 - val_loss: 26.7747
Epoch 52/500
500/500 [==============================] - 1s - loss: 29.4139 - val_loss: 26.7458
Epoch 53/500
500/500 [==============================] - 1s - loss: 28.5147 - val_loss: 26.0697
Epoch 54/500
500/500 [==============================] - 1s - loss: 28.7702 - val_loss: 26.3329
Epoch 55/500
500/500 [==============================] - 1s - loss: 28.7239 - val_loss: 25.6868
Epoch 56/500
500/500 [==============================] - 1s - loss: 28.5961 - val_loss: 26.4685
Epoch 57/500
500/500 [==============================] - 1s - loss: 29.7481 - val_loss: 26.0791
Epoch 58/500
500/500 [==============================] - 1s - loss: 28.8565 - val_loss: 27.3456
Epoch 59/500
500/500 [==============================] - 1s - loss: 28.8071 - val_loss: 25.8198
Epoch 60/500
500/500 [==============================] - 1s - loss: 28.3281 - val_loss: 25.7100
Epoch 61/500
500/500 [==============================] - 1s - loss: 27.8777 - val_loss: 26.0692
Epoch 62/500
500/500 [==============================] - 1s - loss: 27.8926 - val_loss: 25.4982
Epoch 63/500
500/500 [==============================] - 1s - loss: 27.6902 - val_loss: 25.2152
Epoch 64/500
500/500 [==============================] - 1s - loss: 27.1233 - val_loss: 24.7323
Epoch 65/500
500/500 [==============================] - 1s - loss: 26.8366 - val_loss: 24.5293
Epoch 66/500
500/500 [==============================] - 1s - loss: 27.0532 - val_loss: 24.8751
Epoch 67/500
500/500 [==============================] - 1s - loss: 27.3120 - val_loss: 24.3714
Epoch 68/500
500/500 [==============================] - 1s - loss: 26.7316 - val_loss: 24.9043
Epoch 69/500
500/500 [==============================] - 1s - loss: 26.9798 - val_loss: 23.8858
Epoch 70/500
500/500 [==============================] - 1s - loss: 26.3727 - val_loss: 23.8449
Epoch 71/500
500/500 [==============================] - 1s - loss: 26.0630 - val_loss: 23.6661
Epoch 72/500
500/500 [==============================] - 1s - loss: 26.0013 - val_loss: 23.5329
Epoch 73/500
500/500 [==============================] - 1s - loss: 26.1116 - val_loss: 23.7442
Epoch 74/500
500/500 [==============================] - 1s - loss: 25.8768 - val_loss: 23.4318
Epoch 75/500
500/500 [==============================] - 1s - loss: 26.1874 - val_loss: 23.4129
Epoch 76/500
500/500 [==============================] - 1s - loss: 27.0570 - val_loss: 23.4328
Epoch 77/500
500/500 [==============================] - 1s - loss: 25.6738 - val_loss: 22.9433
Epoch 78/500
500/500 [==============================] - 1s - loss: 25.2788 - val_loss: 22.4110
Epoch 79/500
500/500 [==============================] - 1s - loss: 24.9501 - val_loss: 21.9928
Epoch 80/500
500/500 [==============================] - 1s - loss: 24.7120 - val_loss: 22.5425
Epoch 81/500
500/500 [==============================] - 1s - loss: 24.7361 - val_loss: 22.6039
Epoch 82/500
500/500 [==============================] - 1s - loss: 24.9983 - val_loss: 22.7363
Epoch 83/500
500/500 [==============================] - 1s - loss: 25.2060 - val_loss: 22.4622
Epoch 84/500
500/500 [==============================] - 1s - loss: 24.8344 - val_loss: 21.8732
Epoch 85/500
500/500 [==============================] - 1s - loss: 23.9391 - val_loss: 21.3500
Epoch 86/500
500/500 [==============================] - 1s - loss: 23.5522 - val_loss: 21.1678
Epoch 87/500
500/500 [==============================] - 1s - loss: 23.5628 - val_loss: 21.5371
Epoch 88/500
500/500 [==============================] - 1s - loss: 23.7517 - val_loss: 21.7780
Epoch 89/500
500/500 [==============================] - 1s - loss: 23.5532 - val_loss: 22.1706
Epoch 90/500
500/500 [==============================] - 1s - loss: 23.8794 - val_loss: 20.1531
Epoch 91/500
500/500 [==============================] - 1s - loss: 22.6723 - val_loss: 20.2714
Epoch 92/500
500/500 [==============================] - 1s - loss: 22.3922 - val_loss: 19.2760
Epoch 93/500
500/500 [==============================] - 1s - loss: 21.8145 - val_loss: 18.5101
Epoch 94/500
500/500 [==============================] - 1s - loss: 22.4426 - val_loss: 19.3888
Epoch 95/500
500/500 [==============================] - 1s - loss: 22.0816 - val_loss: 18.8926
Epoch 96/500
500/500 [==============================] - 1s - loss: 21.7314 - val_loss: 18.1874
Epoch 97/500
500/500 [==============================] - 1s - loss: 21.8398 - val_loss: 18.5346
Epoch 98/500
500/500 [==============================] - 1s - loss: 21.7493 - val_loss: 20.6972
Epoch 99/500
500/500 [==============================] - 1s - loss: 21.9077 - val_loss: 19.2547
Epoch 100/500
500/500 [==============================] - 1s - loss: 21.1385 - val_loss: 17.6240
Epoch 101/500
500/500 [==============================] - 1s - loss: 20.9727 - val_loss: 17.6485
Epoch 102/500
500/500 [==============================] - 1s - loss: 20.7763 - val_loss: 17.6589
Epoch 103/500
500/500 [==============================] - 1s - loss: 20.2651 - val_loss: 16.5054
Epoch 104/500
500/500 [==============================] - 1s - loss: 19.4422 - val_loss: 16.0809
Epoch 105/500
500/500 [==============================] - 1s - loss: 19.2042 - val_loss: 16.9620
Epoch 106/500
500/500 [==============================] - 1s - loss: 19.6524 - val_loss: 16.7391
Epoch 107/500
500/500 [==============================] - 1s - loss: 19.5323 - val_loss: 16.2183
Epoch 108/500
500/500 [==============================] - 1s - loss: 19.1176 - val_loss: 16.6020
Epoch 109/500
500/500 [==============================] - 1s - loss: 18.7388 - val_loss: 15.8039
Epoch 110/500
500/500 [==============================] - 1s - loss: 19.0691 - val_loss: 15.7187
Epoch 111/500
500/500 [==============================] - 1s - loss: 18.3063 - val_loss: 14.5503
Epoch 112/500
500/500 [==============================] - 1s - loss: 18.3555 - val_loss: 15.1999
Epoch 113/500
500/500 [==============================] - 1s - loss: 18.1069 - val_loss: 14.9871
Epoch 114/500
500/500 [==============================] - 1s - loss: 17.8411 - val_loss: 14.8636
Epoch 115/500
500/500 [==============================] - 1s - loss: 18.3923 - val_loss: 14.1869
Epoch 116/500
500/500 [==============================] - 1s - loss: 17.8015 - val_loss: 15.2624
Epoch 117/500
500/500 [==============================] - 1s - loss: 18.0717 - val_loss: 13.9149
Epoch 118/500
500/500 [==============================] - 1s - loss: 17.1005 - val_loss: 14.2740
Epoch 119/500
500/500 [==============================] - 1s - loss: 17.2014 - val_loss: 14.4739
Epoch 120/500
500/500 [==============================] - 1s - loss: 17.4387 - val_loss: 14.2247
Epoch 121/500
500/500 [==============================] - 1s - loss: 17.1951 - val_loss: 13.7455
Epoch 122/500
500/500 [==============================] - 1s - loss: 16.8486 - val_loss: 13.1874
Epoch 123/500
500/500 [==============================] - 1s - loss: 16.7053 - val_loss: 13.2789
Epoch 124/500
500/500 [==============================] - 1s - loss: 16.3125 - val_loss: 13.0253
Epoch 125/500
500/500 [==============================] - 1s - loss: 16.3424 - val_loss: 12.7554
Epoch 126/500
500/500 [==============================] - 1s - loss: 16.3314 - val_loss: 14.0382
Epoch 127/500
500/500 [==============================] - 1s - loss: 16.7385 - val_loss: 13.5239
Epoch 128/500
500/500 [==============================] - 1s - loss: 16.2890 - val_loss: 12.5187
Epoch 129/500
500/500 [==============================] - 1s - loss: 15.4437 - val_loss: 11.7787
Epoch 130/500
500/500 [==============================] - 1s - loss: 15.5926 - val_loss: 11.9115
Epoch 131/500
500/500 [==============================] - 1s - loss: 15.0373 - val_loss: 11.4172
Epoch 132/500
500/500 [==============================] - 1s - loss: 15.1642 - val_loss: 11.9214
Epoch 133/500
500/500 [==============================] - 1s - loss: 15.4446 - val_loss: 11.6906
Epoch 134/500
500/500 [==============================] - 1s - loss: 16.5509 - val_loss: 15.0385
Epoch 135/500
500/500 [==============================] - 1s - loss: 16.2195 - val_loss: 12.3908
Epoch 136/500
500/500 [==============================] - 1s - loss: 15.7185 - val_loss: 13.9386
Epoch 137/500
500/500 [==============================] - 1s - loss: 15.6152 - val_loss: 11.8112
Epoch 138/500
500/500 [==============================] - 1s - loss: 15.1574 - val_loss: 11.8416
Epoch 139/500
500/500 [==============================] - 1s - loss: 15.0489 - val_loss: 11.2803
Epoch 140/500
500/500 [==============================] - 1s - loss: 14.4673 - val_loss: 11.4361
Epoch 141/500
500/500 [==============================] - 1s - loss: 16.7280 - val_loss: 13.6167
Epoch 142/500
500/500 [==============================] - 1s - loss: 15.7860 - val_loss: 11.2677
Epoch 143/500
500/500 [==============================] - 1s - loss: 14.1296 - val_loss: 10.6362
Epoch 144/500
500/500 [==============================] - 1s - loss: 14.4168 - val_loss: 11.7518
Epoch 145/500
500/500 [==============================] - 1s - loss: 15.6741 - val_loss: 11.5584
Epoch 146/500
500/500 [==============================] - 1s - loss: 14.8495 - val_loss: 11.8084
Epoch 147/500
500/500 [==============================] - 1s - loss: 13.8308 - val_loss: 10.3624
Epoch 148/500
500/500 [==============================] - 1s - loss: 13.2304 - val_loss: 9.8691
Epoch 149/500
500/500 [==============================] - 1s - loss: 13.3060 - val_loss: 9.5735
Epoch 150/500
500/500 [==============================] - 1s - loss: 13.4854 - val_loss: 9.7293
Epoch 151/500
500/500 [==============================] - 1s - loss: 12.7915 - val_loss: 9.6296
Epoch 152/500
500/500 [==============================] - 1s - loss: 12.4320 - val_loss: 8.8409
Epoch 153/500
500/500 [==============================] - 1s - loss: 12.1876 - val_loss: 9.7054
Epoch 154/500
500/500 [==============================] - 1s - loss: 12.3956 - val_loss: 8.5183
Epoch 155/500
500/500 [==============================] - 1s - loss: 11.9358 - val_loss: 9.3293
Epoch 156/500
500/500 [==============================] - 1s - loss: 12.2306 - val_loss: 8.0850
Epoch 157/500
500/500 [==============================] - 1s - loss: 11.4125 - val_loss: 7.5101
Epoch 158/500
500/500 [==============================] - 1s - loss: 11.0173 - val_loss: 7.7434
Epoch 159/500
500/500 [==============================] - 1s - loss: 11.2014 - val_loss: 7.0060
Epoch 160/500
500/500 [==============================] - 1s - loss: 11.0875 - val_loss: 7.6966
Epoch 161/500
500/500 [==============================] - 1s - loss: 11.6276 - val_loss: 7.1349
Epoch 162/500
500/500 [==============================] - 1s - loss: 10.5399 - val_loss: 6.3728
Epoch 163/500
500/500 [==============================] - 1s - loss: 10.8268 - val_loss: 7.9008
Epoch 164/500
500/500 [==============================] - 1s - loss: 10.9474 - val_loss: 7.5107
Epoch 165/500
500/500 [==============================] - 1s - loss: 11.7909 - val_loss: 8.8236
Epoch 166/500
500/500 [==============================] - 1s - loss: 11.4318 - val_loss: 6.8427
Epoch 167/500
500/500 [==============================] - 1s - loss: 10.7585 - val_loss: 7.4368
Epoch 168/500
500/500 [==============================] - 1s - loss: 10.4682 - val_loss: 6.3239
Epoch 169/500
500/500 [==============================] - 1s - loss: 10.2039 - val_loss: 6.7206
Epoch 170/500
500/500 [==============================] - 1s - loss: 10.5190 - val_loss: 6.8035
Epoch 171/500
500/500 [==============================] - 1s - loss: 9.3056 - val_loss: 6.4316
Epoch 172/500
500/500 [==============================] - 1s - loss: 9.0501 - val_loss: 5.1253
Epoch 173/500
500/500 [==============================] - 1s - loss: 8.3399 - val_loss: 5.7806
Epoch 174/500
500/500 [==============================] - 1s - loss: 8.6715 - val_loss: 4.9853
Epoch 175/500
500/500 [==============================] - 1s - loss: 8.8605 - val_loss: 5.6089
Epoch 176/500
500/500 [==============================] - 1s - loss: 8.2402 - val_loss: 4.5588
Epoch 177/500
500/500 [==============================] - 1s - loss: 8.1634 - val_loss: 5.0486
Epoch 178/500
500/500 [==============================] - 1s - loss: 8.2378 - val_loss: 4.8302
Epoch 179/500
500/500 [==============================] - 1s - loss: 8.2387 - val_loss: 5.2692
Epoch 180/500
500/500 [==============================] - 1s - loss: 8.3342 - val_loss: 5.1009
Epoch 181/500
500/500 [==============================] - 1s - loss: 8.1874 - val_loss: 4.4188
Epoch 182/500
500/500 [==============================] - 1s - loss: 8.5127 - val_loss: 5.8360
Epoch 183/500
500/500 [==============================] - 1s - loss: 9.3278 - val_loss: 7.7671
Epoch 184/500
500/500 [==============================] - 1s - loss: 9.9096 - val_loss: 5.9508
Epoch 185/500
500/500 [==============================] - 1s - loss: 8.7522 - val_loss: 5.0897
Epoch 186/500
500/500 [==============================] - 1s - loss: 8.1514 - val_loss: 5.5797
Epoch 187/500
500/500 [==============================] - 1s - loss: 8.0158 - val_loss: 4.6018
Epoch 188/500
500/500 [==============================] - 1s - loss: 7.2932 - val_loss: 3.6828
Epoch 189/500
500/500 [==============================] - 1s - loss: 6.7976 - val_loss: 3.5923
Epoch 190/500
500/500 [==============================] - 1s - loss: 6.6601 - val_loss: 3.4250
Epoch 191/500
500/500 [==============================] - 1s - loss: 6.5509 - val_loss: 3.8488
Epoch 192/500
500/500 [==============================] - 1s - loss: 6.6878 - val_loss: 3.3129
Epoch 193/500
500/500 [==============================] - 1s - loss: 6.1467 - val_loss: 3.7122
Epoch 194/500
500/500 [==============================] - 1s - loss: 6.6668 - val_loss: 3.8315
Epoch 195/500
500/500 [==============================] - 1s - loss: 7.0483 - val_loss: 5.8750
Epoch 196/500
500/500 [==============================] - 1s - loss: 7.1647 - val_loss: 4.6958
Epoch 197/500
500/500 [==============================] - 1s - loss: 6.7713 - val_loss: 3.3452
Epoch 198/500
500/500 [==============================] - 1s - loss: 6.5446 - val_loss: 3.3485
Epoch 199/500
500/500 [==============================] - 1s - loss: 6.3982 - val_loss: 3.9603
Epoch 200/500
500/500 [==============================] - 1s - loss: 6.5716 - val_loss: 3.6029
Epoch 201/500
500/500 [==============================] - 1s - loss: 6.6997 - val_loss: 3.1458
Epoch 202/500
500/500 [==============================] - 1s - loss: 6.2691 - val_loss: 3.2734
Epoch 203/500
500/500 [==============================] - 1s - loss: 6.4622 - val_loss: 3.3147
Epoch 204/500
500/500 [==============================] - 1s - loss: 5.9702 - val_loss: 2.4278
Epoch 205/500
500/500 [==============================] - 1s - loss: 5.6693 - val_loss: 2.9080
Epoch 206/500
500/500 [==============================] - 1s - loss: 6.0875 - val_loss: 2.8858
Epoch 207/500
500/500 [==============================] - 1s - loss: 5.5837 - val_loss: 3.1185
Epoch 208/500
500/500 [==============================] - 1s - loss: 5.6562 - val_loss: 2.7291
Epoch 209/500
500/500 [==============================] - 1s - loss: 5.4512 - val_loss: 2.5840
Epoch 210/500
500/500 [==============================] - 1s - loss: 5.4928 - val_loss: 3.1645
Epoch 211/500
500/500 [==============================] - 1s - loss: 5.6749 - val_loss: 3.1559
Epoch 212/500
500/500 [==============================] - 1s - loss: 6.1027 - val_loss: 2.9530
Epoch 213/500
500/500 [==============================] - 1s - loss: 5.7644 - val_loss: 2.8974
Epoch 214/500
500/500 [==============================] - 1s - loss: 5.4408 - val_loss: 3.0485
Epoch 215/500
500/500 [==============================] - 1s - loss: 5.4080 - val_loss: 2.2956
Epoch 216/500
500/500 [==============================] - 1s - loss: 4.9712 - val_loss: 2.1414
Epoch 217/500
500/500 [==============================] - 1s - loss: 4.7840 - val_loss: 1.8948
Epoch 218/500
500/500 [==============================] - 1s - loss: 5.1520 - val_loss: 2.5227
Epoch 219/500
500/500 [==============================] - 1s - loss: 5.3126 - val_loss: 1.8040
Epoch 220/500
500/500 [==============================] - 1s - loss: 4.8045 - val_loss: 2.0338
Epoch 221/500
500/500 [==============================] - 1s - loss: 4.6550 - val_loss: 1.9782
Epoch 222/500
500/500 [==============================] - 1s - loss: 4.6351 - val_loss: 1.8332
Epoch 223/500
500/500 [==============================] - 1s - loss: 4.6952 - val_loss: 2.2893
Epoch 224/500
500/500 [==============================] - 1s - loss: 4.6099 - val_loss: 2.3695
Epoch 225/500
500/500 [==============================] - 1s - loss: 4.5715 - val_loss: 1.8765
Epoch 226/500
500/500 [==============================] - 1s - loss: 4.3441 - val_loss: 1.7817
Epoch 227/500
500/500 [==============================] - 1s - loss: 4.2001 - val_loss: 1.7008
Epoch 228/500
500/500 [==============================] - 1s - loss: 4.5778 - val_loss: 1.9930
Epoch 229/500
500/500 [==============================] - 1s - loss: 4.5752 - val_loss: 1.9139
Epoch 230/500
500/500 [==============================] - 1s - loss: 4.5134 - val_loss: 1.6818
Epoch 231/500
500/500 [==============================] - 1s - loss: 4.4104 - val_loss: 1.4291
Epoch 232/500
500/500 [==============================] - 1s - loss: 4.3837 - val_loss: 2.0426
Epoch 233/500
500/500 [==============================] - 1s - loss: 4.5516 - val_loss: 1.8445
Epoch 234/500
500/500 [==============================] - 1s - loss: 4.4904 - val_loss: 1.8949
Epoch 235/500
500/500 [==============================] - 1s - loss: 4.4605 - val_loss: 1.5963
Epoch 236/500
500/500 [==============================] - 1s - loss: 4.3438 - val_loss: 1.8792
Epoch 237/500
500/500 [==============================] - 1s - loss: 4.3992 - val_loss: 1.6114
Epoch 238/500
500/500 [==============================] - 1s - loss: 4.1809 - val_loss: 2.0185
Epoch 239/500
500/500 [==============================] - 1s - loss: 4.2456 - val_loss: 1.5622
Epoch 240/500
500/500 [==============================] - 1s - loss: 4.3564 - val_loss: 1.6728
Epoch 241/500
500/500 [==============================] - 1s - loss: 4.1857 - val_loss: 2.0035
Epoch 242/500
500/500 [==============================] - 1s - loss: 4.4218 - val_loss: 2.1638
Epoch 243/500
500/500 [==============================] - 1s - loss: 4.3590 - val_loss: 1.9175
Epoch 244/500
500/500 [==============================] - 1s - loss: 4.4782 - val_loss: 2.3463
Epoch 245/500
500/500 [==============================] - 1s - loss: 4.5182 - val_loss: 1.9176
Epoch 246/500
500/500 [==============================] - 1s - loss: 4.2608 - val_loss: 1.5383
Epoch 247/500
500/500 [==============================] - 1s - loss: 4.4674 - val_loss: 2.0951
Epoch 248/500
500/500 [==============================] - 1s - loss: 3.9751 - val_loss: 1.3204
Epoch 249/500
500/500 [==============================] - 1s - loss: 4.0403 - val_loss: 1.7277
Epoch 250/500
500/500 [==============================] - 1s - loss: 4.0162 - val_loss: 1.5315
Epoch 251/500
500/500 [==============================] - 1s - loss: 3.8845 - val_loss: 1.3248
Epoch 252/500
500/500 [==============================] - 1s - loss: 3.7396 - val_loss: 1.1626
Epoch 253/500
500/500 [==============================] - 1s - loss: 3.7342 - val_loss: 1.4158
Epoch 254/500
500/500 [==============================] - 1s - loss: 3.8723 - val_loss: 1.4234
Epoch 255/500
500/500 [==============================] - 1s - loss: 3.6967 - val_loss: 0.9893
Epoch 256/500
500/500 [==============================] - 1s - loss: 3.6360 - val_loss: 1.7676
Epoch 257/500
500/500 [==============================] - 1s - loss: 4.0274 - val_loss: 1.4162
Epoch 258/500
500/500 [==============================] - 1s - loss: 3.8734 - val_loss: 1.3667
Epoch 259/500
500/500 [==============================] - 1s - loss: 3.7334 - val_loss: 1.3034
Epoch 260/500
500/500 [==============================] - 1s - loss: 3.6527 - val_loss: 1.2300
Epoch 261/500
500/500 [==============================] - 1s - loss: 3.8820 - val_loss: 1.7735
Epoch 262/500
500/500 [==============================] - 1s - loss: 3.9917 - val_loss: 1.3752
Epoch 263/500
500/500 [==============================] - 1s - loss: 3.6973 - val_loss: 1.4040
Epoch 264/500
500/500 [==============================] - 1s - loss: 3.7384 - val_loss: 1.3597
Epoch 265/500
500/500 [==============================] - 1s - loss: 3.8233 - val_loss: 1.5710
Epoch 266/500
500/500 [==============================] - 1s - loss: 3.9037 - val_loss: 1.5031
Epoch 267/500
500/500 [==============================] - 1s - loss: 3.7198 - val_loss: 1.0980
Epoch 268/500
500/500 [==============================] - 1s - loss: 3.6646 - val_loss: 1.6870
Epoch 269/500
500/500 [==============================] - 1s - loss: 3.7391 - val_loss: 1.4695
Epoch 270/500
500/500 [==============================] - 1s - loss: 3.8487 - val_loss: 1.5701
Epoch 271/500
500/500 [==============================] - 1s - loss: 3.6862 - val_loss: 1.0557
Epoch 272/500
500/500 [==============================] - 1s - loss: 3.5585 - val_loss: 1.5156
Epoch 273/500
500/500 [==============================] - 1s - loss: 3.8232 - val_loss: 1.3221
Epoch 274/500
500/500 [==============================] - 1s - loss: 3.8222 - val_loss: 1.3993
Epoch 275/500
500/500 [==============================] - 1s - loss: 3.6637 - val_loss: 1.2120
Epoch 276/500
500/500 [==============================] - 1s - loss: 3.5550 - val_loss: 1.5198
Epoch 277/500
500/500 [==============================] - 1s - loss: 3.5031 - val_loss: 1.3929
Epoch 278/500
500/500 [==============================] - 1s - loss: 3.9795 - val_loss: 1.4485
Epoch 279/500
500/500 [==============================] - 1s - loss: 3.8654 - val_loss: 1.4748
Epoch 280/500
500/500 [==============================] - 1s - loss: 3.4574 - val_loss: 1.2789
Epoch 281/500
500/500 [==============================] - 1s - loss: 3.5138 - val_loss: 1.2360
Epoch 282/500
500/500 [==============================] - 1s - loss: 3.7030 - val_loss: 1.3026
Epoch 283/500
500/500 [==============================] - 1s - loss: 3.8741 - val_loss: 1.4417
Epoch 284/500
500/500 [==============================] - 1s - loss: 3.7972 - val_loss: 1.1690
Epoch 285/500
500/500 [==============================] - 1s - loss: 3.3484 - val_loss: 1.2018
Epoch 286/500
500/500 [==============================] - 1s - loss: 3.3349 - val_loss: 0.9829
Epoch 287/500
500/500 [==============================] - 1s - loss: 3.4195 - val_loss: 1.1481
Epoch 288/500
500/500 [==============================] - 1s - loss: 3.4528 - val_loss: 1.3549
Epoch 289/500
500/500 [==============================] - 1s - loss: 3.5590 - val_loss: 1.9513
Epoch 290/500
500/500 [==============================] - 1s - loss: 4.0321 - val_loss: 1.5812
Epoch 291/500
500/500 [==============================] - 1s - loss: 3.6949 - val_loss: 1.6886
Epoch 292/500
500/500 [==============================] - 1s - loss: 3.7315 - val_loss: 1.2912
Epoch 293/500
500/500 [==============================] - 1s - loss: 3.5747 - val_loss: 1.3013
Epoch 294/500
500/500 [==============================] - 1s - loss: 3.3887 - val_loss: 1.0416
Epoch 295/500
500/500 [==============================] - 1s - loss: 3.3819 - val_loss: 1.0654
Epoch 296/500
500/500 [==============================] - 1s - loss: 3.4369 - val_loss: 1.2010
Epoch 297/500
500/500 [==============================] - 1s - loss: 3.4015 - val_loss: 1.1858
Epoch 298/500
500/500 [==============================] - 1s - loss: 3.3568 - val_loss: 1.0868
Epoch 299/500
500/500 [==============================] - 1s - loss: 3.3142 - val_loss: 1.4660
Epoch 300/500
500/500 [==============================] - 1s - loss: 3.7237 - val_loss: 1.2372
Epoch 301/500
500/500 [==============================] - 1s - loss: 3.4159 - val_loss: 1.6738
Epoch 302/500
500/500 [==============================] - 1s - loss: 3.5486 - val_loss: 1.2870
Epoch 303/500
500/500 [==============================] - 1s - loss: 3.4404 - val_loss: 1.6207
Epoch 304/500
500/500 [==============================] - 1s - loss: 3.2716 - val_loss: 1.2255
Epoch 305/500
500/500 [==============================] - 1s - loss: 3.1875 - val_loss: 1.3057
Epoch 306/500
500/500 [==============================] - 1s - loss: 3.4978 - val_loss: 1.2490
Epoch 307/500
500/500 [==============================] - 1s - loss: 3.5266 - val_loss: 1.3423
Epoch 308/500
500/500 [==============================] - 1s - loss: 3.4850 - val_loss: 1.3093
Epoch 309/500
500/500 [==============================] - 1s - loss: 3.4766 - val_loss: 1.4630
Epoch 310/500
500/500 [==============================] - 1s - loss: 3.3026 - val_loss: 1.0277
Epoch 311/500
500/500 [==============================] - 1s - loss: 3.1343 - val_loss: 0.9550
Epoch 312/500
500/500 [==============================] - 1s - loss: 3.2058 - val_loss: 0.9907
Epoch 313/500
500/500 [==============================] - 1s - loss: 3.3018 - val_loss: 1.4125
Epoch 314/500
500/500 [==============================] - 1s - loss: 3.3261 - val_loss: 0.9826
Epoch 315/500
500/500 [==============================] - 1s - loss: 3.1498 - val_loss: 1.0712
Epoch 316/500
500/500 [==============================] - 1s - loss: 3.2153 - val_loss: 1.0992
Epoch 317/500
500/500 [==============================] - 1s - loss: 3.2806 - val_loss: 1.3962
Epoch 318/500
500/500 [==============================] - 1s - loss: 3.3730 - val_loss: 1.4300
Epoch 319/500
500/500 [==============================] - 1s - loss: 3.4524 - val_loss: 1.1916
Epoch 320/500
500/500 [==============================] - 1s - loss: 3.3216 - val_loss: 1.0728
Epoch 321/500
500/500 [==============================] - 1s - loss: 3.1925 - val_loss: 0.9582
Epoch 322/500
500/500 [==============================] - 1s - loss: 3.1302 - val_loss: 1.0066
Epoch 323/500
500/500 [==============================] - 1s - loss: 3.0876 - val_loss: 1.3794
Epoch 324/500
500/500 [==============================] - 1s - loss: 3.0836 - val_loss: 1.1581
Epoch 325/500
500/500 [==============================] - 1s - loss: 3.2366 - val_loss: 1.3415
Epoch 326/500
500/500 [==============================] - 1s - loss: 3.1781 - val_loss: 1.0848
Epoch 327/500
500/500 [==============================] - 1s - loss: 3.1847 - val_loss: 1.3082
Epoch 328/500
500/500 [==============================] - 1s - loss: 3.1997 - val_loss: 1.3481
Epoch 329/500
500/500 [==============================] - 1s - loss: 3.1705 - val_loss: 1.2140
Epoch 330/500
500/500 [==============================] - 1s - loss: 3.2323 - val_loss: 0.9882
Epoch 331/500
500/500 [==============================] - 1s - loss: 3.2079 - val_loss: 1.4395
Epoch 332/500
500/500 [==============================] - 1s - loss: 3.3927 - val_loss: 1.2815
Epoch 333/500
500/500 [==============================] - 1s - loss: 3.2788 - val_loss: 1.3950
Epoch 334/500
500/500 [==============================] - 1s - loss: 3.2899 - val_loss: 1.3792
Epoch 335/500
500/500 [==============================] - 1s - loss: 3.2420 - val_loss: 1.1922
Epoch 336/500
500/500 [==============================] - 1s - loss: 3.2977 - val_loss: 1.1514
Epoch 337/500
500/500 [==============================] - 1s - loss: 3.0439 - val_loss: 0.9693
Epoch 338/500
500/500 [==============================] - 1s - loss: 3.0493 - val_loss: 1.3604
Epoch 339/500
500/500 [==============================] - 1s - loss: 3.3884 - val_loss: 1.5604
Epoch 340/500
500/500 [==============================] - 1s - loss: 3.6037 - val_loss: 1.6549
Epoch 341/500
500/500 [==============================] - 1s - loss: 3.5605 - val_loss: 1.3416
Epoch 342/500
500/500 [==============================] - 1s - loss: 3.4757 - val_loss: 2.0039
Epoch 343/500
500/500 [==============================] - 1s - loss: 3.5074 - val_loss: 1.1451
Epoch 344/500
500/500 [==============================] - 1s - loss: 3.2544 - val_loss: 1.1766
Epoch 345/500
500/500 [==============================] - 1s - loss: 3.0757 - val_loss: 1.5257
Epoch 346/500
500/500 [==============================] - 1s - loss: 3.2114 - val_loss: 1.3101
Epoch 347/500
500/500 [==============================] - 1s - loss: 3.2737 - val_loss: 1.5882
Epoch 348/500
500/500 [==============================] - 1s - loss: 3.3171 - val_loss: 1.1697
Epoch 349/500
500/500 [==============================] - 1s - loss: 3.0213 - val_loss: 1.2819
Epoch 350/500
500/500 [==============================] - 1s - loss: 3.0606 - val_loss: 0.9880
Epoch 351/500
500/500 [==============================] - 1s - loss: 3.0650 - val_loss: 1.3208
Epoch 352/500
500/500 [==============================] - 1s - loss: 3.1045 - val_loss: 1.3940
Epoch 353/500
500/500 [==============================] - 1s - loss: 3.2777 - val_loss: 1.4500
Epoch 354/500
500/500 [==============================] - 1s - loss: 3.2692 - val_loss: 1.1134
Epoch 355/500
500/500 [==============================] - 1s - loss: 3.1557 - val_loss: 1.3617
Epoch 356/500
500/500 [==============================] - 1s - loss: 3.1645 - val_loss: 1.5315
Epoch 357/500
500/500 [==============================] - 1s - loss: 3.2510 - val_loss: 1.1977
Epoch 358/500
500/500 [==============================] - 1s - loss: 3.2341 - val_loss: 1.3880
Epoch 359/500
500/500 [==============================] - 1s - loss: 3.2242 - val_loss: 1.0072
Epoch 360/500
500/500 [==============================] - 1s - loss: 3.0256 - val_loss: 1.0613
Epoch 361/500
500/500 [==============================] - 1s - loss: 3.0052 - val_loss: 1.1863
Epoch 362/500
500/500 [==============================] - 1s - loss: 2.9494 - val_loss: 1.5005
Epoch 363/500
500/500 [==============================] - 1s - loss: 3.1848 - val_loss: 0.9270
Epoch 364/500
500/500 [==============================] - 1s - loss: 3.0877 - val_loss: 1.1687
Epoch 365/500
500/500 [==============================] - 1s - loss: 3.0506 - val_loss: 0.9988
Epoch 366/500
500/500 [==============================] - 1s - loss: 2.9690 - val_loss: 1.1543
Epoch 367/500
500/500 [==============================] - 1s - loss: 3.0979 - val_loss: 1.2624
Epoch 368/500
500/500 [==============================] - 1s - loss: 3.0079 - val_loss: 1.1323
Epoch 369/500
500/500 [==============================] - 1s - loss: 3.0521 - val_loss: 1.2321
Epoch 370/500
500/500 [==============================] - 1s - loss: 3.0867 - val_loss: 1.1142
Epoch 371/500
500/500 [==============================] - 1s - loss: 2.9492 - val_loss: 0.9846
Epoch 372/500
500/500 [==============================] - 1s - loss: 2.9953 - val_loss: 0.9794
Epoch 373/500
500/500 [==============================] - 1s - loss: 3.1030 - val_loss: 1.2909
Epoch 374/500
500/500 [==============================] - 1s - loss: 3.1844 - val_loss: 1.0073
Epoch 375/500
500/500 [==============================] - 1s - loss: 3.0648 - val_loss: 1.2751
Epoch 376/500
500/500 [==============================] - 1s - loss: 3.0570 - val_loss: 1.0687
Epoch 377/500
500/500 [==============================] - 1s - loss: 2.9099 - val_loss: 0.9214
Epoch 378/500
500/500 [==============================] - 1s - loss: 2.8927 - val_loss: 0.9752
Epoch 379/500
500/500 [==============================] - 1s - loss: 2.7753 - val_loss: 0.8077
Epoch 380/500
500/500 [==============================] - 1s - loss: 2.7440 - val_loss: 0.8956
Epoch 381/500
500/500 [==============================] - 1s - loss: 2.7609 - val_loss: 1.0479
Epoch 382/500
500/500 [==============================] - 1s - loss: 2.7874 - val_loss: 0.8562
Epoch 383/500
500/500 [==============================] - 1s - loss: 2.7265 - val_loss: 0.6732
Epoch 384/500
500/500 [==============================] - 1s - loss: 2.7713 - val_loss: 1.0092
Epoch 385/500
500/500 [==============================] - 1s - loss: 2.8485 - val_loss: 1.0239
Epoch 386/500
500/500 [==============================] - 1s - loss: 2.8394 - val_loss: 1.0833
Epoch 387/500
500/500 [==============================] - 1s - loss: 2.8544 - val_loss: 1.2758
Epoch 388/500
500/500 [==============================] - 1s - loss: 2.9453 - val_loss: 0.9304
Epoch 389/500
500/500 [==============================] - 1s - loss: 2.8345 - val_loss: 0.9291
Epoch 390/500
500/500 [==============================] - 1s - loss: 2.8187 - val_loss: 1.1854
Epoch 391/500
500/500 [==============================] - 1s - loss: 2.7440 - val_loss: 0.8075
Epoch 392/500
500/500 [==============================] - 1s - loss: 2.6701 - val_loss: 0.8387
Epoch 393/500
500/500 [==============================] - 1s - loss: 2.8044 - val_loss: 0.8178
Epoch 394/500
500/500 [==============================] - 1s - loss: 2.8569 - val_loss: 1.1718
Epoch 395/500
500/500 [==============================] - 1s - loss: 2.9057 - val_loss: 1.0679
Epoch 396/500
500/500 [==============================] - 1s - loss: 2.9336 - val_loss: 1.3327
Epoch 397/500
500/500 [==============================] - 1s - loss: 2.9622 - val_loss: 1.0381
Epoch 398/500
500/500 [==============================] - 1s - loss: 2.8567 - val_loss: 1.0641
Epoch 399/500
500/500 [==============================] - 1s - loss: 3.0400 - val_loss: 1.2560
Epoch 400/500
500/500 [==============================] - 1s - loss: 2.8940 - val_loss: 1.0361
Epoch 401/500
500/500 [==============================] - 1s - loss: 2.7723 - val_loss: 1.0377
Epoch 402/500
500/500 [==============================] - 1s - loss: 2.7850 - val_loss: 1.0826
Epoch 403/500
500/500 [==============================] - 1s - loss: 2.8017 - val_loss: 0.8878
Epoch 404/500
500/500 [==============================] - 1s - loss: 2.7510 - val_loss: 0.8614
Epoch 405/500
500/500 [==============================] - 1s - loss: 2.8098 - val_loss: 0.9802
Epoch 406/500
500/500 [==============================] - 1s - loss: 2.9680 - val_loss: 1.1796
Epoch 407/500
500/500 [==============================] - 1s - loss: 2.7935 - val_loss: 0.9946
Epoch 408/500
500/500 [==============================] - 1s - loss: 2.9327 - val_loss: 1.4287
Epoch 409/500
500/500 [==============================] - 1s - loss: 2.9698 - val_loss: 1.0838
Epoch 410/500
500/500 [==============================] - 1s - loss: 2.8139 - val_loss: 0.7942
Epoch 411/500
500/500 [==============================] - 1s - loss: 2.6702 - val_loss: 0.9439
Epoch 412/500
500/500 [==============================] - 1s - loss: 2.6510 - val_loss: 0.7810
Epoch 413/500
500/500 [==============================] - 1s - loss: 2.6641 - val_loss: 0.8238
Epoch 414/500
500/500 [==============================] - 1s - loss: 2.7782 - val_loss: 1.1202
Epoch 415/500
500/500 [==============================] - 1s - loss: 2.9678 - val_loss: 1.1215
Epoch 416/500
500/500 [==============================] - 1s - loss: 2.7939 - val_loss: 0.9038
Epoch 417/500
500/500 [==============================] - 1s - loss: 2.8002 - val_loss: 1.2477
Epoch 418/500
500/500 [==============================] - 1s - loss: 2.9498 - val_loss: 1.2322
Epoch 419/500
500/500 [==============================] - 1s - loss: 2.8769 - val_loss: 1.0341
Epoch 420/500
500/500 [==============================] - 1s - loss: 2.8150 - val_loss: 1.0834
Epoch 421/500
500/500 [==============================] - 1s - loss: 2.7527 - val_loss: 1.0528
Epoch 422/500
500/500 [==============================] - 1s - loss: 2.8166 - val_loss: 1.1400
Epoch 423/500
500/500 [==============================] - 1s - loss: 2.9064 - val_loss: 1.0067
Epoch 424/500
500/500 [==============================] - 1s - loss: 2.6595 - val_loss: 1.0117
Epoch 425/500
500/500 [==============================] - 1s - loss: 2.8324 - val_loss: 1.1863
Epoch 426/500
500/500 [==============================] - 1s - loss: 2.8581 - val_loss: 1.1083
Epoch 427/500
500/500 [==============================] - 1s - loss: 2.8051 - val_loss: 0.8193
Epoch 428/500
500/500 [==============================] - 1s - loss: 2.5928 - val_loss: 1.0478
Epoch 429/500
500/500 [==============================] - 1s - loss: 2.7161 - val_loss: 0.8672
Epoch 430/500
500/500 [==============================] - 1s - loss: 2.7581 - val_loss: 1.2649
Epoch 431/500
500/500 [==============================] - 1s - loss: 2.8570 - val_loss: 1.2107
Epoch 432/500
500/500 [==============================] - 1s - loss: 2.9855 - val_loss: 1.2049
Epoch 433/500
500/500 [==============================] - 1s - loss: 2.8624 - val_loss: 1.0689
Epoch 434/500
500/500 [==============================] - 1s - loss: 2.7993 - val_loss: 1.5174
Epoch 435/500
500/500 [==============================] - 1s - loss: 2.9518 - val_loss: 1.0728
Epoch 436/500
500/500 [==============================] - 1s - loss: 3.0064 - val_loss: 1.2256
Epoch 437/500
500/500 [==============================] - 1s - loss: 2.9413 - val_loss: 0.8973
Epoch 438/500
500/500 [==============================] - 1s - loss: 2.8198 - val_loss: 1.1681
Epoch 439/500
500/500 [==============================] - 1s - loss: 2.6616 - val_loss: 0.8427
Epoch 440/500
500/500 [==============================] - 1s - loss: 2.6762 - val_loss: 1.1082
Epoch 441/500
500/500 [==============================] - 1s - loss: 2.7853 - val_loss: 0.9196
Epoch 442/500
500/500 [==============================] - 1s - loss: 2.7146 - val_loss: 1.1087
Epoch 443/500
500/500 [==============================] - 1s - loss: 2.7808 - val_loss: 1.0361
Epoch 444/500
500/500 [==============================] - 1s - loss: 2.7023 - val_loss: 0.9198
Epoch 445/500
500/500 [==============================] - 1s - loss: 2.7801 - val_loss: 1.1487
Epoch 446/500
500/500 [==============================] - 1s - loss: 2.9748 - val_loss: 0.9606
Epoch 447/500
500/500 [==============================] - 1s - loss: 2.8379 - val_loss: 1.0124
Epoch 448/500
500/500 [==============================] - 1s - loss: 2.7821 - val_loss: 0.9282
Epoch 449/500
500/500 [==============================] - 1s - loss: 2.6463 - val_loss: 1.1668
Epoch 450/500
500/500 [==============================] - 1s - loss: 2.7363 - val_loss: 0.8944
Epoch 451/500
500/500 [==============================] - 1s - loss: 2.7149 - val_loss: 1.1372
Epoch 452/500
500/500 [==============================] - 1s - loss: 2.7972 - val_loss: 1.0422
Epoch 453/500
500/500 [==============================] - 1s - loss: 2.9121 - val_loss: 0.9869
Epoch 454/500
500/500 [==============================] - 1s - loss: 2.8324 - val_loss: 0.9611
Epoch 455/500
500/500 [==============================] - 1s - loss: 2.6154 - val_loss: 0.9452
Epoch 456/500
500/500 [==============================] - 1s - loss: 2.7626 - val_loss: 0.9421
Epoch 457/500
500/500 [==============================] - 1s - loss: 2.6960 - val_loss: 1.2721
Epoch 458/500
500/500 [==============================] - 1s - loss: 2.9348 - val_loss: 1.1670
Epoch 459/500
500/500 [==============================] - 1s - loss: 2.7938 - val_loss: 0.9307
Epoch 460/500
500/500 [==============================] - 1s - loss: 2.7965 - val_loss: 0.9277
Epoch 461/500
500/500 [==============================] - 1s - loss: 2.5116 - val_loss: 1.1485
Epoch 462/500
500/500 [==============================] - 1s - loss: 2.7482 - val_loss: 1.1774
Epoch 463/500
500/500 [==============================] - 1s - loss: 2.8449 - val_loss: 0.8904
Epoch 464/500
500/500 [==============================] - 1s - loss: 2.8624 - val_loss: 1.2008
Epoch 465/500
500/500 [==============================] - 1s - loss: 2.8798 - val_loss: 1.0452
Epoch 466/500
500/500 [==============================] - 1s - loss: 2.6510 - val_loss: 0.9477
Epoch 467/500
500/500 [==============================] - 1s - loss: 2.7047 - val_loss: 1.3045
Epoch 468/500
500/500 [==============================] - 1s - loss: 2.9081 - val_loss: 1.2746
Epoch 469/500
500/500 [==============================] - 1s - loss: 2.8157 - val_loss: 1.2106
Epoch 470/500
500/500 [==============================] - 1s - loss: 2.7818 - val_loss: 1.6937
Epoch 471/500
500/500 [==============================] - 1s - loss: 2.8250 - val_loss: 1.1361
Epoch 472/500
500/500 [==============================] - 1s - loss: 2.6816 - val_loss: 1.1325
Epoch 473/500
500/500 [==============================] - 1s - loss: 2.8659 - val_loss: 1.1268
Epoch 474/500
500/500 [==============================] - 1s - loss: 2.7532 - val_loss: 1.0626
Epoch 475/500
500/500 [==============================] - 1s - loss: 2.7380 - val_loss: 1.6342
Epoch 476/500
500/500 [==============================] - 1s - loss: 2.9656 - val_loss: 1.1002
Epoch 477/500
500/500 [==============================] - 1s - loss: 2.6675 - val_loss: 0.9056
Epoch 478/500
500/500 [==============================] - 1s - loss: 2.6789 - val_loss: 0.9996
Epoch 479/500
500/500 [==============================] - 1s - loss: 2.6139 - val_loss: 0.8488
Epoch 480/500
500/500 [==============================] - 1s - loss: 2.6518 - val_loss: 1.1997
Epoch 481/500
500/500 [==============================] - 1s - loss: 2.5539 - val_loss: 1.0100
Epoch 482/500
500/500 [==============================] - 1s - loss: 2.5982 - val_loss: 0.8822
Epoch 483/500
500/500 [==============================] - 1s - loss: 2.7610 - val_loss: 0.9569
Epoch 484/500
500/500 [==============================] - 1s - loss: 2.6718 - val_loss: 0.8928
Epoch 485/500
500/500 [==============================] - 1s - loss: 2.5639 - val_loss: 1.0198
Epoch 486/500
500/500 [==============================] - 1s - loss: 2.7998 - val_loss: 1.2749
Epoch 487/500
500/500 [==============================] - 1s - loss: 2.7768 - val_loss: 1.2442
Epoch 488/500
500/500 [==============================] - 1s - loss: 2.9754 - val_loss: 1.1099
Epoch 489/500
500/500 [==============================] - 1s - loss: 2.7664 - val_loss: 1.2537
Epoch 490/500
500/500 [==============================] - 1s - loss: 2.7629 - val_loss: 1.0294
Epoch 491/500
500/500 [==============================] - 1s - loss: 2.6245 - val_loss: 1.1686
Epoch 492/500
500/500 [==============================] - 1s - loss: 2.5552 - val_loss: 0.9612
Epoch 493/500
500/500 [==============================] - 1s - loss: 2.5345 - val_loss: 1.1487
Epoch 494/500
500/500 [==============================] - 1s - loss: 2.5948 - val_loss: 1.2097
Epoch 495/500
500/500 [==============================] - 1s - loss: 2.5864 - val_loss: 0.9257
Epoch 496/500
500/500 [==============================] - 1s - loss: 2.7105 - val_loss: 0.7400
Epoch 497/500
500/500 [==============================] - 1s - loss: 2.5360 - val_loss: 0.9044
Epoch 498/500
500/500 [==============================] - 1s - loss: 2.6540 - val_loss: 1.1479
Epoch 499/500
500/500 [==============================] - 1s - loss: 2.6447 - val_loss: 0.8514
Epoch 500/500
500/500 [==============================] - 1s - loss: 2.5779 - val_loss: 1.1611
CPU times: user 2h 11min 39s, sys: 19min 54s, total: 2h 31min 34s
Wall time: 14min 37s

In [10]:
plt.plot(history.history['val_loss'], label = 'Validation loss')
plt.plot(history.history['loss'], label = 'Training loss')

plt.ylabel("Squared error")
plt.xlabel("Epoch")

plt.ylim([0,50])
plt.legend();


Great! I say, at the level of trusting their data, these results are reproducible!