Sentence Level Sentiment Predictator using Word Embeddings

Generate Word Embedding

In the first section, we read sentiment labelled sentences from IMDB reviews and generate word embeddings.


In [1]:
import pandas as pd
import numpy as np
import os

%matplotlib inline
import matplotlib.pyplot as plt
plt.style.use('ggplot')

In [2]:
sentences = pd.read_csv(
    'imdb_labelled.txt', sep='\|', engine='python',
    header=None, names=['sentence', 'sentiment_label']
)

In [3]:
sentences.head()


Out[3]:
sentence sentiment_label
0 A very, very, very slow-moving, aimless movie ... 0
1 Not sure who was more lost - the flat characte... 0
2 Attempting artiness with black & white and cle... 0
3 Very little music or anything to speak of. 0
4 The best scene in the movie was when Gerardo i... 1

These are the unique sentiment labels:


In [4]:
sentences.sentiment_label.unique()


Out[4]:
array([0, 1], dtype=int64)

Let's check the label distribution


In [5]:
sentences.sentiment_label.value_counts().plot(kind='bar', title='Samples per label')


Out[5]:
<matplotlib.axes._subplots.AxesSubplot at 0x1ae862b2c88>

Thus this dataset is almost balanced - so we don't have to worry about the class imbalance problem too much.


In [6]:
sentences.shape


Out[6]:
(1000, 2)

Each sentence is now a single string. Next we tokenize each sentences into a list of strings.


In [7]:
from nltk.tokenize import word_tokenize

sentences = sentences.assign(word_list=sentences.sentence.apply(word_tokenize))
sentences = sentences.drop('sentence', axis=1)

sentences.head()


Out[7]:
sentiment_label word_list
0 0 [A, very, ,, very, ,, very, slow-moving, ,, ai...
1 0 [Not, sure, who, was, more, lost, -, the, flat...
2 0 [Attempting, artiness, with, black, &, white, ...
3 0 [Very, little, music, or, anything, to, speak,...
4 1 [The, best, scene, in, the, movie, was, when, ...

Now we'll use gensim to build the word embeddings and then convert the result into a DataFrame. The index of the dataframe are the words (vocabulary) in our dataset and each row contains the embedding vector.


In [8]:
from gensim.models.word2vec import Word2Vec

embeddings = Word2Vec(
    sentences.word_list.tolist(),
    # use skip-gram model,
    sg=1,
    # size of the embedding dimension
    size=10,
    # size of the context window    
    window=3,
    # for consistency, this affects the initial random embeddings
    seed=1234,
    # ignore words that appear less than this
    min_count=0,
    # Use negative sampling instead of hierarchical softmax
    hs=0
)

embedding_map = {w: embeddings.wv[w] for w in embeddings.wv.vocab}
embedding_df = pd.DataFrame.from_dict(embedding_map, orient='index')

embedding_df.head()


d:\Anaconda3\envs\keras\lib\site-packages\gensim\utils.py:1197: UserWarning: detected Windows; aliasing chunkize to chunkize_serial
  warnings.warn("detected Windows; aliasing chunkize to chunkize_serial")
Out[8]:
0 1 2 3 4 5 6 7 8 9
A -0.046067 -0.183315 0.507321 -0.176546 -0.248928 0.384711 0.393233 0.680458 -0.315859 -0.163710
very -0.064760 -0.205842 0.702986 -0.123562 -0.352325 0.374808 0.511138 0.890570 -0.381449 -0.311933
, -0.077799 -0.194600 0.825287 -0.232362 -0.393387 0.536801 0.652023 1.190048 -0.461544 -0.347977
slow-moving -0.017554 0.000060 0.121923 0.010232 0.002762 0.065538 0.076900 0.135612 -0.009233 -0.072831
aimless -0.025890 0.011001 0.113866 0.004751 -0.064764 0.026288 0.088881 0.133067 -0.026642 -0.011556

Note that since our original dataset was a mixture of uppercase and lowercase, we have ended up with two different embedding vectors for 'A' and 'a'. This could potentially be a problem - for now we just make a note of it.

Building the Classifier

In the first pass, we'll create a simple classifier using a Sequential model with one Dense layer followed by an output layer with sigmoid activation. In this classifier, we'll take the average of the embedding vectors for all the words that are in a given sentence (strictly speaking, the words that are common between the vocabulary and the list of words in the sentence, since we've filtered out the rare words in the embedding construction step).


In [9]:
def average_embedding(list_of_words, embeddings):
    """Return the average of the embedding vectors in `embeddings` for all the words in `list_of_words`. 
    If a word does not exist in `embeddings`, consider it's embeddings to be all zeros."""
    
    # The fillna(0) handles the missing word case 
    return embeddings.reindex(list_of_words, axis=0).fillna(0).mean(axis=0)

def sentence_embeddings(sents, embeddings):
    """Calculate average embeddings for each sentence."""
    sentence_embeddings = sents.word_list.apply(lambda word_list: average_embedding(word_list, embeddings))
    sentence_embeddings = sentence_embeddings.assign(sentiment_label=sents.sentiment_label)
    return sentence_embeddings

In [10]:
input_df = sentence_embeddings(sentences, embedding_df)

In [11]:
input_df.head()


Out[11]:
0 1 2 3 4 5 6 7 8 9 sentiment_label
0 -0.042926 -0.148105 0.575592 -0.140602 -0.268451 0.353110 0.427335 0.755431 -0.296486 -0.224673 0
1 -0.009059 -0.139394 0.537527 -0.126475 -0.247286 0.347000 0.394486 0.729050 -0.274310 -0.192785 0
2 -0.031435 -0.153016 0.543911 -0.132631 -0.254814 0.352186 0.410118 0.734001 -0.268412 -0.206593 0
3 -0.006854 -0.149896 0.593891 -0.152073 -0.278693 0.386144 0.433150 0.783598 -0.317526 -0.221270 0
4 -0.018697 -0.160150 0.573916 -0.154065 -0.272173 0.356531 0.415648 0.751828 -0.288467 -0.203820 1

Now we split our data into a train and test sets.


In [12]:
train_df = input_df.groupby('sentiment_label').apply(lambda g: g.sample(frac=0.7, replace=False, random_state=4231))
train_df.index = train_df.index.droplevel(level=0)
train_df.head()


Out[12]:
0 1 2 3 4 5 6 7 8 9 sentiment_label
838 -0.019435 -0.133985 0.565594 -0.137858 -0.275899 0.360477 0.408289 0.735270 -0.283110 -0.210047 0
139 -0.016961 -0.128489 0.529581 -0.136973 -0.233034 0.340669 0.399643 0.686084 -0.273909 -0.194145 0
174 -0.017202 -0.157779 0.585503 -0.140563 -0.257957 0.382709 0.416051 0.752946 -0.274260 -0.222843 0
227 -0.015950 -0.145161 0.526977 -0.128325 -0.243780 0.347248 0.381607 0.681917 -0.258176 -0.193921 0
15 -0.020370 -0.169573 0.597465 -0.144073 -0.281584 0.389461 0.453698 0.803016 -0.301227 -0.230050 0

In [13]:
test_df = input_df.drop(train_df.index, axis=0)
test_df.head()


Out[13]:
0 1 2 3 4 5 6 7 8 9 sentiment_label
1 -0.009059 -0.139394 0.537527 -0.126475 -0.247286 0.347000 0.394486 0.729050 -0.274310 -0.192785 0
5 -0.033072 -0.139607 0.577956 -0.145244 -0.279555 0.372876 0.431658 0.791745 -0.297434 -0.222029 0
6 -0.014756 -0.127542 0.416245 -0.106317 -0.183163 0.268662 0.305142 0.548000 -0.217445 -0.142333 0
7 -0.025722 -0.152373 0.593671 -0.142071 -0.269999 0.362191 0.445455 0.790208 -0.301834 -0.227874 1
11 -0.033361 -0.153925 0.628671 -0.155574 -0.292488 0.389999 0.449822 0.831638 -0.318951 -0.239236 1

Let's double-check the label distributions in the train and test datasets:


In [14]:
counts = pd.concat({
    'train': train_df.sentiment_label.value_counts(), 
    'test': test_df.sentiment_label.value_counts(), 
}, axis=1)

ax = counts.plot(kind='bar', title='Label counts in train and test split')


Now we're ready to build the model using Keras.


In [15]:
from keras import regularizers, Sequential
from keras.layers import Dense

minibatch_size = 32
# subtract 1 because input_df also contains the label column
embedding_size = input_df.shape[1] - 1

model = Sequential()
model.add(Dense(minibatch_size, 
                activation='relu', 
                input_dim=embedding_size, 
                kernel_regularizer=regularizers.l2(0.01)))
model.add(Dense(1, activation='sigmoid'))

model.compile(optimizer='adam',
              loss='binary_crossentropy',
              metrics=['accuracy'])

model.summary()


Using TensorFlow backend.
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_1 (Dense)              (None, 32)                352       
_________________________________________________________________
dense_2 (Dense)              (None, 1)                 33        
=================================================================
Total params: 385
Trainable params: 385
Non-trainable params: 0
_________________________________________________________________

In [16]:
n_epochs = 2000
y_train = pd.DataFrame(train_df.sentiment_label).astype(np.int32).values

# Scale the X values to zero mean and unit variance
X_train = train_df.drop('sentiment_label', axis=1)
X_train = X_train.sub(X_train.mean(axis=0)).div(X_train.std(axis=0)).astype(np.float32).values

history = model.fit(X_train, y_train, epochs=n_epochs, batch_size=minibatch_size, verbose=1)


Epoch 1/2000
700/700 [==============================] - 1s 926us/step - loss: 0.8606 - acc: 0.4829
Epoch 2/2000
700/700 [==============================] - 0s 63us/step - loss: 0.8268 - acc: 0.5329
Epoch 3/2000
700/700 [==============================] - 0s 61us/step - loss: 0.8132 - acc: 0.5429
Epoch 4/2000
700/700 [==============================] - 0s 57us/step - loss: 0.8040 - acc: 0.5400
Epoch 5/2000
700/700 [==============================] - 0s 53us/step - loss: 0.7938 - acc: 0.5629
Epoch 6/2000
700/700 [==============================] - 0s 51us/step - loss: 0.7863 - acc: 0.5657
Epoch 7/2000
700/700 [==============================] - 0s 57us/step - loss: 0.7783 - acc: 0.5600
Epoch 8/2000
700/700 [==============================] - 0s 54us/step - loss: 0.7722 - acc: 0.5643
Epoch 9/2000
700/700 [==============================] - 0s 56us/step - loss: 0.7658 - acc: 0.5686
Epoch 10/2000
700/700 [==============================] - 0s 51us/step - loss: 0.7604 - acc: 0.5671
Epoch 11/2000
700/700 [==============================] - 0s 64us/step - loss: 0.7549 - acc: 0.5757
Epoch 12/2000
700/700 [==============================] - 0s 59us/step - loss: 0.7510 - acc: 0.5729
Epoch 13/2000
700/700 [==============================] - 0s 69us/step - loss: 0.7457 - acc: 0.5714
Epoch 14/2000
700/700 [==============================] - 0s 61us/step - loss: 0.7414 - acc: 0.5843
Epoch 15/2000
700/700 [==============================] - 0s 54us/step - loss: 0.7378 - acc: 0.5800
Epoch 16/2000
700/700 [==============================] - 0s 57us/step - loss: 0.7341 - acc: 0.5786
Epoch 17/2000
700/700 [==============================] - 0s 66us/step - loss: 0.7319 - acc: 0.5771
Epoch 18/2000
700/700 [==============================] - 0s 59us/step - loss: 0.7300 - acc: 0.5857
Epoch 19/2000
700/700 [==============================] - 0s 56us/step - loss: 0.7269 - acc: 0.5629
Epoch 20/2000
700/700 [==============================] - 0s 53us/step - loss: 0.7233 - acc: 0.5814
Epoch 21/2000
700/700 [==============================] - 0s 60us/step - loss: 0.7211 - acc: 0.5757
Epoch 22/2000
700/700 [==============================] - 0s 54us/step - loss: 0.7184 - acc: 0.5729
Epoch 23/2000
700/700 [==============================] - 0s 54us/step - loss: 0.7165 - acc: 0.5686
Epoch 24/2000
700/700 [==============================] - 0s 57us/step - loss: 0.7142 - acc: 0.5886
Epoch 25/2000
700/700 [==============================] - 0s 63us/step - loss: 0.7124 - acc: 0.5786
Epoch 26/2000
700/700 [==============================] - 0s 60us/step - loss: 0.7101 - acc: 0.5786
Epoch 27/2000
700/700 [==============================] - 0s 61us/step - loss: 0.7090 - acc: 0.5743
Epoch 28/2000
700/700 [==============================] - 0s 60us/step - loss: 0.7063 - acc: 0.5757
Epoch 29/2000
700/700 [==============================] - 0s 70us/step - loss: 0.7050 - acc: 0.5857
Epoch 30/2000
700/700 [==============================] - 0s 63us/step - loss: 0.7035 - acc: 0.5914
Epoch 31/2000
700/700 [==============================] - 0s 59us/step - loss: 0.7027 - acc: 0.5786
Epoch 32/2000
700/700 [==============================] - 0s 59us/step - loss: 0.7008 - acc: 0.5729
Epoch 33/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6995 - acc: 0.5800
Epoch 34/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6986 - acc: 0.5771
Epoch 35/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6972 - acc: 0.5843
Epoch 36/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6975 - acc: 0.5729
Epoch 37/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6961 - acc: 0.5829
Epoch 38/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6943 - acc: 0.5843
Epoch 39/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6938 - acc: 0.5786
Epoch 40/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6928 - acc: 0.5757
Epoch 41/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6913 - acc: 0.5786
Epoch 42/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6908 - acc: 0.5800
Epoch 43/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6906 - acc: 0.5786
Epoch 44/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6904 - acc: 0.5800
Epoch 45/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6885 - acc: 0.5814
Epoch 46/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6881 - acc: 0.5786
Epoch 47/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6878 - acc: 0.5843
Epoch 48/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6888 - acc: 0.5729
Epoch 49/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6867 - acc: 0.5757
Epoch 50/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6864 - acc: 0.5871
Epoch 51/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6857 - acc: 0.5829
Epoch 52/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6864 - acc: 0.5657
Epoch 53/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6854 - acc: 0.5857
Epoch 54/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6838 - acc: 0.5814
Epoch 55/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6848 - acc: 0.5843
Epoch 56/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6837 - acc: 0.5729
Epoch 57/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6828 - acc: 0.5714
Epoch 58/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6823 - acc: 0.5829
Epoch 59/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6826 - acc: 0.5771
Epoch 60/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6814 - acc: 0.5829
Epoch 61/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6808 - acc: 0.5857
Epoch 62/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6813 - acc: 0.5657
Epoch 63/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6810 - acc: 0.5686
Epoch 64/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6805 - acc: 0.5871
Epoch 65/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6806 - acc: 0.5671
Epoch 66/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6800 - acc: 0.5829
Epoch 67/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6799 - acc: 0.5771
Epoch 68/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6796 - acc: 0.5743
Epoch 69/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6802 - acc: 0.5686
Epoch 70/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6789 - acc: 0.5843
Epoch 71/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6798 - acc: 0.5771
Epoch 72/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6793 - acc: 0.5829
Epoch 73/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6788 - acc: 0.5814
Epoch 74/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6783 - acc: 0.5657
Epoch 75/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6788 - acc: 0.5829
Epoch 76/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6784 - acc: 0.5757
Epoch 77/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6782 - acc: 0.5743
Epoch 78/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6787 - acc: 0.5843
Epoch 79/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6774 - acc: 0.5829
Epoch 80/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6771 - acc: 0.5729
Epoch 81/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6783 - acc: 0.5729
Epoch 82/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6768 - acc: 0.5800
Epoch 83/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6786 - acc: 0.5743
Epoch 84/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6768 - acc: 0.5843
Epoch 85/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6764 - acc: 0.5786
Epoch 86/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6773 - acc: 0.5729
Epoch 87/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6769 - acc: 0.5700
Epoch 88/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6794 - acc: 0.5743
Epoch 89/2000
700/700 [==============================] - 0s 70us/step - loss: 0.6765 - acc: 0.5771
Epoch 90/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6771 - acc: 0.5714
Epoch 91/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6763 - acc: 0.5786
Epoch 92/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6760 - acc: 0.5829
Epoch 93/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6767 - acc: 0.5743
Epoch 94/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6762 - acc: 0.5800
Epoch 95/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6752 - acc: 0.5829
Epoch 96/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6763 - acc: 0.5771
Epoch 97/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6762 - acc: 0.5757
Epoch 98/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6753 - acc: 0.5829
Epoch 99/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6770 - acc: 0.5814
Epoch 100/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6758 - acc: 0.5786
Epoch 101/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6753 - acc: 0.5800
Epoch 102/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6755 - acc: 0.5786
Epoch 103/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6748 - acc: 0.5757
Epoch 104/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6754 - acc: 0.5743
Epoch 105/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6749 - acc: 0.5686
Epoch 106/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6751 - acc: 0.5786
Epoch 107/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6760 - acc: 0.5829
Epoch 108/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6743 - acc: 0.5743
Epoch 109/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6750 - acc: 0.5786
Epoch 110/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6751 - acc: 0.5771
Epoch 111/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6751 - acc: 0.5729
Epoch 112/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6745 - acc: 0.5771
Epoch 113/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6741 - acc: 0.5757
Epoch 114/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6750 - acc: 0.5829
Epoch 115/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6737 - acc: 0.5800
Epoch 116/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6753 - acc: 0.5714
Epoch 117/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6740 - acc: 0.5757
Epoch 118/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6753 - acc: 0.5757
Epoch 119/2000
700/700 [==============================] - 0s 70us/step - loss: 0.6738 - acc: 0.5786
Epoch 120/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6734 - acc: 0.5757
Epoch 121/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6743 - acc: 0.5743
Epoch 122/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6737 - acc: 0.5786
Epoch 123/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6747 - acc: 0.5729
Epoch 124/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6736 - acc: 0.5729
Epoch 125/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6742 - acc: 0.5743
Epoch 126/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6733 - acc: 0.5771
Epoch 127/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6733 - acc: 0.5700
Epoch 128/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6734 - acc: 0.5714
Epoch 129/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6735 - acc: 0.5829
Epoch 130/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6738 - acc: 0.5786
Epoch 131/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6742 - acc: 0.5771
Epoch 132/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6731 - acc: 0.5800
Epoch 133/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6732 - acc: 0.5700
Epoch 134/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6746 - acc: 0.5729
Epoch 135/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6732 - acc: 0.5814
Epoch 136/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6740 - acc: 0.5843
Epoch 137/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6744 - acc: 0.5729
Epoch 138/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6732 - acc: 0.5729
Epoch 139/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6725 - acc: 0.5800
Epoch 140/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6735 - acc: 0.5771
Epoch 141/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6736 - acc: 0.5814
Epoch 142/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6730 - acc: 0.5757
Epoch 143/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6732 - acc: 0.5800
Epoch 144/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6734 - acc: 0.5757
Epoch 145/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6729 - acc: 0.5743
Epoch 146/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6748 - acc: 0.5843
Epoch 147/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6742 - acc: 0.5671
Epoch 148/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6739 - acc: 0.5714
Epoch 149/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6722 - acc: 0.5814
Epoch 150/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6722 - acc: 0.5786
Epoch 151/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6737 - acc: 0.5743
Epoch 152/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6731 - acc: 0.5814
Epoch 153/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6724 - acc: 0.5771
Epoch 154/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6727 - acc: 0.5729
Epoch 155/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6723 - acc: 0.5843
Epoch 156/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6726 - acc: 0.5800
Epoch 157/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6733 - acc: 0.5757
Epoch 158/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6724 - acc: 0.5800
Epoch 159/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6741 - acc: 0.5786
Epoch 160/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6717 - acc: 0.5686
Epoch 161/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6727 - acc: 0.5771
Epoch 162/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6722 - acc: 0.5757
Epoch 163/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6722 - acc: 0.5786
Epoch 164/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6746 - acc: 0.5786
Epoch 165/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6723 - acc: 0.5800
Epoch 166/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6739 - acc: 0.5886
Epoch 167/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6741 - acc: 0.5700
Epoch 168/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6717 - acc: 0.5757
Epoch 169/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6719 - acc: 0.5871
Epoch 170/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6729 - acc: 0.5700
Epoch 171/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6734 - acc: 0.5771
Epoch 172/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6717 - acc: 0.5757
Epoch 173/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6718 - acc: 0.5843
Epoch 174/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6713 - acc: 0.5800
Epoch 175/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6718 - acc: 0.5800
Epoch 176/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6713 - acc: 0.5914
Epoch 177/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6728 - acc: 0.5800
Epoch 178/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6723 - acc: 0.5829
Epoch 179/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6721 - acc: 0.5729
Epoch 180/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6733 - acc: 0.5786
Epoch 181/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6728 - acc: 0.5743
Epoch 182/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6723 - acc: 0.5700
Epoch 183/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6712 - acc: 0.5843
Epoch 184/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6725 - acc: 0.5829
Epoch 185/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6714 - acc: 0.5857
Epoch 186/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6713 - acc: 0.5771
Epoch 187/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6712 - acc: 0.5729
Epoch 188/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6719 - acc: 0.5800
Epoch 189/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6714 - acc: 0.5743
Epoch 190/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6709 - acc: 0.5829
Epoch 191/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6708 - acc: 0.5786
Epoch 192/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6718 - acc: 0.5757
Epoch 193/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6727 - acc: 0.5729
Epoch 194/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6711 - acc: 0.5800
Epoch 195/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6723 - acc: 0.5729
Epoch 196/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6732 - acc: 0.5886
Epoch 197/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6706 - acc: 0.5743
Epoch 198/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6702 - acc: 0.5800
Epoch 199/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6712 - acc: 0.5686
Epoch 200/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6731 - acc: 0.5729
Epoch 201/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6744 - acc: 0.5814
Epoch 202/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6725 - acc: 0.5814
Epoch 203/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6719 - acc: 0.5714
Epoch 204/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6701 - acc: 0.5857
Epoch 205/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6718 - acc: 0.5743
Epoch 206/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6711 - acc: 0.5771
Epoch 207/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6705 - acc: 0.5814
Epoch 208/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6706 - acc: 0.5900
Epoch 209/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6714 - acc: 0.5757
Epoch 210/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6705 - acc: 0.5843
Epoch 211/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6725 - acc: 0.5886
Epoch 212/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6741 - acc: 0.5729
Epoch 213/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6735 - acc: 0.5786
Epoch 214/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6716 - acc: 0.5729
Epoch 215/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6716 - acc: 0.5729
Epoch 216/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6719 - acc: 0.5757
Epoch 217/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6723 - acc: 0.5800
Epoch 218/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6702 - acc: 0.5829
Epoch 219/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6704 - acc: 0.5786
Epoch 220/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6716 - acc: 0.5857
Epoch 221/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6720 - acc: 0.5771
Epoch 222/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6709 - acc: 0.5714
Epoch 223/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6701 - acc: 0.5757
Epoch 224/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6707 - acc: 0.5800
Epoch 225/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6707 - acc: 0.5700
Epoch 226/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6707 - acc: 0.5871
Epoch 227/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6703 - acc: 0.5800
Epoch 228/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6707 - acc: 0.5786
Epoch 229/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6713 - acc: 0.5786
Epoch 230/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6692 - acc: 0.5900
Epoch 231/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6707 - acc: 0.5657
Epoch 232/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6700 - acc: 0.5786
Epoch 233/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6696 - acc: 0.5843
Epoch 234/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6711 - acc: 0.5814
Epoch 235/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6696 - acc: 0.5871
Epoch 236/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6690 - acc: 0.5757
Epoch 237/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6698 - acc: 0.5843
Epoch 238/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6697 - acc: 0.5829
Epoch 239/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6700 - acc: 0.5843
Epoch 240/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6712 - acc: 0.5871
Epoch 241/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6690 - acc: 0.5786
Epoch 242/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6696 - acc: 0.5843
Epoch 243/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6696 - acc: 0.5800
Epoch 244/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6694 - acc: 0.5857
Epoch 245/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6704 - acc: 0.5714
Epoch 246/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6685 - acc: 0.5800
Epoch 247/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6688 - acc: 0.5871
Epoch 248/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6690 - acc: 0.5829
Epoch 249/2000
700/700 [==============================] - ETA: 0s - loss: 0.6854 - acc: 0.593 - 0s 57us/step - loss: 0.6695 - acc: 0.5871
Epoch 250/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6692 - acc: 0.5829
Epoch 251/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6687 - acc: 0.5829
Epoch 252/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6691 - acc: 0.5814
Epoch 253/2000
700/700 [==============================] - 0s 71us/step - loss: 0.6699 - acc: 0.5814
Epoch 254/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6697 - acc: 0.5829
Epoch 255/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6682 - acc: 0.5829
Epoch 256/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6691 - acc: 0.5800
Epoch 257/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6699 - acc: 0.5757
Epoch 258/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6686 - acc: 0.5800
Epoch 259/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6693 - acc: 0.5714
Epoch 260/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6704 - acc: 0.5929
Epoch 261/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6694 - acc: 0.5857
Epoch 262/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6720 - acc: 0.5914
Epoch 263/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6698 - acc: 0.5771
Epoch 264/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6686 - acc: 0.5871
Epoch 265/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6682 - acc: 0.5786
Epoch 266/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6699 - acc: 0.5800
Epoch 267/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6717 - acc: 0.5771
Epoch 268/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6685 - acc: 0.5786
Epoch 269/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6700 - acc: 0.5771
Epoch 270/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6693 - acc: 0.5843
Epoch 271/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6708 - acc: 0.5829
Epoch 272/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6682 - acc: 0.5843
Epoch 273/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6674 - acc: 0.5900
Epoch 274/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6677 - acc: 0.5800
Epoch 275/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6695 - acc: 0.5886
Epoch 276/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6698 - acc: 0.5900
Epoch 277/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6689 - acc: 0.5943
Epoch 278/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6688 - acc: 0.5743
Epoch 279/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6671 - acc: 0.5929
Epoch 280/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6701 - acc: 0.5871
Epoch 281/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6692 - acc: 0.5943
Epoch 282/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6671 - acc: 0.5857
Epoch 283/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6700 - acc: 0.5800
Epoch 284/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6691 - acc: 0.5829
Epoch 285/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6671 - acc: 0.5814
Epoch 286/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6705 - acc: 0.5814
Epoch 287/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6684 - acc: 0.5771
Epoch 288/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6672 - acc: 0.5886
Epoch 289/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6693 - acc: 0.5771
Epoch 290/2000
700/700 [==============================] - ETA: 0s - loss: 0.6587 - acc: 0.656 - 0s 60us/step - loss: 0.6679 - acc: 0.5886
Epoch 291/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6673 - acc: 0.5843
Epoch 292/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6684 - acc: 0.6014
Epoch 293/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6676 - acc: 0.5771
Epoch 294/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6678 - acc: 0.5957
Epoch 295/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6667 - acc: 0.5843
Epoch 296/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6690 - acc: 0.5800
Epoch 297/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6663 - acc: 0.5971
Epoch 298/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6694 - acc: 0.5871
Epoch 299/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6697 - acc: 0.5929
Epoch 300/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6671 - acc: 0.5843
Epoch 301/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6675 - acc: 0.5857
Epoch 302/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6669 - acc: 0.5986
Epoch 303/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6696 - acc: 0.5900
Epoch 304/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6671 - acc: 0.5914
Epoch 305/2000
700/700 [==============================] - 0s 76us/step - loss: 0.6671 - acc: 0.5829
Epoch 306/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6670 - acc: 0.5943
Epoch 307/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6662 - acc: 0.5971
Epoch 308/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6670 - acc: 0.6029
Epoch 309/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6659 - acc: 0.5843
Epoch 310/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6662 - acc: 0.5900
Epoch 311/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6667 - acc: 0.5871
Epoch 312/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6666 - acc: 0.5871
Epoch 313/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6665 - acc: 0.5843
Epoch 314/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6654 - acc: 0.5829
Epoch 315/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6669 - acc: 0.5886
Epoch 316/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6658 - acc: 0.5886
Epoch 317/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6659 - acc: 0.5886
Epoch 318/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6667 - acc: 0.6043
Epoch 319/2000
700/700 [==============================] - 0s 73us/step - loss: 0.6651 - acc: 0.5900
Epoch 320/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6660 - acc: 0.5829
Epoch 321/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6670 - acc: 0.5943
Epoch 322/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6671 - acc: 0.5900
Epoch 323/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6658 - acc: 0.5857
Epoch 324/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6666 - acc: 0.6000
Epoch 325/2000
700/700 [==============================] - 0s 74us/step - loss: 0.6664 - acc: 0.5986
Epoch 326/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6663 - acc: 0.5929
Epoch 327/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6661 - acc: 0.5871
Epoch 328/2000
700/700 [==============================] - 0s 87us/step - loss: 0.6664 - acc: 0.5843
Epoch 329/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6666 - acc: 0.5914
Epoch 330/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6674 - acc: 0.5900
Epoch 331/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6680 - acc: 0.5971
Epoch 332/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6680 - acc: 0.5857
Epoch 333/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6652 - acc: 0.5957
Epoch 334/2000
700/700 [==============================] - 0s 77us/step - loss: 0.6660 - acc: 0.6029
Epoch 335/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6687 - acc: 0.5929
Epoch 336/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6659 - acc: 0.5971
Epoch 337/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6659 - acc: 0.5971
Epoch 338/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6655 - acc: 0.5886
Epoch 339/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6668 - acc: 0.5929
Epoch 340/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6666 - acc: 0.5886
Epoch 341/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6656 - acc: 0.5971
Epoch 342/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6650 - acc: 0.5900
Epoch 343/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6656 - acc: 0.5986
Epoch 344/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6648 - acc: 0.5986
Epoch 345/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6659 - acc: 0.5900
Epoch 346/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6670 - acc: 0.5971
Epoch 347/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6680 - acc: 0.5900
Epoch 348/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6666 - acc: 0.5929
Epoch 349/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6651 - acc: 0.5971
Epoch 350/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6651 - acc: 0.5943
Epoch 351/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6665 - acc: 0.5957
Epoch 352/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6655 - acc: 0.6014
Epoch 353/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6656 - acc: 0.5957
Epoch 354/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6643 - acc: 0.5914
Epoch 355/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6658 - acc: 0.5814
Epoch 356/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6647 - acc: 0.5957
Epoch 357/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6634 - acc: 0.5971
Epoch 358/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6656 - acc: 0.5957
Epoch 359/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6667 - acc: 0.5871
Epoch 360/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6674 - acc: 0.5986
Epoch 361/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6632 - acc: 0.6000
Epoch 362/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6663 - acc: 0.5957
Epoch 363/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6652 - acc: 0.6057
Epoch 364/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6670 - acc: 0.5829
Epoch 365/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6637 - acc: 0.6014
Epoch 366/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6648 - acc: 0.6029
Epoch 367/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6653 - acc: 0.5929
Epoch 368/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6638 - acc: 0.5900
Epoch 369/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6651 - acc: 0.6000
Epoch 370/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6659 - acc: 0.5986
Epoch 371/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6634 - acc: 0.6086
Epoch 372/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6629 - acc: 0.6014
Epoch 373/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6625 - acc: 0.6043
Epoch 374/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6645 - acc: 0.6029
Epoch 375/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6677 - acc: 0.5800
Epoch 376/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6643 - acc: 0.5971
Epoch 377/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6639 - acc: 0.5986
Epoch 378/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6639 - acc: 0.6000
Epoch 379/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6627 - acc: 0.6000
Epoch 380/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6644 - acc: 0.5957
Epoch 381/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6640 - acc: 0.6086
Epoch 382/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6633 - acc: 0.5943
Epoch 383/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6626 - acc: 0.6014
Epoch 384/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6645 - acc: 0.5971
Epoch 385/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6615 - acc: 0.6000
Epoch 386/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6621 - acc: 0.5986
Epoch 387/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6632 - acc: 0.5957
Epoch 388/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6637 - acc: 0.5986
Epoch 389/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6636 - acc: 0.6000
Epoch 390/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6696 - acc: 0.5757
Epoch 391/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6647 - acc: 0.5943
Epoch 392/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6635 - acc: 0.5943
Epoch 393/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6642 - acc: 0.6071
Epoch 394/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6646 - acc: 0.5929
Epoch 395/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6643 - acc: 0.5900
Epoch 396/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6648 - acc: 0.5900
Epoch 397/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6652 - acc: 0.6057
Epoch 398/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6638 - acc: 0.5957
Epoch 399/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6623 - acc: 0.5957
Epoch 400/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6632 - acc: 0.6014
Epoch 401/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6617 - acc: 0.6029
Epoch 402/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6643 - acc: 0.5886
Epoch 403/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6629 - acc: 0.6014
Epoch 404/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6626 - acc: 0.5971
Epoch 405/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6618 - acc: 0.6043
Epoch 406/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6627 - acc: 0.5971
Epoch 407/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6618 - acc: 0.6114
Epoch 408/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6627 - acc: 0.6071
Epoch 409/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6624 - acc: 0.6071
Epoch 410/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6615 - acc: 0.6029
Epoch 411/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6611 - acc: 0.6057
Epoch 412/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6632 - acc: 0.5971
Epoch 413/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6634 - acc: 0.6043
Epoch 414/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6648 - acc: 0.5929
Epoch 415/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6677 - acc: 0.6000
Epoch 416/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6633 - acc: 0.6000
Epoch 417/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6617 - acc: 0.5971
Epoch 418/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6614 - acc: 0.6086
Epoch 419/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6616 - acc: 0.6057
Epoch 420/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6603 - acc: 0.6057
Epoch 421/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6622 - acc: 0.6100
Epoch 422/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6644 - acc: 0.6057
Epoch 423/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6606 - acc: 0.6129
Epoch 424/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6631 - acc: 0.6014
Epoch 425/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6610 - acc: 0.6100
Epoch 426/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6624 - acc: 0.5971
Epoch 427/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6601 - acc: 0.6100
Epoch 428/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6616 - acc: 0.6086
Epoch 429/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6608 - acc: 0.6000
Epoch 430/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6603 - acc: 0.6086
Epoch 431/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6611 - acc: 0.6157
Epoch 432/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6627 - acc: 0.5971
Epoch 433/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6614 - acc: 0.5986
Epoch 434/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6609 - acc: 0.6114
Epoch 435/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6623 - acc: 0.6143
Epoch 436/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6588 - acc: 0.6071
Epoch 437/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6608 - acc: 0.6043
Epoch 438/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6622 - acc: 0.5971
Epoch 439/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6617 - acc: 0.6086
Epoch 440/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6609 - acc: 0.6157
Epoch 441/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6610 - acc: 0.6114
Epoch 442/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6595 - acc: 0.6100
Epoch 443/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6622 - acc: 0.6100
Epoch 444/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6610 - acc: 0.6000
Epoch 445/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6605 - acc: 0.6043
Epoch 446/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6621 - acc: 0.6014
Epoch 447/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6600 - acc: 0.6129
Epoch 448/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6615 - acc: 0.5900
Epoch 449/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6625 - acc: 0.6100
Epoch 450/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6598 - acc: 0.6143
Epoch 451/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6607 - acc: 0.6114
Epoch 452/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6598 - acc: 0.6057
Epoch 453/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6597 - acc: 0.6086
Epoch 454/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6597 - acc: 0.6071
Epoch 455/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6620 - acc: 0.6100
Epoch 456/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6600 - acc: 0.6014
Epoch 457/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6588 - acc: 0.6186
Epoch 458/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6630 - acc: 0.5886
Epoch 459/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6593 - acc: 0.5971
Epoch 460/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6584 - acc: 0.6029
Epoch 461/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6605 - acc: 0.6071
Epoch 462/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6593 - acc: 0.6029
Epoch 463/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6580 - acc: 0.6114
Epoch 464/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6583 - acc: 0.6100
Epoch 465/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6612 - acc: 0.6071
Epoch 466/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6610 - acc: 0.6057
Epoch 467/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6617 - acc: 0.6143
Epoch 468/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6659 - acc: 0.5886
Epoch 469/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6592 - acc: 0.6143
Epoch 470/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6594 - acc: 0.6071
Epoch 471/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6602 - acc: 0.6143
Epoch 472/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6609 - acc: 0.6014
Epoch 473/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6604 - acc: 0.6271
Epoch 474/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6588 - acc: 0.6129
Epoch 475/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6592 - acc: 0.6071
Epoch 476/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6609 - acc: 0.5986
Epoch 477/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6582 - acc: 0.6114
Epoch 478/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6571 - acc: 0.6143
Epoch 479/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6567 - acc: 0.6129
Epoch 480/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6605 - acc: 0.6071
Epoch 481/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6575 - acc: 0.6229
Epoch 482/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6615 - acc: 0.6014
Epoch 483/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6565 - acc: 0.6143
Epoch 484/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6585 - acc: 0.6129
Epoch 485/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6578 - acc: 0.6071
Epoch 486/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6581 - acc: 0.6114
Epoch 487/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6591 - acc: 0.6257
Epoch 488/2000
700/700 [==============================] - 0s 73us/step - loss: 0.6575 - acc: 0.6157
Epoch 489/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6645 - acc: 0.6157
Epoch 490/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6597 - acc: 0.6057
Epoch 491/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6578 - acc: 0.6029
Epoch 492/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6579 - acc: 0.6143
Epoch 493/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6582 - acc: 0.6071
Epoch 494/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6596 - acc: 0.6129
Epoch 495/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6583 - acc: 0.6171
Epoch 496/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6593 - acc: 0.6300
Epoch 497/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6596 - acc: 0.6029
Epoch 498/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6580 - acc: 0.6043
Epoch 499/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6594 - acc: 0.6000
Epoch 500/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6569 - acc: 0.6114
Epoch 501/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6563 - acc: 0.6186
Epoch 502/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6571 - acc: 0.6314
Epoch 503/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6575 - acc: 0.6114
Epoch 504/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6567 - acc: 0.6071
Epoch 505/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6579 - acc: 0.6229
Epoch 506/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6584 - acc: 0.6157
Epoch 507/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6566 - acc: 0.6114
Epoch 508/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6589 - acc: 0.6071
Epoch 509/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6598 - acc: 0.6143
Epoch 510/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6584 - acc: 0.6143
Epoch 511/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6582 - acc: 0.6100
Epoch 512/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6583 - acc: 0.6057
Epoch 513/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6580 - acc: 0.6214
Epoch 514/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6551 - acc: 0.6143
Epoch 515/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6570 - acc: 0.6157
Epoch 516/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6563 - acc: 0.6143
Epoch 517/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6559 - acc: 0.6300
Epoch 518/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6552 - acc: 0.6100
Epoch 519/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6568 - acc: 0.6114
Epoch 520/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6548 - acc: 0.6114
Epoch 521/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6566 - acc: 0.6100
Epoch 522/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6575 - acc: 0.6214
Epoch 523/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6569 - acc: 0.6271
Epoch 524/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6560 - acc: 0.6114
Epoch 525/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6572 - acc: 0.6186
Epoch 526/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6542 - acc: 0.6286
Epoch 527/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6577 - acc: 0.6143
Epoch 528/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6546 - acc: 0.6129
Epoch 529/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6557 - acc: 0.6229
Epoch 530/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6553 - acc: 0.6157
Epoch 531/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6552 - acc: 0.6243
Epoch 532/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6553 - acc: 0.6186
Epoch 533/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6564 - acc: 0.6129
Epoch 534/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6561 - acc: 0.6171
Epoch 535/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6561 - acc: 0.6129
Epoch 536/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6593 - acc: 0.6086
Epoch 537/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6562 - acc: 0.6229
Epoch 538/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6571 - acc: 0.6186
Epoch 539/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6535 - acc: 0.6200
Epoch 540/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6558 - acc: 0.6200
Epoch 541/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6570 - acc: 0.6186
Epoch 542/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6560 - acc: 0.6257
Epoch 543/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6551 - acc: 0.6200
Epoch 544/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6542 - acc: 0.6257
Epoch 545/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6544 - acc: 0.6271
Epoch 546/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6570 - acc: 0.6143
Epoch 547/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6564 - acc: 0.6200
Epoch 548/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6547 - acc: 0.6157
Epoch 549/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6529 - acc: 0.6257
Epoch 550/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6543 - acc: 0.6214
Epoch 551/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6566 - acc: 0.6243
Epoch 552/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6552 - acc: 0.6129
Epoch 553/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6539 - acc: 0.6214
Epoch 554/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6533 - acc: 0.6257
Epoch 555/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6540 - acc: 0.6243
Epoch 556/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6531 - acc: 0.6271
Epoch 557/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6586 - acc: 0.6243
Epoch 558/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6535 - acc: 0.6157
Epoch 559/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6529 - acc: 0.6143
Epoch 560/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6572 - acc: 0.6229
Epoch 561/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6576 - acc: 0.6229
Epoch 562/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6547 - acc: 0.6229
Epoch 563/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6525 - acc: 0.6386
Epoch 564/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6540 - acc: 0.6243
Epoch 565/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6515 - acc: 0.6300
Epoch 566/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6526 - acc: 0.6200
Epoch 567/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6523 - acc: 0.6200
Epoch 568/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6518 - acc: 0.6286
Epoch 569/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6526 - acc: 0.6271
Epoch 570/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6544 - acc: 0.6214
Epoch 571/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6543 - acc: 0.6300
Epoch 572/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6539 - acc: 0.6229
Epoch 573/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6554 - acc: 0.6214
Epoch 574/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6548 - acc: 0.6243
Epoch 575/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6560 - acc: 0.6214
Epoch 576/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6543 - acc: 0.6229
Epoch 577/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6521 - acc: 0.6229
Epoch 578/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6541 - acc: 0.6114
Epoch 579/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6561 - acc: 0.6286
Epoch 580/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6529 - acc: 0.6214
Epoch 581/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6532 - acc: 0.6229
Epoch 582/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6505 - acc: 0.6286
Epoch 583/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6523 - acc: 0.6329
Epoch 584/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6527 - acc: 0.6257
Epoch 585/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6544 - acc: 0.6257
Epoch 586/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6525 - acc: 0.6271
Epoch 587/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6540 - acc: 0.6243
Epoch 588/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6523 - acc: 0.6257
Epoch 589/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6524 - acc: 0.6243
Epoch 590/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6527 - acc: 0.6257
Epoch 591/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6533 - acc: 0.6271
Epoch 592/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6529 - acc: 0.6243
Epoch 593/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6546 - acc: 0.6229
Epoch 594/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6540 - acc: 0.6243
Epoch 595/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6510 - acc: 0.6400
Epoch 596/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6509 - acc: 0.6286
Epoch 597/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6511 - acc: 0.6243
Epoch 598/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6504 - acc: 0.6243
Epoch 599/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6518 - acc: 0.6314
Epoch 600/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6501 - acc: 0.6357
Epoch 601/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6520 - acc: 0.6286
Epoch 602/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6498 - acc: 0.6300
Epoch 603/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6543 - acc: 0.6329
Epoch 604/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6584 - acc: 0.6171
Epoch 605/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6540 - acc: 0.6271
Epoch 606/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6486 - acc: 0.6314
Epoch 607/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6534 - acc: 0.6243
Epoch 608/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6517 - acc: 0.6329
Epoch 609/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6507 - acc: 0.6271
Epoch 610/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6523 - acc: 0.6386
Epoch 611/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6507 - acc: 0.6271
Epoch 612/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6498 - acc: 0.6214
Epoch 613/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6536 - acc: 0.6286
Epoch 614/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6536 - acc: 0.6257
Epoch 615/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6506 - acc: 0.6214
Epoch 616/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6504 - acc: 0.6229
Epoch 617/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6499 - acc: 0.6271
Epoch 618/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6495 - acc: 0.6286
Epoch 619/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6490 - acc: 0.6357
Epoch 620/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6526 - acc: 0.6243
Epoch 621/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6493 - acc: 0.6286
Epoch 622/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6501 - acc: 0.6271
Epoch 623/2000
700/700 [==============================] - 0s 71us/step - loss: 0.6493 - acc: 0.6371
Epoch 624/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6489 - acc: 0.6329
Epoch 625/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6500 - acc: 0.6229
Epoch 626/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6505 - acc: 0.6271
Epoch 627/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6515 - acc: 0.6257
Epoch 628/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6524 - acc: 0.6171
Epoch 629/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6490 - acc: 0.6271
Epoch 630/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6486 - acc: 0.6286
Epoch 631/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6508 - acc: 0.6343
Epoch 632/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6500 - acc: 0.6371
Epoch 633/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6477 - acc: 0.6271
Epoch 634/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6537 - acc: 0.6243
Epoch 635/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6502 - acc: 0.6286
Epoch 636/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6507 - acc: 0.6357
Epoch 637/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6476 - acc: 0.6314
Epoch 638/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6488 - acc: 0.6286
Epoch 639/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6480 - acc: 0.6286
Epoch 640/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6511 - acc: 0.6300
Epoch 641/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6496 - acc: 0.6229
Epoch 642/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6516 - acc: 0.6243
Epoch 643/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6485 - acc: 0.6357
Epoch 644/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6482 - acc: 0.6314
Epoch 645/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6469 - acc: 0.6357
Epoch 646/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6529 - acc: 0.6157
Epoch 647/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6586 - acc: 0.6229
Epoch 648/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6495 - acc: 0.6343
Epoch 649/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6483 - acc: 0.6257
Epoch 650/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6496 - acc: 0.6257
Epoch 651/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6481 - acc: 0.6257
Epoch 652/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6523 - acc: 0.6229
Epoch 653/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6490 - acc: 0.6229
Epoch 654/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6477 - acc: 0.6329
Epoch 655/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6485 - acc: 0.6429
Epoch 656/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6481 - acc: 0.6329
Epoch 657/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6492 - acc: 0.6286
Epoch 658/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6586 - acc: 0.6171
Epoch 659/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6509 - acc: 0.6229
Epoch 660/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6474 - acc: 0.6286
Epoch 661/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6490 - acc: 0.6343
Epoch 662/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6508 - acc: 0.6214
Epoch 663/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6496 - acc: 0.6286
Epoch 664/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6498 - acc: 0.6357
Epoch 665/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6503 - acc: 0.6129
Epoch 666/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6490 - acc: 0.6400
Epoch 667/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6530 - acc: 0.6300
Epoch 668/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6501 - acc: 0.6243
Epoch 669/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6498 - acc: 0.6343
Epoch 670/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6480 - acc: 0.6300
Epoch 671/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6499 - acc: 0.6314
Epoch 672/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6472 - acc: 0.6329
Epoch 673/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6478 - acc: 0.6329
Epoch 674/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6470 - acc: 0.6314
Epoch 675/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6485 - acc: 0.6314
Epoch 676/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6477 - acc: 0.6314
Epoch 677/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6469 - acc: 0.6400
Epoch 678/2000
700/700 [==============================] - 0s 71us/step - loss: 0.6513 - acc: 0.6357
Epoch 679/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6503 - acc: 0.6343
Epoch 680/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6503 - acc: 0.6400
Epoch 681/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6456 - acc: 0.6386
Epoch 682/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6462 - acc: 0.6343
Epoch 683/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6477 - acc: 0.6386
Epoch 684/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6456 - acc: 0.6414
Epoch 685/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6489 - acc: 0.6414
Epoch 686/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6499 - acc: 0.6371
Epoch 687/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6514 - acc: 0.6386
Epoch 688/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6499 - acc: 0.6329
Epoch 689/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6463 - acc: 0.6357
Epoch 690/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6490 - acc: 0.6314
Epoch 691/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6506 - acc: 0.6343
Epoch 692/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6487 - acc: 0.6343
Epoch 693/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6485 - acc: 0.6329
Epoch 694/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6464 - acc: 0.6386
Epoch 695/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6456 - acc: 0.6471
Epoch 696/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6456 - acc: 0.6429
Epoch 697/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6490 - acc: 0.6357
Epoch 698/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6493 - acc: 0.6500
Epoch 699/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6482 - acc: 0.6286
Epoch 700/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6467 - acc: 0.6486
Epoch 701/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6476 - acc: 0.6343
Epoch 702/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6478 - acc: 0.6386
Epoch 703/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6482 - acc: 0.6386
Epoch 704/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6514 - acc: 0.6386
Epoch 705/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6534 - acc: 0.6257
Epoch 706/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6506 - acc: 0.6429
Epoch 707/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6500 - acc: 0.6300
Epoch 708/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6464 - acc: 0.6329
Epoch 709/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6485 - acc: 0.6314
Epoch 710/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6479 - acc: 0.6329
Epoch 711/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6469 - acc: 0.6357
Epoch 712/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6468 - acc: 0.6443
Epoch 713/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6463 - acc: 0.6343
Epoch 714/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6429 - acc: 0.6414
Epoch 715/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6456 - acc: 0.6357
Epoch 716/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6492 - acc: 0.6457
Epoch 717/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6488 - acc: 0.6329
Epoch 718/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6466 - acc: 0.6357
Epoch 719/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6441 - acc: 0.6500
Epoch 720/2000
700/700 [==============================] - ETA: 0s - loss: 0.7273 - acc: 0.531 - 0s 63us/step - loss: 0.6498 - acc: 0.6443
Epoch 721/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6467 - acc: 0.6471
Epoch 722/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6461 - acc: 0.6400
Epoch 723/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6483 - acc: 0.6257
Epoch 724/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6488 - acc: 0.6500
Epoch 725/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6496 - acc: 0.6386
Epoch 726/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6444 - acc: 0.6371
Epoch 727/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6439 - acc: 0.6329
Epoch 728/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6455 - acc: 0.6429
Epoch 729/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6445 - acc: 0.6443
Epoch 730/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6455 - acc: 0.6371
Epoch 731/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6438 - acc: 0.6500
Epoch 732/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6445 - acc: 0.6443
Epoch 733/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6449 - acc: 0.6486
Epoch 734/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6447 - acc: 0.6371
Epoch 735/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6458 - acc: 0.6457
Epoch 736/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6479 - acc: 0.6400
Epoch 737/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6477 - acc: 0.6300
Epoch 738/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6442 - acc: 0.6457
Epoch 739/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6482 - acc: 0.6371
Epoch 740/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6457 - acc: 0.6386
Epoch 741/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6441 - acc: 0.6529
Epoch 742/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6435 - acc: 0.6400
Epoch 743/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6431 - acc: 0.6457
Epoch 744/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6448 - acc: 0.6386
Epoch 745/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6446 - acc: 0.6414
Epoch 746/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6469 - acc: 0.6557
Epoch 747/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6463 - acc: 0.6429
Epoch 748/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6496 - acc: 0.6329
Epoch 749/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6445 - acc: 0.6543
Epoch 750/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6453 - acc: 0.6429
Epoch 751/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6426 - acc: 0.6500
Epoch 752/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6462 - acc: 0.6443
Epoch 753/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6460 - acc: 0.6386
Epoch 754/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6548 - acc: 0.6329
Epoch 755/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6450 - acc: 0.6357
Epoch 756/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6437 - acc: 0.6400
Epoch 757/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6452 - acc: 0.6386
Epoch 758/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6482 - acc: 0.6314
Epoch 759/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6443 - acc: 0.6414
Epoch 760/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6432 - acc: 0.6500
Epoch 761/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6446 - acc: 0.6329
Epoch 762/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6463 - acc: 0.6471
Epoch 763/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6488 - acc: 0.6371
Epoch 764/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6454 - acc: 0.6443
Epoch 765/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6444 - acc: 0.6400
Epoch 766/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6467 - acc: 0.6471
Epoch 767/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6444 - acc: 0.6343
Epoch 768/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6439 - acc: 0.6400
Epoch 769/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6426 - acc: 0.6471
Epoch 770/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6431 - acc: 0.6443
Epoch 771/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6443 - acc: 0.6400
Epoch 772/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6404 - acc: 0.6457
Epoch 773/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6458 - acc: 0.6529
Epoch 774/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6431 - acc: 0.6500
Epoch 775/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6452 - acc: 0.6400
Epoch 776/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6489 - acc: 0.6414
Epoch 777/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6448 - acc: 0.6357
Epoch 778/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6483 - acc: 0.6400
Epoch 779/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6465 - acc: 0.6543
Epoch 780/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6445 - acc: 0.6429
Epoch 781/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6420 - acc: 0.6600
Epoch 782/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6465 - acc: 0.6486
Epoch 783/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6487 - acc: 0.6471
Epoch 784/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6444 - acc: 0.6414
Epoch 785/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6419 - acc: 0.6443
Epoch 786/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6434 - acc: 0.6457
Epoch 787/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6406 - acc: 0.6443
Epoch 788/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6433 - acc: 0.6329
Epoch 789/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6469 - acc: 0.6429
Epoch 790/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6435 - acc: 0.6486
Epoch 791/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6439 - acc: 0.6414
Epoch 792/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6436 - acc: 0.6443
Epoch 793/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6434 - acc: 0.6371
Epoch 794/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6448 - acc: 0.6471
Epoch 795/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6491 - acc: 0.6357
Epoch 796/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6488 - acc: 0.6286
Epoch 797/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6427 - acc: 0.6500
Epoch 798/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6423 - acc: 0.6543
Epoch 799/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6428 - acc: 0.6443
Epoch 800/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6437 - acc: 0.6414
Epoch 801/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6415 - acc: 0.6486
Epoch 802/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6426 - acc: 0.6371
Epoch 803/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6421 - acc: 0.6457
Epoch 804/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6485 - acc: 0.6343
Epoch 805/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6413 - acc: 0.6486
Epoch 806/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6412 - acc: 0.6471
Epoch 807/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6392 - acc: 0.6543
Epoch 808/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6426 - acc: 0.6357
Epoch 809/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6425 - acc: 0.6571
Epoch 810/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6431 - acc: 0.6400
Epoch 811/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6442 - acc: 0.6529
Epoch 812/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6445 - acc: 0.6500
Epoch 813/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6402 - acc: 0.6400
Epoch 814/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6402 - acc: 0.6529
Epoch 815/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6410 - acc: 0.6514
Epoch 816/2000
700/700 [==============================] - 0s 48us/step - loss: 0.6446 - acc: 0.6443
Epoch 817/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6403 - acc: 0.6529
Epoch 818/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6404 - acc: 0.6543
Epoch 819/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6414 - acc: 0.6529
Epoch 820/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6407 - acc: 0.6614
Epoch 821/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6422 - acc: 0.6500
Epoch 822/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6431 - acc: 0.6429
Epoch 823/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6438 - acc: 0.6557
Epoch 824/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6402 - acc: 0.6543
Epoch 825/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6421 - acc: 0.6471
Epoch 826/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6418 - acc: 0.6529
Epoch 827/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6399 - acc: 0.6543
Epoch 828/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6407 - acc: 0.6557
Epoch 829/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6414 - acc: 0.6457
Epoch 830/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6406 - acc: 0.6486
Epoch 831/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6417 - acc: 0.6557
Epoch 832/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6407 - acc: 0.6571
Epoch 833/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6428 - acc: 0.6443
Epoch 834/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6413 - acc: 0.6400
Epoch 835/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6417 - acc: 0.6514
Epoch 836/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6414 - acc: 0.6571
Epoch 837/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6418 - acc: 0.6443
Epoch 838/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6432 - acc: 0.6414
Epoch 839/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6405 - acc: 0.6457
Epoch 840/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6419 - acc: 0.6600
Epoch 841/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6389 - acc: 0.6543
Epoch 842/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6391 - acc: 0.6500
Epoch 843/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6468 - acc: 0.6457
Epoch 844/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6463 - acc: 0.6486
Epoch 845/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6407 - acc: 0.6500
Epoch 846/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6411 - acc: 0.6629
Epoch 847/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6397 - acc: 0.6486
Epoch 848/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6419 - acc: 0.6443
Epoch 849/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6405 - acc: 0.6514
Epoch 850/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6406 - acc: 0.6514
Epoch 851/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6434 - acc: 0.6414
Epoch 852/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6415 - acc: 0.6386
Epoch 853/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6405 - acc: 0.6514
Epoch 854/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6452 - acc: 0.6486
Epoch 855/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6453 - acc: 0.6486
Epoch 856/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6401 - acc: 0.6414
Epoch 857/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6398 - acc: 0.6557
Epoch 858/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6381 - acc: 0.6614
Epoch 859/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6445 - acc: 0.6400
Epoch 860/2000
700/700 [==============================] - 0s 70us/step - loss: 0.6409 - acc: 0.6414
Epoch 861/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6448 - acc: 0.6400
Epoch 862/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6426 - acc: 0.6629
Epoch 863/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6403 - acc: 0.6543
Epoch 864/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6401 - acc: 0.6543
Epoch 865/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6430 - acc: 0.6386
Epoch 866/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6391 - acc: 0.6486
Epoch 867/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6397 - acc: 0.6571
Epoch 868/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6457 - acc: 0.6529
Epoch 869/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6432 - acc: 0.6343
Epoch 870/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6397 - acc: 0.6471
Epoch 871/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6395 - acc: 0.6600
Epoch 872/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6454 - acc: 0.6514
Epoch 873/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6408 - acc: 0.6400
Epoch 874/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6375 - acc: 0.6586
Epoch 875/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6417 - acc: 0.6457
Epoch 876/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6480 - acc: 0.6457
Epoch 877/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6433 - acc: 0.6529
Epoch 878/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6378 - acc: 0.6600
Epoch 879/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6380 - acc: 0.6500
Epoch 880/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6389 - acc: 0.6471
Epoch 881/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6469 - acc: 0.6500
Epoch 882/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6383 - acc: 0.6571
Epoch 883/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6393 - acc: 0.6486
Epoch 884/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6429 - acc: 0.6457
Epoch 885/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6329 - acc: 0.6514
Epoch 886/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6416 - acc: 0.6543
Epoch 887/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6422 - acc: 0.6471
Epoch 888/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6404 - acc: 0.6529
Epoch 889/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6406 - acc: 0.6371
Epoch 890/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6401 - acc: 0.6514
Epoch 891/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6389 - acc: 0.6514
Epoch 892/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6379 - acc: 0.6486
Epoch 893/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6381 - acc: 0.6486
Epoch 894/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6368 - acc: 0.6614
Epoch 895/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6406 - acc: 0.6600
Epoch 896/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6396 - acc: 0.6543
Epoch 897/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6391 - acc: 0.6586
Epoch 898/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6388 - acc: 0.6529
Epoch 899/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6385 - acc: 0.6629
Epoch 900/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6391 - acc: 0.6529
Epoch 901/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6387 - acc: 0.6571
Epoch 902/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6436 - acc: 0.6443
Epoch 903/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6534 - acc: 0.6371
Epoch 904/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6526 - acc: 0.6443
Epoch 905/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6401 - acc: 0.6500
Epoch 906/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6390 - acc: 0.6586
Epoch 907/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6375 - acc: 0.6543
Epoch 908/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6403 - acc: 0.6643
Epoch 909/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6480 - acc: 0.6529
Epoch 910/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6478 - acc: 0.6400
Epoch 911/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6400 - acc: 0.6471
Epoch 912/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6383 - acc: 0.6500
Epoch 913/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6381 - acc: 0.6529
Epoch 914/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6379 - acc: 0.6557
Epoch 915/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6399 - acc: 0.6471
Epoch 916/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6423 - acc: 0.6443
Epoch 917/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6412 - acc: 0.6529
Epoch 918/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6377 - acc: 0.6529
Epoch 919/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6411 - acc: 0.6414
Epoch 920/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6400 - acc: 0.6486
Epoch 921/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6377 - acc: 0.6557
Epoch 922/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6370 - acc: 0.6600
Epoch 923/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6388 - acc: 0.6586
Epoch 924/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6374 - acc: 0.6700
Epoch 925/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6430 - acc: 0.6414
Epoch 926/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6402 - acc: 0.6743
Epoch 927/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6408 - acc: 0.6471
Epoch 928/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6399 - acc: 0.6486
Epoch 929/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6372 - acc: 0.6514
Epoch 930/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6359 - acc: 0.6471
Epoch 931/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6367 - acc: 0.6600
Epoch 932/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6386 - acc: 0.6486
Epoch 933/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6381 - acc: 0.6571
Epoch 934/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6403 - acc: 0.6514
Epoch 935/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6415 - acc: 0.6486
Epoch 936/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6397 - acc: 0.6571
Epoch 937/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6391 - acc: 0.6557
Epoch 938/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6437 - acc: 0.6529
Epoch 939/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6358 - acc: 0.6557
Epoch 940/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6440 - acc: 0.6529
Epoch 941/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6445 - acc: 0.6571
Epoch 942/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6395 - acc: 0.6614
Epoch 943/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6380 - acc: 0.6514
Epoch 944/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6360 - acc: 0.6600
Epoch 945/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6394 - acc: 0.6557
Epoch 946/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6474 - acc: 0.6343
Epoch 947/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6431 - acc: 0.6414
Epoch 948/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6390 - acc: 0.6643
Epoch 949/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6382 - acc: 0.6529
Epoch 950/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6400 - acc: 0.6514
Epoch 951/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6361 - acc: 0.6571
Epoch 952/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6371 - acc: 0.6571
Epoch 953/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6364 - acc: 0.6586
Epoch 954/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6348 - acc: 0.6586
Epoch 955/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6408 - acc: 0.6614
Epoch 956/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6383 - acc: 0.6643
Epoch 957/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6412 - acc: 0.6414
Epoch 958/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6402 - acc: 0.6357
Epoch 959/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6387 - acc: 0.6529
Epoch 960/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6387 - acc: 0.6557
Epoch 961/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6392 - acc: 0.6500
Epoch 962/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6382 - acc: 0.6600
Epoch 963/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6391 - acc: 0.6586
Epoch 964/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6377 - acc: 0.6614
Epoch 965/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6369 - acc: 0.6529
Epoch 966/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6385 - acc: 0.6643
Epoch 967/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6368 - acc: 0.6529
Epoch 968/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6401 - acc: 0.6514
Epoch 969/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6440 - acc: 0.6571
Epoch 970/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6482 - acc: 0.6414
Epoch 971/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6388 - acc: 0.6686
Epoch 972/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6367 - acc: 0.6614
Epoch 973/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6346 - acc: 0.6543
Epoch 974/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6369 - acc: 0.6471
Epoch 975/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6361 - acc: 0.6543
Epoch 976/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6354 - acc: 0.6629
Epoch 977/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6374 - acc: 0.6457
Epoch 978/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6366 - acc: 0.6600
Epoch 979/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6396 - acc: 0.6571
Epoch 980/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6376 - acc: 0.6471
Epoch 981/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6363 - acc: 0.6514
Epoch 982/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6351 - acc: 0.6586
Epoch 983/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6367 - acc: 0.6671
Epoch 984/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6370 - acc: 0.6457
Epoch 985/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6407 - acc: 0.6500
Epoch 986/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6411 - acc: 0.6386
Epoch 987/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6375 - acc: 0.6543
Epoch 988/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6354 - acc: 0.6657
Epoch 989/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6362 - acc: 0.6514
Epoch 990/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6381 - acc: 0.6486
Epoch 991/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6380 - acc: 0.6414
Epoch 992/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6407 - acc: 0.6514
Epoch 993/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6379 - acc: 0.6671
Epoch 994/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6394 - acc: 0.6543
Epoch 995/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6339 - acc: 0.6571
Epoch 996/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6355 - acc: 0.6600
Epoch 997/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6353 - acc: 0.6600
Epoch 998/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6353 - acc: 0.6629
Epoch 999/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6345 - acc: 0.6700
Epoch 1000/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6334 - acc: 0.6643
Epoch 1001/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6365 - acc: 0.6500
Epoch 1002/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6384 - acc: 0.6557
Epoch 1003/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6349 - acc: 0.6543
Epoch 1004/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6372 - acc: 0.6586
Epoch 1005/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6353 - acc: 0.6671
Epoch 1006/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6369 - acc: 0.6557
Epoch 1007/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6353 - acc: 0.6614
Epoch 1008/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6366 - acc: 0.6600
Epoch 1009/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6390 - acc: 0.6729
Epoch 1010/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6385 - acc: 0.6571
Epoch 1011/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6399 - acc: 0.6457
Epoch 1012/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6340 - acc: 0.6714
Epoch 1013/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6332 - acc: 0.6529
Epoch 1014/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6369 - acc: 0.6586
Epoch 1015/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6339 - acc: 0.6514
Epoch 1016/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6361 - acc: 0.6629
Epoch 1017/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6402 - acc: 0.6614
Epoch 1018/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6372 - acc: 0.6529
Epoch 1019/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6363 - acc: 0.6500
Epoch 1020/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6375 - acc: 0.6614
Epoch 1021/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6363 - acc: 0.6529
Epoch 1022/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6358 - acc: 0.6714
Epoch 1023/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6357 - acc: 0.6543
Epoch 1024/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6334 - acc: 0.6486
Epoch 1025/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6349 - acc: 0.6586
Epoch 1026/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6343 - acc: 0.6643
Epoch 1027/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6347 - acc: 0.6671
Epoch 1028/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6394 - acc: 0.6471
Epoch 1029/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6330 - acc: 0.6643
Epoch 1030/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6395 - acc: 0.6357
Epoch 1031/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6356 - acc: 0.6614
Epoch 1032/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6330 - acc: 0.6571
Epoch 1033/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6340 - acc: 0.6529
Epoch 1034/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6334 - acc: 0.6629
Epoch 1035/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6373 - acc: 0.6543
Epoch 1036/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6344 - acc: 0.6500
Epoch 1037/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6348 - acc: 0.6586
Epoch 1038/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6361 - acc: 0.6643
Epoch 1039/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6329 - acc: 0.6614
Epoch 1040/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6364 - acc: 0.6529
Epoch 1041/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6331 - acc: 0.6629
Epoch 1042/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6337 - acc: 0.6671
Epoch 1043/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6353 - acc: 0.6571
Epoch 1044/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6346 - acc: 0.6629
Epoch 1045/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6387 - acc: 0.6586
Epoch 1046/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6327 - acc: 0.6557
Epoch 1047/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6344 - acc: 0.6529
Epoch 1048/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6346 - acc: 0.6700
Epoch 1049/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6332 - acc: 0.6629
Epoch 1050/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6347 - acc: 0.6586
Epoch 1051/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6387 - acc: 0.6514
Epoch 1052/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6371 - acc: 0.6571
Epoch 1053/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6376 - acc: 0.6529
Epoch 1054/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6335 - acc: 0.6600
Epoch 1055/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6365 - acc: 0.6543
Epoch 1056/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6328 - acc: 0.6757
Epoch 1057/2000
700/700 [==============================] - ETA: 0s - loss: 0.6749 - acc: 0.625 - 0s 54us/step - loss: 0.6356 - acc: 0.6471
Epoch 1058/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6319 - acc: 0.6571
Epoch 1059/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6362 - acc: 0.6571
Epoch 1060/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6374 - acc: 0.6500
Epoch 1061/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6309 - acc: 0.6586
Epoch 1062/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6337 - acc: 0.6700
Epoch 1063/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6325 - acc: 0.6600
Epoch 1064/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6335 - acc: 0.6557
Epoch 1065/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6324 - acc: 0.6600
Epoch 1066/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6325 - acc: 0.6614
Epoch 1067/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6325 - acc: 0.6657
Epoch 1068/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6346 - acc: 0.6571
Epoch 1069/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6362 - acc: 0.6586
Epoch 1070/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6346 - acc: 0.6557
Epoch 1071/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6327 - acc: 0.6643
Epoch 1072/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6405 - acc: 0.6671
Epoch 1073/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6380 - acc: 0.6457
Epoch 1074/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6350 - acc: 0.6657
Epoch 1075/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6352 - acc: 0.6586
Epoch 1076/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6342 - acc: 0.6714
Epoch 1077/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6307 - acc: 0.6629
Epoch 1078/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6339 - acc: 0.6686
Epoch 1079/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6340 - acc: 0.6557
Epoch 1080/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6377 - acc: 0.6643
Epoch 1081/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6303 - acc: 0.6671
Epoch 1082/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6415 - acc: 0.6586
Epoch 1083/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6440 - acc: 0.6529
Epoch 1084/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6356 - acc: 0.6543
Epoch 1085/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6356 - acc: 0.6629
Epoch 1086/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6350 - acc: 0.6671
Epoch 1087/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6391 - acc: 0.6557
Epoch 1088/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6341 - acc: 0.6614
Epoch 1089/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6356 - acc: 0.6586
Epoch 1090/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6364 - acc: 0.6614
Epoch 1091/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6321 - acc: 0.6671
Epoch 1092/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6338 - acc: 0.6657
Epoch 1093/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6350 - acc: 0.6614
Epoch 1094/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6314 - acc: 0.6629
Epoch 1095/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6320 - acc: 0.6714
Epoch 1096/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6322 - acc: 0.6629
Epoch 1097/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6313 - acc: 0.6614
Epoch 1098/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6395 - acc: 0.6414
Epoch 1099/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6341 - acc: 0.6643
Epoch 1100/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6324 - acc: 0.6686
Epoch 1101/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6366 - acc: 0.6614
Epoch 1102/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6314 - acc: 0.6529
Epoch 1103/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6359 - acc: 0.6600
Epoch 1104/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6339 - acc: 0.6629
Epoch 1105/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6327 - acc: 0.6643
Epoch 1106/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6373 - acc: 0.6471
Epoch 1107/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6334 - acc: 0.6757
Epoch 1108/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6352 - acc: 0.6657
Epoch 1109/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6312 - acc: 0.6629
Epoch 1110/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6307 - acc: 0.6657
Epoch 1111/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6327 - acc: 0.6657
Epoch 1112/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6358 - acc: 0.6629
Epoch 1113/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6340 - acc: 0.6614
Epoch 1114/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6357 - acc: 0.6743
Epoch 1115/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6331 - acc: 0.6686
Epoch 1116/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6343 - acc: 0.6771
Epoch 1117/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6327 - acc: 0.6571
Epoch 1118/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6301 - acc: 0.6529
Epoch 1119/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6398 - acc: 0.6614
Epoch 1120/2000
700/700 [==============================] - 0s 76us/step - loss: 0.6358 - acc: 0.6514
Epoch 1121/2000
700/700 [==============================] - 0s 87us/step - loss: 0.6319 - acc: 0.6629
Epoch 1122/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6328 - acc: 0.6586
Epoch 1123/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6336 - acc: 0.6657
Epoch 1124/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6330 - acc: 0.6657
Epoch 1125/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6334 - acc: 0.6671
Epoch 1126/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6312 - acc: 0.6586
Epoch 1127/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6316 - acc: 0.6671
Epoch 1128/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6334 - acc: 0.6529
Epoch 1129/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6337 - acc: 0.6543
Epoch 1130/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6379 - acc: 0.6743
Epoch 1131/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6324 - acc: 0.6600
Epoch 1132/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6340 - acc: 0.6586
Epoch 1133/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6320 - acc: 0.6700
Epoch 1134/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6359 - acc: 0.6757
Epoch 1135/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6364 - acc: 0.6557
Epoch 1136/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6352 - acc: 0.6714
Epoch 1137/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6403 - acc: 0.6614
Epoch 1138/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6332 - acc: 0.6571
Epoch 1139/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6324 - acc: 0.6529
Epoch 1140/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6338 - acc: 0.6757
Epoch 1141/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6331 - acc: 0.6500
Epoch 1142/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6317 - acc: 0.6657
Epoch 1143/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6339 - acc: 0.6671
Epoch 1144/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6313 - acc: 0.6714
Epoch 1145/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6430 - acc: 0.6514
Epoch 1146/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6395 - acc: 0.6614
Epoch 1147/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6361 - acc: 0.6457
Epoch 1148/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6292 - acc: 0.6614
Epoch 1149/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6333 - acc: 0.6529
Epoch 1150/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6312 - acc: 0.6571
Epoch 1151/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6320 - acc: 0.6686
Epoch 1152/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6371 - acc: 0.6486
Epoch 1153/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6323 - acc: 0.6586
Epoch 1154/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6312 - acc: 0.6614
Epoch 1155/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6367 - acc: 0.6400
Epoch 1156/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6302 - acc: 0.6671
Epoch 1157/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6323 - acc: 0.6657
Epoch 1158/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6322 - acc: 0.6657
Epoch 1159/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6363 - acc: 0.6586
Epoch 1160/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6315 - acc: 0.6614
Epoch 1161/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6338 - acc: 0.6557
Epoch 1162/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6308 - acc: 0.6614
Epoch 1163/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6318 - acc: 0.6557
Epoch 1164/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6285 - acc: 0.6671
Epoch 1165/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6297 - acc: 0.6671
Epoch 1166/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6319 - acc: 0.6586
Epoch 1167/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6287 - acc: 0.6743
Epoch 1168/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6295 - acc: 0.6629
Epoch 1169/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6368 - acc: 0.6671
Epoch 1170/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6351 - acc: 0.6514
Epoch 1171/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6318 - acc: 0.6586
Epoch 1172/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6357 - acc: 0.6600
Epoch 1173/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6311 - acc: 0.6586
Epoch 1174/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6313 - acc: 0.6700
Epoch 1175/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6348 - acc: 0.6557
Epoch 1176/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6294 - acc: 0.6600
Epoch 1177/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6301 - acc: 0.6657
Epoch 1178/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6289 - acc: 0.6714
Epoch 1179/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6373 - acc: 0.6586
Epoch 1180/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6356 - acc: 0.6557
Epoch 1181/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6316 - acc: 0.6671
Epoch 1182/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6380 - acc: 0.6571
Epoch 1183/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6300 - acc: 0.6614
Epoch 1184/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6333 - acc: 0.6614
Epoch 1185/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6367 - acc: 0.6500
Epoch 1186/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6322 - acc: 0.6614
Epoch 1187/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6302 - acc: 0.6657
Epoch 1188/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6312 - acc: 0.6586
Epoch 1189/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6342 - acc: 0.6514
Epoch 1190/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6294 - acc: 0.6686
Epoch 1191/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6352 - acc: 0.6614
Epoch 1192/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6365 - acc: 0.6500
Epoch 1193/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6357 - acc: 0.6629
Epoch 1194/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6295 - acc: 0.6571
Epoch 1195/2000
700/700 [==============================] - 0s 48us/step - loss: 0.6497 - acc: 0.6543
Epoch 1196/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6380 - acc: 0.6414
Epoch 1197/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6378 - acc: 0.6429
Epoch 1198/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6326 - acc: 0.6686
Epoch 1199/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6309 - acc: 0.6714
Epoch 1200/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6368 - acc: 0.6429
Epoch 1201/2000
700/700 [==============================] - 0s 66us/step - loss: 0.6388 - acc: 0.6457
Epoch 1202/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6276 - acc: 0.6729
Epoch 1203/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6316 - acc: 0.6571
Epoch 1204/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6270 - acc: 0.6671
Epoch 1205/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6292 - acc: 0.6643
Epoch 1206/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6289 - acc: 0.6657
Epoch 1207/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6307 - acc: 0.6757
Epoch 1208/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6299 - acc: 0.6557
Epoch 1209/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6296 - acc: 0.6657
Epoch 1210/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6337 - acc: 0.6714
Epoch 1211/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6366 - acc: 0.6586
Epoch 1212/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6328 - acc: 0.6657
Epoch 1213/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6291 - acc: 0.6671
Epoch 1214/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6306 - acc: 0.6657
Epoch 1215/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6270 - acc: 0.6743
Epoch 1216/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6342 - acc: 0.6657
Epoch 1217/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6304 - acc: 0.6671
Epoch 1218/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6303 - acc: 0.6629
Epoch 1219/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6297 - acc: 0.6657
Epoch 1220/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6308 - acc: 0.6600
Epoch 1221/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6288 - acc: 0.6743
Epoch 1222/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6291 - acc: 0.6671
Epoch 1223/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6352 - acc: 0.6571
Epoch 1224/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6240 - acc: 0.6700
Epoch 1225/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6315 - acc: 0.6586
Epoch 1226/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6261 - acc: 0.6729
Epoch 1227/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6332 - acc: 0.6557
Epoch 1228/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6296 - acc: 0.6686
Epoch 1229/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6292 - acc: 0.6671
Epoch 1230/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6333 - acc: 0.6657
Epoch 1231/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6312 - acc: 0.6614
Epoch 1232/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6278 - acc: 0.6729
Epoch 1233/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6296 - acc: 0.6457
Epoch 1234/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6346 - acc: 0.6543
Epoch 1235/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6433 - acc: 0.6486
Epoch 1236/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6332 - acc: 0.6657
Epoch 1237/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6269 - acc: 0.6686
Epoch 1238/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6278 - acc: 0.6686
Epoch 1239/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6264 - acc: 0.6786
Epoch 1240/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6310 - acc: 0.6657
Epoch 1241/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6257 - acc: 0.6786
Epoch 1242/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6297 - acc: 0.6729
Epoch 1243/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6422 - acc: 0.6471
Epoch 1244/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6387 - acc: 0.6486
Epoch 1245/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6373 - acc: 0.6514
Epoch 1246/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6280 - acc: 0.6714
Epoch 1247/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6279 - acc: 0.6729
Epoch 1248/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6288 - acc: 0.6757
Epoch 1249/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6289 - acc: 0.6786
Epoch 1250/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6300 - acc: 0.6686
Epoch 1251/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6295 - acc: 0.6686
Epoch 1252/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6336 - acc: 0.6671
Epoch 1253/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6332 - acc: 0.6543
Epoch 1254/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6301 - acc: 0.6786
Epoch 1255/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6284 - acc: 0.6700
Epoch 1256/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6282 - acc: 0.6586
Epoch 1257/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6307 - acc: 0.6614
Epoch 1258/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6285 - acc: 0.6643
Epoch 1259/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6279 - acc: 0.6714
Epoch 1260/2000
700/700 [==============================] - 0s 46us/step - loss: 0.6310 - acc: 0.6700
Epoch 1261/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6265 - acc: 0.6671
Epoch 1262/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6291 - acc: 0.6543
Epoch 1263/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6315 - acc: 0.6686
Epoch 1264/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6325 - acc: 0.6671
Epoch 1265/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6395 - acc: 0.6486
Epoch 1266/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6278 - acc: 0.6629
Epoch 1267/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6290 - acc: 0.6743
Epoch 1268/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6279 - acc: 0.6614
Epoch 1269/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6279 - acc: 0.6657
Epoch 1270/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6292 - acc: 0.6657
Epoch 1271/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6288 - acc: 0.6643
Epoch 1272/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6266 - acc: 0.6743
Epoch 1273/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6317 - acc: 0.6757
Epoch 1274/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6280 - acc: 0.6571
Epoch 1275/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6265 - acc: 0.6714
Epoch 1276/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6283 - acc: 0.6586
Epoch 1277/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6252 - acc: 0.6729
Epoch 1278/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6312 - acc: 0.6657
Epoch 1279/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6316 - acc: 0.6629
Epoch 1280/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6273 - acc: 0.6771
Epoch 1281/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6280 - acc: 0.6700
Epoch 1282/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6277 - acc: 0.6743
Epoch 1283/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6281 - acc: 0.6729
Epoch 1284/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6273 - acc: 0.6700
Epoch 1285/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6257 - acc: 0.6643
Epoch 1286/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6275 - acc: 0.6671
Epoch 1287/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6281 - acc: 0.6714
Epoch 1288/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6380 - acc: 0.6586
Epoch 1289/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6272 - acc: 0.6714
Epoch 1290/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6263 - acc: 0.6829
Epoch 1291/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6265 - acc: 0.6757
Epoch 1292/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6269 - acc: 0.6714
Epoch 1293/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6348 - acc: 0.6486
Epoch 1294/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6289 - acc: 0.6743
Epoch 1295/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6320 - acc: 0.6486
Epoch 1296/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6318 - acc: 0.6643
Epoch 1297/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6287 - acc: 0.6700
Epoch 1298/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6319 - acc: 0.6629
Epoch 1299/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6282 - acc: 0.6629
Epoch 1300/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6261 - acc: 0.6700
Epoch 1301/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6254 - acc: 0.6786
Epoch 1302/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6284 - acc: 0.6743
Epoch 1303/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6277 - acc: 0.6714
Epoch 1304/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6254 - acc: 0.6686
Epoch 1305/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6286 - acc: 0.6571
Epoch 1306/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6359 - acc: 0.6629
Epoch 1307/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6287 - acc: 0.6700
Epoch 1308/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6284 - acc: 0.6614
Epoch 1309/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6341 - acc: 0.6686
Epoch 1310/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6359 - acc: 0.6529
Epoch 1311/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6294 - acc: 0.6686
Epoch 1312/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6269 - acc: 0.6671
Epoch 1313/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6301 - acc: 0.6729
Epoch 1314/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6286 - acc: 0.6657
Epoch 1315/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6249 - acc: 0.6571
Epoch 1316/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6253 - acc: 0.6714
Epoch 1317/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6271 - acc: 0.6729
Epoch 1318/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6260 - acc: 0.6614
Epoch 1319/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6283 - acc: 0.6700
Epoch 1320/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6300 - acc: 0.6600
Epoch 1321/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6340 - acc: 0.6643
Epoch 1322/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6302 - acc: 0.6771
Epoch 1323/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6256 - acc: 0.6814
Epoch 1324/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6272 - acc: 0.6557
Epoch 1325/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6293 - acc: 0.6729
Epoch 1326/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6274 - acc: 0.6671
Epoch 1327/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6269 - acc: 0.6686
Epoch 1328/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6303 - acc: 0.6500
Epoch 1329/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6283 - acc: 0.6571
Epoch 1330/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6324 - acc: 0.6500
Epoch 1331/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6309 - acc: 0.6586
Epoch 1332/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6277 - acc: 0.6686
Epoch 1333/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6261 - acc: 0.6700
Epoch 1334/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6244 - acc: 0.6743
Epoch 1335/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6290 - acc: 0.6686
Epoch 1336/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6272 - acc: 0.6757
Epoch 1337/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6269 - acc: 0.6700
Epoch 1338/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6269 - acc: 0.6700
Epoch 1339/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6251 - acc: 0.6686
Epoch 1340/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6263 - acc: 0.6700
Epoch 1341/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6261 - acc: 0.6586
Epoch 1342/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6270 - acc: 0.6700
Epoch 1343/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6293 - acc: 0.6757
Epoch 1344/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6307 - acc: 0.6671
Epoch 1345/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6262 - acc: 0.6700
Epoch 1346/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6284 - acc: 0.6714
Epoch 1347/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6300 - acc: 0.6714
Epoch 1348/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6246 - acc: 0.6671
Epoch 1349/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6278 - acc: 0.6686
Epoch 1350/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6269 - acc: 0.6557
Epoch 1351/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6270 - acc: 0.6743
Epoch 1352/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6293 - acc: 0.6586
Epoch 1353/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6383 - acc: 0.6643
Epoch 1354/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6262 - acc: 0.6686
Epoch 1355/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6261 - acc: 0.6671
Epoch 1356/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6290 - acc: 0.6643
Epoch 1357/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6259 - acc: 0.6714
Epoch 1358/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6244 - acc: 0.6714
Epoch 1359/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6252 - acc: 0.6814
Epoch 1360/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6284 - acc: 0.6757
Epoch 1361/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6315 - acc: 0.6543
Epoch 1362/2000
700/700 [==============================] - 0s 69us/step - loss: 0.6254 - acc: 0.6714
Epoch 1363/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6337 - acc: 0.6671
Epoch 1364/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6350 - acc: 0.6529
Epoch 1365/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6240 - acc: 0.6786
Epoch 1366/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6243 - acc: 0.6843
Epoch 1367/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6255 - acc: 0.6614
Epoch 1368/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6280 - acc: 0.6700
Epoch 1369/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6258 - acc: 0.6714
Epoch 1370/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6263 - acc: 0.6671
Epoch 1371/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6370 - acc: 0.6586
Epoch 1372/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6290 - acc: 0.6714
Epoch 1373/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6271 - acc: 0.6629
Epoch 1374/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6248 - acc: 0.6700
Epoch 1375/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6244 - acc: 0.6786
Epoch 1376/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6252 - acc: 0.6814
Epoch 1377/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6282 - acc: 0.6586
Epoch 1378/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6240 - acc: 0.6671
Epoch 1379/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6235 - acc: 0.6857
Epoch 1380/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6291 - acc: 0.6557
Epoch 1381/2000
700/700 [==============================] - ETA: 0s - loss: 0.5205 - acc: 0.875 - 0s 51us/step - loss: 0.6248 - acc: 0.6614
Epoch 1382/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6301 - acc: 0.6729
Epoch 1383/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6262 - acc: 0.6714
Epoch 1384/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6236 - acc: 0.6714
Epoch 1385/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6240 - acc: 0.6800
Epoch 1386/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6249 - acc: 0.6814
Epoch 1387/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6277 - acc: 0.6729
Epoch 1388/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6267 - acc: 0.6671
Epoch 1389/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6241 - acc: 0.6629
Epoch 1390/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6280 - acc: 0.6714
Epoch 1391/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6316 - acc: 0.6500
Epoch 1392/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6257 - acc: 0.6743
Epoch 1393/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6275 - acc: 0.6671
Epoch 1394/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6281 - acc: 0.6771
Epoch 1395/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6349 - acc: 0.6643
Epoch 1396/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6294 - acc: 0.6614
Epoch 1397/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6248 - acc: 0.6700
Epoch 1398/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6233 - acc: 0.6786
Epoch 1399/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6261 - acc: 0.6700
Epoch 1400/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6243 - acc: 0.6657
Epoch 1401/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6375 - acc: 0.6529
Epoch 1402/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6330 - acc: 0.6686
Epoch 1403/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6226 - acc: 0.6829
Epoch 1404/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6299 - acc: 0.6571
Epoch 1405/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6233 - acc: 0.6686
Epoch 1406/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6261 - acc: 0.6557
Epoch 1407/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6277 - acc: 0.6686
Epoch 1408/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6296 - acc: 0.6786
Epoch 1409/2000
700/700 [==============================] - 0s 46us/step - loss: 0.6252 - acc: 0.6671
Epoch 1410/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6237 - acc: 0.6843
Epoch 1411/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6313 - acc: 0.6571
Epoch 1412/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6241 - acc: 0.6743
Epoch 1413/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6241 - acc: 0.6700
Epoch 1414/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6221 - acc: 0.6714
Epoch 1415/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6242 - acc: 0.6657
Epoch 1416/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6274 - acc: 0.6614
Epoch 1417/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6264 - acc: 0.6714
Epoch 1418/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6348 - acc: 0.6671
Epoch 1419/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6279 - acc: 0.6643
Epoch 1420/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6215 - acc: 0.6814
Epoch 1421/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6225 - acc: 0.6657
Epoch 1422/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6254 - acc: 0.6729
Epoch 1423/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6252 - acc: 0.6757
Epoch 1424/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6254 - acc: 0.6786
Epoch 1425/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6271 - acc: 0.6714
Epoch 1426/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6370 - acc: 0.6486
Epoch 1427/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6349 - acc: 0.6671
Epoch 1428/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6358 - acc: 0.6714
Epoch 1429/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6262 - acc: 0.6614
Epoch 1430/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6238 - acc: 0.6700
Epoch 1431/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6227 - acc: 0.6800
Epoch 1432/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6260 - acc: 0.6671
Epoch 1433/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6244 - acc: 0.6743
Epoch 1434/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6243 - acc: 0.6771
Epoch 1435/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6257 - acc: 0.6786
Epoch 1436/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6238 - acc: 0.6743
Epoch 1437/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6296 - acc: 0.6657
Epoch 1438/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6233 - acc: 0.6686
Epoch 1439/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6250 - acc: 0.6829
Epoch 1440/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6277 - acc: 0.6629
Epoch 1441/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6271 - acc: 0.6586
Epoch 1442/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6363 - acc: 0.6557
Epoch 1443/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6332 - acc: 0.6671
Epoch 1444/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6243 - acc: 0.6729
Epoch 1445/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6262 - acc: 0.6643
Epoch 1446/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6267 - acc: 0.6671
Epoch 1447/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6280 - acc: 0.6643
Epoch 1448/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6233 - acc: 0.6814
Epoch 1449/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6272 - acc: 0.6714
Epoch 1450/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6286 - acc: 0.6529
Epoch 1451/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6250 - acc: 0.6686
Epoch 1452/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6238 - acc: 0.6757
Epoch 1453/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6222 - acc: 0.6700
Epoch 1454/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6249 - acc: 0.6800
Epoch 1455/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6249 - acc: 0.6886
Epoch 1456/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6225 - acc: 0.6800
Epoch 1457/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6229 - acc: 0.6757
Epoch 1458/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6211 - acc: 0.6786
Epoch 1459/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6234 - acc: 0.6671
Epoch 1460/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6259 - acc: 0.6714
Epoch 1461/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6285 - acc: 0.6743
Epoch 1462/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6259 - acc: 0.6657
Epoch 1463/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6269 - acc: 0.6814
Epoch 1464/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6284 - acc: 0.6686
Epoch 1465/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6226 - acc: 0.6700
Epoch 1466/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6253 - acc: 0.6614
Epoch 1467/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6240 - acc: 0.6771
Epoch 1468/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6248 - acc: 0.6586
Epoch 1469/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6297 - acc: 0.6671
Epoch 1470/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6288 - acc: 0.6714
Epoch 1471/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6238 - acc: 0.6657
Epoch 1472/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6239 - acc: 0.6786
Epoch 1473/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6231 - acc: 0.6814
Epoch 1474/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6262 - acc: 0.6571
Epoch 1475/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6246 - acc: 0.6700
Epoch 1476/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6214 - acc: 0.6814
Epoch 1477/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6237 - acc: 0.6743
Epoch 1478/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6272 - acc: 0.6671
Epoch 1479/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6276 - acc: 0.6571
Epoch 1480/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6231 - acc: 0.6757
Epoch 1481/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6268 - acc: 0.6657
Epoch 1482/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6233 - acc: 0.6786
Epoch 1483/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6253 - acc: 0.6743
Epoch 1484/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6286 - acc: 0.6600
Epoch 1485/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6259 - acc: 0.6829
Epoch 1486/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6216 - acc: 0.6671
Epoch 1487/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6217 - acc: 0.6729
Epoch 1488/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6249 - acc: 0.6686
Epoch 1489/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6267 - acc: 0.6814
Epoch 1490/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6262 - acc: 0.6657
Epoch 1491/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6320 - acc: 0.6643
Epoch 1492/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6259 - acc: 0.6600
Epoch 1493/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6223 - acc: 0.6700
Epoch 1494/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6264 - acc: 0.6614
Epoch 1495/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6249 - acc: 0.6643
Epoch 1496/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6231 - acc: 0.6814
Epoch 1497/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6281 - acc: 0.6757
Epoch 1498/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6318 - acc: 0.6643
Epoch 1499/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6253 - acc: 0.6657
Epoch 1500/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6288 - acc: 0.6729
Epoch 1501/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6207 - acc: 0.6743
Epoch 1502/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6252 - acc: 0.6671
Epoch 1503/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6240 - acc: 0.6771
Epoch 1504/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6234 - acc: 0.6771
Epoch 1505/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6290 - acc: 0.6700
Epoch 1506/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6282 - acc: 0.6729
Epoch 1507/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6221 - acc: 0.6729
Epoch 1508/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6263 - acc: 0.6829
Epoch 1509/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6231 - acc: 0.6757
Epoch 1510/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6239 - acc: 0.6614
Epoch 1511/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6257 - acc: 0.6643
Epoch 1512/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6205 - acc: 0.6700
Epoch 1513/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6250 - acc: 0.6671
Epoch 1514/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6248 - acc: 0.6786
Epoch 1515/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6204 - acc: 0.6771
Epoch 1516/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6231 - acc: 0.6743
Epoch 1517/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6330 - acc: 0.6600
Epoch 1518/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6368 - acc: 0.6629
Epoch 1519/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6260 - acc: 0.6643
Epoch 1520/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6248 - acc: 0.6800
Epoch 1521/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6224 - acc: 0.6700
Epoch 1522/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6230 - acc: 0.6757
Epoch 1523/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6281 - acc: 0.6729
Epoch 1524/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6303 - acc: 0.6686
Epoch 1525/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6234 - acc: 0.6729
Epoch 1526/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6279 - acc: 0.6657
Epoch 1527/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6714
Epoch 1528/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6262 - acc: 0.6700
Epoch 1529/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6234 - acc: 0.6571
Epoch 1530/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6277 - acc: 0.6771
Epoch 1531/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6228 - acc: 0.6729
Epoch 1532/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6221 - acc: 0.6871
Epoch 1533/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6215 - acc: 0.6857
Epoch 1534/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6253 - acc: 0.6786
Epoch 1535/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6209 - acc: 0.6771
Epoch 1536/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6235 - acc: 0.6629
Epoch 1537/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6428 - acc: 0.6443
Epoch 1538/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6302 - acc: 0.6543
Epoch 1539/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6195 - acc: 0.6814
Epoch 1540/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6295 - acc: 0.6543
Epoch 1541/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6241 - acc: 0.6786
Epoch 1542/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6249 - acc: 0.6671
Epoch 1543/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6279 - acc: 0.6729
Epoch 1544/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6240 - acc: 0.6743
Epoch 1545/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6224 - acc: 0.6800
Epoch 1546/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6256 - acc: 0.6671
Epoch 1547/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6213 - acc: 0.6786
Epoch 1548/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6271 - acc: 0.6571
Epoch 1549/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6260 - acc: 0.6800
Epoch 1550/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6199 - acc: 0.6843
Epoch 1551/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6236 - acc: 0.6671
Epoch 1552/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6248 - acc: 0.6700
Epoch 1553/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6223 - acc: 0.6743
Epoch 1554/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6261 - acc: 0.6600
Epoch 1555/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6204 - acc: 0.6729
Epoch 1556/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6236 - acc: 0.6843
Epoch 1557/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6236 - acc: 0.6857
Epoch 1558/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6207 - acc: 0.6814
Epoch 1559/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6234 - acc: 0.6700
Epoch 1560/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6204 - acc: 0.6800
Epoch 1561/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6229 - acc: 0.6843
Epoch 1562/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6250 - acc: 0.6814
Epoch 1563/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6274 - acc: 0.6686
Epoch 1564/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6216 - acc: 0.6614
Epoch 1565/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6205 - acc: 0.6771
Epoch 1566/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6226 - acc: 0.6829
Epoch 1567/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6229 - acc: 0.6871
Epoch 1568/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6225 - acc: 0.6614
Epoch 1569/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6188 - acc: 0.6686
Epoch 1570/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6197 - acc: 0.6800
Epoch 1571/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6206 - acc: 0.6700
Epoch 1572/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6251 - acc: 0.6657
Epoch 1573/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6220 - acc: 0.6714
Epoch 1574/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6257 - acc: 0.6771
Epoch 1575/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6269 - acc: 0.6714
Epoch 1576/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6244 - acc: 0.6729
Epoch 1577/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6272 - acc: 0.6614
Epoch 1578/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6221 - acc: 0.6800
Epoch 1579/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6330 - acc: 0.6686
Epoch 1580/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6295 - acc: 0.6729
Epoch 1581/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6429 - acc: 0.6557
Epoch 1582/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6303 - acc: 0.6571
Epoch 1583/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6228 - acc: 0.6657
Epoch 1584/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6250 - acc: 0.6757
Epoch 1585/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6244 - acc: 0.6771
Epoch 1586/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6197 - acc: 0.6757
Epoch 1587/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6235 - acc: 0.6843
Epoch 1588/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6241 - acc: 0.6757
Epoch 1589/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6240 - acc: 0.6814
Epoch 1590/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6198 - acc: 0.6843
Epoch 1591/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6216 - acc: 0.6714
Epoch 1592/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6355 - acc: 0.6400
Epoch 1593/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6239 - acc: 0.6771
Epoch 1594/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6195 - acc: 0.6814
Epoch 1595/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6221 - acc: 0.6700
Epoch 1596/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6199 - acc: 0.6600
Epoch 1597/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6217 - acc: 0.6714
Epoch 1598/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6267 - acc: 0.6686
Epoch 1599/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6238 - acc: 0.6729
Epoch 1600/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6200 - acc: 0.6743
Epoch 1601/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6191 - acc: 0.6771
Epoch 1602/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6203 - acc: 0.6843
Epoch 1603/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6227 - acc: 0.6700
Epoch 1604/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6267 - acc: 0.6743
Epoch 1605/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6210 - acc: 0.6686
Epoch 1606/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6212 - acc: 0.6771
Epoch 1607/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6195 - acc: 0.6757
Epoch 1608/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6208 - acc: 0.6771
Epoch 1609/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6186 - acc: 0.6829
Epoch 1610/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6238 - acc: 0.6657
Epoch 1611/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6176 - acc: 0.6814
Epoch 1612/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6217 - acc: 0.6800
Epoch 1613/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6210 - acc: 0.6729
Epoch 1614/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6211 - acc: 0.6843
Epoch 1615/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6175 - acc: 0.6829
Epoch 1616/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6206 - acc: 0.6800
Epoch 1617/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6234 - acc: 0.6743
Epoch 1618/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6221 - acc: 0.6714
Epoch 1619/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6253 - acc: 0.6500
Epoch 1620/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6219 - acc: 0.6714
Epoch 1621/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6197 - acc: 0.6800
Epoch 1622/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6244 - acc: 0.6700
Epoch 1623/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6239 - acc: 0.6786
Epoch 1624/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6247 - acc: 0.6786
Epoch 1625/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6224 - acc: 0.6800
Epoch 1626/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6843
Epoch 1627/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6213 - acc: 0.6843
Epoch 1628/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6230 - acc: 0.6671
Epoch 1629/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6296 - acc: 0.6757
Epoch 1630/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6306 - acc: 0.6586
Epoch 1631/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6233 - acc: 0.6757
Epoch 1632/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6211 - acc: 0.6686
Epoch 1633/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6189 - acc: 0.6814
Epoch 1634/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6244 - acc: 0.6857
Epoch 1635/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6217 - acc: 0.6743
Epoch 1636/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6195 - acc: 0.6814
Epoch 1637/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6209 - acc: 0.6714
Epoch 1638/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6254 - acc: 0.6686
Epoch 1639/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6214 - acc: 0.6771
Epoch 1640/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6218 - acc: 0.6671
Epoch 1641/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6195 - acc: 0.6743
Epoch 1642/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6198 - acc: 0.6600
Epoch 1643/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6254 - acc: 0.6729
Epoch 1644/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6283 - acc: 0.6757
Epoch 1645/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6225 - acc: 0.6771
Epoch 1646/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6269 - acc: 0.6600
Epoch 1647/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6185 - acc: 0.6857
Epoch 1648/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6207 - acc: 0.6829
Epoch 1649/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6195 - acc: 0.6757
Epoch 1650/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6209 - acc: 0.6657
Epoch 1651/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6217 - acc: 0.6614
Epoch 1652/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6224 - acc: 0.6743
Epoch 1653/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6213 - acc: 0.6771
Epoch 1654/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6191 - acc: 0.6800
Epoch 1655/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6199 - acc: 0.6671
Epoch 1656/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6218 - acc: 0.6743
Epoch 1657/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6247 - acc: 0.6714
Epoch 1658/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6282 - acc: 0.6757
Epoch 1659/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6219 - acc: 0.6843
Epoch 1660/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6189 - acc: 0.6757
Epoch 1661/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6200 - acc: 0.6757
Epoch 1662/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6213 - acc: 0.6743
Epoch 1663/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6283 - acc: 0.6729
Epoch 1664/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6189 - acc: 0.6643
Epoch 1665/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6222 - acc: 0.6700
Epoch 1666/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6196 - acc: 0.6686
Epoch 1667/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6231 - acc: 0.6700
Epoch 1668/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6176 - acc: 0.6829
Epoch 1669/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6196 - acc: 0.6700
Epoch 1670/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6202 - acc: 0.6843
Epoch 1671/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6233 - acc: 0.6771
Epoch 1672/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6193 - acc: 0.6829
Epoch 1673/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6206 - acc: 0.6714
Epoch 1674/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6253 - acc: 0.6757
Epoch 1675/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6312 - acc: 0.6614
Epoch 1676/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6181 - acc: 0.6800
Epoch 1677/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6187 - acc: 0.6814
Epoch 1678/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6183 - acc: 0.6786
Epoch 1679/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6191 - acc: 0.6700
Epoch 1680/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6181 - acc: 0.6700
Epoch 1681/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6189 - acc: 0.6786
Epoch 1682/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6203 - acc: 0.6671
Epoch 1683/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6220 - acc: 0.6614
Epoch 1684/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6223 - acc: 0.6771
Epoch 1685/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6191 - acc: 0.6800
Epoch 1686/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6178 - acc: 0.6743
Epoch 1687/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6195 - acc: 0.6757
Epoch 1688/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6267 - acc: 0.6629
Epoch 1689/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6281 - acc: 0.6629
Epoch 1690/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6292 - acc: 0.6714
Epoch 1691/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6256 - acc: 0.6614
Epoch 1692/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6222 - acc: 0.6757
Epoch 1693/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6179 - acc: 0.6771
Epoch 1694/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6181 - acc: 0.6843
Epoch 1695/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6211 - acc: 0.6714
Epoch 1696/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6174 - acc: 0.6843
Epoch 1697/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6204 - acc: 0.6829
Epoch 1698/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6246 - acc: 0.6657
Epoch 1699/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6253 - acc: 0.6686
Epoch 1700/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6186 - acc: 0.6771
Epoch 1701/2000
700/700 [==============================] - 0s 64us/step - loss: 0.6176 - acc: 0.6771
Epoch 1702/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6184 - acc: 0.6771
Epoch 1703/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6225 - acc: 0.6786
Epoch 1704/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6292 - acc: 0.6800
Epoch 1705/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6264 - acc: 0.6743
Epoch 1706/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6265 - acc: 0.6629
Epoch 1707/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6209 - acc: 0.6786
Epoch 1708/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6208 - acc: 0.6729
Epoch 1709/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6224 - acc: 0.6729
Epoch 1710/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6249 - acc: 0.6714
Epoch 1711/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6786
Epoch 1712/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6217 - acc: 0.6814
Epoch 1713/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6211 - acc: 0.6829
Epoch 1714/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6213 - acc: 0.6586
Epoch 1715/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6216 - acc: 0.6771
Epoch 1716/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6213 - acc: 0.6757
Epoch 1717/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6217 - acc: 0.6843
Epoch 1718/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6177 - acc: 0.6871
Epoch 1719/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6243 - acc: 0.6843
Epoch 1720/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6220 - acc: 0.6671
Epoch 1721/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6226 - acc: 0.6757
Epoch 1722/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6269 - acc: 0.6700
Epoch 1723/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6180 - acc: 0.6786
Epoch 1724/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6148 - acc: 0.6914
Epoch 1725/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6209 - acc: 0.6743
Epoch 1726/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6179 - acc: 0.6843
Epoch 1727/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6355 - acc: 0.6571
Epoch 1728/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6317 - acc: 0.6586
Epoch 1729/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6207 - acc: 0.6729
Epoch 1730/2000
700/700 [==============================] - ETA: 0s - loss: 0.7105 - acc: 0.531 - 0s 50us/step - loss: 0.6199 - acc: 0.6814
Epoch 1731/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6165 - acc: 0.6871
Epoch 1732/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6178 - acc: 0.6786
Epoch 1733/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6194 - acc: 0.6857
Epoch 1734/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6227 - acc: 0.6729
Epoch 1735/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6209 - acc: 0.6643
Epoch 1736/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6197 - acc: 0.6829
Epoch 1737/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6198 - acc: 0.6786
Epoch 1738/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6162 - acc: 0.6829
Epoch 1739/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6185 - acc: 0.6771
Epoch 1740/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6226 - acc: 0.6743
Epoch 1741/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6210 - acc: 0.6729
Epoch 1742/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6269 - acc: 0.6757
Epoch 1743/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6168 - acc: 0.6829
Epoch 1744/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6194 - acc: 0.6786
Epoch 1745/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6209 - acc: 0.6786
Epoch 1746/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6246 - acc: 0.6743
Epoch 1747/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6178 - acc: 0.6743
Epoch 1748/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6185 - acc: 0.6814
Epoch 1749/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6230 - acc: 0.6800
Epoch 1750/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6232 - acc: 0.6857
Epoch 1751/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6224 - acc: 0.6714
Epoch 1752/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6184 - acc: 0.6786
Epoch 1753/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6227 - acc: 0.6700
Epoch 1754/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6202 - acc: 0.6800
Epoch 1755/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6224 - acc: 0.6671
Epoch 1756/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6184 - acc: 0.6800
Epoch 1757/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6174 - acc: 0.6843
Epoch 1758/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6154 - acc: 0.6671
Epoch 1759/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6193 - acc: 0.6829
Epoch 1760/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6221 - acc: 0.6786
Epoch 1761/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6212 - acc: 0.6657
Epoch 1762/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6227 - acc: 0.6671
Epoch 1763/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6156 - acc: 0.6786
Epoch 1764/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6160 - acc: 0.6843
Epoch 1765/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6145 - acc: 0.6857
Epoch 1766/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6223 - acc: 0.6757
Epoch 1767/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6232 - acc: 0.6729
Epoch 1768/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6222 - acc: 0.6671
Epoch 1769/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6188 - acc: 0.6671
Epoch 1770/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6179 - acc: 0.6657
Epoch 1771/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6195 - acc: 0.6714
Epoch 1772/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6196 - acc: 0.6814
Epoch 1773/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6174 - acc: 0.6929
Epoch 1774/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6226 - acc: 0.6729
Epoch 1775/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6222 - acc: 0.6786
Epoch 1776/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6195 - acc: 0.6743
Epoch 1777/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6161 - acc: 0.6771
Epoch 1778/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6156 - acc: 0.6771
Epoch 1779/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6250 - acc: 0.6771
Epoch 1780/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6146 - acc: 0.6829
Epoch 1781/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6279 - acc: 0.6714
Epoch 1782/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6274 - acc: 0.6700
Epoch 1783/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6163 - acc: 0.6829
Epoch 1784/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6800
Epoch 1785/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6227 - acc: 0.6843
Epoch 1786/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6857
Epoch 1787/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6226 - acc: 0.6757
Epoch 1788/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6139 - acc: 0.6914
Epoch 1789/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6171 - acc: 0.6700
Epoch 1790/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6182 - acc: 0.6857
Epoch 1791/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6178 - acc: 0.6829
Epoch 1792/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6166 - acc: 0.6900
Epoch 1793/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6197 - acc: 0.6714
Epoch 1794/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6193 - acc: 0.6800
Epoch 1795/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6212 - acc: 0.6771
Epoch 1796/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6203 - acc: 0.6786
Epoch 1797/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6189 - acc: 0.6900
Epoch 1798/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6151 - acc: 0.6814
Epoch 1799/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6206 - acc: 0.6829
Epoch 1800/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6210 - acc: 0.6800
Epoch 1801/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6188 - acc: 0.6886
Epoch 1802/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6198 - acc: 0.6857
Epoch 1803/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6203 - acc: 0.6757
Epoch 1804/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6209 - acc: 0.6671
Epoch 1805/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6207 - acc: 0.6757
Epoch 1806/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6226 - acc: 0.6829
Epoch 1807/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6179 - acc: 0.6800
Epoch 1808/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6207 - acc: 0.6643
Epoch 1809/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6262 - acc: 0.6786
Epoch 1810/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6198 - acc: 0.6743
Epoch 1811/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6182 - acc: 0.6800
Epoch 1812/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6172 - acc: 0.6814
Epoch 1813/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6213 - acc: 0.6671
Epoch 1814/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6184 - acc: 0.6757
Epoch 1815/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6262 - acc: 0.6700
Epoch 1816/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6214 - acc: 0.6786
Epoch 1817/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6284 - acc: 0.6486
Epoch 1818/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6170 - acc: 0.6671
Epoch 1819/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6159 - acc: 0.6814
Epoch 1820/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6286 - acc: 0.6643
Epoch 1821/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6216 - acc: 0.6757
Epoch 1822/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6219 - acc: 0.6786
Epoch 1823/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6155 - acc: 0.6786
Epoch 1824/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6219 - acc: 0.6800
Epoch 1825/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6167 - acc: 0.6786
Epoch 1826/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6171 - acc: 0.6871
Epoch 1827/2000
700/700 [==============================] - 0s 76us/step - loss: 0.6164 - acc: 0.6757
Epoch 1828/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6189 - acc: 0.6743
Epoch 1829/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6159 - acc: 0.6900
Epoch 1830/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6278 - acc: 0.6586
Epoch 1831/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6192 - acc: 0.6800
Epoch 1832/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6137 - acc: 0.6757
Epoch 1833/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6147 - acc: 0.6771
Epoch 1834/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6160 - acc: 0.6829
Epoch 1835/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6168 - acc: 0.6757
Epoch 1836/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6191 - acc: 0.6800
Epoch 1837/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6154 - acc: 0.6729
Epoch 1838/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6314 - acc: 0.6529
Epoch 1839/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6239 - acc: 0.6743
Epoch 1840/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6140 - acc: 0.6857
Epoch 1841/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6222 - acc: 0.6614
Epoch 1842/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6251 - acc: 0.6743
Epoch 1843/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6324 - acc: 0.6714
Epoch 1844/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6218 - acc: 0.6586
Epoch 1845/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6219 - acc: 0.6814
Epoch 1846/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6309 - acc: 0.6500
Epoch 1847/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6164 - acc: 0.6686
Epoch 1848/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6201 - acc: 0.6771
Epoch 1849/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6190 - acc: 0.6686
Epoch 1850/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6166 - acc: 0.6829
Epoch 1851/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6189 - acc: 0.6900
Epoch 1852/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6219 - acc: 0.6871
Epoch 1853/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6198 - acc: 0.6771
Epoch 1854/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6285 - acc: 0.6571
Epoch 1855/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6167 - acc: 0.6700
Epoch 1856/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6216 - acc: 0.6786
Epoch 1857/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6148 - acc: 0.6829
Epoch 1858/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6172 - acc: 0.6814
Epoch 1859/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6237 - acc: 0.6586
Epoch 1860/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6268 - acc: 0.6500
Epoch 1861/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6179 - acc: 0.6857
Epoch 1862/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6209 - acc: 0.6686
Epoch 1863/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6148 - acc: 0.6857
Epoch 1864/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6202 - acc: 0.6757
Epoch 1865/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6204 - acc: 0.6729
Epoch 1866/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6212 - acc: 0.6671
Epoch 1867/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6226 - acc: 0.6686
Epoch 1868/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6151 - acc: 0.6800
Epoch 1869/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6180 - acc: 0.6743
Epoch 1870/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6182 - acc: 0.6829
Epoch 1871/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6167 - acc: 0.6829
Epoch 1872/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6168 - acc: 0.6871
Epoch 1873/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6150 - acc: 0.6900
Epoch 1874/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6169 - acc: 0.6714
Epoch 1875/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6225 - acc: 0.6743
Epoch 1876/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6183 - acc: 0.6771
Epoch 1877/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6182 - acc: 0.6843
Epoch 1878/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6130 - acc: 0.6829
Epoch 1879/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6144 - acc: 0.6843
Epoch 1880/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6158 - acc: 0.6786
Epoch 1881/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6141 - acc: 0.6829
Epoch 1882/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6199 - acc: 0.6843
Epoch 1883/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6140 - acc: 0.6814
Epoch 1884/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6215 - acc: 0.6686
Epoch 1885/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6158 - acc: 0.6971
Epoch 1886/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6159 - acc: 0.6857
Epoch 1887/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6198 - acc: 0.6843
Epoch 1888/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6184 - acc: 0.6743
Epoch 1889/2000
700/700 [==============================] - 0s 47us/step - loss: 0.6222 - acc: 0.6686
Epoch 1890/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6219 - acc: 0.6829
Epoch 1891/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6149 - acc: 0.6914
Epoch 1892/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6144 - acc: 0.6829
Epoch 1893/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6184 - acc: 0.6771
Epoch 1894/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6159 - acc: 0.6857
Epoch 1895/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6182 - acc: 0.6757
Epoch 1896/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6134 - acc: 0.6871
Epoch 1897/2000
700/700 [==============================] - 0s 61us/step - loss: 0.6194 - acc: 0.6743
Epoch 1898/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6168 - acc: 0.6757
Epoch 1899/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6177 - acc: 0.6829
Epoch 1900/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6175 - acc: 0.6671
Epoch 1901/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6169 - acc: 0.6729
Epoch 1902/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6178 - acc: 0.6857
Epoch 1903/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6188 - acc: 0.6814
Epoch 1904/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6125 - acc: 0.6786
Epoch 1905/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6155 - acc: 0.6757
Epoch 1906/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6321 - acc: 0.6757
Epoch 1907/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6200 - acc: 0.6686
Epoch 1908/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6162 - acc: 0.6800
Epoch 1909/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6231 - acc: 0.6743
Epoch 1910/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6169 - acc: 0.6771
Epoch 1911/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6186 - acc: 0.6743
Epoch 1912/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6180 - acc: 0.6814
Epoch 1913/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6210 - acc: 0.6743
Epoch 1914/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6205 - acc: 0.6800
Epoch 1915/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6221 - acc: 0.6686
Epoch 1916/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6155 - acc: 0.6814
Epoch 1917/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6176 - acc: 0.6800
Epoch 1918/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6151 - acc: 0.6929
Epoch 1919/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6162 - acc: 0.6771
Epoch 1920/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6259 - acc: 0.6671
Epoch 1921/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6180 - acc: 0.6743
Epoch 1922/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6140 - acc: 0.6786
Epoch 1923/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6153 - acc: 0.6771
Epoch 1924/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6145 - acc: 0.6829
Epoch 1925/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6175 - acc: 0.6729
Epoch 1926/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6190 - acc: 0.6729
Epoch 1927/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6140 - acc: 0.6829
Epoch 1928/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6192 - acc: 0.6671
Epoch 1929/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6149 - acc: 0.6843
Epoch 1930/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6292 - acc: 0.6700
Epoch 1931/2000
700/700 [==============================] - 0s 60us/step - loss: 0.6228 - acc: 0.6800
Epoch 1932/2000
700/700 [==============================] - 0s 63us/step - loss: 0.6163 - acc: 0.6700
Epoch 1933/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6178 - acc: 0.6657
Epoch 1934/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6181 - acc: 0.6729
Epoch 1935/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6126 - acc: 0.6857
Epoch 1936/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6146 - acc: 0.6871
Epoch 1937/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6172 - acc: 0.6843
Epoch 1938/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6285 - acc: 0.6614
Epoch 1939/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6194 - acc: 0.6786
Epoch 1940/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6153 - acc: 0.6843
Epoch 1941/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6148 - acc: 0.6829
Epoch 1942/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6182 - acc: 0.6857
Epoch 1943/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6246 - acc: 0.6686
Epoch 1944/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6297 - acc: 0.6671
Epoch 1945/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6178 - acc: 0.6771
Epoch 1946/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6160 - acc: 0.6743
Epoch 1947/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6204 - acc: 0.6629
Epoch 1948/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6149 - acc: 0.6814
Epoch 1949/2000
700/700 [==============================] - 0s 67us/step - loss: 0.6144 - acc: 0.6900
Epoch 1950/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6177 - acc: 0.6614
Epoch 1951/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6201 - acc: 0.6714
Epoch 1952/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6194 - acc: 0.6743
Epoch 1953/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6152 - acc: 0.6771
Epoch 1954/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6192 - acc: 0.6700
Epoch 1955/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6188 - acc: 0.6786
Epoch 1956/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6210 - acc: 0.6643
Epoch 1957/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6167 - acc: 0.6686
Epoch 1958/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6204 - acc: 0.6743
Epoch 1959/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6189 - acc: 0.6814
Epoch 1960/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6155 - acc: 0.6800
Epoch 1961/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6240 - acc: 0.6743
Epoch 1962/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6198 - acc: 0.6671
Epoch 1963/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6260 - acc: 0.6614
Epoch 1964/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6138 - acc: 0.6757
Epoch 1965/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6178 - acc: 0.6786
Epoch 1966/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6197 - acc: 0.6700
Epoch 1967/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6179 - acc: 0.6829
Epoch 1968/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6158 - acc: 0.6829
Epoch 1969/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6184 - acc: 0.6943
Epoch 1970/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6166 - acc: 0.6814
Epoch 1971/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6126 - acc: 0.6714
Epoch 1972/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6115 - acc: 0.6900
Epoch 1973/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6116 - acc: 0.6900
Epoch 1974/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6134 - acc: 0.6829
Epoch 1975/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6090 - acc: 0.6829
Epoch 1976/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6213 - acc: 0.6786
Epoch 1977/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6141 - acc: 0.6757
Epoch 1978/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6173 - acc: 0.6743
Epoch 1979/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6176 - acc: 0.6886
Epoch 1980/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6152 - acc: 0.6743
Epoch 1981/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6207 - acc: 0.6671
Epoch 1982/2000
700/700 [==============================] - 0s 57us/step - loss: 0.6202 - acc: 0.6786
Epoch 1983/2000
700/700 [==============================] - 0s 56us/step - loss: 0.6211 - acc: 0.6786
Epoch 1984/2000
700/700 [==============================] - 0s 52us/step - loss: 0.6357 - acc: 0.6629
Epoch 1985/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6220 - acc: 0.6657
Epoch 1986/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6230 - acc: 0.6743
Epoch 1987/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6164 - acc: 0.6743
Epoch 1988/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6149 - acc: 0.6729
Epoch 1989/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6153 - acc: 0.6771
Epoch 1990/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6170 - acc: 0.6729
Epoch 1991/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6147 - acc: 0.6671
Epoch 1992/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6133 - acc: 0.6929
Epoch 1993/2000
700/700 [==============================] - 0s 49us/step - loss: 0.6149 - acc: 0.6771
Epoch 1994/2000
700/700 [==============================] - 0s 59us/step - loss: 0.6199 - acc: 0.6757
Epoch 1995/2000
700/700 [==============================] - 0s 51us/step - loss: 0.6212 - acc: 0.6829
Epoch 1996/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6155 - acc: 0.6800
Epoch 1997/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6153 - acc: 0.6700
Epoch 1998/2000
700/700 [==============================] - 0s 53us/step - loss: 0.6148 - acc: 0.6814
Epoch 1999/2000
700/700 [==============================] - 0s 50us/step - loss: 0.6181 - acc: 0.6743
Epoch 2000/2000
700/700 [==============================] - 0s 54us/step - loss: 0.6128 - acc: 0.6857

In [17]:
losses = history.history['loss']
ax = pd.Series(losses).rolling(20).mean().plot()


Now let's evaluate our model against the test set.


In [18]:
y_test = pd.DataFrame(test_df.sentiment_label).astype(np.int32).values

# Scale the X values to zero mean and unit variance
X_test = test_df.drop('sentiment_label', axis=1)
X_test = X_test.sub(X_test.mean(axis=0)).div(X_test.std(axis=0)).astype(np.float32).values

train_accuracy, test_accuracy = model.evaluate(X_test, y_test)
print('train_accuracy: {:.4f}, test_accuracy: {:.4f}'.format(train_accuracy, test_accuracy))


300/300 [==============================] - 0s 117us/step
train_accuracy: 0.7307, test_accuracy: 0.5500

In [19]:
predictions = model.predict(X_test).squeeze()
predictions = np.where(predictions > 0.5, 1, 0)
pred_series = pd.Series(index=test_df.index.copy(), data=predictions, name='predictions')

results_df = pd.concat({'predictions': pred_series, 'actual': test_df.sentiment_label}, axis=1)
results_df.head()


Out[19]:
actual predictions
1 0 1
5 0 1
6 0 1
7 1 0
11 1 1

Now we generate the Confusion Matrix.


In [20]:
import seaborn as sns
v = pd.crosstab(results_df.predictions, results_df.actual)
sns.heatmap(v, annot=True)


Out[20]:
<matplotlib.axes._subplots.AxesSubplot at 0x1ae8dea0cc0>