notebook.community

Edit and run

Gender Classification with Keras

This is an experimentation on gender classification using neural network with keras. The classification will be done by building neural network model based on music and movie preferences.

This is an experimentation of simple neural network in python.

  • This algorithm takes dataset for training from file training_data.csv.
  • Build model and save its structure and weights to json and h5py
  • Predict output(Male|Female) based on new input

Dataset description

  • Extracted from kaggle dataset(https://www.kaggle.com/miroslavsabo/young-people-survey) by using only music and movie preferences
  • Contains 32 columns(31 inputs and 1 output(0=Female|1=Male))
  • The 31 inputs are consists of music and movie preferences
  • Each preferences has integer option 1 to 5 where 1 is very negative and all the way to 5 is positive(Example: Pop. 1=Dont enjoy at all, 5=Enjoy very much)
  • Last output is in last column consist of (0=Female|1=Male)

Research Question

  • Based on listed music and movie preferences, is he/she male or female?

Requirement

  • Python: 3.6.0 |Anaconda 4.3.1 (64-bit)| (default, Dec 23 2016, 12:22:00) [GCC 4.4.7 20120313 (Red Hat 4.4.7-1)]
  • scipy: 0.18.1
  • numpy: 1.11.3
  • sklearn: 0.18.1
  • tensorflow: 1.0.0
  • keras: 2.0.4
  • h5py




In [33]:



    


import numpy
import os
import pydot
import graphviz

Fix seed for reproducibility





In [34]:



    


seed = 7
numpy.random.seed(seed)

Load dataset





In [35]:



    


dataset = numpy.genfromtxt('dataset.csv', delimiter=',', skip_header=1)

Split dataset into two variables, X for datas and Y for labels





In [36]:



    


X = dataset[:,0:31]
Y = dataset[:,31]

mask = ~numpy.any(numpy.isnan(X), axis=1)

X = X[mask]
Y = Y[mask]

Create model





In [37]:



    


from keras.models import Sequential
from keras.layers import Dense

model = Sequential()
model.add(Dense(62, input_dim=31, kernel_initializer='uniform', activation='relu'))
model.add(Dense(8, kernel_initializer='uniform', activation='relu'))
model.add(Dense(8, kernel_initializer='uniform', activation='relu'))
model.add(Dense(15, kernel_initializer='uniform', activation='relu'))
model.add(Dense(31, kernel_initializer='uniform', activation='relu'))
model.add(Dense(5, kernel_initializer='uniform', activation='relu'))
model.add(Dense(1, kernel_initializer='uniform', activation='sigmoid'))

Compile model





In [38]:



    


model.compile(loss='binary_crossentropy', optimizer='adam', metrics=['accuracy'])

Train model using provided dataset





In [39]:



    


history = model.fit(X, Y, validation_split=0.33, epochs=500, batch_size=10)



    


















    






Train on 604 samples, validate on 298 samples
Epoch 1/500
604/604 [==============================] - 1s 1ms/step - loss: 0.6913 - acc: 0.6060 - val_loss: 0.6897 - val_acc: 0.5839
Epoch 2/500
604/604 [==============================] - 0s 338us/step - loss: 0.6810 - acc: 0.6060 - val_loss: 0.6725 - val_acc: 0.5839
Epoch 3/500
604/604 [==============================] - 0s 324us/step - loss: 0.6484 - acc: 0.6060 - val_loss: 0.6315 - val_acc: 0.5839
Epoch 4/500
604/604 [==============================] - 0s 363us/step - loss: 0.5711 - acc: 0.6060 - val_loss: 0.5358 - val_acc: 0.5839
Epoch 5/500
604/604 [==============================] - 0s 367us/step - loss: 0.4867 - acc: 0.6341 - val_loss: 0.5056 - val_acc: 0.7987
Epoch 6/500
604/604 [==============================] - 0s 373us/step - loss: 0.4631 - acc: 0.8311 - val_loss: 0.5283 - val_acc: 0.7785
Epoch 7/500
604/604 [==============================] - 0s 353us/step - loss: 0.4536 - acc: 0.8361 - val_loss: 0.5033 - val_acc: 0.7953
Epoch 8/500
604/604 [==============================] - 0s 397us/step - loss: 0.4479 - acc: 0.8427 - val_loss: 0.4921 - val_acc: 0.8087
Epoch 9/500
604/604 [==============================] - 0s 338us/step - loss: 0.4335 - acc: 0.8411 - val_loss: 0.5002 - val_acc: 0.7584
Epoch 10/500
604/604 [==============================] - 0s 308us/step - loss: 0.4336 - acc: 0.8179 - val_loss: 0.4873 - val_acc: 0.8020
Epoch 11/500
604/604 [==============================] - 0s 343us/step - loss: 0.4268 - acc: 0.8344 - val_loss: 0.4870 - val_acc: 0.8020
Epoch 12/500
604/604 [==============================] - 0s 406us/step - loss: 0.4177 - acc: 0.8377 - val_loss: 0.4856 - val_acc: 0.7987
Epoch 13/500
604/604 [==============================] - 0s 402us/step - loss: 0.4130 - acc: 0.8361 - val_loss: 0.4967 - val_acc: 0.7953
Epoch 14/500
604/604 [==============================] - 0s 440us/step - loss: 0.4043 - acc: 0.8543 - val_loss: 0.4801 - val_acc: 0.7852
Epoch 15/500
604/604 [==============================] - 0s 439us/step - loss: 0.4052 - acc: 0.8510 - val_loss: 0.4837 - val_acc: 0.7953
Epoch 16/500
604/604 [==============================] - 0s 459us/step - loss: 0.3996 - acc: 0.8444 - val_loss: 0.4966 - val_acc: 0.7953
Epoch 17/500
604/604 [==============================] - 0s 439us/step - loss: 0.4022 - acc: 0.8394 - val_loss: 0.4752 - val_acc: 0.7919
Epoch 18/500
604/604 [==============================] - 0s 343us/step - loss: 0.4024 - acc: 0.8427 - val_loss: 0.4758 - val_acc: 0.7987
Epoch 19/500
604/604 [==============================] - 0s 301us/step - loss: 0.3980 - acc: 0.8526 - val_loss: 0.4823 - val_acc: 0.7987
Epoch 20/500
604/604 [==============================] - 0s 282us/step - loss: 0.3974 - acc: 0.8411 - val_loss: 0.4847 - val_acc: 0.7953
Epoch 21/500
604/604 [==============================] - 0s 295us/step - loss: 0.3888 - acc: 0.8543 - val_loss: 0.4825 - val_acc: 0.7987
Epoch 22/500
604/604 [==============================] - 0s 280us/step - loss: 0.3881 - acc: 0.8493 - val_loss: 0.4729 - val_acc: 0.7752
Epoch 23/500
604/604 [==============================] - 0s 344us/step - loss: 0.3852 - acc: 0.8427 - val_loss: 0.4742 - val_acc: 0.7718
Epoch 24/500
604/604 [==============================] - 0s 327us/step - loss: 0.3847 - acc: 0.8444 - val_loss: 0.4774 - val_acc: 0.7685
Epoch 25/500
604/604 [==============================] - 0s 340us/step - loss: 0.3872 - acc: 0.8444 - val_loss: 0.4685 - val_acc: 0.7886
Epoch 26/500
604/604 [==============================] - 0s 274us/step - loss: 0.3752 - acc: 0.8526 - val_loss: 0.4777 - val_acc: 0.7651
Epoch 27/500
604/604 [==============================] - 0s 281us/step - loss: 0.3807 - acc: 0.8493 - val_loss: 0.4672 - val_acc: 0.7785
Epoch 28/500
604/604 [==============================] - 0s 275us/step - loss: 0.3778 - acc: 0.8510 - val_loss: 0.4748 - val_acc: 0.7886
Epoch 29/500
604/604 [==============================] - 0s 334us/step - loss: 0.3838 - acc: 0.8427 - val_loss: 0.4686 - val_acc: 0.7752
Epoch 30/500
604/604 [==============================] - 0s 295us/step - loss: 0.3787 - acc: 0.8427 - val_loss: 0.4691 - val_acc: 0.7752
Epoch 31/500
604/604 [==============================] - 0s 350us/step - loss: 0.3769 - acc: 0.8642 - val_loss: 0.4670 - val_acc: 0.7953
Epoch 32/500
604/604 [==============================] - 0s 322us/step - loss: 0.3703 - acc: 0.8626 - val_loss: 0.4668 - val_acc: 0.7953
Epoch 33/500
604/604 [==============================] - 0s 283us/step - loss: 0.3685 - acc: 0.8593 - val_loss: 0.4908 - val_acc: 0.7953
Epoch 34/500
604/604 [==============================] - 0s 328us/step - loss: 0.3705 - acc: 0.8576 - val_loss: 0.4699 - val_acc: 0.7886
Epoch 35/500
604/604 [==============================] - 0s 351us/step - loss: 0.3698 - acc: 0.8543 - val_loss: 0.4772 - val_acc: 0.7953
Epoch 36/500
604/604 [==============================] - 0s 328us/step - loss: 0.3675 - acc: 0.8576 - val_loss: 0.4658 - val_acc: 0.7919
Epoch 37/500
604/604 [==============================] - 0s 268us/step - loss: 0.3639 - acc: 0.8576 - val_loss: 0.4708 - val_acc: 0.7718
Epoch 38/500
604/604 [==============================] - 0s 271us/step - loss: 0.3661 - acc: 0.8510 - val_loss: 0.5081 - val_acc: 0.7886
Epoch 39/500
604/604 [==============================] - 0s 287us/step - loss: 0.3694 - acc: 0.8477 - val_loss: 0.4704 - val_acc: 0.7987
Epoch 40/500
604/604 [==============================] - 0s 311us/step - loss: 0.3642 - acc: 0.8493 - val_loss: 0.4614 - val_acc: 0.7852
Epoch 41/500
604/604 [==============================] - 0s 281us/step - loss: 0.3715 - acc: 0.8427 - val_loss: 0.4728 - val_acc: 0.7919
Epoch 42/500
604/604 [==============================] - 0s 261us/step - loss: 0.3699 - acc: 0.8560 - val_loss: 0.5431 - val_acc: 0.7987
Epoch 43/500
604/604 [==============================] - 0s 268us/step - loss: 0.3603 - acc: 0.8560 - val_loss: 0.4659 - val_acc: 0.7919
Epoch 44/500
604/604 [==============================] - 0s 256us/step - loss: 0.3570 - acc: 0.8609 - val_loss: 0.4737 - val_acc: 0.7919
Epoch 45/500
604/604 [==============================] - 0s 265us/step - loss: 0.3678 - acc: 0.8493 - val_loss: 0.4770 - val_acc: 0.7953
Epoch 46/500
604/604 [==============================] - 0s 250us/step - loss: 0.3652 - acc: 0.8593 - val_loss: 0.4772 - val_acc: 0.7852
Epoch 47/500
604/604 [==============================] - 0s 259us/step - loss: 0.3599 - acc: 0.8460 - val_loss: 0.4699 - val_acc: 0.7953
Epoch 48/500
604/604 [==============================] - 0s 268us/step - loss: 0.3577 - acc: 0.8576 - val_loss: 0.4667 - val_acc: 0.7852
Epoch 49/500
604/604 [==============================] - 0s 273us/step - loss: 0.3589 - acc: 0.8593 - val_loss: 0.5019 - val_acc: 0.7852
Epoch 50/500
604/604 [==============================] - 0s 267us/step - loss: 0.3577 - acc: 0.8477 - val_loss: 0.4782 - val_acc: 0.7953
Epoch 51/500
604/604 [==============================] - 0s 254us/step - loss: 0.3592 - acc: 0.8560 - val_loss: 0.4954 - val_acc: 0.7886
Epoch 52/500
604/604 [==============================] - 0s 259us/step - loss: 0.3610 - acc: 0.8510 - val_loss: 0.4604 - val_acc: 0.7819
Epoch 53/500
604/604 [==============================] - 0s 255us/step - loss: 0.3621 - acc: 0.8526 - val_loss: 0.4572 - val_acc: 0.7886
Epoch 54/500
604/604 [==============================] - 0s 274us/step - loss: 0.3729 - acc: 0.8361 - val_loss: 0.4589 - val_acc: 0.7987
Epoch 55/500
604/604 [==============================] - 0s 275us/step - loss: 0.3516 - acc: 0.8593 - val_loss: 0.4747 - val_acc: 0.7987
Epoch 56/500
604/604 [==============================] - 0s 291us/step - loss: 0.3688 - acc: 0.8460 - val_loss: 0.4831 - val_acc: 0.7886
Epoch 57/500
604/604 [==============================] - 0s 316us/step - loss: 0.3555 - acc: 0.8526 - val_loss: 0.4669 - val_acc: 0.7886
Epoch 58/500
604/604 [==============================] - 0s 292us/step - loss: 0.3540 - acc: 0.8593 - val_loss: 0.4615 - val_acc: 0.7987
Epoch 59/500
604/604 [==============================] - 0s 279us/step - loss: 0.3517 - acc: 0.8593 - val_loss: 0.4606 - val_acc: 0.7886
Epoch 60/500
604/604 [==============================] - 0s 290us/step - loss: 0.3591 - acc: 0.8560 - val_loss: 0.4673 - val_acc: 0.7685
Epoch 61/500
604/604 [==============================] - 0s 294us/step - loss: 0.3566 - acc: 0.8543 - val_loss: 0.4671 - val_acc: 0.7953
Epoch 62/500
604/604 [==============================] - 0s 275us/step - loss: 0.3773 - acc: 0.8411 - val_loss: 0.4975 - val_acc: 0.7987
Epoch 63/500
604/604 [==============================] - 0s 294us/step - loss: 0.3610 - acc: 0.8411 - val_loss: 0.4672 - val_acc: 0.7617
Epoch 64/500
604/604 [==============================] - 0s 333us/step - loss: 0.3489 - acc: 0.8493 - val_loss: 0.4848 - val_acc: 0.7987
Epoch 65/500
604/604 [==============================] - 0s 232us/step - loss: 0.3571 - acc: 0.8427 - val_loss: 0.4513 - val_acc: 0.7953
Epoch 66/500
604/604 [==============================] - 0s 342us/step - loss: 0.3489 - acc: 0.8626 - val_loss: 0.4828 - val_acc: 0.7987
Epoch 67/500
604/604 [==============================] - 0s 263us/step - loss: 0.3491 - acc: 0.8543 - val_loss: 0.4600 - val_acc: 0.7953
Epoch 68/500
604/604 [==============================] - 0s 272us/step - loss: 0.3526 - acc: 0.8593 - val_loss: 0.4511 - val_acc: 0.7919
Epoch 69/500
604/604 [==============================] - 0s 265us/step - loss: 0.3660 - acc: 0.8344 - val_loss: 0.4879 - val_acc: 0.7450
Epoch 70/500
604/604 [==============================] - 0s 269us/step - loss: 0.3537 - acc: 0.8543 - val_loss: 0.4503 - val_acc: 0.7752
Epoch 71/500
604/604 [==============================] - 0s 269us/step - loss: 0.3455 - acc: 0.8560 - val_loss: 0.4634 - val_acc: 0.7919
Epoch 72/500
604/604 [==============================] - 0s 298us/step - loss: 0.3452 - acc: 0.8576 - val_loss: 0.4536 - val_acc: 0.7953
Epoch 73/500
604/604 [==============================] - 0s 319us/step - loss: 0.3427 - acc: 0.8560 - val_loss: 0.4502 - val_acc: 0.7953
Epoch 74/500
604/604 [==============================] - 0s 300us/step - loss: 0.3410 - acc: 0.8626 - val_loss: 0.4547 - val_acc: 0.7819
Epoch 75/500
604/604 [==============================] - 0s 449us/step - loss: 0.3495 - acc: 0.8543 - val_loss: 0.4489 - val_acc: 0.7852
Epoch 76/500
604/604 [==============================] - 0s 287us/step - loss: 0.3493 - acc: 0.8626 - val_loss: 0.4619 - val_acc: 0.7953
Epoch 77/500
604/604 [==============================] - 0s 289us/step - loss: 0.3392 - acc: 0.8659 - val_loss: 0.4576 - val_acc: 0.7987
Epoch 78/500
604/604 [==============================] - 0s 298us/step - loss: 0.3421 - acc: 0.8543 - val_loss: 0.4634 - val_acc: 0.7953
Epoch 79/500
604/604 [==============================] - 0s 288us/step - loss: 0.3453 - acc: 0.8642 - val_loss: 0.4714 - val_acc: 0.7919
Epoch 80/500
604/604 [==============================] - 0s 327us/step - loss: 0.3385 - acc: 0.8609 - val_loss: 0.5029 - val_acc: 0.7852
Epoch 81/500
604/604 [==============================] - 0s 383us/step - loss: 0.3371 - acc: 0.8675 - val_loss: 0.4843 - val_acc: 0.7919
Epoch 82/500
604/604 [==============================] - 0s 296us/step - loss: 0.3619 - acc: 0.8510 - val_loss: 0.4520 - val_acc: 0.8054
Epoch 83/500
604/604 [==============================] - 0s 284us/step - loss: 0.3374 - acc: 0.8609 - val_loss: 0.5015 - val_acc: 0.7919
Epoch 84/500
604/604 [==============================] - 0s 275us/step - loss: 0.3376 - acc: 0.8626 - val_loss: 0.4658 - val_acc: 0.7953
Epoch 85/500
604/604 [==============================] - 0s 274us/step - loss: 0.3368 - acc: 0.8609 - val_loss: 0.4722 - val_acc: 0.7953
Epoch 86/500
604/604 [==============================] - 0s 313us/step - loss: 0.3385 - acc: 0.8692 - val_loss: 0.4674 - val_acc: 0.7987
Epoch 87/500
604/604 [==============================] - 0s 433us/step - loss: 0.3274 - acc: 0.8709 - val_loss: 0.4772 - val_acc: 0.7886
Epoch 88/500
604/604 [==============================] - 0s 309us/step - loss: 0.3356 - acc: 0.8692 - val_loss: 0.4544 - val_acc: 0.7919
Epoch 89/500
604/604 [==============================] - 0s 442us/step - loss: 0.3370 - acc: 0.8659 - val_loss: 0.4683 - val_acc: 0.7919
Epoch 90/500
604/604 [==============================] - 0s 437us/step - loss: 0.3325 - acc: 0.8642 - val_loss: 0.4645 - val_acc: 0.7718
Epoch 91/500
604/604 [==============================] - 0s 416us/step - loss: 0.3414 - acc: 0.8675 - val_loss: 0.4530 - val_acc: 0.7919
Epoch 92/500
604/604 [==============================] - 0s 438us/step - loss: 0.3321 - acc: 0.8709 - val_loss: 0.4634 - val_acc: 0.7852
Epoch 93/500
604/604 [==============================] - 0s 394us/step - loss: 0.3317 - acc: 0.8742 - val_loss: 0.4604 - val_acc: 0.7987
Epoch 94/500
604/604 [==============================] - 0s 457us/step - loss: 0.3281 - acc: 0.8709 - val_loss: 0.4862 - val_acc: 0.7819
Epoch 95/500
604/604 [==============================] - 0s 398us/step - loss: 0.3208 - acc: 0.8775 - val_loss: 0.4640 - val_acc: 0.7953
Epoch 96/500
604/604 [==============================] - 0s 424us/step - loss: 0.3241 - acc: 0.8709 - val_loss: 0.4684 - val_acc: 0.7919
Epoch 97/500
604/604 [==============================] - 0s 406us/step - loss: 0.3277 - acc: 0.8675 - val_loss: 0.4596 - val_acc: 0.7953
Epoch 98/500
604/604 [==============================] - 0s 397us/step - loss: 0.3219 - acc: 0.8808 - val_loss: 0.4576 - val_acc: 0.7886
Epoch 99/500
604/604 [==============================] - 0s 283us/step - loss: 0.3181 - acc: 0.8858 - val_loss: 0.4703 - val_acc: 0.8020
Epoch 100/500
604/604 [==============================] - 0s 270us/step - loss: 0.3230 - acc: 0.8692 - val_loss: 0.4737 - val_acc: 0.7852
Epoch 101/500
604/604 [==============================] - 0s 415us/step - loss: 0.3159 - acc: 0.8791 - val_loss: 0.5442 - val_acc: 0.7886
Epoch 102/500
604/604 [==============================] - 0s 474us/step - loss: 0.3255 - acc: 0.8675 - val_loss: 0.5137 - val_acc: 0.7953
Epoch 103/500
604/604 [==============================] - 0s 367us/step - loss: 0.3133 - acc: 0.8891 - val_loss: 0.4688 - val_acc: 0.7852
Epoch 104/500
604/604 [==============================] - 0s 295us/step - loss: 0.3085 - acc: 0.8874 - val_loss: 0.4902 - val_acc: 0.7919
Epoch 105/500
604/604 [==============================] - 0s 265us/step - loss: 0.3247 - acc: 0.8742 - val_loss: 0.4733 - val_acc: 0.7919
Epoch 106/500
604/604 [==============================] - 0s 277us/step - loss: 0.3266 - acc: 0.8709 - val_loss: 0.4588 - val_acc: 0.7919
Epoch 107/500
604/604 [==============================] - 0s 282us/step - loss: 0.3119 - acc: 0.8841 - val_loss: 0.4726 - val_acc: 0.7819
Epoch 108/500
604/604 [==============================] - 0s 286us/step - loss: 0.3257 - acc: 0.8709 - val_loss: 0.4618 - val_acc: 0.7953
Epoch 109/500
604/604 [==============================] - 0s 270us/step - loss: 0.3169 - acc: 0.8725 - val_loss: 0.4876 - val_acc: 0.7886
Epoch 110/500
604/604 [==============================] - 0s 335us/step - loss: 0.3066 - acc: 0.8858 - val_loss: 0.4737 - val_acc: 0.7886
Epoch 111/500
604/604 [==============================] - 0s 280us/step - loss: 0.2995 - acc: 0.8858 - val_loss: 0.4815 - val_acc: 0.7852
Epoch 112/500
604/604 [==============================] - 0s 273us/step - loss: 0.3107 - acc: 0.8858 - val_loss: 0.5741 - val_acc: 0.7752
Epoch 113/500
604/604 [==============================] - 0s 294us/step - loss: 0.3105 - acc: 0.8841 - val_loss: 0.5461 - val_acc: 0.7852
Epoch 114/500
604/604 [==============================] - 0s 303us/step - loss: 0.3026 - acc: 0.8841 - val_loss: 0.4689 - val_acc: 0.7785
Epoch 115/500
604/604 [==============================] - 0s 332us/step - loss: 0.2945 - acc: 0.8957 - val_loss: 0.5149 - val_acc: 0.7886
Epoch 116/500
604/604 [==============================] - 0s 344us/step - loss: 0.2967 - acc: 0.8891 - val_loss: 0.4978 - val_acc: 0.7785
Epoch 117/500
604/604 [==============================] - 0s 294us/step - loss: 0.3107 - acc: 0.8791 - val_loss: 0.5045 - val_acc: 0.7819
Epoch 118/500
604/604 [==============================] - 0s 298us/step - loss: 0.3066 - acc: 0.8758 - val_loss: 0.4953 - val_acc: 0.7919
Epoch 119/500
604/604 [==============================] - 0s 314us/step - loss: 0.3094 - acc: 0.8858 - val_loss: 0.5069 - val_acc: 0.7852
Epoch 120/500
604/604 [==============================] - 0s 414us/step - loss: 0.2993 - acc: 0.8841 - val_loss: 0.4906 - val_acc: 0.7852
Epoch 121/500
604/604 [==============================] - 0s 295us/step - loss: 0.2889 - acc: 0.8924 - val_loss: 0.5388 - val_acc: 0.7785
Epoch 122/500
604/604 [==============================] - 0s 284us/step - loss: 0.3013 - acc: 0.8891 - val_loss: 0.4905 - val_acc: 0.7886
Epoch 123/500
604/604 [==============================] - 0s 279us/step - loss: 0.2869 - acc: 0.8940 - val_loss: 0.5041 - val_acc: 0.7852
Epoch 124/500
604/604 [==============================] - 0s 346us/step - loss: 0.2950 - acc: 0.9040 - val_loss: 0.5294 - val_acc: 0.7919
Epoch 125/500
604/604 [==============================] - 0s 272us/step - loss: 0.2943 - acc: 0.8924 - val_loss: 0.5109 - val_acc: 0.7919
Epoch 126/500
604/604 [==============================] - 0s 286us/step - loss: 0.3086 - acc: 0.8825 - val_loss: 0.4856 - val_acc: 0.7852
Epoch 127/500
604/604 [==============================] - 0s 278us/step - loss: 0.2898 - acc: 0.8940 - val_loss: 0.4963 - val_acc: 0.7919
Epoch 128/500
604/604 [==============================] - 0s 262us/step - loss: 0.2864 - acc: 0.8907 - val_loss: 0.5074 - val_acc: 0.7852
Epoch 129/500
604/604 [==============================] - 0s 270us/step - loss: 0.2929 - acc: 0.8924 - val_loss: 0.5004 - val_acc: 0.7852
Epoch 130/500
604/604 [==============================] - 0s 293us/step - loss: 0.2878 - acc: 0.8940 - val_loss: 0.4969 - val_acc: 0.7919
Epoch 131/500
604/604 [==============================] - 0s 280us/step - loss: 0.2804 - acc: 0.8974 - val_loss: 0.5020 - val_acc: 0.7886
Epoch 132/500
604/604 [==============================] - 0s 290us/step - loss: 0.2722 - acc: 0.9023 - val_loss: 0.5766 - val_acc: 0.7819
Epoch 133/500
604/604 [==============================] - 0s 267us/step - loss: 0.3026 - acc: 0.8825 - val_loss: 0.4968 - val_acc: 0.7886
Epoch 134/500
604/604 [==============================] - 0s 290us/step - loss: 0.2823 - acc: 0.9040 - val_loss: 0.5142 - val_acc: 0.7785
Epoch 135/500
604/604 [==============================] - 0s 293us/step - loss: 0.2925 - acc: 0.8825 - val_loss: 0.5181 - val_acc: 0.7919
Epoch 136/500
604/604 [==============================] - 0s 279us/step - loss: 0.2784 - acc: 0.8974 - val_loss: 0.5218 - val_acc: 0.7886
Epoch 137/500
604/604 [==============================] - 0s 255us/step - loss: 0.2881 - acc: 0.8907 - val_loss: 0.5403 - val_acc: 0.7819
Epoch 138/500
604/604 [==============================] - 0s 268us/step - loss: 0.2718 - acc: 0.9040 - val_loss: 0.5237 - val_acc: 0.7785
Epoch 139/500
604/604 [==============================] - 0s 281us/step - loss: 0.2900 - acc: 0.8940 - val_loss: 0.5008 - val_acc: 0.7718
Epoch 140/500
604/604 [==============================] - 0s 285us/step - loss: 0.2762 - acc: 0.9040 - val_loss: 0.5481 - val_acc: 0.7819
Epoch 141/500
604/604 [==============================] - 0s 270us/step - loss: 0.2735 - acc: 0.9023 - val_loss: 0.6289 - val_acc: 0.7819
Epoch 142/500
604/604 [==============================] - 0s 272us/step - loss: 0.2820 - acc: 0.8974 - val_loss: 0.5565 - val_acc: 0.7886
Epoch 143/500
604/604 [==============================] - 0s 294us/step - loss: 0.2787 - acc: 0.9073 - val_loss: 0.5380 - val_acc: 0.7819
Epoch 144/500
604/604 [==============================] - 0s 302us/step - loss: 0.2774 - acc: 0.8957 - val_loss: 0.5585 - val_acc: 0.7886
Epoch 145/500
604/604 [==============================] - 0s 277us/step - loss: 0.2639 - acc: 0.9106 - val_loss: 0.5468 - val_acc: 0.7819
Epoch 146/500
604/604 [==============================] - 0s 303us/step - loss: 0.3031 - acc: 0.8907 - val_loss: 0.5195 - val_acc: 0.7819
Epoch 147/500
604/604 [==============================] - 0s 286us/step - loss: 0.2855 - acc: 0.8957 - val_loss: 0.5119 - val_acc: 0.7785
Epoch 148/500
604/604 [==============================] - 0s 276us/step - loss: 0.2769 - acc: 0.9007 - val_loss: 0.5645 - val_acc: 0.7819
Epoch 149/500
604/604 [==============================] - 0s 299us/step - loss: 0.2654 - acc: 0.9106 - val_loss: 0.5315 - val_acc: 0.7852
Epoch 150/500
604/604 [==============================] - 0s 291us/step - loss: 0.2809 - acc: 0.8924 - val_loss: 0.5519 - val_acc: 0.7819
Epoch 151/500
604/604 [==============================] - 0s 268us/step - loss: 0.2627 - acc: 0.9106 - val_loss: 0.5479 - val_acc: 0.7852
Epoch 152/500
604/604 [==============================] - 0s 292us/step - loss: 0.2626 - acc: 0.9139 - val_loss: 0.5179 - val_acc: 0.7886
Epoch 153/500
604/604 [==============================] - 0s 356us/step - loss: 0.2656 - acc: 0.9089 - val_loss: 0.6014 - val_acc: 0.7785
Epoch 154/500
604/604 [==============================] - 0s 278us/step - loss: 0.2749 - acc: 0.8974 - val_loss: 0.5245 - val_acc: 0.7785
Epoch 155/500
604/604 [==============================] - 0s 293us/step - loss: 0.2644 - acc: 0.9056 - val_loss: 0.5991 - val_acc: 0.7886
Epoch 156/500
604/604 [==============================] - 0s 257us/step - loss: 0.2575 - acc: 0.9123 - val_loss: 0.5665 - val_acc: 0.7785
Epoch 157/500
604/604 [==============================] - 0s 273us/step - loss: 0.2731 - acc: 0.8974 - val_loss: 0.5541 - val_acc: 0.7785
Epoch 158/500
604/604 [==============================] - 0s 300us/step - loss: 0.2588 - acc: 0.9123 - val_loss: 0.5342 - val_acc: 0.7819
Epoch 159/500
604/604 [==============================] - 0s 288us/step - loss: 0.2833 - acc: 0.8891 - val_loss: 0.5270 - val_acc: 0.7785
Epoch 160/500
604/604 [==============================] - 0s 295us/step - loss: 0.2718 - acc: 0.8990 - val_loss: 0.6033 - val_acc: 0.7852
Epoch 161/500
604/604 [==============================] - 0s 296us/step - loss: 0.2621 - acc: 0.9040 - val_loss: 0.5485 - val_acc: 0.7785
Epoch 162/500
604/604 [==============================] - 0s 270us/step - loss: 0.2475 - acc: 0.9156 - val_loss: 0.5709 - val_acc: 0.7752
Epoch 163/500
604/604 [==============================] - 0s 288us/step - loss: 0.2518 - acc: 0.9139 - val_loss: 0.5819 - val_acc: 0.7718
Epoch 164/500
604/604 [==============================] - 0s 311us/step - loss: 0.2690 - acc: 0.9073 - val_loss: 0.5953 - val_acc: 0.7819
Epoch 165/500
604/604 [==============================] - 0s 292us/step - loss: 0.2492 - acc: 0.9123 - val_loss: 0.5480 - val_acc: 0.7785
Epoch 166/500
604/604 [==============================] - 0s 293us/step - loss: 0.2508 - acc: 0.9123 - val_loss: 0.5558 - val_acc: 0.7785
Epoch 167/500
604/604 [==============================] - 0s 278us/step - loss: 0.2486 - acc: 0.9156 - val_loss: 0.5654 - val_acc: 0.7886
Epoch 168/500
604/604 [==============================] - 0s 323us/step - loss: 0.2516 - acc: 0.9139 - val_loss: 0.5768 - val_acc: 0.7819
Epoch 169/500
604/604 [==============================] - 0s 270us/step - loss: 0.2564 - acc: 0.9040 - val_loss: 0.5921 - val_acc: 0.7819
Epoch 170/500
604/604 [==============================] - 0s 304us/step - loss: 0.2626 - acc: 0.9056 - val_loss: 0.5554 - val_acc: 0.7718
Epoch 171/500
604/604 [==============================] - 0s 289us/step - loss: 0.2493 - acc: 0.9106 - val_loss: 0.6208 - val_acc: 0.7819
Epoch 172/500
604/604 [==============================] - 0s 304us/step - loss: 0.2415 - acc: 0.9139 - val_loss: 0.6160 - val_acc: 0.7785
Epoch 173/500
604/604 [==============================] - 0s 294us/step - loss: 0.2319 - acc: 0.9222 - val_loss: 0.5547 - val_acc: 0.7785
Epoch 174/500
604/604 [==============================] - 0s 284us/step - loss: 0.2332 - acc: 0.9255 - val_loss: 0.6143 - val_acc: 0.7819
Epoch 175/500
604/604 [==============================] - 0s 283us/step - loss: 0.2372 - acc: 0.9123 - val_loss: 0.7107 - val_acc: 0.7886
Epoch 176/500
604/604 [==============================] - 0s 292us/step - loss: 0.3152 - acc: 0.8808 - val_loss: 0.6726 - val_acc: 0.7785
Epoch 177/500
604/604 [==============================] - 0s 291us/step - loss: 0.2684 - acc: 0.9007 - val_loss: 0.6195 - val_acc: 0.7819
Epoch 178/500
604/604 [==============================] - 0s 299us/step - loss: 0.2478 - acc: 0.9139 - val_loss: 0.5942 - val_acc: 0.7651
Epoch 179/500
604/604 [==============================] - 0s 262us/step - loss: 0.2295 - acc: 0.9222 - val_loss: 0.5925 - val_acc: 0.7819
Epoch 180/500
604/604 [==============================] - 0s 291us/step - loss: 0.2520 - acc: 0.9073 - val_loss: 0.6103 - val_acc: 0.7718
Epoch 181/500
604/604 [==============================] - 0s 349us/step - loss: 0.2393 - acc: 0.9139 - val_loss: 0.7099 - val_acc: 0.7886
Epoch 182/500
604/604 [==============================] - 0s 288us/step - loss: 0.2409 - acc: 0.9106 - val_loss: 0.6283 - val_acc: 0.7617
Epoch 183/500
604/604 [==============================] - 0s 285us/step - loss: 0.2549 - acc: 0.9056 - val_loss: 0.6767 - val_acc: 0.7752
Epoch 184/500
604/604 [==============================] - 0s 268us/step - loss: 0.2704 - acc: 0.9073 - val_loss: 0.6174 - val_acc: 0.7349
Epoch 185/500
604/604 [==============================] - 0s 268us/step - loss: 0.2592 - acc: 0.9056 - val_loss: 0.6062 - val_acc: 0.7651
Epoch 186/500
604/604 [==============================] - 0s 276us/step - loss: 0.2230 - acc: 0.9238 - val_loss: 0.6514 - val_acc: 0.7752
Epoch 187/500
604/604 [==============================] - 0s 282us/step - loss: 0.2301 - acc: 0.9189 - val_loss: 0.7617 - val_acc: 0.7785
Epoch 188/500
604/604 [==============================] - 0s 288us/step - loss: 0.2449 - acc: 0.9089 - val_loss: 0.7982 - val_acc: 0.7651
Epoch 189/500
604/604 [==============================] - 0s 251us/step - loss: 0.2625 - acc: 0.9073 - val_loss: 0.6325 - val_acc: 0.7651
Epoch 190/500
604/604 [==============================] - 0s 269us/step - loss: 0.2210 - acc: 0.9238 - val_loss: 0.6111 - val_acc: 0.7685
Epoch 191/500
604/604 [==============================] - 0s 279us/step - loss: 0.2320 - acc: 0.9222 - val_loss: 0.5887 - val_acc: 0.7718
Epoch 192/500
604/604 [==============================] - 0s 279us/step - loss: 0.2593 - acc: 0.9007 - val_loss: 0.6461 - val_acc: 0.7651
Epoch 193/500
604/604 [==============================] - 0s 318us/step - loss: 0.2389 - acc: 0.9123 - val_loss: 0.6505 - val_acc: 0.7752
Epoch 194/500
604/604 [==============================] - 0s 297us/step - loss: 0.2214 - acc: 0.9205 - val_loss: 0.6241 - val_acc: 0.7685
Epoch 195/500
604/604 [==============================] - 0s 280us/step - loss: 0.2239 - acc: 0.9238 - val_loss: 0.7725 - val_acc: 0.7819
Epoch 196/500
604/604 [==============================] - 0s 293us/step - loss: 0.2538 - acc: 0.9073 - val_loss: 0.6015 - val_acc: 0.7819
Epoch 197/500
604/604 [==============================] - 0s 298us/step - loss: 0.2455 - acc: 0.9123 - val_loss: 0.6227 - val_acc: 0.7617
Epoch 198/500
604/604 [==============================] - 0s 294us/step - loss: 0.2197 - acc: 0.9238 - val_loss: 0.6656 - val_acc: 0.7819
Epoch 199/500
604/604 [==============================] - 0s 309us/step - loss: 0.2097 - acc: 0.9305 - val_loss: 0.6963 - val_acc: 0.7617
Epoch 200/500
604/604 [==============================] - 0s 310us/step - loss: 0.2330 - acc: 0.9172 - val_loss: 0.6623 - val_acc: 0.7718
Epoch 201/500
604/604 [==============================] - 0s 254us/step - loss: 0.2551 - acc: 0.9007 - val_loss: 0.6444 - val_acc: 0.7752
Epoch 202/500
604/604 [==============================] - 0s 272us/step - loss: 0.2131 - acc: 0.9288 - val_loss: 0.6762 - val_acc: 0.7718
Epoch 203/500
604/604 [==============================] - 0s 281us/step - loss: 0.2194 - acc: 0.9238 - val_loss: 0.6563 - val_acc: 0.7819
Epoch 204/500
604/604 [==============================] - 0s 289us/step - loss: 0.2321 - acc: 0.9189 - val_loss: 0.6863 - val_acc: 0.7651
Epoch 205/500
604/604 [==============================] - 0s 285us/step - loss: 0.2100 - acc: 0.9255 - val_loss: 0.6319 - val_acc: 0.7617
Epoch 206/500
604/604 [==============================] - 0s 293us/step - loss: 0.2200 - acc: 0.9255 - val_loss: 0.7074 - val_acc: 0.7752
Epoch 207/500
604/604 [==============================] - 0s 300us/step - loss: 0.2111 - acc: 0.9305 - val_loss: 0.6639 - val_acc: 0.7752
Epoch 208/500
604/604 [==============================] - 0s 305us/step - loss: 0.2169 - acc: 0.9238 - val_loss: 0.7712 - val_acc: 0.7785
Epoch 209/500
604/604 [==============================] - 0s 285us/step - loss: 0.2205 - acc: 0.9156 - val_loss: 0.8167 - val_acc: 0.7718
Epoch 210/500
604/604 [==============================] - 0s 287us/step - loss: 0.2260 - acc: 0.9222 - val_loss: 0.6256 - val_acc: 0.7517
Epoch 211/500
604/604 [==============================] - 0s 306us/step - loss: 0.2122 - acc: 0.9338 - val_loss: 0.7619 - val_acc: 0.7651
Epoch 212/500
604/604 [==============================] - 0s 303us/step - loss: 0.2261 - acc: 0.9238 - val_loss: 0.6539 - val_acc: 0.7617
Epoch 213/500
604/604 [==============================] - 0s 291us/step - loss: 0.2073 - acc: 0.9321 - val_loss: 0.7161 - val_acc: 0.7718
Epoch 214/500
604/604 [==============================] - 0s 297us/step - loss: 0.2359 - acc: 0.9222 - val_loss: 0.7766 - val_acc: 0.7685
Epoch 215/500
604/604 [==============================] - 0s 294us/step - loss: 0.2895 - acc: 0.8907 - val_loss: 0.8777 - val_acc: 0.7550
Epoch 216/500
604/604 [==============================] - 0s 258us/step - loss: 0.2304 - acc: 0.9238 - val_loss: 0.7401 - val_acc: 0.7785
Epoch 217/500
604/604 [==============================] - 0s 289us/step - loss: 0.1971 - acc: 0.9321 - val_loss: 0.7413 - val_acc: 0.7785
Epoch 218/500
604/604 [==============================] - 0s 266us/step - loss: 0.2546 - acc: 0.9056 - val_loss: 0.6629 - val_acc: 0.7785
Epoch 219/500
604/604 [==============================] - 0s 288us/step - loss: 0.2157 - acc: 0.9272 - val_loss: 0.7103 - val_acc: 0.7685
Epoch 220/500
604/604 [==============================] - 0s 280us/step - loss: 0.2379 - acc: 0.9106 - val_loss: 0.7526 - val_acc: 0.7718
Epoch 221/500
604/604 [==============================] - 0s 308us/step - loss: 0.2324 - acc: 0.9089 - val_loss: 0.6743 - val_acc: 0.7584
Epoch 222/500
604/604 [==============================] - 0s 321us/step - loss: 0.2148 - acc: 0.9272 - val_loss: 0.7330 - val_acc: 0.7819
Epoch 223/500
604/604 [==============================] - 0s 298us/step - loss: 0.2077 - acc: 0.9272 - val_loss: 0.9461 - val_acc: 0.7718
Epoch 224/500
604/604 [==============================] - 0s 288us/step - loss: 0.2195 - acc: 0.9189 - val_loss: 0.7094 - val_acc: 0.7651
Epoch 225/500
604/604 [==============================] - 0s 277us/step - loss: 0.1782 - acc: 0.9404 - val_loss: 0.7607 - val_acc: 0.7651
Epoch 226/500
604/604 [==============================] - 0s 283us/step - loss: 0.1672 - acc: 0.9503 - val_loss: 0.8396 - val_acc: 0.7718
Epoch 227/500
604/604 [==============================] - 0s 312us/step - loss: 0.1820 - acc: 0.9371 - val_loss: 0.9188 - val_acc: 0.7617
Epoch 228/500
604/604 [==============================] - 0s 300us/step - loss: 0.2052 - acc: 0.9305 - val_loss: 0.7511 - val_acc: 0.7718
Epoch 229/500
604/604 [==============================] - 0s 292us/step - loss: 0.1779 - acc: 0.9404 - val_loss: 0.8985 - val_acc: 0.7685
Epoch 230/500
604/604 [==============================] - 0s 266us/step - loss: 0.1709 - acc: 0.9487 - val_loss: 0.8973 - val_acc: 0.7685
Epoch 231/500
604/604 [==============================] - 0s 275us/step - loss: 0.1743 - acc: 0.9421 - val_loss: 0.8414 - val_acc: 0.7752
Epoch 232/500
604/604 [==============================] - 0s 284us/step - loss: 0.1921 - acc: 0.9305 - val_loss: 0.8647 - val_acc: 0.7651
Epoch 233/500
604/604 [==============================] - 0s 298us/step - loss: 0.2371 - acc: 0.9238 - val_loss: 0.7732 - val_acc: 0.7081
Epoch 234/500
604/604 [==============================] - 0s 287us/step - loss: 0.2647 - acc: 0.8957 - val_loss: 0.6884 - val_acc: 0.7483
Epoch 235/500
604/604 [==============================] - 0s 264us/step - loss: 0.1955 - acc: 0.9354 - val_loss: 0.8135 - val_acc: 0.7685
Epoch 236/500
604/604 [==============================] - 0s 269us/step - loss: 0.1669 - acc: 0.9454 - val_loss: 0.8114 - val_acc: 0.7718
Epoch 237/500
604/604 [==============================] - 0s 268us/step - loss: 0.1944 - acc: 0.9338 - val_loss: 0.9183 - val_acc: 0.7651
Epoch 238/500
604/604 [==============================] - 0s 288us/step - loss: 0.1885 - acc: 0.9321 - val_loss: 0.8345 - val_acc: 0.7584
Epoch 239/500
604/604 [==============================] - 0s 310us/step - loss: 0.2088 - acc: 0.9205 - val_loss: 0.8557 - val_acc: 0.7819
Epoch 240/500
604/604 [==============================] - 0s 296us/step - loss: 0.1680 - acc: 0.9437 - val_loss: 0.8862 - val_acc: 0.7651
Epoch 241/500
604/604 [==============================] - 0s 287us/step - loss: 0.1738 - acc: 0.9421 - val_loss: 1.1188 - val_acc: 0.7718
Epoch 242/500
604/604 [==============================] - 0s 342us/step - loss: 0.1886 - acc: 0.9404 - val_loss: 0.8605 - val_acc: 0.7651
Epoch 243/500
604/604 [==============================] - 0s 304us/step - loss: 0.1724 - acc: 0.9454 - val_loss: 0.8618 - val_acc: 0.7685
Epoch 244/500
604/604 [==============================] - 0s 304us/step - loss: 0.1663 - acc: 0.9454 - val_loss: 1.0171 - val_acc: 0.7785
Epoch 245/500
604/604 [==============================] - 0s 309us/step - loss: 0.1610 - acc: 0.9454 - val_loss: 1.0083 - val_acc: 0.7852
Epoch 246/500
604/604 [==============================] - 0s 284us/step - loss: 0.1728 - acc: 0.9470 - val_loss: 0.9048 - val_acc: 0.7752
Epoch 247/500
604/604 [==============================] - 0s 301us/step - loss: 0.3451 - acc: 0.8692 - val_loss: 1.0031 - val_acc: 0.7852
Epoch 248/500
604/604 [==============================] - 0s 280us/step - loss: 0.2220 - acc: 0.9172 - val_loss: 0.8176 - val_acc: 0.7584
Epoch 249/500
604/604 [==============================] - 0s 323us/step - loss: 0.2340 - acc: 0.9123 - val_loss: 0.8550 - val_acc: 0.7785
Epoch 250/500
604/604 [==============================] - 0s 290us/step - loss: 0.2243 - acc: 0.9189 - val_loss: 0.7044 - val_acc: 0.7584
Epoch 251/500
604/604 [==============================] - 0s 301us/step - loss: 0.1884 - acc: 0.9404 - val_loss: 0.7949 - val_acc: 0.7852
Epoch 252/500
604/604 [==============================] - 0s 270us/step - loss: 0.1659 - acc: 0.9437 - val_loss: 0.8822 - val_acc: 0.7852
Epoch 253/500
604/604 [==============================] - 0s 295us/step - loss: 0.1728 - acc: 0.9421 - val_loss: 0.8678 - val_acc: 0.7852
Epoch 254/500
604/604 [==============================] - 0s 283us/step - loss: 0.1469 - acc: 0.9570 - val_loss: 1.0069 - val_acc: 0.7819
Epoch 255/500
604/604 [==============================] - 0s 302us/step - loss: 0.1411 - acc: 0.9586 - val_loss: 1.0561 - val_acc: 0.7886
Epoch 256/500
604/604 [==============================] - 0s 296us/step - loss: 0.1516 - acc: 0.9553 - val_loss: 1.0537 - val_acc: 0.7819
Epoch 257/500
604/604 [==============================] - 0s 271us/step - loss: 0.2363 - acc: 0.9139 - val_loss: 1.0098 - val_acc: 0.7819
Epoch 258/500
604/604 [==============================] - 0s 283us/step - loss: 0.1782 - acc: 0.9404 - val_loss: 0.9356 - val_acc: 0.7886
Epoch 259/500
604/604 [==============================] - 0s 310us/step - loss: 0.1487 - acc: 0.9553 - val_loss: 1.1126 - val_acc: 0.7852
Epoch 260/500
604/604 [==============================] - 0s 304us/step - loss: 0.1867 - acc: 0.9354 - val_loss: 0.8481 - val_acc: 0.7852
Epoch 261/500
604/604 [==============================] - 0s 300us/step - loss: 0.1676 - acc: 0.9421 - val_loss: 0.8667 - val_acc: 0.7617
Epoch 262/500
604/604 [==============================] - 0s 330us/step - loss: 0.1605 - acc: 0.9421 - val_loss: 0.9752 - val_acc: 0.7752
Epoch 263/500
604/604 [==============================] - 0s 290us/step - loss: 0.1488 - acc: 0.9536 - val_loss: 0.9851 - val_acc: 0.7718
Epoch 264/500
604/604 [==============================] - 0s 307us/step - loss: 0.1349 - acc: 0.9636 - val_loss: 1.0201 - val_acc: 0.7785
Epoch 265/500
604/604 [==============================] - 0s 287us/step - loss: 0.1273 - acc: 0.9652 - val_loss: 1.1411 - val_acc: 0.7819
Epoch 266/500
604/604 [==============================] - 0s 330us/step - loss: 0.1291 - acc: 0.9636 - val_loss: 1.1160 - val_acc: 0.7785
Epoch 267/500
604/604 [==============================] - 0s 290us/step - loss: 0.1466 - acc: 0.9553 - val_loss: 1.3389 - val_acc: 0.7685
Epoch 268/500
604/604 [==============================] - 0s 293us/step - loss: 0.2278 - acc: 0.9238 - val_loss: 0.8980 - val_acc: 0.7785
Epoch 269/500
604/604 [==============================] - 0s 275us/step - loss: 0.2497 - acc: 0.9073 - val_loss: 0.8968 - val_acc: 0.7718
Epoch 270/500
604/604 [==============================] - 0s 312us/step - loss: 0.1553 - acc: 0.9503 - val_loss: 0.9746 - val_acc: 0.7886
Epoch 271/500
604/604 [==============================] - 0s 311us/step - loss: 0.1478 - acc: 0.9536 - val_loss: 0.9310 - val_acc: 0.7550
Epoch 272/500
604/604 [==============================] - 0s 350us/step - loss: 0.1450 - acc: 0.9553 - val_loss: 1.1243 - val_acc: 0.7819
Epoch 273/500
604/604 [==============================] - 0s 296us/step - loss: 0.1346 - acc: 0.9636 - val_loss: 1.2579 - val_acc: 0.7752
Epoch 274/500
604/604 [==============================] - 0s 321us/step - loss: 0.1510 - acc: 0.9553 - val_loss: 1.0504 - val_acc: 0.7752
Epoch 275/500
604/604 [==============================] - 0s 301us/step - loss: 0.1267 - acc: 0.9619 - val_loss: 1.1131 - val_acc: 0.7718
Epoch 276/500
604/604 [==============================] - 0s 298us/step - loss: 0.1248 - acc: 0.9636 - val_loss: 1.1263 - val_acc: 0.7685
Epoch 277/500
604/604 [==============================] - 0s 304us/step - loss: 0.1251 - acc: 0.9636 - val_loss: 1.1652 - val_acc: 0.7685
Epoch 278/500
604/604 [==============================] - 0s 316us/step - loss: 0.1228 - acc: 0.9669 - val_loss: 1.1542 - val_acc: 0.7819
Epoch 279/500
604/604 [==============================] - 0s 298us/step - loss: 0.1239 - acc: 0.9636 - val_loss: 1.2267 - val_acc: 0.7752
Epoch 280/500
604/604 [==============================] - 0s 291us/step - loss: 0.1320 - acc: 0.9619 - val_loss: 1.0528 - val_acc: 0.7584
Epoch 281/500
604/604 [==============================] - 0s 291us/step - loss: 0.5018 - acc: 0.8013 - val_loss: 0.9488 - val_acc: 0.7215
Epoch 282/500
604/604 [==============================] - 0s 311us/step - loss: 0.3605 - acc: 0.8642 - val_loss: 0.9802 - val_acc: 0.7685
Epoch 283/500
604/604 [==============================] - 0s 291us/step - loss: 0.2385 - acc: 0.9073 - val_loss: 0.7633 - val_acc: 0.7685
Epoch 284/500
604/604 [==============================] - 0s 301us/step - loss: 0.1956 - acc: 0.9238 - val_loss: 0.9397 - val_acc: 0.7919
Epoch 285/500
604/604 [==============================] - 0s 286us/step - loss: 0.1964 - acc: 0.9288 - val_loss: 0.8532 - val_acc: 0.7651
Epoch 286/500
604/604 [==============================] - 0s 296us/step - loss: 0.1761 - acc: 0.9421 - val_loss: 1.0075 - val_acc: 0.7718
Epoch 287/500
604/604 [==============================] - 0s 295us/step - loss: 0.1631 - acc: 0.9487 - val_loss: 0.9889 - val_acc: 0.7685
Epoch 288/500
604/604 [==============================] - 0s 294us/step - loss: 0.1645 - acc: 0.9470 - val_loss: 1.1399 - val_acc: 0.7752
Epoch 289/500
604/604 [==============================] - 0s 300us/step - loss: 0.2333 - acc: 0.9172 - val_loss: 0.9110 - val_acc: 0.7718
Epoch 290/500
604/604 [==============================] - 0s 314us/step - loss: 0.1678 - acc: 0.9470 - val_loss: 0.9470 - val_acc: 0.7785
Epoch 291/500
604/604 [==============================] - 0s 313us/step - loss: 0.1439 - acc: 0.9570 - val_loss: 1.0094 - val_acc: 0.7852
Epoch 292/500
604/604 [==============================] - 0s 298us/step - loss: 0.1297 - acc: 0.9636 - val_loss: 1.0509 - val_acc: 0.7819
Epoch 293/500
604/604 [==============================] - 0s 308us/step - loss: 0.1256 - acc: 0.9669 - val_loss: 1.0753 - val_acc: 0.7819
Epoch 294/500
604/604 [==============================] - 0s 308us/step - loss: 0.1238 - acc: 0.9669 - val_loss: 1.1022 - val_acc: 0.7819
Epoch 295/500
604/604 [==============================] - 0s 296us/step - loss: 0.1236 - acc: 0.9669 - val_loss: 1.0661 - val_acc: 0.7718
Epoch 296/500
604/604 [==============================] - 0s 268us/step - loss: 0.1212 - acc: 0.9669 - val_loss: 1.1074 - val_acc: 0.7785
Epoch 297/500
604/604 [==============================] - 0s 288us/step - loss: 0.1209 - acc: 0.9652 - val_loss: 1.1212 - val_acc: 0.7819
Epoch 298/500
604/604 [==============================] - 0s 284us/step - loss: 0.1207 - acc: 0.9652 - val_loss: 1.1730 - val_acc: 0.7752
Epoch 299/500
604/604 [==============================] - 0s 289us/step - loss: 0.1199 - acc: 0.9669 - val_loss: 1.1516 - val_acc: 0.7752
Epoch 300/500
604/604 [==============================] - 0s 266us/step - loss: 0.1196 - acc: 0.9669 - val_loss: 1.1066 - val_acc: 0.7785
Epoch 301/500
604/604 [==============================] - 0s 262us/step - loss: 0.1589 - acc: 0.9503 - val_loss: 1.2735 - val_acc: 0.7852
Epoch 302/500
604/604 [==============================] - 0s 320us/step - loss: 0.2353 - acc: 0.9205 - val_loss: 0.9825 - val_acc: 0.7752
Epoch 303/500
604/604 [==============================] - 0s 297us/step - loss: 0.1687 - acc: 0.9421 - val_loss: 0.9709 - val_acc: 0.7819
Epoch 304/500
604/604 [==============================] - 0s 281us/step - loss: 0.1365 - acc: 0.9603 - val_loss: 1.0631 - val_acc: 0.7785
Epoch 305/500
604/604 [==============================] - 0s 347us/step - loss: 0.1225 - acc: 0.9652 - val_loss: 1.0681 - val_acc: 0.7852
Epoch 306/500
604/604 [==============================] - 0s 306us/step - loss: 0.1236 - acc: 0.9652 - val_loss: 1.2183 - val_acc: 0.7785
Epoch 307/500
604/604 [==============================] - 0s 269us/step - loss: 0.1968 - acc: 0.9338 - val_loss: 1.1114 - val_acc: 0.7819
Epoch 308/500
604/604 [==============================] - 0s 268us/step - loss: 0.1774 - acc: 0.9404 - val_loss: 1.0957 - val_acc: 0.7886
Epoch 309/500
604/604 [==============================] - 0s 267us/step - loss: 0.1529 - acc: 0.9536 - val_loss: 0.9883 - val_acc: 0.7785
Epoch 310/500
604/604 [==============================] - 0s 314us/step - loss: 0.1552 - acc: 0.9553 - val_loss: 1.1399 - val_acc: 0.7953
Epoch 311/500
604/604 [==============================] - 0s 289us/step - loss: 0.1305 - acc: 0.9619 - val_loss: 1.0665 - val_acc: 0.7852
Epoch 312/500
604/604 [==============================] - 0s 281us/step - loss: 0.1235 - acc: 0.9636 - val_loss: 1.0595 - val_acc: 0.7819
Epoch 313/500
604/604 [==============================] - 0s 279us/step - loss: 0.1349 - acc: 0.9619 - val_loss: 1.0746 - val_acc: 0.7852
Epoch 314/500
604/604 [==============================] - 0s 299us/step - loss: 0.2119 - acc: 0.9255 - val_loss: 1.1641 - val_acc: 0.7651
Epoch 315/500
604/604 [==============================] - 0s 303us/step - loss: 0.1547 - acc: 0.9503 - val_loss: 1.0783 - val_acc: 0.7785
Epoch 316/500
604/604 [==============================] - 0s 287us/step - loss: 0.1328 - acc: 0.9619 - val_loss: 1.1653 - val_acc: 0.7785
Epoch 317/500
604/604 [==============================] - 0s 288us/step - loss: 0.1245 - acc: 0.9652 - val_loss: 1.0631 - val_acc: 0.7919
Epoch 318/500
604/604 [==============================] - 0s 291us/step - loss: 0.1216 - acc: 0.9652 - val_loss: 1.1030 - val_acc: 0.7886
Epoch 319/500
604/604 [==============================] - 0s 273us/step - loss: 0.1300 - acc: 0.9603 - val_loss: 1.0662 - val_acc: 0.7718
Epoch 320/500
604/604 [==============================] - 0s 279us/step - loss: 0.1312 - acc: 0.9603 - val_loss: 1.2243 - val_acc: 0.7718
Epoch 321/500
604/604 [==============================] - 0s 292us/step - loss: 0.1362 - acc: 0.9586 - val_loss: 1.3880 - val_acc: 0.7785
Epoch 322/500
604/604 [==============================] - 0s 292us/step - loss: 0.1419 - acc: 0.9570 - val_loss: 1.1702 - val_acc: 0.7752
Epoch 323/500
604/604 [==============================] - 0s 295us/step - loss: 0.1272 - acc: 0.9636 - val_loss: 1.1219 - val_acc: 0.7752
Epoch 324/500
604/604 [==============================] - 0s 286us/step - loss: 0.1209 - acc: 0.9669 - val_loss: 1.1648 - val_acc: 0.7785
Epoch 325/500
604/604 [==============================] - 0s 272us/step - loss: 0.1185 - acc: 0.9669 - val_loss: 1.2360 - val_acc: 0.7785
Epoch 326/500
604/604 [==============================] - 0s 274us/step - loss: 0.1178 - acc: 0.9669 - val_loss: 1.2182 - val_acc: 0.7852
Epoch 327/500
604/604 [==============================] - 0s 308us/step - loss: 0.1179 - acc: 0.9669 - val_loss: 1.2191 - val_acc: 0.7785
Epoch 328/500
604/604 [==============================] - 0s 315us/step - loss: 0.1175 - acc: 0.9669 - val_loss: 1.2436 - val_acc: 0.7785
Epoch 329/500
604/604 [==============================] - 0s 282us/step - loss: 0.1172 - acc: 0.9669 - val_loss: 1.3060 - val_acc: 0.7752
Epoch 330/500
604/604 [==============================] - 0s 305us/step - loss: 0.1175 - acc: 0.9669 - val_loss: 1.2582 - val_acc: 0.7785
Epoch 331/500
604/604 [==============================] - 0s 315us/step - loss: 0.1172 - acc: 0.9669 - val_loss: 1.3269 - val_acc: 0.7752
Epoch 332/500
604/604 [==============================] - 0s 302us/step - loss: 0.1171 - acc: 0.9669 - val_loss: 1.2021 - val_acc: 0.7819
Epoch 333/500
604/604 [==============================] - 0s 362us/step - loss: 0.1172 - acc: 0.9669 - val_loss: 1.2704 - val_acc: 0.7785
Epoch 334/500
604/604 [==============================] - 0s 280us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3188 - val_acc: 0.7752
Epoch 335/500
604/604 [==============================] - 0s 293us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3153 - val_acc: 0.7785
Epoch 336/500
604/604 [==============================] - 0s 287us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3094 - val_acc: 0.7785
Epoch 337/500
604/604 [==============================] - 0s 298us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3419 - val_acc: 0.7785
Epoch 338/500
604/604 [==============================] - 0s 269us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2734 - val_acc: 0.7819
Epoch 339/500
604/604 [==============================] - 0s 289us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3161 - val_acc: 0.7819
Epoch 340/500
604/604 [==============================] - 0s 276us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3178 - val_acc: 0.7819
Epoch 341/500
604/604 [==============================] - 0s 285us/step - loss: 0.1170 - acc: 0.9669 - val_loss: 1.2998 - val_acc: 0.7852
Epoch 342/500
604/604 [==============================] - 0s 294us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3327 - val_acc: 0.7852
Epoch 343/500
604/604 [==============================] - 0s 288us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3219 - val_acc: 0.7886
Epoch 344/500
604/604 [==============================] - 0s 280us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3581 - val_acc: 0.7886
Epoch 345/500
604/604 [==============================] - 0s 293us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3810 - val_acc: 0.7852
Epoch 346/500
604/604 [==============================] - 0s 290us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3650 - val_acc: 0.7886
Epoch 347/500
604/604 [==============================] - 0s 298us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3176 - val_acc: 0.7886
Epoch 348/500
604/604 [==============================] - 0s 297us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3564 - val_acc: 0.7819
Epoch 349/500
604/604 [==============================] - 0s 296us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3981 - val_acc: 0.7819
Epoch 350/500
604/604 [==============================] - 0s 332us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3659 - val_acc: 0.7852
Epoch 351/500
604/604 [==============================] - 0s 287us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4123 - val_acc: 0.7819
Epoch 352/500
604/604 [==============================] - 0s 280us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4298 - val_acc: 0.7819
Epoch 353/500
604/604 [==============================] - 0s 294us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3715 - val_acc: 0.7852
Epoch 354/500
604/604 [==============================] - 0s 298us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4052 - val_acc: 0.7819
Epoch 355/500
604/604 [==============================] - 0s 296us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4226 - val_acc: 0.7819
Epoch 356/500
604/604 [==============================] - 0s 289us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4385 - val_acc: 0.7819
Epoch 357/500
604/604 [==============================] - 0s 290us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3861 - val_acc: 0.7852
Epoch 358/500
604/604 [==============================] - 0s 299us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4052 - val_acc: 0.7852
Epoch 359/500
604/604 [==============================] - 0s 309us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4234 - val_acc: 0.7819
Epoch 360/500
604/604 [==============================] - 0s 327us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3913 - val_acc: 0.7886
Epoch 361/500
604/604 [==============================] - 0s 303us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4352 - val_acc: 0.7819 - ETA: 0s - loss: 0.1101 - acc: 0.9700
Epoch 362/500
604/604 [==============================] - 0s 294us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4530 - val_acc: 0.7819
Epoch 363/500
604/604 [==============================] - 0s 270us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4667 - val_acc: 0.7819
Epoch 364/500
604/604 [==============================] - 0s 310us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3888 - val_acc: 0.7852
Epoch 365/500
604/604 [==============================] - 0s 302us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4226 - val_acc: 0.7819
Epoch 366/500
604/604 [==============================] - 0s 292us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4525 - val_acc: 0.7785
Epoch 367/500
604/604 [==============================] - 0s 319us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2630 - val_acc: 0.7617
Epoch 368/500
604/604 [==============================] - 0s 311us/step - loss: 0.1276 - acc: 0.9619 - val_loss: 1.7724 - val_acc: 0.7785
Epoch 369/500
604/604 [==============================] - 0s 308us/step - loss: 0.5415 - acc: 0.8195 - val_loss: 0.9251 - val_acc: 0.7651
Epoch 370/500
604/604 [==============================] - 0s 303us/step - loss: 0.3173 - acc: 0.8642 - val_loss: 0.6898 - val_acc: 0.7718
Epoch 371/500
604/604 [==============================] - 0s 303us/step - loss: 0.2371 - acc: 0.8990 - val_loss: 0.6468 - val_acc: 0.7852
Epoch 372/500
604/604 [==============================] - 0s 313us/step - loss: 0.2168 - acc: 0.9156 - val_loss: 0.8048 - val_acc: 0.7785
Epoch 373/500
604/604 [==============================] - 0s 295us/step - loss: 0.1803 - acc: 0.9354 - val_loss: 0.8352 - val_acc: 0.7852
Epoch 374/500
604/604 [==============================] - 0s 280us/step - loss: 0.1804 - acc: 0.9387 - val_loss: 0.8349 - val_acc: 0.7718
Epoch 375/500
604/604 [==============================] - 0s 306us/step - loss: 0.1647 - acc: 0.9470 - val_loss: 0.8762 - val_acc: 0.7886
Epoch 376/500
604/604 [==============================] - 0s 307us/step - loss: 0.1704 - acc: 0.9387 - val_loss: 0.7583 - val_acc: 0.7685
Epoch 377/500
604/604 [==============================] - 0s 297us/step - loss: 0.1818 - acc: 0.9404 - val_loss: 0.9270 - val_acc: 0.7919
Epoch 378/500
604/604 [==============================] - 0s 311us/step - loss: 0.1632 - acc: 0.9536 - val_loss: 1.2213 - val_acc: 0.7919
Epoch 379/500
604/604 [==============================] - 0s 273us/step - loss: 0.1933 - acc: 0.9371 - val_loss: 1.0773 - val_acc: 0.7752
Epoch 380/500
604/604 [==============================] - 0s 271us/step - loss: 0.1452 - acc: 0.9570 - val_loss: 1.0688 - val_acc: 0.7886
Epoch 381/500
604/604 [==============================] - 0s 289us/step - loss: 0.1524 - acc: 0.9536 - val_loss: 1.2844 - val_acc: 0.7752
Epoch 382/500
604/604 [==============================] - 0s 309us/step - loss: 0.1702 - acc: 0.9421 - val_loss: 0.9787 - val_acc: 0.7819
Epoch 383/500
604/604 [==============================] - 0s 310us/step - loss: 0.1454 - acc: 0.9553 - val_loss: 1.0557 - val_acc: 0.7852
Epoch 384/500
604/604 [==============================] - 0s 299us/step - loss: 0.2212 - acc: 0.9222 - val_loss: 0.9667 - val_acc: 0.7752
Epoch 385/500
604/604 [==============================] - 0s 298us/step - loss: 0.1306 - acc: 0.9636 - val_loss: 1.0607 - val_acc: 0.7852
Epoch 386/500
604/604 [==============================] - 0s 284us/step - loss: 0.1232 - acc: 0.9669 - val_loss: 1.0799 - val_acc: 0.7886
Epoch 387/500
604/604 [==============================] - 0s 301us/step - loss: 0.1199 - acc: 0.9669 - val_loss: 1.1007 - val_acc: 0.7886
Epoch 388/500
604/604 [==============================] - 0s 318us/step - loss: 0.1187 - acc: 0.9669 - val_loss: 1.1675 - val_acc: 0.7886
Epoch 389/500
604/604 [==============================] - 0s 305us/step - loss: 0.1179 - acc: 0.9669 - val_loss: 1.2203 - val_acc: 0.7919
Epoch 390/500
604/604 [==============================] - 0s 308us/step - loss: 0.1178 - acc: 0.9669 - val_loss: 1.2047 - val_acc: 0.7953
Epoch 391/500
604/604 [==============================] - 0s 289us/step - loss: 0.1177 - acc: 0.9669 - val_loss: 1.2088 - val_acc: 0.7987
Epoch 392/500
604/604 [==============================] - 0s 308us/step - loss: 0.1175 - acc: 0.9669 - val_loss: 1.2120 - val_acc: 0.7919
Epoch 393/500
604/604 [==============================] - 0s 289us/step - loss: 0.1175 - acc: 0.9669 - val_loss: 1.1472 - val_acc: 0.7953
Epoch 394/500
604/604 [==============================] - 0s 310us/step - loss: 0.1185 - acc: 0.9669 - val_loss: 1.0930 - val_acc: 0.7785
Epoch 395/500
604/604 [==============================] - 0s 300us/step - loss: 0.1188 - acc: 0.9669 - val_loss: 1.2357 - val_acc: 0.7852
Epoch 396/500
604/604 [==============================] - 0s 273us/step - loss: 0.1173 - acc: 0.9669 - val_loss: 1.2499 - val_acc: 0.7919
Epoch 397/500
604/604 [==============================] - 0s 336us/step - loss: 0.1172 - acc: 0.9669 - val_loss: 1.2590 - val_acc: 0.7852
Epoch 398/500
604/604 [==============================] - 0s 302us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3019 - val_acc: 0.7886
Epoch 399/500
604/604 [==============================] - 0s 319us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.3042 - val_acc: 0.7919
Epoch 400/500
604/604 [==============================] - 0s 318us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.2371 - val_acc: 0.7919
Epoch 401/500
604/604 [==============================] - 0s 325us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.2373 - val_acc: 0.7919
Epoch 402/500
604/604 [==============================] - 0s 322us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2954 - val_acc: 0.7953
Epoch 403/500
604/604 [==============================] - 0s 305us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2800 - val_acc: 0.7886
Epoch 404/500
604/604 [==============================] - 0s 296us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3158 - val_acc: 0.7919
Epoch 405/500
604/604 [==============================] - 0s 293us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2760 - val_acc: 0.7919
Epoch 406/500
604/604 [==============================] - 0s 282us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3279 - val_acc: 0.7987
Epoch 407/500
604/604 [==============================] - 0s 300us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2966 - val_acc: 0.7987
Epoch 408/500
604/604 [==============================] - 0s 298us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3241 - val_acc: 0.7953
Epoch 409/500
604/604 [==============================] - 0s 274us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3523 - val_acc: 0.7953
Epoch 410/500
604/604 [==============================] - 0s 314us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3397 - val_acc: 0.7953
Epoch 411/500
604/604 [==============================] - 0s 307us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3772 - val_acc: 0.7919
Epoch 412/500
604/604 [==============================] - 0s 292us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.3326 - val_acc: 0.7953
Epoch 413/500
604/604 [==============================] - 0s 267us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.1314 - val_acc: 0.7785
Epoch 414/500
604/604 [==============================] - 0s 280us/step - loss: 0.4373 - acc: 0.8593 - val_loss: 0.8438 - val_acc: 0.7919
Epoch 415/500
604/604 [==============================] - 0s 293us/step - loss: 0.2875 - acc: 0.8907 - val_loss: 0.6542 - val_acc: 0.7752
Epoch 416/500
604/604 [==============================] - 0s 279us/step - loss: 0.2256 - acc: 0.9172 - val_loss: 0.7405 - val_acc: 0.7886
Epoch 417/500
604/604 [==============================] - 0s 348us/step - loss: 0.1863 - acc: 0.9354 - val_loss: 0.9033 - val_acc: 0.7785
Epoch 418/500
604/604 [==============================] - 0s 288us/step - loss: 0.1872 - acc: 0.9338 - val_loss: 0.8874 - val_acc: 0.7886
Epoch 419/500
604/604 [==============================] - 0s 301us/step - loss: 0.1581 - acc: 0.9536 - val_loss: 1.0596 - val_acc: 0.7886
Epoch 420/500
604/604 [==============================] - 0s 292us/step - loss: 0.1649 - acc: 0.9503 - val_loss: 1.0359 - val_acc: 0.7718
Epoch 421/500
604/604 [==============================] - 0s 303us/step - loss: 0.1745 - acc: 0.9454 - val_loss: 0.9520 - val_acc: 0.7852
Epoch 422/500
604/604 [==============================] - 0s 293us/step - loss: 0.1573 - acc: 0.9470 - val_loss: 0.9864 - val_acc: 0.7987
Epoch 423/500
604/604 [==============================] - 0s 288us/step - loss: 0.1680 - acc: 0.9437 - val_loss: 0.9326 - val_acc: 0.7919
Epoch 424/500
604/604 [==============================] - 0s 272us/step - loss: 0.1391 - acc: 0.9553 - val_loss: 1.0443 - val_acc: 0.7919
Epoch 425/500
604/604 [==============================] - 0s 288us/step - loss: 0.1221 - acc: 0.9669 - val_loss: 1.0488 - val_acc: 0.7886
Epoch 426/500
604/604 [==============================] - 0s 302us/step - loss: 0.1215 - acc: 0.9669 - val_loss: 1.1203 - val_acc: 0.7919
Epoch 427/500
604/604 [==============================] - 0s 299us/step - loss: 0.1198 - acc: 0.9669 - val_loss: 1.1811 - val_acc: 0.7886
Epoch 428/500
604/604 [==============================] - 0s 311us/step - loss: 0.1189 - acc: 0.9669 - val_loss: 1.1618 - val_acc: 0.7886
Epoch 429/500
604/604 [==============================] - 0s 284us/step - loss: 0.1180 - acc: 0.9669 - val_loss: 1.1974 - val_acc: 0.7886
Epoch 430/500
604/604 [==============================] - 0s 295us/step - loss: 0.1182 - acc: 0.9669 - val_loss: 1.2033 - val_acc: 0.7919
Epoch 431/500
604/604 [==============================] - 0s 295us/step - loss: 0.1174 - acc: 0.9669 - val_loss: 1.2490 - val_acc: 0.7919
Epoch 432/500
604/604 [==============================] - 0s 338us/step - loss: 0.1174 - acc: 0.9669 - val_loss: 1.2468 - val_acc: 0.7886
Epoch 433/500
604/604 [==============================] - 0s 300us/step - loss: 0.1171 - acc: 0.9669 - val_loss: 1.2498 - val_acc: 0.7852
Epoch 434/500
604/604 [==============================] - 0s 304us/step - loss: 0.1171 - acc: 0.9669 - val_loss: 1.2104 - val_acc: 0.7886
Epoch 435/500
604/604 [==============================] - 0s 286us/step - loss: 0.1172 - acc: 0.9669 - val_loss: 1.2677 - val_acc: 0.7919
Epoch 436/500
604/604 [==============================] - 0s 292us/step - loss: 0.1646 - acc: 0.9536 - val_loss: 0.9931 - val_acc: 0.7886
Epoch 437/500
604/604 [==============================] - 0s 313us/step - loss: 0.2384 - acc: 0.9123 - val_loss: 1.0624 - val_acc: 0.7483
Epoch 438/500
604/604 [==============================] - 0s 307us/step - loss: 0.1894 - acc: 0.9387 - val_loss: 1.2266 - val_acc: 0.7752
Epoch 439/500
604/604 [==============================] - 0s 288us/step - loss: 0.1529 - acc: 0.9503 - val_loss: 1.0148 - val_acc: 0.7718
Epoch 440/500
604/604 [==============================] - 0s 268us/step - loss: 0.1756 - acc: 0.9437 - val_loss: 1.1598 - val_acc: 0.7852
Epoch 441/500
604/604 [==============================] - 0s 280us/step - loss: 0.1435 - acc: 0.9553 - val_loss: 0.9720 - val_acc: 0.7752
Epoch 442/500
604/604 [==============================] - 0s 283us/step - loss: 0.1256 - acc: 0.9669 - val_loss: 1.1542 - val_acc: 0.7852
Epoch 443/500
604/604 [==============================] - 0s 288us/step - loss: 0.1766 - acc: 0.9387 - val_loss: 1.0012 - val_acc: 0.7852
Epoch 444/500
604/604 [==============================] - 0s 307us/step - loss: 0.1490 - acc: 0.9553 - val_loss: 1.1368 - val_acc: 0.7886
Epoch 445/500
604/604 [==============================] - 0s 300us/step - loss: 0.1551 - acc: 0.9487 - val_loss: 1.0439 - val_acc: 0.7819
Epoch 446/500
604/604 [==============================] - 0s 303us/step - loss: 0.1418 - acc: 0.9603 - val_loss: 1.0628 - val_acc: 0.7886
Epoch 447/500
604/604 [==============================] - 0s 313us/step - loss: 0.1199 - acc: 0.9669 - val_loss: 1.0995 - val_acc: 0.7919
Epoch 448/500
604/604 [==============================] - 0s 303us/step - loss: 0.1186 - acc: 0.9669 - val_loss: 1.1204 - val_acc: 0.7886
Epoch 449/500
604/604 [==============================] - 0s 314us/step - loss: 0.1187 - acc: 0.9669 - val_loss: 1.0560 - val_acc: 0.7785
Epoch 450/500
604/604 [==============================] - 0s 277us/step - loss: 0.1198 - acc: 0.9669 - val_loss: 1.1392 - val_acc: 0.7919
Epoch 451/500
604/604 [==============================] - 0s 283us/step - loss: 0.1175 - acc: 0.9669 - val_loss: 1.1925 - val_acc: 0.7886
Epoch 452/500
604/604 [==============================] - 0s 274us/step - loss: 0.1171 - acc: 0.9669 - val_loss: 1.2496 - val_acc: 0.7752
Epoch 453/500
604/604 [==============================] - 0s 281us/step - loss: 0.1171 - acc: 0.9669 - val_loss: 1.2135 - val_acc: 0.7886
Epoch 454/500
604/604 [==============================] - 0s 297us/step - loss: 0.1170 - acc: 0.9669 - val_loss: 1.2409 - val_acc: 0.7852
Epoch 455/500
604/604 [==============================] - 0s 295us/step - loss: 0.1170 - acc: 0.9669 - val_loss: 1.2393 - val_acc: 0.7852
Epoch 456/500
604/604 [==============================] - 0s 262us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.2459 - val_acc: 0.7886
Epoch 457/500
604/604 [==============================] - 0s 261us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.2628 - val_acc: 0.7886
Epoch 458/500
604/604 [==============================] - 0s 272us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2455 - val_acc: 0.7886
Epoch 459/500
604/604 [==============================] - 0s 320us/step - loss: 0.1169 - acc: 0.9669 - val_loss: 1.1701 - val_acc: 0.7886
Epoch 460/500
604/604 [==============================] - 0s 375us/step - loss: 0.1170 - acc: 0.9669 - val_loss: 1.2301 - val_acc: 0.7919
Epoch 461/500
604/604 [==============================] - 0s 307us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2688 - val_acc: 0.7886
Epoch 462/500
604/604 [==============================] - 0s 275us/step - loss: 0.1168 - acc: 0.9669 - val_loss: 1.2530 - val_acc: 0.7852
Epoch 463/500
604/604 [==============================] - 0s 272us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2924 - val_acc: 0.7819
Epoch 464/500
604/604 [==============================] - 0s 278us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3158 - val_acc: 0.7819
Epoch 465/500
604/604 [==============================] - 0s 278us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3268 - val_acc: 0.7819
Epoch 466/500
604/604 [==============================] - 0s 294us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3155 - val_acc: 0.7819
Epoch 467/500
604/604 [==============================] - 0s 299us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3391 - val_acc: 0.7785
Epoch 468/500
604/604 [==============================] - 0s 295us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3232 - val_acc: 0.7819
Epoch 469/500
604/604 [==============================] - 0s 305us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3483 - val_acc: 0.7752
Epoch 470/500
604/604 [==============================] - 0s 292us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3101 - val_acc: 0.7852
Epoch 471/500
604/604 [==============================] - 0s 307us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3265 - val_acc: 0.7852
Epoch 472/500
604/604 [==============================] - 0s 300us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2650 - val_acc: 0.7919
Epoch 473/500
604/604 [==============================] - 0s 320us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3013 - val_acc: 0.7886
Epoch 474/500
604/604 [==============================] - 0s 317us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2343 - val_acc: 0.7886
Epoch 475/500
604/604 [==============================] - ETA: 0s - loss: 0.1172 - acc: 0.9667 - 0s 328us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2996 - val_acc: 0.7886
Epoch 476/500
604/604 [==============================] - 0s 309us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.2697 - val_acc: 0.7852
Epoch 477/500
604/604 [==============================] - 0s 294us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.3203 - val_acc: 0.7886
Epoch 478/500
604/604 [==============================] - 0s 292us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.2420 - val_acc: 0.7886
Epoch 479/500
604/604 [==============================] - 0s 305us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2975 - val_acc: 0.7919
Epoch 480/500
604/604 [==============================] - 0s 293us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3275 - val_acc: 0.7886
Epoch 481/500
604/604 [==============================] - 0s 303us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3483 - val_acc: 0.7819
Epoch 482/500
604/604 [==============================] - 0s 292us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3651 - val_acc: 0.7819
Epoch 483/500
604/604 [==============================] - 0s 305us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.3808 - val_acc: 0.7819
Epoch 484/500
604/604 [==============================] - 0s 291us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.3470 - val_acc: 0.7852
Epoch 485/500
604/604 [==============================] - 0s 298us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.3675 - val_acc: 0.7852
Epoch 486/500
604/604 [==============================] - 0s 314us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.3894 - val_acc: 0.7819
Epoch 487/500
604/604 [==============================] - 0s 298us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4050 - val_acc: 0.7819
Epoch 488/500
604/604 [==============================] - 0s 296us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4187 - val_acc: 0.7819
Epoch 489/500
604/604 [==============================] - 0s 272us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4307 - val_acc: 0.7785
Epoch 490/500
604/604 [==============================] - 0s 303us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4171 - val_acc: 0.7819
Epoch 491/500
604/604 [==============================] - 0s 327us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4293 - val_acc: 0.7819
Epoch 492/500
604/604 [==============================] - 0s 322us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4399 - val_acc: 0.7785
Epoch 493/500
604/604 [==============================] - 0s 329us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.3260 - val_acc: 0.7852
Epoch 494/500
604/604 [==============================] - 0s 301us/step - loss: 0.1166 - acc: 0.9669 - val_loss: 1.4199 - val_acc: 0.7752
Epoch 495/500
604/604 [==============================] - 0s 291us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4451 - val_acc: 0.7752
Epoch 496/500
604/604 [==============================] - 0s 294us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4630 - val_acc: 0.7752
Epoch 497/500
604/604 [==============================] - 0s 290us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4794 - val_acc: 0.7752
Epoch 498/500
604/604 [==============================] - 0s 282us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.4924 - val_acc: 0.7752
Epoch 499/500
604/604 [==============================] - 0s 287us/step - loss: 0.1165 - acc: 0.9669 - val_loss: 1.2754 - val_acc: 0.7886
Epoch 500/500
604/604 [==============================] - 0s 300us/step - loss: 0.1167 - acc: 0.9669 - val_loss: 1.2062 - val_acc: 0.7785

Test trained model





In [40]:



    


scores = model.evaluate(X, Y)
print("%s: %.2f%%" % (model.metrics_names[1], scores[1]*100))



    


















    






902/902 [==============================] - 0s 46us/step
acc: 90.47%

Save model structure and weight





In [41]:



    


model_json = model.to_json()
with open("model_structure.json", "w") as json_file:
    json_file.write(model_json)

model.save_weights("model_weight.h5")

Plot model training and validation accuracy and loss





In [43]:



    


%matplotlib notebook

import matplotlib.pyplot as plt

acc = history.history['acc']
val_acc = history.history['val_acc']
loss = history.history['loss']
val_loss = history.history['val_loss']
epochs = range(len(acc))

fig_accuracy = plt.figure()
plt.plot(epochs, acc, 'r.', label='training')
plt.plot(epochs, val_acc, 'r', label='validation')
plt.title('Training and validation accuracy')
plt.xlabel('Epochs')
plt.legend(loc='upper left')
# fig_accuracy.savefig('fine_tuning_plot_accuracy_%d_%d_%d.png' % (EPOCHS, BAT_SIZE, FROZEN_LAYERS))
plt.show()

Content source: herdiansc/gender_by_mm

Similar notebooks:

notebook.community | gallery | about