Watson Visual Recognition Training with Spectrogram Images from SETI Signal Data


Install the Watson Developer Cloud Python SDK

  • Install the Python SDK if has not been previously installed !pip install --upgrade watson-developer-cloud
  • Restart the kernel, after installing the SDK

In [3]:
#!pip install --user --upgrade watson-developer-cloud

In [4]:
#Making a local folder to put my data.

#NOTE: YOU MUST do something like this on a Spark Enterprise cluster at the hackathon so that
#you can put your data into a separate local file space. Otherwise, you'll likely collide with 
#your fellow participants. 

my_team_name_data_folder = 'my_team_name_data_folder'

mydatafolder = os.environ['PWD'] + '/' +  my_team_name_data_folder + '/zipfiles'
if os.path.exists(mydatafolder) is False:
    os.makedirs(mydatafolder)

In [5]:
!ls -al $mydatafolder


total 4168752
drwx------ 2 sd2d-634b36332a0fab-8605aaf2c6e1 users    16384 Jun  9 19:57 .
drwx------ 4 sd2d-634b36332a0fab-8605aaf2c6e1 users     4096 Jun  9 19:52 ..
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 18861624 Jun  9 19:55 classification_10_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 15728896 Jun  9 19:55 classification_10_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  1010329 Jun  9 19:55 classification_10_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 10639276 Jun  9 19:54 classification_10_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26276682 Jun  9 19:55 classification_1_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26540364 Jun  9 19:54 classification_1_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26524332 Jun  9 19:55 classification_1_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26500379 Jun  9 19:54 classification_1_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26277414 Jun  9 19:55 classification_2_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26492757 Jun  9 19:54 classification_2_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26330632 Jun  9 19:55 classification_2_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26294891 Jun  9 19:54 classification_2_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26419644 Jun  9 19:55 classification_3_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26601599 Jun  9 19:54 classification_3_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26385436 Jun  9 19:55 classification_3_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26343102 Jun  9 19:54 classification_3_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26377530 Jun  9 19:55 classification_4_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26412492 Jun  9 19:55 classification_4_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26540008 Jun  9 19:55 classification_4_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26406601 Jun  9 19:54 classification_4_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26546650 Jun  9 19:55 classification_5_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26260672 Jun  9 19:55 classification_5_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26227651 Jun  9 19:55 classification_5_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26308468 Jun  9 19:54 classification_5_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26466793 Jun  9 19:55 classification_6_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26409022 Jun  9 19:55 classification_6_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26398476 Jun  9 19:55 classification_6_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26463098 Jun  9 19:54 classification_6_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26480744 Jun  9 19:55 classification_7_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26551595 Jun  9 19:55 classification_7_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26540629 Jun  9 19:55 classification_7_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26484031 Jun  9 19:54 classification_7_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26254084 Jun  9 19:55 classification_8_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26429626 Jun  9 19:55 classification_8_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26334556 Jun  9 19:55 classification_8_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26273982 Jun  9 19:54 classification_8_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26390358 Jun  9 19:55 classification_9_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26271551 Jun  9 19:55 classification_9_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26214480 Jun  9 19:55 classification_9_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users 26471836 Jun  9 19:54 classification_9_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4809557 Jun  9 19:57 testset_10_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4819877 Jun  9 19:57 testset_10_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5074352 Jun  9 19:57 testset_10_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5137352 Jun  9 19:57 testset_10_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4975722 Jun  9 19:57 testset_11_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5131749 Jun  9 19:57 testset_11_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5102467 Jun  9 19:57 testset_11_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4838410 Jun  9 19:57 testset_11_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4866630 Jun  9 19:57 testset_12_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5007882 Jun  9 19:57 testset_12_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5052983 Jun  9 19:57 testset_12_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4778377 Jun  9 19:57 testset_12_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5121092 Jun  9 19:57 testset_13_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5137742 Jun  9 19:57 testset_13_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4793915 Jun  9 19:57 testset_13_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4878121 Jun  9 19:57 testset_13_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5001160 Jun  9 19:57 testset_14_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4913022 Jun  9 19:57 testset_14_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5058149 Jun  9 19:57 testset_14_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5069271 Jun  9 19:57 testset_14_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4919241 Jun  9 19:57 testset_15_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4808709 Jun  9 19:57 testset_15_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5099819 Jun  9 19:57 testset_15_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4787396 Jun  9 19:57 testset_15_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4824590 Jun  9 19:57 testset_16_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5058430 Jun  9 19:57 testset_16_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5098353 Jun  9 19:57 testset_16_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4871490 Jun  9 19:57 testset_16_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4804236 Jun  9 19:57 testset_17_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5068962 Jun  9 19:57 testset_17_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4834194 Jun  9 19:57 testset_17_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5123255 Jun  9 19:57 testset_17_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4847334 Jun  9 19:57 testset_18_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4880808 Jun  9 19:57 testset_18_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5063219 Jun  9 19:57 testset_18_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4879899 Jun  9 19:57 testset_18_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5117977 Jun  9 19:57 testset_19_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5036244 Jun  9 19:57 testset_19_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5106902 Jun  9 19:57 testset_19_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4835412 Jun  9 19:57 testset_19_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4924552 Jun  9 19:57 testset_1_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4964034 Jun  9 19:57 testset_1_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5081532 Jun  9 19:57 testset_1_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5019746 Jun  9 19:57 testset_1_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4758834 Jun  9 19:57 testset_20_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5002892 Jun  9 19:57 testset_20_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5088423 Jun  9 19:57 testset_20_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5086407 Jun  9 19:57 testset_20_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5041240 Jun  9 19:57 testset_21_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4993238 Jun  9 19:57 testset_21_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  1695094 Jun  9 19:57 testset_21_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5060292 Jun  9 19:57 testset_21_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4813098 Jun  9 19:57 testset_22_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  3740227 Jun  9 19:57 testset_22_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  1426499 Jun  9 19:57 testset_22_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  1114483 Jun  9 19:57 testset_23_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5101982 Jun  9 19:57 testset_2_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4815075 Jun  9 19:57 testset_2_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5116147 Jun  9 19:57 testset_2_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4827263 Jun  9 19:57 testset_2_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5020215 Jun  9 19:57 testset_3_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4870139 Jun  9 19:57 testset_3_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5100494 Jun  9 19:57 testset_3_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4855987 Jun  9 19:57 testset_3_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4893495 Jun  9 19:57 testset_4_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4898871 Jun  9 19:57 testset_4_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5063548 Jun  9 19:57 testset_4_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5114276 Jun  9 19:57 testset_4_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5024460 Jun  9 19:57 testset_5_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4958632 Jun  9 19:57 testset_5_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5126353 Jun  9 19:57 testset_5_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4951333 Jun  9 19:57 testset_5_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5101972 Jun  9 19:57 testset_6_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4888836 Jun  9 19:57 testset_6_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4838496 Jun  9 19:57 testset_6_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5002980 Jun  9 19:57 testset_6_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5004919 Jun  9 19:57 testset_7_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5082047 Jun  9 19:57 testset_7_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5086383 Jun  9 19:57 testset_7_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4992398 Jun  9 19:57 testset_7_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4957263 Jun  9 19:57 testset_8_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4968412 Jun  9 19:57 testset_8_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4826095 Jun  9 19:57 testset_8_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5127167 Jun  9 19:57 testset_8_squiggle.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4888130 Jun  9 19:57 testset_9_narrowbanddrd.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4849225 Jun  9 19:57 testset_9_narrowband.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  4810512 Jun  9 19:57 testset_9_noise.zip
-rw------- 1 sd2d-634b36332a0fab-8605aaf2c6e1 users  5067000 Jun  9 19:57 testset_9_squiggle.zip

In [6]:
from __future__ import division

import cStringIO
import glob
import json
import numpy
import os
import re
import requests
import time
import timeit
import zipfile
import copy

from random import randint

import matplotlib.pyplot as plt
import numpy as np

import ibmseti

from watson_developer_cloud import VisualRecognitionV3

In [7]:
apiVer = VisualRecognitionV3.latest_version #'2016-05-20'
classifier_prefix = 'setisignals'

#You can sign up with WatsonVR through Bluemix to get a key
#However, Hackathon participants will be provided with a WATSON VR key that has more free API calls per day.
apiKey = 'WATSON-VISUAL-RECOGNITION-API-KEY'  
# TODO: remove before publication
apiKey = ''


Init the Watson Visual Recognition Python Library

  • you may need to install the SDK first: !pip install --upgrade watson-developer-cloud
  • you will need the API key from the Watson Visual Recognition Service

In [8]:
vr = VisualRecognitionV3(apiVer, api_key=apiKey)


Look For Existing Custom Classifier

Use an existing custom classifier (and update) if one exists, else a new custom classifier will be created


In [9]:
## View all of your classifiers

classifiers = vr.list_classifiers()
print json.dumps(classifiers, indent=2)


{
  "classifiers": [
    {
      "status": "ready", 
      "classifier_id": "setisignals_344356204", 
      "name": "setisignals"
    }
  ]
}

In [10]:
## Run this cell ONLY IF you want to REMOVE all classifiers
# Otherwise, the subsequent cell will append images to the `classifier_prefix` classifier
classifiers = vr.list_classifiers()
for c in classifiers['classifiers']:
    vr.delete_classifier(c['classifier_id'])

In [11]:
classifiers = vr.list_classifiers()
print json.dumps(classifiers, indent=2)


{
  "classifiers": []
}

In [12]:
#Create new classifier, or get the ID for the latest SETISIGNALS classifier

classifier_id = None
classifier = None

classifiers = vr.list_classifiers()

for c in classifiers['classifiers']:
    if c['status'] == 'ready' and (classifier_prefix in c['classifier_id']):
        classifier_id = c['classifier_id']


if classifier_id is not None:
    classifier = vr.get_classifier(classifier_id)
    print '\r\nFound classifer:\r\n\r\n{}'.format(json.dumps(classifier, indent=2))
else:
    print 'No custom classifier available\r\n'
    print(json.dumps(classifiers, indent=2))


No custom classifier available

{
  "classifiers": []
}

In [13]:
squiggle = sorted(glob.glob('{}/classification_*_squiggle.zip'.format(mydatafolder)))
narrowband = sorted(glob.glob('{}/classification_*_narrowband.zip'.format(mydatafolder)))
narrowbanddrd = sorted(glob.glob('{}/classification_*_narrowbanddrd.zip'.format(mydatafolder)))
noise = sorted(glob.glob('{}/classification_*_noise.zip'.format(mydatafolder)))

sq = len(squiggle)
nb = len(narrowband)
nd = len(narrowbanddrd)
ns = len(noise)

## Possible todo here: Try using the 'noise' as a "negative" example when training Watson. See the Watson documentation.

num = max(sq, nb, nd, ns)
#num = max(sq, nb, nd)

if classifier_id is None:
    print 'Adding custom classifier ... this may take awhile'
else:
    print 'Updating custom classifier {} ... this may take awhile'.format(classifier_id)

for i in range(num):
    squiggle_p = open(squiggle[i], 'rb') if i < sq else None
    narrowband_p = open(narrowband[i], 'rb') if i < nb else None
    narrowbanddrd_p = open(narrowbanddrd[i], 'rb') if i < nd else None
    noise_p = open(noise[i], 'rb') if i < ns else None

    if classifier_id is None:
#        print 'Creating with\r\n{}\r\n{}\r\n{}\r'.format(squiggle_p, narrowband_p, narrowbanddrd_p)  #use this line if going to use 'noise' as negative example
        print 'Creating with\r\n{}\r\n{}\r\n{}\r\n{}\r'.format(squiggle_p, narrowband_p, narrowbanddrd_p, noise_p)
        classifier = vr.create_classifier(
            classifier_prefix,
            squiggle_positive_examples = squiggle_p,
            narrowband_positive_examples = narrowband_p,
            narrowbanddrd_positive_examples = narrowbanddrd_p,
            noise_positive_examples = noise_p  #remove this if going to use noise as 'negative' examples
        )
        
        classifier_id = classifier['classifier_id']
    else:
        print 'Updating with\r\n{}\r\n{}\r\n{}\r\n{}\r'.format(squiggle_p, narrowband_p, narrowbanddrd_p, noise_p)
#        print 'Updating with\r\n{}\r\n{}\r\n{}\r'.format(squiggle_p, narrowband_p, narrowbanddrd_p)  #use this line if going to use 'noise' as negative example
        classifier = vr.update_classifier(
            classifier_id,
            squiggle_positive_examples = squiggle_p,
            narrowband_positive_examples = narrowband_p,
            narrowbanddrd_positive_examples = narrowbanddrd_p,
            noise_positive_examples = noise_p #remove this if going to use noise as 'negative' examples
        )

    if squiggle_p is not None:
        squiggle_p.close()
    if narrowband_p is not None:
        narrowband_p.close()
    if narrowbanddrd_p is not None:
        narrowbanddrd_p.close()
    if noise_p is not None:
        noise_p.close()

    if classifier is not None:
        print('Classifier: {}'.format(classifier_id))
        status = classifier['status']
        startTimer = timeit.default_timer()
        while status in ['training', 'retraining']:
            print('Status: {}'.format(status))
            time.sleep(10)
            classifier = vr.get_classifier(classifier_id)
            status = classifier['status']
        stopTimer = timeit.default_timer()
        print '{} took {} minutes'.format('Training' if i == 0 else 'Retraining', int(stopTimer - startTimer) / 60)

print(json.dumps(vr.get_classifier(classifier_id), indent=2))


Adding custom classifier ... this may take awhile
Creating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_10_squiggle.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_10_narrowband.zip', mode 'rb' at 0x7f867107b150>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_10_narrowbanddrd.zip', mode 'rb' at 0x7f867107b1e0>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_10_noise.zip', mode 'rb' at 0x7f867107b270>
Classifier: setisignals_1997353171
Status: training
Status: training
Status: training
Training took 0.516666666667 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_1_squiggle.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_1_narrowband.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_1_narrowbanddrd.zip', mode 'rb' at 0x7f867107b150>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_1_noise.zip', mode 'rb' at 0x7f867107b1e0>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 2.41666666667 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_2_squiggle.zip', mode 'rb' at 0x7f867107b300>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_2_narrowband.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_2_narrowbanddrd.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_2_noise.zip', mode 'rb' at 0x7f867107b150>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 1.2 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_3_squiggle.zip', mode 'rb' at 0x7f867107b270>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_3_narrowband.zip', mode 'rb' at 0x7f867107b300>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_3_narrowbanddrd.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_3_noise.zip', mode 'rb' at 0x7f86710f2f60>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 4.3 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_4_squiggle.zip', mode 'rb' at 0x7f867107b1e0>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_4_narrowband.zip', mode 'rb' at 0x7f867107b270>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_4_narrowbanddrd.zip', mode 'rb' at 0x7f867107b300>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_4_noise.zip', mode 'rb' at 0x7f867107b390>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 4.53333333333 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_5_squiggle.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_5_narrowband.zip', mode 'rb' at 0x7f867107b1e0>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_5_narrowbanddrd.zip', mode 'rb' at 0x7f867107b270>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_5_noise.zip', mode 'rb' at 0x7f867107b300>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 5.7 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_6_squiggle.zip', mode 'rb' at 0x7f867107b150>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_6_narrowband.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_6_narrowbanddrd.zip', mode 'rb' at 0x7f867107b1e0>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_6_noise.zip', mode 'rb' at 0x7f867107b270>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 6.4 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_7_squiggle.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_7_narrowband.zip', mode 'rb' at 0x7f867107b150>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_7_narrowbanddrd.zip', mode 'rb' at 0x7f86710f2f60>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_7_noise.zip', mode 'rb' at 0x7f867107b1e0>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 7.1 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_8_squiggle.zip', mode 'rb' at 0x7f867107b300>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_8_narrowband.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_8_narrowbanddrd.zip', mode 'rb' at 0x7f867107b150>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_8_noise.zip', mode 'rb' at 0x7f86710f2f60>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 7.95 minutes
Updating with
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_9_squiggle.zip', mode 'rb' at 0x7f867107b270>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_9_narrowband.zip', mode 'rb' at 0x7f867107b300>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_9_narrowbanddrd.zip', mode 'rb' at 0x7f867107b390>
<open file '/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/classification_9_noise.zip', mode 'rb' at 0x7f867107b150>
Classifier: setisignals_1997353171
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Status: retraining
Retraining took 4.5 minutes
{
  "status": "ready", 
  "name": "setisignals", 
  "created": "2017-06-10T01:06:36.345Z", 
  "retrained": "2017-06-10T01:52:17.424Z", 
  "classes": [
    {
      "class": "squiggle"
    }, 
    {
      "class": "noise"
    }, 
    {
      "class": "narrowbanddrd"
    }, 
    {
      "class": "narrowband"
    }
  ], 
  "owner": "0ce79092-a1b7-4922-b01b-dd39c5e1f415", 
  "classifier_id": "setisignals_1997353171"
}


Take a Random Data File for Testing

  • Take a random data file from the test set
  • Create a Spectrogram Image

In [14]:
zz = zipfile.ZipFile(mydatafolder + '/' + 'testset_1_narrowband.zip')

In [15]:
test_list = zz.namelist()
randomSignal = zz.open(test_list[10],'r')

In [16]:
from IPython.display import Image
squigImg = randomSignal.read()
Image(squigImg)


Out[16]:

In [17]:
#note - have to 'open' this again because it was already .read() out in the line above
randomSignal = zz.open(test_list[10],'r')

url_result = vr.classify(images_file=randomSignal, classifier_ids=classifier_id, threshold=0.0)

print(json.dumps(url_result, indent=2))


{
  "images": [
    {
      "image": "gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/png/86a3cde6-be85-4130-a2a7-d374c2fd16ff.dat.png", 
      "classifiers": [
        {
          "classes": [
            {
              "score": 0.625134, 
              "class": "narrowband"
            }, 
            {
              "score": 0.471323, 
              "class": "narrowbanddrd"
            }, 
            {
              "score": 0.154072, 
              "class": "noise"
            }, 
            {
              "score": 0.057637, 
              "class": "squiggle"
            }
          ], 
          "classifier_id": "setisignals_1997353171", 
          "name": "setisignals"
        }
      ]
    }
  ], 
  "custom_classes": 4, 
  "images_processed": 1
}


Run the Complete Test Set


In [18]:
#Create a dictionary object to store results from Watson

from collections import defaultdict

class_list = ['squiggle', 'noise', 'narrowband', 'narrowbanddrd']

results_group_by_class = {}
for classification in class_list:
    results_group_by_class[classification] = defaultdict(list)
    
failed_to_classify_uuid_list = []

print classifier_id

results_group_by_class


setisignals_1997353171
Out[18]:
{'narrowband': defaultdict(list, {}),
 'narrowbanddrd': defaultdict(list, {}),
 'noise': defaultdict(list, {}),
 'squiggle': defaultdict(list, {})}

In [19]:
# locate test archives that were produced in step 3 and add them to the test set
test_set = []
for classification in class_list:
    test_set = numpy.concatenate((test_set, sorted(glob.glob('{}/testset_*_{}.zip'.format(mydatafolder, classification)))))

In [36]:
for image_archive_name in test_set:
    image_count = 0
    # count number of images in <image_archive_name>
    with zipfile.ZipFile(image_archive_name,'r') as image_archive:
        images = image_archive.namelist()
        image_count = len(images)

    # bulk classify images in <image_archive_name>
    with open(image_archive_name, 'rb') as images_file:
        print 'Running test ({} images) for {}... this may take a while.'.format(image_count, image_archive_name)
        startTimer = timeit.default_timer()
        classify_results = vr.classify(images_file=images_file, classifier_ids=[classifier_id], threshold=0.0)
        # print(json.dumps(classify_results, indent=2))
        # identify class from ZIP file name, e.g. testset_10_squiggle.zip
        mo = re.match('^(.+)_(\d+)_(.+)\.zip$',image_archive_name.split('/')[-1])
        classification = mo.group(3)
        resdict = results_group_by_class[classification]
        passed = 0
            
        for classify_result in classify_results['images']:
            pngfilename = classify_result['image'].split('/')[-1]
            uuid = pngfilename.split('.')[0]
                
            maxscore = 0
            maxscoreclass = None

            if "error" in classify_result:
                # print error information
                print classify_result
                #add to failed list
                failed_to_classify_uuid_list.append(uuid)                  
            else:
                classifiers_arr = classify_result['classifiers']
                score_list = []
                for classifier_result in classifiers_arr:
                    for class_result in classifier_result['classes']:
                        score_list.append((class_result['class'],class_result['score']))
                        if class_result['score'] > maxscore:
                            maxscore = class_result['score']
                            maxscoreclass = class_result['class']
                            
                #sort alphabetically
                score_list.sort(key = lambda x: x[0])
                score_list = map(lambda x:x[1], score_list)
                        
                if maxscoreclass is None:
                    print 'Failed: {} - Actual: {}, No classification returned'.format(pngfilename, classification)
                    #print(json.dumps(classify_result, indent=2))
                elif maxscoreclass != classification:
                    print 'Failed: {} - Actual: {}, Watson Predicted: {} ({})'.format(pngfilename, classification, maxscoreclass, maxscore)
                else:
                    passed += 1
                    print 'Passed: {} - Actual: {}, Watson Predicted: {} ({})'.format(pngfilename, classification, maxscoreclass, maxscore)

                if maxscoreclass is not None:
                    resdict['signal_classification'].append(classification)
                    resdict['uuid'].append(uuid)
                    resdict['watson_class'].append(maxscoreclass)
                    resdict['watson_class_score'].append(maxscore)
                    resdict['scores'].append(score_list)
                else:
                    #add to failed list
                    failed_to_classify_uuid_list.append(uuid)                
           
        stopTimer = timeit.default_timer()
        
        print 'Test Score: {}% ({} of {} Passed)'.format(int((float(passed) / image_count) * 100), passed, image_count)
        print 'Tested {} images in {} minutes'.format(image_count, int(stopTimer - startTimer) / 60)
        
print "DONE."


Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_10_squiggle.zip... this may take a while.
Passed: a41e55a9-c018-4f04-adc9-95b7b4a26a2e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968129)
Passed: 13be283b-e718-41b3-9704-5312a112148b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971797)
Passed: 534d63a8-2689-4807-803b-c4b17c43ab53.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.930251)
Passed: c9e68f0e-8456-4db0-9266-a033038e6a0a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962804)
Passed: 174e0a2f-0504-4394-bdd7-c623a79f5ffd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.934021)
Passed: 7b31f440-b62f-4d83-94dd-e6c9890c46b5.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.920926)
Passed: e9074c19-aa06-4d89-bece-2a82e16b7509.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.869588)
Passed: e08a1875-12b3-4c87-bc73-231d977f4966.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974204)
Passed: cf606038-88d1-44cc-9971-29d3d8da4446.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962925)
Passed: 25f3939c-9215-472e-a0c4-1b6e8766936b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972874)
Passed: dab31c51-cd94-47a5-bcf4-4479579b565b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.953241)
Passed: 3baf84b0-c489-40c8-8203-b7c0e5ec9a21.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.892753)
Passed: 72710c56-cec7-4cc9-b3a9-369044012356.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972046)
Passed: 5e799670-cde4-4d65-8a08-54f53396cb02.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.93706)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_11_squiggle.zip... this may take a while.
Passed: e38d6c70-6c6a-43da-82a8-10f5e1647624.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969929)
Passed: 6d1b0036-5658-4cf3-861a-687983472804.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967279)
Passed: 4958c0a2-fad8-4904-8d5a-8e75ee4013b4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959361)
Passed: cd90e133-4bbd-49d1-837d-0906507e4129.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.960319)
Passed: ad0aed19-e17e-4288-a2ba-acd666d69465.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968918)
Passed: 600a5176-94ba-4b5f-bb2f-847086bc7fb9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973989)
Passed: ec953af4-5a56-48e1-a881-870a626bf4c4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.874414)
Passed: 1b8ba1c7-c778-4e61-b3a5-1403d803b5dd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.78708)
Passed: 6f2dbd4e-27b2-4fbe-b090-57e16cdebdbb.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962843)
Passed: 0ef517da-e401-48bb-9bb2-2aac702cd07d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.95369)
Passed: d4454b36-ef9c-4788-9890-1ac4843b1354.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967552)
Passed: 883bb00d-6b6d-45fa-bb8b-ae589e7ac251.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968756)
Passed: 1b4556b7-4dd0-4c0d-88b8-1559be939f7d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965252)
Passed: 7299ab41-68fe-4a08-8f0c-0d2fb7cdb4aa.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973405)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_12_squiggle.zip... this may take a while.
Passed: 417e00d7-4df6-4165-b07c-dd5f36f0ba63.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.924316)
Passed: a54d1a61-0111-475f-8ba9-d8d479e90b98.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966855)
Passed: 423faebb-5fc2-4a07-b47d-b6cef3bd8255.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963815)
Failed: fa37e3d6-0ffc-4d0b-9691-0f161c3d5990.dat.png - Actual: squiggle, Watson Predicted: narrowbanddrd (0.692459)
Passed: d2de3445-d4f5-4477-a79e-7b0d4d0bc6ad.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958839)
Passed: aa154372-161a-4d3d-a539-cf9d8f8d22af.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.961723)
Passed: 8fcfe7d3-f4ba-4bbb-972c-1ac94b916163.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.964974)
Passed: 9f569985-bbd7-4195-bdde-0c5730594828.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973078)
Passed: 8a18698a-da18-4e51-98c7-0b44350d36cf.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.819155)
Passed: 93b2c443-f223-4fb6-9648-a6bc576fb24a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967825)
Passed: c5ed02e0-92c2-45b1-9dd5-a88c697a5466.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974392)
Passed: e5ec6910-fe38-4994-af28-68e19d5a5025.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.953165)
Passed: eb36435f-565d-4c4a-a99b-2523933a2dec.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.893081)
Passed: 62a02d40-282f-4fb0-b118-7628591f9d78.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968549)
Test Score: 92% (13 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_13_squiggle.zip... this may take a while.
Passed: ab71f60e-2aa3-475b-ab6f-6efdad252a88.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971971)
Passed: f4bc26e1-ac4d-4293-a8b8-c3c9a57e2006.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.891287)
Passed: 509fe981-b6b6-4986-a917-685b3a4d8e4e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96751)
Passed: 0263d3d5-531a-412b-8c44-bded066adb14.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966667)
Passed: fdb0e9c1-0bef-49a1-a767-07eba79470fb.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974354)
Passed: d0b6ea0e-1b07-4b30-887e-dbe06841346d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963816)
Passed: 0ee5a1fb-b5a5-464c-953f-5ab8faefc552.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973279)
Passed: b47ec6a4-a4a9-4d38-aac6-33416df9d1b1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.949129)
Passed: ed3a1f25-d33a-4fb0-81c3-2fe7ba55dafc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.92482)
Passed: 4e020e83-5c2e-464a-a9d0-915c8f5db8d4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.950851)
Passed: 7197c169-413f-4e48-b3e9-e4f289c9ea36.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974232)
Passed: 62972e7e-86e1-4282-af2f-329a78a6e7c7.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.961671)
Passed: 050e3a4c-0a35-4171-8a1e-27315fba3e0d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.774959)
Passed: bcf7c231-c6e6-494e-a979-14a887c9aa17.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958105)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_14_squiggle.zip... this may take a while.
Passed: 77620c45-479f-4688-a331-37a285b8bba1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.909112)
Passed: 874964b3-4ce5-4a91-b89f-c9af4dca1016.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.960904)
Passed: f54837ab-d2f6-4c28-a816-ca760d1acab1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.928815)
Passed: c264521f-2265-4102-bc6c-1b10840f3aee.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.77074)
Passed: 5fe231f4-427c-439c-81fd-666a729f5f48.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972059)
Passed: 7f4ae9a7-e7c4-4335-8c15-884f6bc3b694.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.954483)
Passed: 655915d6-8576-4ee5-9d93-c919302a0ff2.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965672)
Passed: e16b3d30-e515-47ff-a27a-c798354fa63a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962945)
Passed: cbfb0826-e6a9-49f2-8f1b-9e94c15e52fc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959438)
Passed: 303c7aa5-4661-411a-bd21-61f423657776.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966042)
Passed: 27e38771-433f-4e33-bf11-4b32873ea349.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.964899)
Passed: 0a6861e1-4ff6-45b1-b5a8-c02a533ea2ee.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966334)
Passed: 24cc63f6-cea3-4954-a1e7-2e39fffbcc31.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.882036)
Passed: b11a9e2d-48d5-4f8a-b2e9-42a76c6ac7f7.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970725)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_15_squiggle.zip... this may take a while.
Passed: 931a3aa6-f323-4178-bba1-cad7040a6d76.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.9647)
Passed: bf9c77e7-40d4-4fd2-a69a-75edc3d930bb.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.924537)
Passed: b48da995-8015-4e65-a935-8e44f40c3745.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968985)
Passed: 9846d4c1-0836-4d87-99c3-0af87dd6c3e3.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957018)
Passed: a3782996-963b-402f-b920-052f4cf741af.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966044)
Passed: 98faebf6-8cf9-4f3d-afaa-001b724059ca.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974809)
Passed: 70aec524-28cb-406e-a5e9-ce20de92e41b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.896115)
Passed: f6fd7a0b-c6dd-4f04-ac5e-3315426e7db8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957797)
Passed: 609d78f4-5b3d-428d-9427-1fcab9b33604.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970221)
Passed: 22a3b532-f01e-44a5-8960-27dd0ba47b84.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973614)
Passed: 84cf2032-1527-4cf0-8498-125f5baa1c5e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963028)
Passed: 5343c2d2-bc58-4bf8-8e0a-5bd3bf203ded.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.843869)
Passed: f9018f49-5e93-4ba4-8de7-de9d53136cfc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966601)
Test Score: 100% (13 of 13 Passed)
Tested 13 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_16_squiggle.zip... this may take a while.
Passed: 4598a286-34c0-4f13-9ee0-87bdf2b361fe.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965855)
Passed: 787c39fc-d65a-4dff-a59a-48f73976402f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.871967)
Passed: f3a14e5c-73f1-4ab8-8cb3-561339d035de.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967564)
Passed: a98d43c4-0362-4a88-b234-6b9c9f160905.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.82145)
Passed: 3f35b6b4-f963-4f83-84e1-ac221f4998c9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.77255)
Passed: 7b7a162d-9562-41d8-9dce-3d81a624b4b4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96265)
Passed: 20f7760f-b699-4a86-930f-389c2aa0f154.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96704)
Passed: 976a80d2-2966-4232-acff-1ae1b7209578.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.911097)
Passed: eb1eedd5-1021-4905-87b7-c4d363275458.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973011)
Passed: e3cf0373-a336-4c1b-a20d-6aaf75758b69.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968535)
Passed: 4ab2bc49-5b8c-4535-a52e-ac82ef63b732.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965648)
Passed: b7c1dc56-0f50-4779-b65e-2068d66c38a8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973264)
Passed: c937fac5-e2f0-4efa-8589-2adeacce3c5c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972627)
Test Score: 100% (13 of 13 Passed)
Tested 13 images in 0.15 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_17_squiggle.zip... this may take a while.
Passed: 8bb5fa05-6e19-4bb6-93d5-508d43452eaf.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974642)
Passed: 3c810e54-2c10-4a02-9251-b961c599c7df.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972293)
Passed: 02dc90d2-ffea-4b54-b0f5-bca10844f757.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.944261)
Passed: 3432abfe-f899-410b-86ab-11613456e0ad.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972688)
Passed: dd12a6ee-99f2-490b-942f-eac012e572f6.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.910706)
Passed: 44099811-9832-4c48-b902-9995ef99b38c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963507)
Passed: b2db9fad-6149-48e5-bd64-01fcf02ca6f4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966203)
Passed: f0f79111-5dbb-4ff2-8b86-d90e472073d0.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965492)
Passed: 0fb1b345-e771-474e-809f-a849b41548b4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.914311)
Passed: 2c9cbf5a-95f8-4ad8-bb63-6840fe7e6d2f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970504)
Passed: b66f57f2-aaaf-4608-9ced-cdcfe5483364.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.97227)
Passed: 8fa516f4-73dd-4a36-8457-394dbcac8e33.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970856)
Passed: d018a62b-a4ad-4fc2-9a27-6e0a42d1e2d3.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.94588)
Passed: 5808065e-06e4-4493-8c83-3092760fc159.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.948258)
Passed: c5c37845-68be-43e2-863c-2d65053b4d2d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974078)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_18_squiggle.zip... this may take a while.
Passed: 794734ba-2d1e-496b-9343-b01b67c40ba4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962969)
Passed: 3297b81a-4513-4c10-b0ba-dfa14a242be7.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.81621)
Passed: 57ccd8c8-bc5a-43bf-856d-58399d243101.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.97324)
Passed: ee4bde2e-3ed0-41b0-ab96-7e9f6d07ca7c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968219)
Passed: 04dc75c3-0bef-4456-8d58-43e22a85eb64.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973108)
Passed: fb620240-fa4c-405c-9ff9-d15c1237caf3.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.954831)
Passed: c43af4da-65d6-488d-bae6-c623867d4d14.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970418)
Passed: e3449cb7-dd79-4b5b-96aa-7685d1e4183a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969432)
Passed: d679ceaf-c7bc-4d2d-920e-c2e09851e838.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.8792)
Passed: d72a2868-f795-48d5-9c8e-1408df5e287b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973063)
Passed: c76944be-7fbc-4d3b-99f0-6413e58daf2d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.97178)
Passed: 0ac854ea-bf34-4c13-9094-62ec07458034.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968188)
Passed: 2cc9a3cf-4b62-42ab-9fc6-d1ce1d7a1e77.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.955646)
Passed: dca48f58-70e6-4673-b121-acf0b4011720.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.919584)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_squiggle.zip... this may take a while.
Passed: 8d9adc5e-e8e5-4e36-97d1-18ad52845bea.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970221)
Passed: 97a69313-71ea-4e39-a18a-6bda7ca5fe89.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963865)
Passed: 05f512a2-147e-4013-9ef0-318d184f87a2.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970448)
Passed: a99cf37c-82b8-46d0-853b-9ce60c8e33c6.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.924092)
Passed: e8054648-b18d-48f3-84df-6aa91b3ec331.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974126)
Passed: d387c7ca-0639-4b35-a248-515095753059.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.941196)
{u'image': u'/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_squiggle.zip/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/png/e0cb0212-d7d7-43b1-a0af-821fee1cae9b.dat.png', u'error': {u'error_id': u'server_error', u'description': u'An undefined server error occurred.'}}
Passed: 3e5e68a1-49bc-4c00-99cb-b5ba7fe0f9f5.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.960138)
Passed: a8d64f69-ecfc-4718-8bfd-abd27f0eef08.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96575)
{u'image': u'/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_squiggle.zip/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/png/994d2547-88d4-48e6-8551-e74eaaadb33a.dat.png', u'error': {u'error_id': u'server_error', u'description': u'An undefined server error occurred.'}}
{u'image': u'/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_squiggle.zip/gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/png/d0d9ee29-020a-4417-ab8a-99db2f68e3e3.dat.png', u'error': {u'error_id': u'server_error', u'description': u'An undefined server error occurred.'}}
Passed: 7583509f-5507-4115-8fa0-07675683321a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.952011)
Passed: afc734e1-4f20-4e8b-b5f7-60472ec93c31.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958473)
Passed: e441775b-70ff-42ee-bc6f-c26cf5a9d548.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.961957)
Test Score: 78% (11 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_1_squiggle.zip... this may take a while.
Passed: 7cb82a42-82f7-49e1-8198-34b30546760d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970035)
Passed: d8c11f4b-45e5-4d37-a13f-c3f5827ab1cb.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.964051)
Passed: 7887dc9a-fac7-47bb-a9fe-4b38c384ba2b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.756071)
Passed: 5cd78334-60a7-4d07-8a44-a0c9cf79b903.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.95244)
Passed: 88dba5e6-dfec-4bb2-a84a-18b3d078fb05.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.894522)
Passed: 039d2b8d-a768-4504-aba5-bcc4e68f37bd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.904056)
Passed: 13d3142a-e27a-41bd-baa7-2904ae93db5e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958524)
Passed: 38be0e35-1a25-4583-bb10-ae21ed0a3633.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958403)
Passed: 0cda11cb-3eda-46bf-9342-59bfa66b3d09.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971062)
Passed: 7e7ddb49-d2d3-4262-83a2-4124f6d3b0f9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959297)
Passed: ca02085d-92fe-49fb-98f4-ccf8cf01d893.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96829)
Passed: 90342f17-af57-4ea2-b0b6-e30191302267.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973799)
Passed: de12fc35-e0b2-4c71-80db-d15512d7e125.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.97362)
Passed: 3fbd4b2e-460d-4375-a880-d3332e2b59b8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.878246)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_20_squiggle.zip... this may take a while.
Passed: f03683cb-a12b-46e5-9ff2-67af124e70e9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.954923)
Passed: 417fb305-7ba9-43e8-acdd-b1462919e2ec.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.960538)
Passed: e0cff2bf-7b19-41b9-a59a-d66829b475be.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971921)
Passed: 7ff887e5-a172-4bcb-8921-0a1b3921033d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.918518)
Passed: d4dd3469-2070-4dac-9a72-e8f1b08a3b63.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.92506)
Passed: b1a0e208-9366-4964-b91a-85bba4cb563f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.954184)
Passed: 91bb27c2-448e-42e7-9709-a7396a70981b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.947088)
Passed: 6be5b161-2baf-458e-84a1-0c2ac07d1047.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.949536)
Passed: 50347ad9-1e08-4e81-af6b-9ff200f6ef3c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.882896)
Passed: 81215657-a08e-4df6-90b2-4531e7d70520.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973612)
Passed: f9fc0623-5506-4e8c-aa4f-6becae520de4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973986)
Passed: 53a3cbd7-d9c8-4197-a1dc-530101efa6ea.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973291)
Passed: 68ee9508-d5bd-4411-a74e-9aa8e889b0a1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967262)
Passed: bf4d4422-5ae6-45bd-8358-9b3317fd8526.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.943572)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_21_squiggle.zip... this may take a while.
Passed: 9a5575f9-9f09-49ce-88c3-a6ea74b8a958.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.832915)
Passed: ed2b0804-4911-46e2-b6fc-4fe307e137ab.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957354)
Passed: 54fd0346-00f6-42c4-9097-aa78ee27500f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967367)
Passed: 641df498-db1a-4aa6-9c70-ba0314f225ef.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.835709)
Passed: 9803a09b-0503-4bd3-9dbb-37f0f405ac88.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970391)
Passed: 611a7031-900a-41e6-a47d-c4a0764ec42f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971274)
Passed: d81bcb04-c968-4a85-8968-7b57a137a697.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.964285)
Passed: 4ab7e5ff-c0ad-4bbc-b754-288a074c9b9b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.923045)
Passed: 20594160-d72b-472d-95bc-3e6f695fbc40.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971454)
Passed: 8c191145-71ba-4a60-9574-4b79e6422acc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971205)
Passed: 284d21fb-9e08-4e47-b057-2f1c5bed5dd7.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970007)
Passed: 573fd533-b9d7-438f-a743-7808345740b0.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968643)
Passed: 8470806f-9150-40ec-b80d-a4a1fa54e37f.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.947308)
Passed: 1ac1f4f0-bb3f-4d1d-a54c-46440a1d7141.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962728)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.133333333333 minutes
Running test (4 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_22_squiggle.zip... this may take a while.
Passed: 1e5339f8-8ed0-4b4b-8001-8d93a4e51949.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.942511)
Passed: 1c396696-baac-418b-9c14-bd798172ac61.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972043)
Passed: e382aa1f-5d2d-492e-9a11-3f5cda4e7815.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971011)
Passed: ee3157b9-2d7f-45c5-9e5b-596921d6352d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.943083)
Test Score: 100% (4 of 4 Passed)
Tested 4 images in 0.0333333333333 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_2_squiggle.zip... this may take a while.
Passed: fe57b37a-f68e-4ea9-889f-7e8bf6db3be2.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.961903)
Passed: 1764f993-6250-4bb7-a6ac-653d380bf061.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974981)
Passed: 7320a2a1-4b4d-450d-87c8-d7d6bd9f5328.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968204)
Passed: 59a7e92b-4c64-455d-ad82-f0ad8c01f1bd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968151)
Passed: 1ad673fa-4121-4d00-ace0-3efce6c99ea4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969663)
Passed: 6647cdd2-0225-487e-9313-80223d37ec88.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971265)
Passed: 234b03a8-0ea1-4fd7-97b4-762369e43ca3.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958435)
Passed: 50e6a8ec-a4f5-47a9-88c5-5eda344ef92c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968439)
Passed: 0beeb681-7821-4091-9c74-44e560f0e723.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963043)
Passed: a1aac746-98a3-42ed-a593-786eb6d5fc37.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.950116)
Passed: 3914f0c0-1bda-43ae-ae75-b7ef04479774.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.640242)
Passed: 7cee04d4-4b1a-4338-ae2b-93c6801ebde9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965201)
Passed: 71142ad2-cffe-485f-8cad-aa067d849872.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972359)
Passed: 4b8d8f6e-4e32-4b3a-bde2-e799a03c4998.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962248)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_3_squiggle.zip... this may take a while.
Passed: 3df47b07-6ec4-4402-b098-9ae400e18675.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.93294)
Passed: 8787c1d7-8baa-4963-9b23-3b499f78d378.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968531)
Passed: 18d3530c-e7d8-4565-8acd-b812ba9d9b92.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967099)
Passed: 2656f1a7-b9e6-450b-9596-06a45db47d8a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.807177)
Passed: acc0fb10-4356-47b2-828f-41b42b2dc915.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.949525)
Passed: 9def142d-d4c7-4d72-8549-b52934fb7234.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959133)
Passed: ab9ac582-120c-4fec-bac5-05c847b60db4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958457)
Passed: b17ff609-0092-4b2e-aef5-c71a45348f91.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966965)
Passed: 2042819b-a881-4f14-8cca-3ca1e4f5934b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.92666)
Passed: b5012557-2af6-45c9-89cc-fe9093279a65.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.928852)
Passed: a9ef4f31-6375-488c-9596-a9816809a582.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.898587)
Passed: 7af465a5-160f-4828-b8be-bc32552aaf2e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972868)
Passed: d4c3c008-d9b5-4161-aafe-fbd1e1625341.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.950423)
Passed: c61b6f22-ae74-475e-856e-f707d2466265.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.956593)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_4_squiggle.zip... this may take a while.
Passed: 5bd33b2f-1705-4529-8a7b-e6f1260841f8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974147)
Passed: 34128845-76c8-4bb4-a74f-df3349bbfa4e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.929623)
Passed: ed928f76-0c8f-4876-8142-a273e361151a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957984)
Passed: 27e2acf2-1d37-405b-8d19-0c682c92bf1d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971559)
Passed: f5a50d2b-247e-47e6-bc24-cff02c53de7d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969978)
Passed: b0c4274d-3587-4b12-acbd-48c2106f744d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972068)
Passed: b84f9eec-b3de-42cf-afdc-18d5b1ceeb99.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968041)
Passed: bbbb85b1-77c8-4be1-883d-a6add1f7001e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969448)
Passed: 84473a09-8698-4f10-be07-0e3a716eae9d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96041)
Passed: 8be2711a-6188-4020-8e99-321351ff2b60.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972413)
Passed: 2798507a-857a-47cb-bc6f-9d7d10945c1e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959688)
Passed: 0e3948e6-0ce0-4362-b6b2-e9c5db351507.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968593)
Passed: 7e1d9b18-c9a9-4bef-9d5f-f90f86baa1fa.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.944483)
Passed: a007d262-c656-4517-9a37-0d52b9bf0c4c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958636)
Passed: 062416d2-7556-489e-9c96-036559ed727b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96599)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_5_squiggle.zip... this may take a while.
Passed: 0810bb1c-2d35-4aa7-85f2-4be7e17e74de.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.500697)
Passed: 65ee4959-225b-448c-8e2a-33a905451f0c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.953543)
Passed: 4df9aeab-c339-4be9-aeca-2fcea1dade0d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.786448)
Passed: 55420a45-10f6-4cf0-a966-031a19e37c90.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969622)
Passed: b06e3bca-e2ce-48e4-97c5-76cb5780ff2c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.956137)
Passed: cc30be5f-afbe-4c88-8f9f-acaf891aa8f9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.9628)
Passed: 202fde10-dfd6-4716-8cdc-d75154753739.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96645)
Passed: b086dcf9-0958-4949-b26b-9b0132f89f56.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971693)
Passed: 2a387105-b3c7-40ba-8ff9-cf78c6259085.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972202)
Passed: a726574b-853a-4b04-a982-5d500c2bc660.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.97137)
Passed: 34cb2333-89d8-4ecf-9d0d-fc596fc92db7.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.967123)
Passed: 2556fcfa-2909-458e-b67f-ff87ec04d543.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970477)
Passed: 9e1bb6b2-23e5-4df8-b974-bcffabdb5b8a.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.942898)
Passed: 75686d48-d9e1-46a5-b0f6-1cb9f8200091.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966978)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_6_squiggle.zip... this may take a while.
Passed: b83bed37-ae21-4638-a4b7-0514408f5c62.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969679)
Passed: 5f67f1ba-453b-49f8-85f3-19af8ecc9b95.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.853591)
Passed: 834203c0-46c7-4199-a22e-a7df21850b4b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958689)
Passed: 77f095b9-3170-4653-84a1-ea77d45bc49c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.916597)
Passed: 43332ceb-9ee1-4f5e-a756-0515952b5431.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.918121)
Passed: ed92a8dc-d671-4b77-b31f-724c17dbd061.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.96674)
Failed: 1f1c2c27-2876-4b13-bd15-80386064b31e.dat.png - Actual: squiggle, Watson Predicted: noise (0.475823)
Passed: 92ace734-83eb-4b5a-bbf8-64e86643d0a1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962055)
Passed: 5d5771ea-18a2-4cc5-b3c4-80cd927d44c5.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.939411)
Passed: 825e5587-1610-470d-92b9-956b51fcfc91.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971376)
Passed: e409e8b1-92a2-420b-8460-4ba0ac63d373.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.960137)
Passed: 5fe29382-9437-46b7-94d8-221b94a0780d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.966823)
Passed: f7de0ab3-6503-48e0-9074-b7aeddb30f1d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.566948)
Passed: 5e17856d-07d6-49a9-a0c2-bb29022c6add.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957801)
Passed: c14d0f8f-c588-481b-9faf-e1a0a500bf03.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972998)
Test Score: 93% (14 of 15 Passed)
Tested 15 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_7_squiggle.zip... this may take a while.
Passed: 466e3807-e67d-4d74-bf1b-33311d794958.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.948182)
Passed: dceb8cbc-48fe-4f45-a3b2-b0c24a77ffcc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972742)
Passed: 78bfacd6-0d97-4fca-b7d7-ddcd9dda79de.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.938203)
Passed: 4a476143-137c-4dd3-a41f-40582b7228f6.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.870366)
Passed: d60cbfe7-1c40-4f02-979f-4f58e5a8d8c8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972695)
Passed: fcde0803-9e84-4bd1-bbdc-351efe7b27dd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973064)
Passed: c24c9f53-98e5-4ba4-bab8-67682cced224.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969242)
Passed: 515219d8-f1d2-4b56-84b7-f03b8d0eaebd.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.973768)
Passed: f622eb68-b555-4d08-9745-11a7480ac15e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.965393)
Passed: 285b681e-1ad0-4332-930e-329820c5fdf1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.886573)
Passed: 0465d61b-2a2a-4177-93e7-a49398b6c4e4.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.95935)
Passed: 0f00d8cc-3e42-49d9-8bc7-d82fb3ec4625.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.963617)
Passed: d2ea7edb-4e7f-46c6-b829-a9a5ea5dee76.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.867419)
Passed: 577ea33a-edd5-4720-8915-78f7811c9c29.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974698)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_8_squiggle.zip... this may take a while.
Passed: 5532ed42-7770-4ae5-84f0-55c2cee8a667.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969113)
Passed: e3f4b053-9bd1-4629-83ca-695246927e39.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.933665)
Passed: fba02404-a065-4a19-9102-b91671ad2499.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.958853)
Passed: 96ddb6a4-eaf8-46c9-b679-025fc7f96a18.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.968997)
Passed: 7a3c3b2d-286c-41f7-9142-2f9520ca2caf.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.962471)
Passed: 21c412c0-6f85-4dfc-a332-aa2df8e41fd9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969443)
Passed: d7ebc047-b90c-4489-bc78-b5db4b86a262.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.869905)
Passed: 46069cb0-7300-4e90-b122-b3abe7c92227.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.957545)
Passed: 23ce752b-26c0-430e-96ed-3de671d1bda6.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.930239)
Passed: cbe0d7d4-8b80-4c47-b4ce-99a3d6571d4e.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.934277)
Passed: 77107e6c-65e0-492e-a994-02ede07f0d3b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.959053)
Passed: 7dd694b7-0f4f-4510-adf7-cbec3b210bd9.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.945614)
Passed: f0461f3f-269a-4453-aa54-f363d620ecdf.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972629)
Passed: 874fec03-6134-459f-9bf8-efed9c0e8c07.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.935835)
Passed: bf555318-3f3f-4503-89d2-54b899b41bf0.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.580043)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_9_squiggle.zip... this may take a while.
Passed: 41b6d1f9-78b6-4dbe-872f-502bc867eb4c.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974018)
Passed: 33e66bd3-0bde-4558-8a65-1a4184525d11.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.93411)
Passed: 6c77e429-d0a4-4abf-8c2d-71f98ccb6c8b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.876756)
Failed: 8dd7e1d3-d030-43b4-bc72-38764edcf8b1.dat.png - Actual: squiggle, Watson Predicted: narrowbanddrd (0.84497)
Passed: 78bbf8d3-d4d9-42ca-ab26-e487e29e8a26.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.906745)
Passed: 88b5b627-c508-4279-8729-a1853b57c7dc.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.929914)
Passed: 26b7bc35-46e5-4c7a-8155-1212f65929eb.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971244)
Passed: a84999b6-8e0b-4f59-a05c-69981cd17bc1.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.971628)
Passed: 35a22155-cc90-4356-bfed-a165a67ff579.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.969003)
Passed: f6ac9460-f31d-4c12-9883-de4615366a65.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.974109)
Passed: 76f3d2d8-588d-43eb-bca0-e1b6e9631d85.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.970085)
Passed: 6bcb9648-b4da-443a-9e6a-eb26acdf082d.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.972966)
Passed: 21e23aed-5376-4c08-b398-d17e7ace2fb8.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.803063)
Passed: 4f263793-8d94-416a-94e8-701d88a8429b.dat.png - Actual: squiggle, Watson Predicted: squiggle (0.931037)
Test Score: 92% (13 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_10_noise.zip... this may take a while.
Passed: c1bf18dc-12b3-4477-953a-82541784234e.dat.png - Actual: noise, Watson Predicted: noise (0.934783)
Passed: ca90a9ff-c6dc-4bee-b8f9-5c3ce222f177.dat.png - Actual: noise, Watson Predicted: noise (0.903579)
Passed: b0496195-4ca0-4837-9b76-607a4601ce07.dat.png - Actual: noise, Watson Predicted: noise (0.835971)
Passed: d0aa7a4d-ec85-4ec8-b02c-055ea4f75cea.dat.png - Actual: noise, Watson Predicted: noise (0.933381)
Passed: ea0d3003-4848-4a76-8041-8a1dfa8e1177.dat.png - Actual: noise, Watson Predicted: noise (0.924419)
Passed: 443a8f18-4401-4771-81a7-0773d9b10e17.dat.png - Actual: noise, Watson Predicted: noise (0.926131)
Passed: 3adc4a57-cc63-44ed-9917-fd1c51c79f81.dat.png - Actual: noise, Watson Predicted: noise (0.925429)
Passed: 11753e8e-4cba-4879-b02c-ce9198de171d.dat.png - Actual: noise, Watson Predicted: noise (0.937234)
Passed: 0b883dcd-1cd3-4bd7-b831-f667279f9072.dat.png - Actual: noise, Watson Predicted: noise (0.920911)
Passed: e92e322d-96af-428c-b6c6-8b579ca0e95b.dat.png - Actual: noise, Watson Predicted: noise (0.906582)
Passed: a0e659fe-d0a9-43c6-9560-7532325920e1.dat.png - Actual: noise, Watson Predicted: noise (0.920129)
Passed: aa94c86e-2e1b-4d23-b5f1-8b69fc40044d.dat.png - Actual: noise, Watson Predicted: noise (0.878682)
Passed: 50cdc5c9-2d3f-4f38-a018-1cf7b87e9f59.dat.png - Actual: noise, Watson Predicted: noise (0.895277)
Passed: 462d549f-8c41-4b63-9c9f-1355412b78d5.dat.png - Actual: noise, Watson Predicted: noise (0.913923)
Passed: cfc6d87b-ebd0-4cd5-a18a-1e5aec13346b.dat.png - Actual: noise, Watson Predicted: noise (0.788052)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.133333333333 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_11_noise.zip... this may take a while.
Passed: 5634e09e-da8f-4e0b-881b-998bf916ec94.dat.png - Actual: noise, Watson Predicted: noise (0.880303)
Passed: 851c24cc-2a33-4b67-9413-eff35ff1cac6.dat.png - Actual: noise, Watson Predicted: noise (0.893112)
Passed: c96a242e-aaac-4407-9bf0-58ce6a5529b7.dat.png - Actual: noise, Watson Predicted: noise (0.904871)
Passed: 815cd9a7-9a44-419a-9c0a-5764665cd7cf.dat.png - Actual: noise, Watson Predicted: noise (0.939732)
Passed: f6050435-3cca-4218-8a65-5ed1d35a638f.dat.png - Actual: noise, Watson Predicted: noise (0.941136)
Passed: d39a5219-2ccd-48ae-ab5b-0175773f73ca.dat.png - Actual: noise, Watson Predicted: noise (0.93729)
Passed: b30fc6d2-96f1-4c71-9a7c-471e56dc2ed9.dat.png - Actual: noise, Watson Predicted: noise (0.945693)
Passed: 613189fe-ac6b-40a9-95a1-6dd1112726c6.dat.png - Actual: noise, Watson Predicted: noise (0.728142)
Passed: 23415db2-303b-4933-ab77-5a5bb1417a47.dat.png - Actual: noise, Watson Predicted: noise (0.895461)
Passed: 01718726-869d-4393-b516-1f3ef42cf522.dat.png - Actual: noise, Watson Predicted: noise (0.943939)
Passed: b2bdc803-68f4-46be-9eb5-2d7a25c5185a.dat.png - Actual: noise, Watson Predicted: noise (0.9078)
Passed: b25be080-c5cf-496e-8020-abb4c0527ab0.dat.png - Actual: noise, Watson Predicted: noise (0.891391)
Passed: 8820d122-3246-4d09-804d-c68768db8450.dat.png - Actual: noise, Watson Predicted: noise (0.81431)
Passed: 675b826f-b2fe-4a84-a9e4-2ea62bd596d8.dat.png - Actual: noise, Watson Predicted: noise (0.896372)
Passed: 742292c6-8e46-4c86-97af-0f2a2671e33d.dat.png - Actual: noise, Watson Predicted: noise (0.934568)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.133333333333 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_12_noise.zip... this may take a while.
Passed: 1d937da9-c0fd-4bc7-9d32-a45beced17df.dat.png - Actual: noise, Watson Predicted: noise (0.910989)
Passed: 739d1568-1cb2-4496-a922-13ac9e43a175.dat.png - Actual: noise, Watson Predicted: noise (0.901003)
Passed: 9b6a4b25-f662-470f-a229-b9f3770c31b9.dat.png - Actual: noise, Watson Predicted: noise (0.933403)
Passed: c5a4e35b-aaba-4192-9d3e-ee3ce7e3831f.dat.png - Actual: noise, Watson Predicted: noise (0.913786)
Passed: 4f8f1c0b-39b7-427e-a8a0-e0b150ab357c.dat.png - Actual: noise, Watson Predicted: noise (0.932921)
Passed: f352303f-533b-43f9-865f-fe1e6867ee8f.dat.png - Actual: noise, Watson Predicted: noise (0.770172)
Passed: f50b0db8-d31a-4c26-a2a4-fba258423fd8.dat.png - Actual: noise, Watson Predicted: noise (0.899658)
Passed: ed71baa3-3e87-4a79-a027-e69e7ce620c4.dat.png - Actual: noise, Watson Predicted: noise (0.928787)
Passed: 9e456a96-d214-427f-b95a-f85e0c59acfd.dat.png - Actual: noise, Watson Predicted: noise (0.942439)
Passed: b0927b12-53df-4075-ba64-2af9e1c6eb70.dat.png - Actual: noise, Watson Predicted: noise (0.900905)
Passed: 1a807a96-0eef-4375-8e67-eea7a1b7fe7c.dat.png - Actual: noise, Watson Predicted: noise (0.863752)
Passed: c9c841c5-9208-4189-8920-8de27ba58220.dat.png - Actual: noise, Watson Predicted: noise (0.937223)
Passed: 5858214e-c9c5-4ec5-baa3-c17e0eeb5940.dat.png - Actual: noise, Watson Predicted: noise (0.924025)
Passed: 66849617-2313-4f14-b3e7-63889cd92470.dat.png - Actual: noise, Watson Predicted: noise (0.825766)
Passed: 70551f04-9aa9-453f-ae8a-8bd06d49d75d.dat.png - Actual: noise, Watson Predicted: noise (0.924302)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_13_noise.zip... this may take a while.
Passed: 413764e5-2345-45e2-9583-b59c10f719f1.dat.png - Actual: noise, Watson Predicted: noise (0.945516)
Passed: 3373d7d8-6e09-490b-810e-7c5a91ced552.dat.png - Actual: noise, Watson Predicted: noise (0.879544)
Passed: f00f2de2-1dad-4082-b004-f3465d5439ca.dat.png - Actual: noise, Watson Predicted: noise (0.905252)
Passed: 65a94fdd-7996-4f4c-adc6-df2d40279565.dat.png - Actual: noise, Watson Predicted: noise (0.915348)
Passed: a6238f41-2772-461e-aeee-5a1ea00f4788.dat.png - Actual: noise, Watson Predicted: noise (0.928628)
Passed: 5393f9c0-d85b-4ac9-be29-7a9cd8d7bea6.dat.png - Actual: noise, Watson Predicted: noise (0.936148)
Passed: 833a0b1a-21ef-4a01-b039-75454c6a726e.dat.png - Actual: noise, Watson Predicted: noise (0.936576)
Passed: 456a2590-adbe-4083-b502-33da358f02b9.dat.png - Actual: noise, Watson Predicted: noise (0.931918)
Passed: 5d996f45-9f16-4b34-8c95-8c28611b7885.dat.png - Actual: noise, Watson Predicted: noise (0.892046)
Passed: 392590c2-b0a5-411e-906b-cf03078d939e.dat.png - Actual: noise, Watson Predicted: noise (0.916668)
Passed: 325b4bbe-75ad-40ec-aa77-1d8a48ed3077.dat.png - Actual: noise, Watson Predicted: noise (0.939118)
Passed: a90d3033-3095-4fc1-b222-3a275f24a91d.dat.png - Actual: noise, Watson Predicted: noise (0.907362)
Passed: 19767257-c4df-4e3e-849b-1554917d7e84.dat.png - Actual: noise, Watson Predicted: noise (0.933958)
Passed: 917d19a6-5a48-43d7-ad70-73b4c42599e7.dat.png - Actual: noise, Watson Predicted: noise (0.83731)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_14_noise.zip... this may take a while.
Passed: b82087b8-a98a-44ac-b703-da87b5406e15.dat.png - Actual: noise, Watson Predicted: noise (0.931057)
Passed: 7fa4489a-4c79-4995-ab51-dc7f1728ee5a.dat.png - Actual: noise, Watson Predicted: noise (0.890338)
Passed: 63ee933e-ac85-48f0-a1f4-5490f3135890.dat.png - Actual: noise, Watson Predicted: noise (0.906678)
Passed: 95fd0e6c-8226-4ad4-a6e8-a57ae13fb808.dat.png - Actual: noise, Watson Predicted: noise (0.898746)
Passed: 82b5fe95-5bce-49ab-86f7-6b0ad282fe34.dat.png - Actual: noise, Watson Predicted: noise (0.880084)
Passed: da33af1c-41cb-433b-ad39-6a93ecbf5073.dat.png - Actual: noise, Watson Predicted: noise (0.901545)
Passed: 4316179a-f317-4814-8bc9-caed31cd17dd.dat.png - Actual: noise, Watson Predicted: noise (0.86164)
Passed: 9b53dd1d-a3ec-4dc2-b55a-489083884478.dat.png - Actual: noise, Watson Predicted: noise (0.892948)
Passed: f9dc4629-7a34-46af-bcaf-a5549c7351bb.dat.png - Actual: noise, Watson Predicted: noise (0.912325)
Passed: e8c790cb-582e-461b-88e9-e5a44869ff03.dat.png - Actual: noise, Watson Predicted: noise (0.799325)
Passed: 7ef547c4-3068-408a-8aa8-e4b68fce79fa.dat.png - Actual: noise, Watson Predicted: noise (0.892571)
Passed: be850466-db91-49ec-a9c3-526b9cbf4896.dat.png - Actual: noise, Watson Predicted: noise (0.942381)
Passed: 86ccbddf-01c6-41cd-b40d-9118decc0626.dat.png - Actual: noise, Watson Predicted: noise (0.929425)
Passed: 43e1e261-39d3-4311-8ec0-4bfe665d82c9.dat.png - Actual: noise, Watson Predicted: noise (0.807197)
Passed: 44e6f04f-6845-411d-96fc-43626a82a350.dat.png - Actual: noise, Watson Predicted: noise (0.889502)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_15_noise.zip... this may take a while.
Passed: a3d0d233-c944-44df-88f7-c9de0242913d.dat.png - Actual: noise, Watson Predicted: noise (0.884353)
Passed: ccafad1c-2857-466d-a6ed-8fde8e754896.dat.png - Actual: noise, Watson Predicted: noise (0.938149)
Passed: 7cbefd4b-bc13-44fa-9a76-a92d65509b4b.dat.png - Actual: noise, Watson Predicted: noise (0.923695)
Passed: de8a1384-aa55-40fe-a8c0-df7634063809.dat.png - Actual: noise, Watson Predicted: noise (0.927227)
Passed: 62dee652-6796-4cdd-80b4-cd05f3fe1382.dat.png - Actual: noise, Watson Predicted: noise (0.887338)
Passed: d9559bfc-efa1-487d-a239-74b1a542e334.dat.png - Actual: noise, Watson Predicted: noise (0.790276)
Passed: 382791f2-1a90-4b2c-ad17-e1f0fdebb6d5.dat.png - Actual: noise, Watson Predicted: noise (0.931924)
Passed: 55dd42c1-f566-4603-9d24-b3593d23eb63.dat.png - Actual: noise, Watson Predicted: noise (0.866925)
Passed: 99858525-2042-4af6-b698-472b1913b029.dat.png - Actual: noise, Watson Predicted: noise (0.921502)
Passed: 84b5e2ad-a003-42ee-8bf2-ea6b526068d0.dat.png - Actual: noise, Watson Predicted: noise (0.919106)
Passed: 6ca19a2f-ccb8-4234-b2a9-831b1df680f1.dat.png - Actual: noise, Watson Predicted: noise (0.911828)
Passed: 55ef323d-7a3d-4dd9-b7d7-ea55140ccde9.dat.png - Actual: noise, Watson Predicted: noise (0.94668)
Passed: fc7bbed8-e4ce-435c-a00e-e46b023d934d.dat.png - Actual: noise, Watson Predicted: noise (0.917392)
Passed: 7caca856-6b71-45e9-bf87-ddb8a78426b2.dat.png - Actual: noise, Watson Predicted: noise (0.860872)
Passed: efb30f2f-65b5-45cd-ac94-a71137816a53.dat.png - Actual: noise, Watson Predicted: noise (0.87905)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.133333333333 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_16_noise.zip... this may take a while.
Passed: 33afa776-c203-4614-bd9e-caeb37ed6398.dat.png - Actual: noise, Watson Predicted: noise (0.924351)
Passed: 1209edf8-900c-4b30-890f-0e73d4173801.dat.png - Actual: noise, Watson Predicted: noise (0.908673)
Passed: cc48f900-3332-49f7-91da-cf0ad169ded3.dat.png - Actual: noise, Watson Predicted: noise (0.695233)
Passed: caf70308-4421-46ae-9cc0-5deb5ec3173e.dat.png - Actual: noise, Watson Predicted: noise (0.918075)
Passed: 619a85e3-4f6b-4f7c-b0aa-ecced6e87197.dat.png - Actual: noise, Watson Predicted: noise (0.93997)
Passed: 80e4e01b-60d8-47b5-86f2-abe10d1126dd.dat.png - Actual: noise, Watson Predicted: noise (0.865122)
Passed: 725c2deb-a50a-482c-964d-a67528ec9494.dat.png - Actual: noise, Watson Predicted: noise (0.895895)
Passed: 97f5b076-217f-44b5-8c71-75ecb803d17b.dat.png - Actual: noise, Watson Predicted: noise (0.936907)
Passed: 3ff58ce5-8375-4b76-a2b2-ab890b450fb7.dat.png - Actual: noise, Watson Predicted: noise (0.917471)
Passed: c11cecef-ac88-4c19-be77-327c7815b4ed.dat.png - Actual: noise, Watson Predicted: noise (0.88621)
Passed: 85c748b1-ed80-4031-ba87-d58056b8c7be.dat.png - Actual: noise, Watson Predicted: noise (0.865723)
Passed: 7ee7f129-262d-4ad1-9b5c-6a8d22accab4.dat.png - Actual: noise, Watson Predicted: noise (0.8955)
Passed: 5ef3fee9-79b0-406c-a348-b2284ee72caf.dat.png - Actual: noise, Watson Predicted: noise (0.930372)
Passed: 2ac3f2fd-7e06-4aaf-bb9a-6d84b2cc83b6.dat.png - Actual: noise, Watson Predicted: noise (0.92371)
Passed: f9e62f52-2c02-4f27-8cda-ee4156e31468.dat.png - Actual: noise, Watson Predicted: noise (0.934545)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.133333333333 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_17_noise.zip... this may take a while.
Passed: b538a5a6-757a-4053-ac3a-2e20f09ed2ef.dat.png - Actual: noise, Watson Predicted: noise (0.867452)
Passed: 41176b3b-9c62-4ddc-8045-4bf27a25d57d.dat.png - Actual: noise, Watson Predicted: noise (0.936835)
Passed: a62abf54-c4c4-44e7-b37b-4d2c7192a635.dat.png - Actual: noise, Watson Predicted: noise (0.931037)
Passed: 73066802-31ea-4e70-acc5-e3ddbf2e9565.dat.png - Actual: noise, Watson Predicted: noise (0.912909)
Passed: 54401fc5-44b9-4e6e-8861-91a3a03d3ea3.dat.png - Actual: noise, Watson Predicted: noise (0.858633)
Passed: 77fe543c-4af9-4660-8a85-bfe1c5420af8.dat.png - Actual: noise, Watson Predicted: noise (0.923272)
Passed: 12f8352f-bee8-4a7f-bfcf-32db78532f35.dat.png - Actual: noise, Watson Predicted: noise (0.949375)
Passed: ee729c61-bbc3-433f-a6f3-e5cf856b3ea4.dat.png - Actual: noise, Watson Predicted: noise (0.9096)
Passed: f10963d4-eeb2-4905-96cb-70599631ab06.dat.png - Actual: noise, Watson Predicted: noise (0.907525)
Passed: 43219f67-79ad-48b3-b6ea-f7f1371b4738.dat.png - Actual: noise, Watson Predicted: noise (0.93063)
Passed: 533548c4-3414-4d1a-a27e-4d839c73d818.dat.png - Actual: noise, Watson Predicted: noise (0.937376)
Passed: cc793790-073b-41bf-9419-62fbbd8a7f8f.dat.png - Actual: noise, Watson Predicted: noise (0.914539)
Passed: a8337a1a-ccc8-42d2-b77b-192129081877.dat.png - Actual: noise, Watson Predicted: noise (0.901614)
Passed: 46467a3b-f11c-4805-b449-582d54c915da.dat.png - Actual: noise, Watson Predicted: noise (0.943341)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_18_noise.zip... this may take a while.
Passed: 8ad7b163-0dbd-4b73-9243-cffcb19606be.dat.png - Actual: noise, Watson Predicted: noise (0.878268)
Passed: 43748ad2-f165-4f09-b567-bdad8dfc201f.dat.png - Actual: noise, Watson Predicted: noise (0.927239)
Passed: c8697ec0-924d-4e00-a351-9ea2496f0ccd.dat.png - Actual: noise, Watson Predicted: noise (0.938602)
Passed: 042ef3b3-bcbf-456d-92f0-bd2a66b4f158.dat.png - Actual: noise, Watson Predicted: noise (0.92043)
Passed: 82e8e181-a13b-4608-9efc-4fff1b4b10d4.dat.png - Actual: noise, Watson Predicted: noise (0.918051)
Passed: d5d83d4d-7ca8-4fa6-9dcd-c28cbc394230.dat.png - Actual: noise, Watson Predicted: noise (0.836037)
Passed: 6dcf5a61-db24-4c8e-9b91-63d3f9989391.dat.png - Actual: noise, Watson Predicted: noise (0.927902)
Passed: 0a88d056-91d7-4165-b3dd-18dfffb85e01.dat.png - Actual: noise, Watson Predicted: noise (0.939983)
Passed: 0c8a833c-240c-47b7-aaac-064a2e6572a7.dat.png - Actual: noise, Watson Predicted: noise (0.922982)
Passed: 7950e591-3602-4835-8bb8-564ecac40302.dat.png - Actual: noise, Watson Predicted: noise (0.828606)
Passed: 0b22b5fe-4a93-4130-8e92-3251562358b1.dat.png - Actual: noise, Watson Predicted: noise (0.886838)
Passed: 9125e448-4e28-4b52-ba96-fad5c5664408.dat.png - Actual: noise, Watson Predicted: noise (0.910106)
Passed: 0ece65a9-11a5-4237-a5a6-ee8a92d426eb.dat.png - Actual: noise, Watson Predicted: noise (0.91177)
Passed: 8a5aef5f-0d00-4eec-9b27-76f797f242ae.dat.png - Actual: noise, Watson Predicted: noise (0.884023)
Passed: bb18238e-57b9-4c26-b2f9-7888831ceb96.dat.png - Actual: noise, Watson Predicted: noise (0.892503)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_noise.zip... this may take a while.
Passed: 2737ef7e-2c02-4e5d-9488-6c07063466c6.dat.png - Actual: noise, Watson Predicted: noise (0.929868)
Passed: 611c5b35-1ab1-436e-9e2f-300ce7421dae.dat.png - Actual: noise, Watson Predicted: noise (0.946009)
Passed: 0f14d2a5-cf6b-429b-a8f6-8cd158df7692.dat.png - Actual: noise, Watson Predicted: noise (0.935883)
Passed: c12e6118-7c5a-4787-a31c-438b2277f94d.dat.png - Actual: noise, Watson Predicted: noise (0.905708)
Passed: 40be4e25-2c14-4e12-a56f-85b803159cf4.dat.png - Actual: noise, Watson Predicted: noise (0.912195)
Passed: eceb6026-f477-41ea-b12f-4828630d11c8.dat.png - Actual: noise, Watson Predicted: noise (0.936296)
Passed: 2a9598de-b34b-495b-8054-d4664f802961.dat.png - Actual: noise, Watson Predicted: noise (0.891349)
Passed: 6dc29933-16fb-4572-a883-112890a8c771.dat.png - Actual: noise, Watson Predicted: noise (0.92771)
Passed: b22a633b-91da-4e6c-9119-128cc210c202.dat.png - Actual: noise, Watson Predicted: noise (0.942491)
Passed: ad40809b-9f87-4eef-80d1-556022698032.dat.png - Actual: noise, Watson Predicted: noise (0.922565)
Passed: 7fe67a01-1259-4f6a-a4bd-b4715a0d390a.dat.png - Actual: noise, Watson Predicted: noise (0.932179)
Passed: db9a326b-a4d3-4019-9507-5b33ad0ab919.dat.png - Actual: noise, Watson Predicted: noise (0.926111)
Passed: 5c29cb85-e059-42a6-8f69-be1aba024e5c.dat.png - Actual: noise, Watson Predicted: noise (0.933227)
Passed: 0325f6ad-c09b-497d-8c81-99a89e0df414.dat.png - Actual: noise, Watson Predicted: noise (0.913375)
Passed: 3effca5a-e00a-4d08-9a41-ddbf3a6481c2.dat.png - Actual: noise, Watson Predicted: noise (0.932297)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.15 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_1_noise.zip... this may take a while.
Passed: a377f274-1847-43d2-a730-77814cf2c74a.dat.png - Actual: noise, Watson Predicted: noise (0.909115)
Passed: a3401bda-1b18-4749-99e1-6effde283718.dat.png - Actual: noise, Watson Predicted: noise (0.922878)
Passed: b40d47e7-3aa4-466f-b0a6-8254464cb4ab.dat.png - Actual: noise, Watson Predicted: noise (0.880925)
Passed: 8efef66b-1bb6-4c9f-b572-12be7746d7f0.dat.png - Actual: noise, Watson Predicted: noise (0.888354)
Passed: 4311e07c-dda7-4400-9e79-96623f35a1e6.dat.png - Actual: noise, Watson Predicted: noise (0.919207)
Passed: 1bcc9fdd-e419-4570-8abc-dd040c7bd610.dat.png - Actual: noise, Watson Predicted: noise (0.952093)
Passed: 2c90882b-9d00-40e8-82a2-9895d031f912.dat.png - Actual: noise, Watson Predicted: noise (0.913106)
Passed: 9c700d70-ab51-4cb0-9623-b87768ad0b55.dat.png - Actual: noise, Watson Predicted: noise (0.874755)
Passed: d6237113-1f12-44e4-b23d-72005be6581b.dat.png - Actual: noise, Watson Predicted: noise (0.921758)
Passed: 8be835f8-dfa0-476d-a921-57d1117fe110.dat.png - Actual: noise, Watson Predicted: noise (0.917213)
Passed: bdcf94b2-ce5f-453e-ac9b-80ec106dc0f4.dat.png - Actual: noise, Watson Predicted: noise (0.832067)
Passed: f1dc6b0c-65a5-4316-9a8e-8ffa7df8587a.dat.png - Actual: noise, Watson Predicted: noise (0.937944)
Passed: ef4a2f6e-3bea-4d6c-80e8-543dc6c0c22e.dat.png - Actual: noise, Watson Predicted: noise (0.928308)
Passed: 7d5e50f9-1908-427e-ab4b-f76fe4b8d36d.dat.png - Actual: noise, Watson Predicted: noise (0.902115)
Passed: 6ed39b0c-f957-49a5-9faf-cf60a05127a0.dat.png - Actual: noise, Watson Predicted: noise (0.898928)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_20_noise.zip... this may take a while.
Passed: f5d06f6e-90cd-4171-8859-e5ccd859bde7.dat.png - Actual: noise, Watson Predicted: noise (0.91777)
Passed: 3b617973-3f70-4480-af9e-ea2aaaa9fe34.dat.png - Actual: noise, Watson Predicted: noise (0.917706)
Passed: 7e8aa203-0249-45b7-9fd6-6198824c6c3a.dat.png - Actual: noise, Watson Predicted: noise (0.903695)
Passed: 6ebd9b76-eb5f-4672-95cf-e6549dacb441.dat.png - Actual: noise, Watson Predicted: noise (0.91843)
Passed: 2538b111-22ec-4e9f-a94a-3386e902353e.dat.png - Actual: noise, Watson Predicted: noise (0.881142)
Passed: 6e1b0232-4c3d-45b4-97d4-7a77a0bce881.dat.png - Actual: noise, Watson Predicted: noise (0.929326)
Passed: 8fc2def3-01ad-4089-aa41-2746077e93b1.dat.png - Actual: noise, Watson Predicted: noise (0.931593)
Passed: 3010d8a5-a0a9-4063-aac9-1f231b0f3407.dat.png - Actual: noise, Watson Predicted: noise (0.89526)
Passed: a1ba4bca-0fb0-4227-ab35-3f2556ace744.dat.png - Actual: noise, Watson Predicted: noise (0.907464)
Passed: 33d4c5ec-4dd1-47a0-a5aa-cfe715f7bfb9.dat.png - Actual: noise, Watson Predicted: noise (0.884678)
Passed: 82957099-40e8-4cc1-834b-618d0d4bcaac.dat.png - Actual: noise, Watson Predicted: noise (0.926558)
Passed: d290d06c-1265-4010-9b8f-30ef8fc4d6a8.dat.png - Actual: noise, Watson Predicted: noise (0.905391)
Passed: 23d79afd-4cf2-4295-ba8c-34c9645a4166.dat.png - Actual: noise, Watson Predicted: noise (0.922694)
Passed: 37064eee-fd25-4135-add5-9e5e12ed45ac.dat.png - Actual: noise, Watson Predicted: noise (0.934)
Passed: 1e83f192-0fb3-4605-9e58-60a8c2a29df4.dat.png - Actual: noise, Watson Predicted: noise (0.879079)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (5 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_21_noise.zip... this may take a while.
Passed: ceac976c-3040-4e0d-b9df-236d17e7b1fb.dat.png - Actual: noise, Watson Predicted: noise (0.921827)
Passed: a0e51cf7-89f2-4a54-bc20-756b2832db2d.dat.png - Actual: noise, Watson Predicted: noise (0.907948)
Passed: f536a727-112e-4fc6-becd-52d8eea649bd.dat.png - Actual: noise, Watson Predicted: noise (0.911192)
Passed: 6ac5babd-9672-444e-8d1d-1eb2ecbb7d92.dat.png - Actual: noise, Watson Predicted: noise (0.937078)
Passed: fe584a74-09ed-4e6a-be62-279c75e8a888.dat.png - Actual: noise, Watson Predicted: noise (0.91855)
Test Score: 100% (5 of 5 Passed)
Tested 5 images in 0.0666666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_2_noise.zip... this may take a while.
Passed: 16410556-bf82-4dbe-9dc1-eaf027af7547.dat.png - Actual: noise, Watson Predicted: noise (0.852443)
Passed: e5029960-ccf1-4ad3-a4c9-ea85d6a50f8e.dat.png - Actual: noise, Watson Predicted: noise (0.924874)
Passed: 744e6276-f680-4b40-8f9d-76e24dee32c5.dat.png - Actual: noise, Watson Predicted: noise (0.926927)
Passed: 7b9b829d-f45b-401d-ade5-7ef9564708e1.dat.png - Actual: noise, Watson Predicted: noise (0.910387)
Passed: 86dc8eb5-7884-4e78-bcd9-058c553c706b.dat.png - Actual: noise, Watson Predicted: noise (0.933168)
Passed: 7d5e6988-eb4f-4792-9397-79433e179475.dat.png - Actual: noise, Watson Predicted: noise (0.905564)
Passed: 10a442e7-9d92-4b8f-b6be-e6826d181036.dat.png - Actual: noise, Watson Predicted: noise (0.914756)
Passed: eb5b6372-4235-4e73-a81f-7a0f807a40ed.dat.png - Actual: noise, Watson Predicted: noise (0.927278)
Passed: eac753b2-a581-4ec0-8974-8db8a811f2c4.dat.png - Actual: noise, Watson Predicted: noise (0.89947)
Passed: e9050081-13e0-4ba5-b762-b461c4d47bf8.dat.png - Actual: noise, Watson Predicted: noise (0.931773)
Passed: 96c37c79-da37-45f2-815e-4b1e9a1e939e.dat.png - Actual: noise, Watson Predicted: noise (0.942516)
Passed: 4a2db6f1-482b-4f69-9b4f-7492f5628048.dat.png - Actual: noise, Watson Predicted: noise (0.914079)
Passed: 4eb46847-ba94-4599-b276-59331f711511.dat.png - Actual: noise, Watson Predicted: noise (0.924938)
Passed: 1cf33bea-fe39-4d0b-bd5e-91001613fac1.dat.png - Actual: noise, Watson Predicted: noise (0.883721)
Passed: 06f1a128-9f67-4589-910b-d5049ab1c862.dat.png - Actual: noise, Watson Predicted: noise (0.906322)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_3_noise.zip... this may take a while.
Passed: f6a04404-4706-4033-b814-8a9e852ae2f1.dat.png - Actual: noise, Watson Predicted: noise (0.940015)
Passed: 5ec937ef-3a92-413d-a37a-63a68ba635a4.dat.png - Actual: noise, Watson Predicted: noise (0.921684)
Passed: 8da9755a-cf8a-4c24-8cd2-dc2d92e0fd17.dat.png - Actual: noise, Watson Predicted: noise (0.791075)
Passed: 2e2497ed-d19a-4dbc-aaf1-ea5edf88a938.dat.png - Actual: noise, Watson Predicted: noise (0.905411)
Passed: c24644ba-c59d-4f53-84de-7f6f7f2ca532.dat.png - Actual: noise, Watson Predicted: noise (0.930285)
Passed: dd1f0e9a-29a5-463d-9e70-4f5ecd9b844b.dat.png - Actual: noise, Watson Predicted: noise (0.8999)
Passed: 4899cfcc-982e-46d6-9747-7f3bd2585c5b.dat.png - Actual: noise, Watson Predicted: noise (0.918009)
Passed: 51eaec07-8cb6-4b98-8718-beed484777c3.dat.png - Actual: noise, Watson Predicted: noise (0.946428)
Passed: ff556e36-6ff3-4a84-9c66-4053ce881434.dat.png - Actual: noise, Watson Predicted: noise (0.892947)
Passed: 0ab0dd88-f200-40bf-baa1-ad03f64e1457.dat.png - Actual: noise, Watson Predicted: noise (0.946446)
Passed: 1adddf00-a686-462b-bd17-5800fd1dc759.dat.png - Actual: noise, Watson Predicted: noise (0.881686)
Passed: b96ef9a9-72cf-4835-991c-d356dd34b141.dat.png - Actual: noise, Watson Predicted: noise (0.920546)
Passed: 99a8c139-9a2d-4026-9248-1cc43b7bd722.dat.png - Actual: noise, Watson Predicted: noise (0.942103)
Passed: 3de18661-3f3e-4c5c-a7a8-c3313dcb81ae.dat.png - Actual: noise, Watson Predicted: noise (0.916471)
Passed: 78c21b77-8ab0-49f6-b702-a00494d7b297.dat.png - Actual: noise, Watson Predicted: noise (0.917664)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.183333333333 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_4_noise.zip... this may take a while.
Passed: 20a37980-c259-4fd3-84c8-c74ac729496b.dat.png - Actual: noise, Watson Predicted: noise (0.905523)
Passed: 1c5d751a-8536-46b8-8651-f3aaa01a951e.dat.png - Actual: noise, Watson Predicted: noise (0.912627)
Passed: 9a6b009d-3b97-44f1-9fc0-052b3dc735c2.dat.png - Actual: noise, Watson Predicted: noise (0.886293)
Passed: 7270c66d-dc48-4e63-8715-521c1767177f.dat.png - Actual: noise, Watson Predicted: noise (0.942633)
Passed: 76096200-b1f9-44a4-ac61-bf0dc91b8016.dat.png - Actual: noise, Watson Predicted: noise (0.910996)
Passed: d0a226bc-f3ce-4dbb-b999-d75d77be0d89.dat.png - Actual: noise, Watson Predicted: noise (0.835714)
Passed: 863df6ef-992a-412d-ac2e-e7e77ff3f633.dat.png - Actual: noise, Watson Predicted: noise (0.947297)
Passed: e4ebdebf-b2bd-4e41-9f48-3f41496846d7.dat.png - Actual: noise, Watson Predicted: noise (0.941126)
Passed: 88fa2b3e-668f-4ff7-9344-cd9514978cac.dat.png - Actual: noise, Watson Predicted: noise (0.844103)
Passed: 1a08789b-2743-49ed-a846-30ad87957dac.dat.png - Actual: noise, Watson Predicted: noise (0.921283)
Passed: c07bd08a-f217-434e-8b2a-8ec6abc3ced6.dat.png - Actual: noise, Watson Predicted: noise (0.888737)
Passed: 762ab5da-14c9-4fc3-bf08-30b589ec1526.dat.png - Actual: noise, Watson Predicted: noise (0.859479)
Passed: 9fa9f691-cb95-4581-aa89-e4536b0ec39a.dat.png - Actual: noise, Watson Predicted: noise (0.919174)
Passed: 0edd531d-a793-4e2e-8900-9e724a63e858.dat.png - Actual: noise, Watson Predicted: noise (0.939105)
Passed: 0e89d1a2-1aa0-460c-9495-f2f4f7647298.dat.png - Actual: noise, Watson Predicted: noise (0.827672)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.133333333333 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_5_noise.zip... this may take a while.
Passed: 2efeb3c0-81d1-4dfd-b87c-04f117c8bbe9.dat.png - Actual: noise, Watson Predicted: noise (0.942324)
Passed: 938a9721-ad86-48d6-b92d-baf24ab75ccc.dat.png - Actual: noise, Watson Predicted: noise (0.902955)
Passed: e0c1de78-f371-4bbb-8f19-f9a63cee8af9.dat.png - Actual: noise, Watson Predicted: noise (0.922682)
Passed: 673c9a12-b291-45ea-acd0-0bb1ed7858e4.dat.png - Actual: noise, Watson Predicted: noise (0.918309)
Passed: 047b6e66-1aa0-4afe-9134-353e2df0440e.dat.png - Actual: noise, Watson Predicted: noise (0.92964)
Passed: fc08780c-2914-4297-836f-8e671573f079.dat.png - Actual: noise, Watson Predicted: noise (0.91048)
Passed: 29d70425-7c69-4000-a80e-ef0bf8d9509c.dat.png - Actual: noise, Watson Predicted: noise (0.933545)
Passed: 7840df7b-94ff-4bda-ae85-eb42ce9a7625.dat.png - Actual: noise, Watson Predicted: noise (0.938721)
Passed: 9c02745c-ff9c-44c9-b974-e94380b9156c.dat.png - Actual: noise, Watson Predicted: noise (0.922514)
Passed: 94ea3719-eaaf-41f8-bf45-1ac322b89610.dat.png - Actual: noise, Watson Predicted: noise (0.937361)
Passed: 4e0c3e0d-130a-4959-9d07-ea7b66261fb6.dat.png - Actual: noise, Watson Predicted: noise (0.925412)
Passed: abd857fe-9d13-4057-9411-a63ed9a0dbeb.dat.png - Actual: noise, Watson Predicted: noise (0.93078)
Passed: f189df32-aa04-439f-a405-d34fbe9f2d9d.dat.png - Actual: noise, Watson Predicted: noise (0.942557)
Passed: 2c0e3eea-356e-4203-99e6-6a6a830a4dd1.dat.png - Actual: noise, Watson Predicted: noise (0.852297)
Passed: e3aa23a5-f014-4988-93a4-3a596fbcc2b3.dat.png - Actual: noise, Watson Predicted: noise (0.860217)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_6_noise.zip... this may take a while.
Passed: 8cd52264-f357-473f-835f-f46dcf3f4b3f.dat.png - Actual: noise, Watson Predicted: noise (0.880362)
Passed: cbff493b-123d-4efa-a511-fe0964e3894a.dat.png - Actual: noise, Watson Predicted: noise (0.933607)
Passed: 6ec9b3f0-8de4-421e-a266-ffceeab08197.dat.png - Actual: noise, Watson Predicted: noise (0.909454)
Passed: e9276535-6d26-466e-978b-92a70f9394ee.dat.png - Actual: noise, Watson Predicted: noise (0.926401)
Passed: b6514f1a-dd5e-4a37-abd3-36c599c36594.dat.png - Actual: noise, Watson Predicted: noise (0.914084)
Passed: 9862eb86-53b5-4a8c-9e5d-8eddd27b8c95.dat.png - Actual: noise, Watson Predicted: noise (0.928928)
Passed: 4d4bb1b1-475b-44b5-8764-d85690502a4d.dat.png - Actual: noise, Watson Predicted: noise (0.80064)
Passed: c606447e-7fbf-47dc-b84f-5ab4b2849a73.dat.png - Actual: noise, Watson Predicted: noise (0.877949)
Passed: 82d418aa-9a59-4b31-a341-63b25816f725.dat.png - Actual: noise, Watson Predicted: noise (0.918115)
Passed: 6dbbbaaa-d671-4495-9195-3c5dd696b91e.dat.png - Actual: noise, Watson Predicted: noise (0.941498)
Passed: 3230d7f9-61e2-42f8-8b63-20d9b76d2e8c.dat.png - Actual: noise, Watson Predicted: noise (0.921741)
Passed: 6a32b803-a63f-4ed0-9398-00e77b401277.dat.png - Actual: noise, Watson Predicted: noise (0.915944)
Passed: 9a0dc4f3-3c8c-4f0f-90d3-e9f50ef3ab0a.dat.png - Actual: noise, Watson Predicted: noise (0.923899)
Passed: 72ac76aa-29bc-4c11-965f-a0acf08c8ee4.dat.png - Actual: noise, Watson Predicted: noise (0.930037)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (15 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_7_noise.zip... this may take a while.
Passed: ff55d8b1-27ad-4e71-8b82-8564fabdd41a.dat.png - Actual: noise, Watson Predicted: noise (0.911096)
Passed: 08552bf7-f052-471c-b783-99e82d888225.dat.png - Actual: noise, Watson Predicted: noise (0.872399)
Passed: e4ceee34-0f6a-4713-81af-301461f9290e.dat.png - Actual: noise, Watson Predicted: noise (0.844427)
Passed: 83c5d9d6-e98b-4261-a6cc-0af6b1480c63.dat.png - Actual: noise, Watson Predicted: noise (0.872084)
Passed: 163f4794-d143-4cbb-aa6a-3f4d4d553f6f.dat.png - Actual: noise, Watson Predicted: noise (0.925187)
Passed: 6ac37d60-d3c7-46f1-96e6-292a7042c537.dat.png - Actual: noise, Watson Predicted: noise (0.898254)
Passed: 89362a86-54e8-41f6-bbcf-446a9e37d47f.dat.png - Actual: noise, Watson Predicted: noise (0.814792)
Passed: 3bf6631c-7d5e-47a0-b55b-b2877d44b21b.dat.png - Actual: noise, Watson Predicted: noise (0.9355)
Passed: 2d894522-0128-4001-a9c4-1889732a75e6.dat.png - Actual: noise, Watson Predicted: noise (0.914923)
Passed: dde63e84-f3da-4a99-8df5-fd9e53622807.dat.png - Actual: noise, Watson Predicted: noise (0.909969)
Passed: f88191a2-ecef-4b4c-b2fe-3460460900f0.dat.png - Actual: noise, Watson Predicted: noise (0.923405)
Passed: 95f3cf7a-d261-4e0b-8b82-0114c18b3e6f.dat.png - Actual: noise, Watson Predicted: noise (0.920869)
Passed: a4928418-3ae7-42a5-bc66-c3e53f2f38b7.dat.png - Actual: noise, Watson Predicted: noise (0.922194)
Passed: 8a8632de-68d7-4140-ab0e-578ae1fb9da9.dat.png - Actual: noise, Watson Predicted: noise (0.76628)
Passed: 68c37aeb-70ed-46b4-b94b-daa352ed7b9c.dat.png - Actual: noise, Watson Predicted: noise (0.916756)
Test Score: 100% (15 of 15 Passed)
Tested 15 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_8_noise.zip... this may take a while.
Passed: e697a630-e150-4ad8-a4c3-d1d882c66a31.dat.png - Actual: noise, Watson Predicted: noise (0.911426)
Passed: 03199113-5b06-4675-8549-e40689ac8d10.dat.png - Actual: noise, Watson Predicted: noise (0.871884)
Passed: 315aee09-85cb-4754-846c-92395d6a6b9f.dat.png - Actual: noise, Watson Predicted: noise (0.928728)
Passed: 56468755-1967-461a-b2d5-4c90fb9cc915.dat.png - Actual: noise, Watson Predicted: noise (0.868639)
Passed: 155cfa41-8a11-4f07-b1d7-9ddb61d653c5.dat.png - Actual: noise, Watson Predicted: noise (0.851038)
Passed: 3819dc67-f10a-4874-a979-9aa89192d7ba.dat.png - Actual: noise, Watson Predicted: noise (0.896121)
Passed: f9e0bc9a-51e7-431c-8af2-51c646257b06.dat.png - Actual: noise, Watson Predicted: noise (0.917759)
Passed: e86b0bc3-e7f7-4af9-99bb-20bdc9e175da.dat.png - Actual: noise, Watson Predicted: noise (0.92941)
Passed: dba4daa7-fea0-4c52-9577-7bf2d6508c35.dat.png - Actual: noise, Watson Predicted: noise (0.923115)
Passed: 2cc2e990-470e-4f27-bb12-8fc1b02771bc.dat.png - Actual: noise, Watson Predicted: noise (0.914785)
Passed: f173054b-b604-478d-8a02-a02e048c2b59.dat.png - Actual: noise, Watson Predicted: noise (0.921818)
Passed: 2c5027c0-5353-40ee-90d4-8510a8b33ce9.dat.png - Actual: noise, Watson Predicted: noise (0.905517)
Passed: df787b8c-587f-4489-9fe6-2054a5542720.dat.png - Actual: noise, Watson Predicted: noise (0.954091)
Passed: 2750d442-3e13-40fe-af0e-46a6a71c4b63.dat.png - Actual: noise, Watson Predicted: noise (0.898916)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.133333333333 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_9_noise.zip... this may take a while.
Passed: 3856020b-0a41-4df1-8a24-a21af3124a8a.dat.png - Actual: noise, Watson Predicted: noise (0.877681)
Passed: 31f7abbb-8fa9-4a01-bd55-4037565bf722.dat.png - Actual: noise, Watson Predicted: noise (0.905095)
Passed: 3365ce86-27a1-46f6-9e29-067cf3012dfb.dat.png - Actual: noise, Watson Predicted: noise (0.903211)
Passed: dc71111f-f45a-4755-a523-5c58497f474a.dat.png - Actual: noise, Watson Predicted: noise (0.899029)
Passed: ad8f8799-9025-46ff-85b3-9cccc905a540.dat.png - Actual: noise, Watson Predicted: noise (0.927059)
Passed: a4b4dea7-b6ba-4104-b837-079289aac12a.dat.png - Actual: noise, Watson Predicted: noise (0.833534)
Passed: c26770f4-19b9-4587-abb4-dde30d2e7cce.dat.png - Actual: noise, Watson Predicted: noise (0.941131)
Passed: 4e5a75c8-d8d1-47bb-8e16-fe18070121b1.dat.png - Actual: noise, Watson Predicted: noise (0.901786)
Passed: c696d601-594c-49fc-ae54-cd30cc9efd0c.dat.png - Actual: noise, Watson Predicted: noise (0.854323)
Passed: 83c15d26-13a2-4b17-bae5-2a89354220c3.dat.png - Actual: noise, Watson Predicted: noise (0.911131)
Passed: 9f631655-866c-4758-a655-559a434a0fff.dat.png - Actual: noise, Watson Predicted: noise (0.884426)
Passed: 7bdaabbe-b4e4-45bb-83fd-ddf5704ca9aa.dat.png - Actual: noise, Watson Predicted: noise (0.887357)
Passed: d0668e33-8b94-4dff-9779-d2e54414b6a9.dat.png - Actual: noise, Watson Predicted: noise (0.884532)
Passed: a5e7d55c-3d31-45f3-a79d-339709d066fa.dat.png - Actual: noise, Watson Predicted: noise (0.928201)
Test Score: 100% (14 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_10_narrowband.zip... this may take a while.
Failed: 5231f49a-a2be-4384-91da-062fd369dcdc.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.901131)
Passed: 1b16c7ce-5c8b-4eb7-aaf9-18d479167919.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.596292)
Passed: 7cbecc68-cc89-4422-a6e7-a3169800e3c0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.670558)
Passed: eed7f176-6047-4be3-a8bf-8a6a097a71c0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.928417)
Passed: cac10606-3d76-4170-bd67-72f6962a56f4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.868632)
Passed: 69dbb7fb-4cc9-4e3f-a520-71b10cc422de.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.536011)
Failed: 0922eb95-b43f-42a0-94cc-06068e676e4a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.686087)
Passed: 832ac4cc-cbf9-4fec-a21e-ab8d1a3cb816.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.840674)
Failed: 7b7b41b6-86ae-4b4a-b1ee-04335e421dfc.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.563285)
Failed: 3f7f82d4-5610-4be9-a576-a1eac7c5cddd.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.746253)
Passed: b6d21cc8-bd5e-44c5-8ac5-6162eca1beb8.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.836348)
Failed: 680fed4b-40c6-407d-ad92-24598a8c5014.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.727291)
Passed: 7cb80b31-b8ce-4db9-af42-ce466ca1844a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.928988)
Test Score: 61% (8 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_11_narrowband.zip... this may take a while.
Failed: ade18b00-5aeb-4148-8c65-169eec14e9b8.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.788069)
Passed: e7579d11-dcf8-4867-b551-1cc467440f6d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.663301)
Passed: 641e23e1-25d6-4e27-be96-ed3287d674df.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.751345)
Failed: a0a29437-bce7-4f9e-89c1-56096c24c661.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.769241)
Passed: f3be8a1c-99a9-4977-85b7-3393a09c35b2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.813409)
Passed: 5a9aaa21-a266-4eb9-ad0e-f58f17fc8995.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.599388)
Passed: 1cccb5f9-6447-44b2-be03-1a20f27c7b48.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.659279)
Failed: 55c7268f-148f-482c-b2ea-84eecc607e6b.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.924546)
Failed: 72faa1b6-6870-4116-aed5-8a2884e34b4c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.816875)
Failed: 654d5969-c83f-4971-8e0f-d12947f0e52b.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.668137)
Failed: bff38672-bc99-42e5-9d65-ffcc048cdb98.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.476676)
Passed: ff406724-c60a-49cf-91a3-31a0945d3838.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.632158)
Passed: fad84b5c-f035-4987-8fce-a1b46218b25a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.807188)
Failed: 91a538d3-76e7-4406-b9c2-e2d5d79d4c93.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.742523)
Test Score: 50% (7 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_12_narrowband.zip... this may take a while.
Failed: 8cf30e36-cb4c-4407-ab34-e89332551746.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.612595)
Passed: 33efd6ac-ebd9-49cc-bea7-de369ed77ded.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.599595)
Failed: 3e2e26c6-9e0a-4216-a536-5fcc47316e69.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.490766)
Failed: 54795772-6d19-4090-93ea-fd2a9adf878e.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.687306)
Passed: 24b69580-59dd-4fa8-972e-41f328340e4c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.716328)
Passed: a13a4f94-6e1c-42e0-b671-a955a418624d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.760651)
Passed: e13205c4-c7e8-4c4b-928f-832aa1be25ac.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.546827)
Passed: d542573f-bd77-48e0-ab69-0a1a1ae10699.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.883974)
Failed: 7ca548d9-4f53-41c6-83a1-4c829aed79c0.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.637778)
Passed: 98035ce4-9a7a-4b8f-8e17-be8687342a9c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.896874)
Failed: ac3afb83-3ff2-4373-b7d0-3be9e890be2b.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.76995)
Passed: 922348a7-29c8-466b-a8b0-3acbc9e4f83a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.843094)
Passed: 7905cb15-f6aa-43f0-b25d-16c07e37e5e4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.8761)
Passed: 27d4d9fe-e779-4ebb-bc37-fcb249cd6af8.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.764572)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_13_narrowband.zip... this may take a while.
Failed: abfa90c1-cf74-4884-b131-316d7a53311e.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.901224)
Passed: eada7c9b-8521-4a2c-a921-e412b1626504.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.74408)
Failed: 0acb4f13-6b20-4caa-b8dd-cefe0a24cbf2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.825474)
Passed: 4e8e0653-9479-44e2-bda6-f5d28c1a58c2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.633366)
Passed: e158b219-4ca1-4923-8506-9fd1bbaeaa99.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.805201)
Passed: c6da2dcb-520b-47fd-9326-3c486f5b457c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.704062)
Failed: 742693de-938c-41a2-b731-d814ec28f2bb.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.715966)
Passed: ca8e4c33-5268-4dc2-8c7e-6e2493f64a0a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.827371)
Passed: c6bfbd1f-6abc-4247-97f9-12d8364d4e4a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.874593)
Passed: 29f8c86f-0d3d-45c4-8650-1fa2a0fee462.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.524631)
Passed: 3ec3693d-857a-464a-be68-a4ce42a1ab79.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.58707)
Passed: dc979eca-546d-4fcf-8a95-e9636fd76ed1.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.926554)
Failed: d6a0352b-9802-46e5-80f4-c8c1abd8af09.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.7636)
Passed: 15fa6a70-b345-4a3b-8b9f-865b812a9170.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.84678)
Test Score: 71% (10 of 14 Passed)
Tested 14 images in 0.15 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_14_narrowband.zip... this may take a while.
Passed: b02e0562-d8a3-4308-9a88-5e51945312e4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.653076)
Passed: 840d14c5-e63e-47be-b2a8-90876792e3fa.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.63894)
Passed: 68c63f06-2090-40cd-8d5b-e07b0a544fc9.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.8111)
Passed: e8f617cd-aecb-49db-bc5f-62f9afdfd4a8.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.834434)
Passed: c5bbf362-dcff-4114-9a05-7a7ef1d62651.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.550818)
Passed: 9bb92323-ada7-4cb5-adf8-4ee1471a6c5a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.653206)
Failed: 898e6131-11d1-4316-9e10-5b1ebffa3f40.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.625114)
Failed: 90b10e97-de47-406a-87fb-fbc339767d76.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.533265)
Failed: 45343a02-9e86-4b41-ab64-37f97ac3aa0c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.541026)
Failed: 712102d8-0319-40c9-9e74-647764e679ee.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.890438)
Passed: 0742bb44-8e19-4276-832b-161a9c600066.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.653686)
Passed: f4b8b7c8-3afe-468e-b87b-bf733f13ad95.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.434869)
Passed: 3f5cc83e-a239-492b-ae48-e71986d5abf0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.840107)
Failed: 2c7481e6-dcc3-4a2d-af0b-fcc56d5cb401.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.721981)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.133333333333 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_15_narrowband.zip... this may take a while.
Failed: aaf0e685-983b-4a5a-a38a-8447fceb7860.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.59072)
Failed: 25adc49c-e458-48fd-b367-8f557ada241c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.686377)
Failed: 80f22860-0e23-43fb-b3c5-7280de411809.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.681141)
Passed: 067278f1-0c11-427a-879f-6f93ed58b75b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.604082)
Passed: 1757ff69-f798-433e-88c8-3074b87c9eb8.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.763552)
Failed: d474f6aa-a4ee-4765-9a3e-f7708f614d90.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.593698)
Failed: c0ceeaa1-ac5e-4b12-a0e6-3df388dd5f11.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.89457)
Passed: cbcb3536-2406-4e1b-ba01-846fcbcec9a0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.945942)
Passed: 7a2ccc5f-2580-44af-aa29-9f19a402545a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.677266)
Passed: d9e03fbf-11ee-482a-9e9d-f9a2c8e776e5.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.799376)
Failed: 9d21a161-d99f-45c5-bab5-45dc8b3e2e8f.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.74233)
Passed: 4c013a8a-efd4-462a-a274-98112acd5646.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.866123)
Passed: 49bd3a98-4cf4-4603-9b78-2334c710f3ab.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.891562)
Test Score: 53% (7 of 13 Passed)
Tested 13 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_16_narrowband.zip... this may take a while.
Failed: 6a2c7892-d807-47d4-b494-d81dae020e42.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.889031)
Failed: af407d96-31f5-4140-8704-1e5fcb36c1c2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.659562)
Passed: 65d40aaa-69c1-430f-a94e-656186dce29c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.686998)
Passed: 3bb0f6a4-5ebb-4c28-99a7-bc785283330d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.834696)
Passed: 9f45cdc2-23b5-4d7a-a269-56c62972557e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.555478)
Passed: 061ae647-85b5-4891-b9a4-e67ae7776fa2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.845774)
Failed: 989654f7-8185-4411-ae88-c28e9b603c35.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.627177)
Passed: a8fe8ab1-f0d5-4ac3-b096-2e1ef7fa6262.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.824295)
Failed: 278773b6-01c4-41f0-8c73-adbe67be356a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.659201)
Failed: e77c962c-af65-4e4a-bd4d-5ba19e9ceb8e.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.429616)
Passed: 743f2771-27e5-469c-b813-26554711d60d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.613085)
Passed: 1e1c0a76-059d-43a0-9cf7-4fe15a80d333.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.859393)
Failed: 3c7054f3-743b-4efa-a341-3ae14b011667.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.888752)
Failed: ee3af4a4-2578-46b6-b7ae-1d58d33afb10.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.563625)
Test Score: 50% (7 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_17_narrowband.zip... this may take a while.
Passed: a62b7ca4-b6f5-437d-904c-e6f73f4ea7d2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.51378)
Passed: 68b70d71-7ec2-462e-a68e-297e13128263.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.918892)
Failed: 68688162-db4c-4958-acc2-677458bf0665.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.914403)
Failed: cf78dd84-20e5-4565-8e64-7d1088e07693.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.68974)
Passed: 0ae2172b-31c0-4fca-b6e7-ced8981a492c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.864144)
Failed: fbe02280-8ab1-4e3b-904f-042779874462.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.810573)
Passed: 87443f24-4181-4213-b54e-d1737b0d8269.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.642756)
Passed: 224dad55-1a1b-4fde-9d9e-c8d6f508a095.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.821401)
Passed: b681a26f-d5a0-49f6-8469-571dea172505.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.573248)
Failed: 67421f1e-07dc-431f-9f3c-f54cbc2b02c3.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.785205)
Passed: 541ac010-b172-46b2-a8c9-2b301aa9ad3f.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.560685)
Passed: 9fd37cef-c42e-400e-9280-cd05ef9e0a97.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.833762)
Failed: bc013224-be47-4061-9a64-a0306ef43cc9.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.885712)
Passed: c84ef448-021a-4997-be98-23d0149e4389.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.902783)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_18_narrowband.zip... this may take a while.
Failed: 2b452ff9-c4fa-4f52-a979-720a5605eb67.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.853463)
Passed: 9427a863-254b-4314-95e6-8567963558e7.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.834951)
Passed: 5081d1d0-bc42-44ed-af1c-269c8552401f.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.750849)
Passed: b15ddeed-d355-4f1c-a78d-441f3bb3c040.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.644999)
Failed: 422382a7-d85c-4f98-af20-9683f5214128.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.86818)
Passed: e555e21d-794c-4332-861f-434f2a6c50c0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.679566)
Passed: 1d9757da-f250-487e-8511-578f46ab4623.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.492529)
Passed: 3786bb5d-de5f-4066-94cb-f4941742e600.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.539525)
Passed: e1fec6dd-a028-4f5a-8921-5acfc1f8404e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.94084)
Passed: 008f5103-bd62-4d4a-b4ba-7a2dcc0ba217.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.924861)
Failed: afa2550c-0fa2-44ce-a9d0-92447d8f1ed4.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.587395)
Passed: 4b26a1f0-43ca-4770-a7be-9602f3cfb0f3.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.8236)
Failed: 5a39fa87-e35e-4287-876f-b4d243825159.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.810483)
Passed: 266c60dd-14b8-4e1d-ab47-b77bde8ff2a7.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.806233)
Test Score: 71% (10 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_narrowband.zip... this may take a while.
Passed: 52b873b1-e2c5-4990-b3a6-40f897c5f941.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.686917)
Passed: e38eb583-868e-4899-87dd-553d335b5ee4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.649759)
Passed: d6f0b4fa-509f-43b5-a2cd-8e5db7bca6c3.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.912575)
Failed: 706d747f-d968-472e-b839-e5c6e49cd5d8.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.924439)
Failed: ca0bd6b9-bd6f-477a-a5cc-5baa10edbade.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.654249)
Failed: 0861b89e-1b60-4bcf-86e0-22e1fc27b18a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.649323)
Passed: b71f89e7-822e-444f-bb9d-21ae9a87bb86.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.870031)
Passed: 547b7191-de92-4095-8038-6bbce93e9597.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.615972)
Passed: 2f794bf7-451a-4bd1-aff7-d53b66434b50.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.656172)
Passed: ecf61097-da02-45ba-aac9-00a276258de6.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.734622)
Failed: a564f976-a972-4a4c-920d-c64215c86183.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.667454)
Passed: b80f3cc2-9bc1-4162-8cb4-2a9bfc935481.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.748515)
Passed: 5a4fd3a3-e7c3-4456-a9f1-133c0683b2f2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.766245)
Failed: ed362237-9ba8-48c0-b7a4-b136ae05f394.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.741016)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_1_narrowband.zip... this may take a while.
Failed: a5beea56-8ca4-469c-b4a4-e2f5094f0673.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.604136)
Passed: 52cf30f6-bd6d-4c93-8069-0dcb3cb7c421.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.618568)
Passed: 5dc88ee9-0a45-45de-a7ce-c7ef6e3e7145.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.88834)
Passed: abfe1501-ac17-4a42-a33f-ad23f34567e9.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.795592)
Passed: 091f9ba4-5572-402f-88f2-e5ced6fca532.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.800557)
Failed: a3a09fbc-166c-4c76-8635-df91f1a28035.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.899463)
Passed: f4320188-3044-46a9-ac8f-21a36e123e18.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.70249)
Failed: 2da5f48c-d804-4f0e-95e8-48aa357a42f0.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.813069)
Passed: f3f20065-d999-4dc8-8654-a0141ac4ab67.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.790311)
Passed: 26caeb72-f348-4ad9-b851-511ae487af76.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.865008)
Passed: 86a3cde6-be85-4130-a2a7-d374c2fd16ff.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.625134)
Failed: 6358b812-828d-4681-89b7-c52463f21d8b.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.703883)
Failed: 1c5979fd-4afd-47e3-8104-711f944ef15a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.856281)
Failed: 025779be-eb7e-4ee2-a7f6-c6543f658110.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.738539)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_20_narrowband.zip... this may take a while.
Failed: 28d298b5-d55e-4952-a222-01c4ea5c1b59.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.605717)
Passed: a5fac7f4-af7c-40f5-9fc8-f1c8c28eed59.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.781097)
Passed: 63a94b7f-5b71-4b50-a050-55a789c7e066.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.528207)
Failed: 372ea195-2ff9-4bcf-8d0d-1a28a442ce4c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.773723)
Failed: 61e246da-a27a-48e8-9b5b-e18a95ab5b1d.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.743061)
Passed: a9215edb-c5af-4c29-961b-1dbf44c5ba6b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.562153)
Passed: 877b0099-a981-4f49-a28c-9db3e1b7199d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.869514)
Failed: 76226e49-1c30-4ba5-b448-b48990fa82f7.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.91436)
Passed: 8400e162-151d-47ff-90d5-088af6773bb5.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.73805)
Passed: 69becf30-6c4c-4f31-893b-0b0acf1ea8c6.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.673179)
Passed: f5faa3aa-3060-4e42-bbb5-c2f81df18a9e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.621866)
Failed: 6c41fe36-2fc6-4d7a-8b00-fe90b499e579.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.516068)
Failed: 51ee5719-0a9a-48bf-b6b8-96b67b27b8d9.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.616459)
Passed: 832e66fa-b791-4d04-9aaa-1143ff96087e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.750054)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_21_narrowband.zip... this may take a while.
Failed: d3288584-c1c1-4cfc-86f5-415818a80123.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.673304)
Passed: fa8df588-e83d-4bb3-91bb-a44386e72940.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.594472)
Failed: 547f1769-fd15-443a-b299-9e913ab8beac.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.897542)
Passed: eb50e669-a85d-4084-b4cb-77efc6765450.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.453681)
Failed: 742f24de-e9e1-44b3-9dde-927288a1e461.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.681172)
Passed: b0907794-ca99-4c6f-84d2-4b4b1ed6aeb4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.823123)
Failed: 33f06b3a-4590-4e1d-a1bc-8aaddb13d9ff.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.877292)
Failed: 24f70655-6991-4aee-875e-473cafef5923.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.635514)
Passed: 7f30f31b-6517-4b7e-a889-25b029ab430c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.595931)
Passed: 1271cb49-919b-4fb4-9b62-d7f2490af503.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.829818)
Passed: a7043693-9df1-4e98-b9cf-ef8052953c6e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.850808)
Passed: a27d09a1-020e-48bc-9980-38f6e311539f.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.654906)
Passed: 10fc5a0e-7d3e-4df2-b26c-bba33a4fba34.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.636017)
Passed: 4ab5802c-97a3-452b-b64f-1a0175711201.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.850694)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (11 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_22_narrowband.zip... this may take a while.
Failed: 1efd0188-7281-4235-a504-c5a31fbed6f2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.830409)
Passed: 67bbf539-2d1a-461e-81ee-956232235fea.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.763119)
Passed: acf19d52-c26c-4f59-a89b-d735868ee456.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.79752)
Failed: 36f2ac77-f47f-4e20-b442-d83c26d4f6b4.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.559706)
Failed: c0115192-991a-4809-ac93-8cc807faa6f0.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.844037)
Passed: f33236be-2956-4b33-93f8-02347600a117.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.796191)
Failed: dbe846f8-83ad-4879-b877-d45320cc85b5.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.855863)
Passed: 721a7b9e-44fe-4801-98f5-7b246cc94ec1.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.828361)
Passed: ef6f38fd-c2e5-411f-840e-6559392c4595.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.752282)
Passed: f5f7d4c1-a9d8-4b1b-9edb-84d3f6bf0a2c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.899583)
Failed: ee870d5e-871c-4527-8bee-690d3d014bcd.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.520561)
Test Score: 54% (6 of 11 Passed)
Tested 11 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_2_narrowband.zip... this may take a while.
Passed: 608b6382-304a-45a2-9c45-c8d5e4d404ec.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.933424)
Failed: 2b737681-5379-4e54-bf60-5bf267d36a60.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.676389)
Passed: f33c7926-9a2f-486e-9044-be155aa984f7.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.928673)
Failed: ac795d54-93c3-4614-9d80-3da9bc6b6fc4.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.558942)
Passed: 33823be7-ee2b-4471-a2c6-8e6c1e356a48.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.673443)
Passed: b4ccf007-ce88-41fd-b6df-d76818b974f6.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.770187)
Failed: 4286511d-94aa-4e00-bb71-61a15c91d2db.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.851003)
Failed: 16651676-7b1d-4095-b4a3-262c4e445be3.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.778665)
Failed: bab2edbf-bba1-4466-83aa-ba2c8cd0ebd3.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.645162)
Passed: fa3a8f61-675b-4f20-b201-6057d6d109f4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.843424)
Passed: 4f24940f-8c21-4799-a80a-c4bbdc0f0af7.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.741396)
Failed: eec0df22-934e-4904-89d5-e84a311423d8.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.774108)
Passed: eb6165fe-1f62-4b7d-8506-eaea3045e83e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.622846)
Passed: cb072df6-cd29-4670-87f9-4e0a8c5b7730.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.670927)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_3_narrowband.zip... this may take a while.
Passed: b762bdf2-592e-400b-9ea3-76be1829652a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.515457)
Passed: bd082683-b790-49b5-9d01-4f063fb29fdd.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.80327)
Passed: 201c836f-3f88-47da-98a2-d2479b5de4cd.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.686069)
Passed: 04690d45-8aed-4c4f-86b9-93ed24eb2a72.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.835796)
Failed: 09656261-64a2-4279-a4f6-81084fe515c5.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.701237)
Passed: a08b87a2-e8f9-4eec-a46c-7900218a5845.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.91551)
Passed: d125b75d-459e-412a-818b-7f02c118096b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.657282)
Passed: 3c8215c8-7f92-4e29-abbd-a17770ef670f.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.759277)
Passed: 08096881-2b19-46d2-8195-6f2f37515bfc.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.758448)
Passed: 947593d2-6ddc-4867-92b3-cc8352ed488a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.91556)
Failed: fe54dcb1-a227-42ba-84ee-028f7039ce39.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.630809)
Passed: b3271079-a6fe-4b37-930b-bb8aba24d4f5.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.641995)
Failed: c6a88860-aadb-40ab-9ed0-de08cae4d120.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.738216)
Test Score: 76% (10 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_4_narrowband.zip... this may take a while.
Passed: e9365574-9085-46c5-9229-d0ae65afcf41.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.68862)
Passed: 60c4287b-8cae-44ef-9635-8b3617c4c77c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.802184)
Passed: 8abaffe5-a224-4c0c-9728-8f3ef3e0d43e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.737925)
Failed: 3cc113ae-4652-4011-83a8-1e4a10556021.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.768197)
Passed: 45dc4827-201d-4f34-b4ab-ae5d8b2d9c58.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.492723)
Failed: 6bc956e7-5219-4aea-acff-b1c1f5b132fe.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.749795)
Failed: e4240b2a-e961-44e1-8309-5d248979c59a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.509272)
Failed: 56416f78-ed95-4a77-9a10-e6748f61c855.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.701765)
Passed: 69cae085-d8a6-42c5-ab23-641b863d0c4b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.618614)
Passed: 3b16e7d7-b489-4f17-84eb-28ac5bbc2a95.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.70257)
Passed: 431771ce-08b0-415a-a123-1532ca1e0edb.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.859674)
Passed: 039212ca-5eeb-4b0a-934b-4df91d49b358.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.712858)
Passed: 280e8edc-19dd-4681-937a-7559448baf63.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.650922)
Failed: 889ad857-5d59-4833-b5be-7c6333a2be5d.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.68842)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_5_narrowband.zip... this may take a while.
Passed: d516f39d-ec32-4000-94b0-83da17ae7649.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.763162)
Passed: 8bd70c8e-7bb9-4b80-905a-1c3323d0ffd0.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.703923)
Passed: c55e3b1e-76ff-49ac-858f-5405153da75c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.794962)
Failed: 1906c771-e894-4fed-8340-eaf227fc7a5c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.66344)
Failed: c5d8b1da-ea0d-4be3-8e02-13872f828151.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.961225)
Failed: 63d9cb2f-c4e9-43e9-927e-0a423d1c2875.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.869346)
Passed: 7e806dab-7a41-473b-bd7d-d45382184a1a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.800941)
Passed: 820a891e-53da-4c1c-8646-142471010580.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.813028)
Failed: 447d7615-c59f-466d-abbc-b61971343f56.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.773918)
Passed: 11effdf0-6b3b-40aa-a36f-9040c448b6d2.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.834403)
Failed: d7f86c9b-b424-4d1b-9aef-ad6a6b7c56bc.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.818571)
Failed: d6981a73-aad8-4dd4-a785-cf6221ef5ab8.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.887714)
Passed: b59edd13-4bdc-4903-a94b-745482f783e1.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.583173)
Failed: 87fbd825-348a-48af-8b10-7c22d2853640.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.596949)
Test Score: 50% (7 of 14 Passed)
Tested 14 images in 0.15 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_6_narrowband.zip... this may take a while.
Passed: f013a9e5-c73f-43f6-8013-fc7a6ba4cdd9.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.852047)
Failed: 244792f5-9cc7-48b6-abd7-2ead2a3d3451.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.861345)
Passed: 6239eb4b-94b2-4e2c-8675-85b94dbbce8c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.882039)
Passed: 36c3dce8-438a-4a09-8ac6-d61eb18840fc.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.577663)
Failed: b7877021-af0c-4f2d-a46c-0cfea68cf198.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.733338)
Passed: e66f1776-c501-49a1-a10e-9bd3cde44bb6.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.427344)
Passed: 8b801413-aaa5-4dda-abab-786767d1b06b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.824906)
Failed: 05defd55-619f-4a5d-bb62-b633bc2395fe.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.868324)
Passed: c59870fc-502c-4b85-b4ac-1d5f23fcc388.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.821515)
Failed: 6a87602b-74e2-4c14-a03f-05bf65e31aa2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.79564)
Passed: 8b092832-a349-4227-87d1-5adeb6272530.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.815788)
Passed: ededf7a0-b7e1-4944-b66a-52f2a08cd631.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.642349)
Failed: 830f279a-cc84-4132-a28d-a288081bfca4.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.915953)
Test Score: 61% (8 of 13 Passed)
Tested 13 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_7_narrowband.zip... this may take a while.
Failed: 2e76ca0b-56c4-4b67-a20e-70004ee461f0.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.715982)
Failed: 4d92fdf3-872b-4fb6-85c0-c26cdf90299d.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.918692)
Failed: 1f999c9b-595d-4932-96b6-4a3db140d9f4.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.684762)
Passed: b71c6102-36d9-413e-aa9e-18491ee6054e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.834828)
Passed: 73ef2b30-2fd8-4e02-bf5d-8995968254a4.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.863471)
Failed: ffaaceb1-e3f3-485e-a50f-d00e848d9727.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.962187)
Passed: 7dfb30d1-42cc-4345-bba3-d4aebd58476c.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.52315)
Failed: 0b6d230e-1708-49ec-94b9-1c2b91fc28f2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.947992)
Passed: a89eba8f-4c22-4ce6-80a4-04e4a2442643.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.865162)
Passed: 44e08cba-e52d-4602-a276-2bb790b5d8b9.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.767407)
Passed: d3d208e5-63d0-4eda-b282-e39d084f812d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.934926)
Failed: 2dc479a2-80be-4ed8-a70b-3fd283492668.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.941991)
Passed: 620b1fb2-2e50-47e3-9934-072d04fc35b8.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.793901)
Test Score: 53% (7 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_8_narrowband.zip... this may take a while.
Passed: 370ba5f2-aac2-4f96-9926-bd5f53964e2a.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.668771)
Failed: 0d10d084-a2cb-4f02-bfc1-7f1b149e928d.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.87977)
Failed: 94318a04-b8ec-4cae-ba7d-b32186ae093c.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.698828)
Failed: 817f46ba-3469-4250-8494-3cfc67625fc6.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.700379)
Failed: f5f8de49-6dc7-433c-87b2-afb1f8cc966d.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.561787)
Failed: 074e737f-9dbb-447c-bdb1-1903a2e16a53.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.735556)
Failed: f335f63a-15db-497c-8107-1830cb8010a6.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.825318)
Passed: d397e86c-3d63-40c4-8daa-d903092c7f73.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.604893)
Passed: 39d28f4e-07b0-418d-881f-c624567b4484.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.797221)
Passed: 35045d69-437b-47de-965a-7d986be72848.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.881235)
Failed: 6831e3a2-48fa-448d-88b0-29ac2f314d9e.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.723234)
Failed: 5ab75a5e-593b-4558-8a48-8143f4aaa9c8.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.790067)
Passed: b718b45e-ebb4-4015-af2f-3450aec8b681.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.621603)
Passed: cd1badeb-96e9-4b3c-9961-1116e527956e.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.681202)
Test Score: 42% (6 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_9_narrowband.zip... this may take a while.
Failed: 12458a47-f333-4237-9026-ab777c8bfef9.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.694792)
Failed: 797dbd65-c36d-4277-9081-6666c44e0524.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.635731)
Passed: 4477b139-a7ff-46ff-aff0-977d539e2f8b.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.883363)
Passed: 29f19abd-acbd-4cde-a3e4-61e9385a8609.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.835304)
Failed: dec4bd26-9a7d-4dfb-8317-8458983eb16a.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.853371)
Passed: 966729cb-057d-448f-aa21-639092bd3c7d.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.88216)
Failed: 8591745d-8814-4542-a7da-2720b860d248.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.649541)
Failed: 85f23db2-d897-4879-9e82-615cca0040eb.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.588593)
Failed: 83b685fe-d9cf-4d54-bffb-7523f3226261.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.792839)
Passed: 9258b94b-acff-4f74-bb19-6b067d11bbfd.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.752221)
Passed: b8669fff-ebda-48f5-806d-6e844cc6f921.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.53149)
Passed: ddffe334-d638-49e1-8103-7067756ae2e9.dat.png - Actual: narrowband, Watson Predicted: narrowband (0.720413)
Failed: 0f6b63da-b2be-4260-9de7-b1315c1c331e.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.688963)
Failed: 71c1b2f3-fb5f-4328-8154-5eb0560391b2.dat.png - Actual: narrowband, Watson Predicted: narrowbanddrd (0.62321)
Test Score: 42% (6 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_10_narrowbanddrd.zip... this may take a while.
Failed: 36444f65-331d-468e-8842-e6c539328ac1.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.762849)
Failed: 76a09127-f316-456e-b033-b9c6a80beac9.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.907817)
Passed: 91054c02-9bf0-44fa-b67e-cd5cac7450fb.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.963118)
Passed: 3e3fa569-0938-48d5-8f01-3c3feeb261f5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.936958)
Passed: a9b5400f-f3c7-4845-8414-49087104a1fd.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.81209)
Passed: 24f60e99-d258-46e1-9b31-2d5bf81fd151.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.779345)
Passed: e53bb444-5df1-47f0-85fd-fe04c0441b66.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.648442)
Failed: 12d853bd-b107-4c47-958f-127a02dc1312.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.603515)
Passed: 498b0b02-dd43-4804-9ccc-9721f4d70b85.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.811213)
Failed: a2078935-cb05-404c-9c61-edaea5f4a3b5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.747722)
Passed: 35b04b2c-a9ee-46fc-bedf-3a27de4dcb43.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.724223)
Passed: b0f4b974-9976-45c9-afe8-7874842f34a7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.699406)
Passed: 09160672-dd11-4e1b-b43c-2abab221f1c5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.898063)
Test Score: 69% (9 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_11_narrowbanddrd.zip... this may take a while.
Passed: c4a2517e-d2ed-4181-89d8-bc66f7667913.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.828483)
Failed: dc7ebe4f-0229-44eb-a90a-4c396c6f4969.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.832419)
Passed: ef27b0a7-a7dc-4ae0-b9d5-72ed60a40c5d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.913924)
Failed: e6cc5ba7-32a0-46aa-925f-77bb88b13774.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.498654)
Failed: fc2e08f2-ee87-48f2-a03e-08e3ac26b433.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.59338)
Failed: 542d93b3-0745-4b85-8f9a-622c5a92f685.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.560937)
Passed: a708b33c-9442-4609-b71e-4bf1f8c813f9.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.510364)
Passed: aef41dfb-eaa7-49b0-b3a4-d26ff93e175f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.642188)
Passed: 0582bf2e-587f-4bc2-865c-9ef13feda309.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.895134)
Passed: 1973c93c-3a0c-4fa0-ae92-dc3f6f2a5855.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.665322)
Passed: 6fc85bc0-a844-4c2e-a2e3-15ee02f9c7aa.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.748727)
Passed: bf6992ef-a367-4db8-8317-a03d6d404cda.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.693088)
Passed: f3cbdf52-436e-4b5c-bd8d-e056e46f54f4.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.886792)
Failed: cdbe5111-53fd-4a88-9ac1-affd2ac90944.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.354558)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.133333333333 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_12_narrowbanddrd.zip... this may take a while.
Failed: 3ea563b8-ab6a-4b28-921a-f129b488b5d2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.883139)
Passed: eff79bd0-4b3d-4c7c-9c98-24a652a4cb06.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.655681)
Passed: 6372ed56-5495-40f1-b2a6-96295a92a128.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.788659)
Failed: fea4c157-1d41-47b9-8383-9f7fe7681292.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.778054)
Failed: 78a83674-f2f4-47b1-b940-eecc5b1263cc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.914244)
Passed: 4b503fd0-fadc-472b-9518-902a7861ead1.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.672763)
Failed: 899e51f1-2bf8-40da-9d20-23563cb7f81a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.499888)
Passed: e9ffe9d5-e9b9-43c3-8380-10dd429fb65d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.906917)
Passed: fe6f4c8f-3de2-4923-85db-2d75b3e77e4e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.559366)
Failed: 3e2b5b79-b515-417a-82c0-3c19aa2444ad.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.569803)
Passed: f082ab21-57d7-4342-a579-1e8c6db2db3d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.818271)
Passed: db414c71-afc8-4ed6-aee6-b2721f37b780.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.93051)
Passed: 85e80379-0f91-4392-bc67-f37bceb0dc6c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.874722)
Test Score: 61% (8 of 13 Passed)
Tested 13 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_13_narrowbanddrd.zip... this may take a while.
Passed: c9ca1316-2463-4ab0-90fa-74ec0da5be63.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.596937)
Passed: ce5b7bba-e29e-470e-b0e5-40c47f0d57aa.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.931727)
Passed: 27aa16e2-9391-4af1-a52e-313c00f0a45d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.752042)
Failed: 469f5453-2e4c-461e-a9a4-ffdac2b88b17.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.721535)
Passed: 23481689-8341-4897-8822-e5c6de553b48.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.681327)
Passed: 9ce5ec24-ba60-43d7-ab24-2e343076f770.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.861771)
Passed: acaabc27-e67f-409e-8322-4de5f5bad8aa.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.685653)
Passed: d2b60a58-aab2-48f1-94dc-e9606836d48f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.765415)
Failed: 78666cb4-120c-48c9-b0a0-a1bf0ac0a867.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.93506)
Failed: 7989b06e-6266-4020-a7e2-1d9573f8bec0.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.927956)
Passed: 97d32e04-24ea-4a92-991e-c8e698b6e4ee.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.917747)
Failed: 732e9de7-cd76-41b6-bb43-b18fcdc22fee.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.631602)
Failed: f9af7405-bce6-4f06-bd65-d65641df2ed3.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.70258)
Failed: 458c0dfc-d8dd-4541-aa71-f9a3946c8680.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.622523)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_14_narrowbanddrd.zip... this may take a while.
Failed: 7e631737-1561-4358-85c3-fb2ca51adefc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.773216)
Failed: ba536566-0d7e-4552-9474-5ceb6d4fc10f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.735459)
Failed: 23180343-cc97-4427-b90b-d1fdb5056797.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.618497)
Failed: 7e44a48d-d3bf-43ae-99d9-de09f1a53dc8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.77912)
Passed: faa9cbd9-484d-4d80-a182-d71d4f4cc55c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.754271)
Failed: 798e20b9-c126-4ecd-a6ee-dee895d14d44.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.587637)
Passed: 3db5cd24-665d-455b-98ba-71441045169d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.780164)
Passed: 52cf2853-2637-438a-85b0-e7bee90a61df.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.904507)
Passed: b31d9dec-5659-4c9d-8094-3570cb94c9c5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.919595)
Passed: 0a052828-09cc-4a64-abde-a5a8e2843383.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.66883)
Passed: ba85e428-5c8b-44a5-ab42-c0130261b531.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.909245)
Passed: f54b0993-e0cd-43f7-a10a-92a88f401155.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.64949)
Passed: 66090ae3-a553-4f7c-9b4a-bee47bddbfae.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.88766)
Passed: 7f565c9e-cc3d-4936-85ee-7f8702806a4b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.727583)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_15_narrowbanddrd.zip... this may take a while.
Passed: efc2b4d3-fd30-40c3-8cfb-eb12ef2f153e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.865361)
Failed: aa7fcc4b-9194-445b-a6ea-58b5c96ce269.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.590565)
Failed: b1b3ebe8-f39f-4c03-b258-28902e1d0ca6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.694715)
Failed: ff5c88bd-56c3-473e-8712-ae5dc36ab1ad.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.583127)
Failed: fb63ee20-74e7-420b-ac63-cd221381b256.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.602699)
Failed: b6d04876-a03a-46a2-af7e-5129810c7f04.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.752086)
Passed: c7b988e5-023f-4e24-8195-95dbab13634a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.587252)
Passed: f7349332-f9b8-485a-9050-f3cba70ae643.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.821904)
Failed: d8cf4624-fa1f-4deb-b233-07917403d9c8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.86012)
Passed: 59631170-32e0-4bc8-82e6-ef9993c0d161.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.68925)
Failed: c0651aa4-db03-4a02-9491-cabf55039d2d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.623791)
Passed: 2fdf9595-bf35-4e61-ba17-9053e8c55fdc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.867887)
Failed: 81eb19c4-2b52-4c0f-bcfe-c607161fc4ef.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.902195)
Test Score: 38% (5 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_16_narrowbanddrd.zip... this may take a while.
Failed: ea7dd5e0-6e75-4509-a017-cccdefb08c07.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.725612)
Failed: 78a61f67-74a7-4ea6-9c3b-522e9e7b91bb.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.674317)
Failed: be770123-f10c-4483-b96b-45617c51a9e8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.810918)
Passed: c5ff6efc-91fb-4038-9d46-d50a4275a42a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.814879)
Passed: 0829926f-dc27-4c00-80fd-968a7ea558ca.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.597)
Failed: ae394633-d37f-4311-ac27-845b8674042e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.886899)
Passed: a59262d9-3eeb-4e22-8c5c-514daf6fb77f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.775232)
Passed: 7280145c-d5bb-45a0-8933-c24caf2aedb8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.771557)
Passed: d7656f9e-e389-4583-a326-21e584e153cd.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.86166)
Failed: 407461e9-f1c5-4eed-8e14-7a0c7acbc748.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.803454)
Passed: e580cdae-bf33-4167-b5ec-74df272fca86.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.935398)
Failed: a6a3a120-abf1-49b4-9d92-2b9671a40589.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.888515)
Passed: dac2a874-0206-4350-8637-119aa69f7ed7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.771759)
Test Score: 53% (7 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_17_narrowbanddrd.zip... this may take a while.
Passed: a2abe937-168b-4612-b07a-5053d6b28825.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.673056)
Failed: 1677993d-7507-433e-9215-10bb7da93f69.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.675577)
Passed: 1e433c9b-9dfa-4da7-b1da-c8dd64c03e36.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.91678)
Passed: a5eca1b3-e131-4985-a285-ae96597d67d8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.546524)
Failed: 8d5a7a65-e9f2-4a33-b02c-d8b89c97739f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.529697)
Failed: 8d1dce92-aab0-44bc-869f-8b997fe32423.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.501534)
Failed: 379d1fb1-ae7c-4662-b304-aae595d88f4d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.574289)
Passed: b1f2b409-13be-473f-9243-bec2afe29d58.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.887839)
Passed: 31efa14b-cb36-4ff7-ac36-6fba12b7f0df.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.854787)
Failed: e69bc753-86fb-48cd-aac8-6304b2aaa6e1.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.515925)
Failed: 98e5e791-16ba-4f44-964b-ae40a377502c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.63337)
Failed: ab75db8a-6c3e-4ef0-b686-1a88f3bbcbb0.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.691314)
Passed: 10aa3e9a-a2a6-4544-8c05-3355bf8d6546.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.673353)
Test Score: 46% (6 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_18_narrowbanddrd.zip... this may take a while.
Passed: b308a947-3181-4dcd-9b81-88d0d19ad8b2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.731584)
Failed: 1d85e906-cade-4c18-b2e7-c626f9f68435.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.690758)
Passed: 46a5343e-d611-4530-8582-f6861f2b3c01.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.705949)
Failed: bf69fc6f-e65b-4708-8dc5-963cbac7322c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.680375)
Passed: 52420254-5068-4de8-aa1d-9c4ac6aa4034.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.824172)
Passed: cd1ab8b3-1699-4a1a-af11-7531d4574040.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.90389)
Failed: 5b8e91a9-b3f8-48f6-b8aa-5fcf9b54a167.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.908118)
Failed: 3d21961a-5cbf-4083-ab8d-46e0d5dcd956.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.903534)
Failed: b7098eb7-cfd5-43e3-abfe-47f2ad90e658.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.828654)
Passed: 53a4940c-d810-4c6c-89eb-a7f9b59de453.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.741954)
Failed: 2af112c7-6f05-4490-9005-bc5d7dc750e2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.935695)
Failed: 08e4b48f-8410-4c6c-be9c-4b5ad381eed9.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.686846)
Failed: 82f06118-2882-47bc-8313-48f18a536d56.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.888204)
Test Score: 38% (5 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_19_narrowbanddrd.zip... this may take a while.
Failed: e3e9d859-64e1-4030-b188-80f9a80a52db.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.789822)
Failed: 80673aad-2d9f-4651-a35e-7f39afd65226.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.821802)
Passed: 3254d849-6c03-4396-88f1-2ab26fcde8d6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.826488)
Failed: 6accb8ae-5647-4fde-9c53-54baabed9c73.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.719351)
Failed: a04292d1-b797-4488-8c42-685bad8a7351.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.85016)
Passed: fd8c988b-6421-4f74-97b0-1ec77295680b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.672051)
Passed: 3124da89-f0b1-4f54-a1f8-1870b8534fe2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.824603)
Passed: 01cbdc8a-3ee0-4a54-b82d-7b1b61712b79.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.865113)
Passed: 241a37f8-f832-4287-9889-3ade4cb086d1.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.674905)
Failed: 4952ff1f-daff-425c-bbb8-de0eb3e818f5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.715842)
Passed: e428eaa8-458c-41d2-8f8e-881f47049627.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.862871)
Passed: d9385877-e633-4278-ba95-7c8ba82854b6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.874183)
Passed: 4a34a913-f71a-4bf0-81b5-b45fa2632768.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.662123)
Failed: 781b4358-db5d-4be9-941f-3458412e4a95.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.670221)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_1_narrowbanddrd.zip... this may take a while.
Passed: f7714f41-4a43-4430-9451-7db44a7dc831.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.679925)
Failed: 65b7d552-3fdb-4d94-9846-7a649a39b356.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.911956)
Failed: 75169aed-9367-417c-82a5-0bf1b4fc4ee9.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.66581)
Failed: 2e715bbe-9f4e-4797-99c1-0f7b329df949.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.823565)
Failed: 38d20769-3f94-4dee-ac37-73233a25dfd5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.707825)
Passed: 374705e5-e659-4aee-a46e-e725096c45d6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.779261)
Passed: ccc341f8-a154-4613-89c3-85cd67dafa66.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.770894)
Passed: c8e5755b-27dd-4fcd-a4c3-336e1ef8c6e3.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.718782)
Failed: fa080707-b521-45f4-acf0-17f2b9342a57.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.413373)
Passed: e4477781-07d8-4553-8bff-bf091ca4f2de.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.690129)
Failed: c92c7dd1-2610-40f3-8b70-2f574b7f8f6b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.477325)
Failed: ce2d0efe-eef2-466a-b561-cbb2df75aebd.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.893317)
Passed: cdd4d849-fe4b-4a90-9fa5-afb642aacad8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.654896)
Test Score: 46% (6 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_20_narrowbanddrd.zip... this may take a while.
Failed: 684df170-a8da-42d1-b6c7-ea245c0c795c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.807979)
Failed: fe547600-8bf9-4830-8ecf-a4ee6f2ebf45.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.845065)
Failed: 0a0ae231-d3b5-470d-83fa-23861c19f5cd.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.495771)
Passed: 7cb77b18-575f-4040-a954-8f1640f2bdab.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.885032)
Failed: f1b5d4ab-ae4e-4ca0-832d-c14fdd03894c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.837273)
Failed: 647b6dd6-a026-4f96-b431-35b1c47129da.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.78807)
Passed: 70a7638f-9d98-4090-8a17-c6adbe5f6055.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.707602)
Failed: 105b2236-6b4b-4d13-a43b-fe993e9214f2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.802356)
Failed: 3c7a3844-db7e-449d-8058-01a853d4188c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.637746)
Failed: e5764e09-77fd-4499-bd20-d0209484626a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.801197)
Failed: c0901a41-3c0d-496e-835b-81158dce8036.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.621494)
Passed: cb81e039-690a-4e43-99eb-c81311cdd0f2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.809727)
Failed: 14df76fd-e0f4-44d6-aebf-cafad2a8a7ab.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.889867)
Test Score: 23% (3 of 13 Passed)
Tested 13 images in 0.116666666667 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_21_narrowbanddrd.zip... this may take a while.
Failed: d12addbc-50db-47c9-97f1-40f75290a88a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.803873)
Passed: d4cf7d09-18dd-4a26-b4b3-0d38e3ee3a8f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.854419)
Passed: 43d75330-ca2d-4c2c-b96d-d36c8c8f628b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.717813)
Passed: 8a312ce1-9c13-4c0b-a94a-4aa6dc772c09.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.807769)
Passed: bc5eee51-1690-4226-9557-b7477090b88b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.813856)
Passed: c28feed7-8b6f-44c2-8b39-9b4ba7f663f7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.585917)
Passed: 3b29338f-76b4-45cb-80cc-837cc0e09c8c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.927951)
Failed: 3627b667-9943-4761-b4a7-9c52ffcb6db6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.596465)
Failed: 7545cafa-97ba-4dc2-9c2c-37f543e71312.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.539455)
Failed: b3b57da2-539c-4b20-a041-dead2113dba8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.603547)
Passed: 05506ee5-113f-4fa1-a6f0-29b9cbf069bc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.82971)
Failed: 2e6ba277-8d96-437d-9f83-c4942774aa41.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.698513)
Failed: a50a5e82-7c18-418c-bffb-30cea101ac56.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.888367)
Passed: 18803ef1-2101-451e-9e66-37c14e004b49.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.466819)
Test Score: 57% (8 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_22_narrowbanddrd.zip... this may take a while.
Failed: 574cb2bc-9524-46ae-b5e3-ad5f12c94f7e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.58183)
Failed: 0d76c951-60f1-4ce5-8be3-17486ca08bed.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.769697)
Failed: fb4ffd22-2aa1-45d7-923f-d94cd8835e2f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.762342)
Passed: e4c35e01-b178-4d83-afe6-3e680e446c88.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.861988)
Passed: 81d0e3cb-d033-4ce4-97e9-cb68852f4ce6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.701658)
Failed: ed5b49c9-05e6-4fc9-b603-3cc0ce615157.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.771521)
Passed: 13d9673a-6589-40bd-ac2b-e83bb3e7c796.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.800555)
Failed: 4e4caf48-54e1-4569-95b5-4ebae3e0630c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.508403)
Failed: 8f323bd7-297a-4db4-bf97-180528adda2f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.75654)
Failed: 5c93371e-66f8-4321-acf1-902378793357.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.657714)
Failed: 84a3b30f-d717-4328-9f3b-4360fe3f884e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.811447)
Failed: bb803df6-3b37-4e1c-9c42-3984603eac8c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.55944)
Passed: bbc9540e-08d4-4c8c-8519-54d0ff8a2cab.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.872159)
Test Score: 30% (4 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (3 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_23_narrowbanddrd.zip... this may take a while.
Passed: c03d7d18-feb1-495d-a613-6ccdbf48312f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.79112)
Passed: 4b70b9e2-f6a1-4ed5-b165-a93931dbf5bb.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.646835)
Failed: 05ae39c5-4460-4f7b-b523-3859792f8d7d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.602628)
Test Score: 66% (2 of 3 Passed)
Tested 3 images in 0.0333333333333 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_2_narrowbanddrd.zip... this may take a while.
Passed: 972d592a-aa69-4e26-b3a0-e00bfadffcfa.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.558543)
Failed: 481ad4e3-7efb-4923-a50d-dfd71c3a2a2f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.65076)
Failed: 0a42d105-1b8a-4726-b125-1216403aaaca.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.622539)
Failed: be2d2c82-0471-4179-a06f-b9e67a2a14d2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.853033)
Passed: 8ffddf82-7888-4d14-8764-9fba52fee506.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.81796)
Passed: beea0e17-1e80-4d81-9c1e-a432171cbfa5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.670977)
Passed: a0777332-8e2d-4df0-99c6-5211f9835f3f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.631423)
Failed: 073b0500-260f-4af8-bcef-7c96798f10f0.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.701023)
Passed: a22f0139-7023-416c-bc13-6541017bd150.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.760879)
Failed: bf1ac52f-4d80-4eed-839e-f5fd18effd5c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.734798)
Passed: 13c225be-c190-4cda-bebb-41b142f85d44.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.841021)
Passed: ba1e97ef-76a9-4d07-b6fd-dc09ecf88400.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.925037)
Passed: 1b43db3a-07e1-40a4-801c-5fd63da734bc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.823198)
Passed: 1dbdd158-ce74-4aa0-b0ac-99df1886461d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.848158)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_3_narrowbanddrd.zip... this may take a while.
Failed: bd52e3f2-bdc8-4705-9cc6-3b346a22e529.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.89306)
Failed: 1c46d169-a797-45b3-a3ec-509d877cec1a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.705378)
Failed: 171054ab-793a-422b-a249-ace99eef167d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.77791)
Passed: 188cab72-b761-43c2-91ee-41dbf8773f3e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.693235)
Passed: a243dc0a-10bd-4ca5-bbce-27524f42b38c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.683759)
Failed: 6206ecd7-4a16-47b8-b732-74c3f4716c8a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.793224)
Passed: c750cdcf-4354-4adf-abf8-325bf13f65d7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.757835)
Failed: 23973c5a-08df-4e57-b4b2-e7ca30b0074d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.586278)
Failed: 934dd973-f333-47fd-97fd-0245744b72af.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.569825)
Failed: 746b8520-fdf5-4380-af26-32a43cef7ea4.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.50958)
Failed: a9b90343-f8aa-4848-91b1-82470552889f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.762071)
Failed: 9ccabf93-0a4d-452b-9165-8d0e8b2b9e66.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.910189)
Failed: 088b7703-422c-4438-8905-f0fed9e1a32e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.804665)
Passed: 16e76b83-0226-4cd6-bc17-97debe3329f9.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.745287)
Test Score: 28% (4 of 14 Passed)
Tested 14 images in 0.116666666667 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_4_narrowbanddrd.zip... this may take a while.
Passed: 396bd543-a3db-494c-a9e5-e555d16fa59c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.624328)
Passed: 721ca11b-a359-40ac-a902-dfe06d254d6e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.807147)
Passed: 620cd747-b99e-4c0f-ad6b-d9609a015699.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.687473)
Failed: b7088c11-46e8-42d6-9b94-911d226926cb.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.660456)
Passed: 174a4b3f-d2c6-4e72-a9ef-456b2f946629.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.950641)
Passed: 3940d08f-c7a3-4ea6-91e4-4310bc771de7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.752363)
Passed: b0178f21-ef1d-44f4-b6dd-17d5e2873bb8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.929507)
Passed: 8640c350-67b1-4a53-a752-c750128e7c0c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.872499)
Failed: 4f5dc2cd-e440-46db-80f5-47b51230490e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.60169)
Failed: 3f8fa7ef-0aee-4f0d-b3c0-761a306f5ff0.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.71171)
Passed: d5bcb47b-662d-4f06-8f74-d1c4c8ada55e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.926241)
Failed: 5824b87c-6816-4f35-966e-160195f3c57b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.749364)
Passed: 91f8c79c-ebc2-451c-9ebe-90e8ee6d3844.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.822811)
Test Score: 69% (9 of 13 Passed)
Tested 13 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_5_narrowbanddrd.zip... this may take a while.
Passed: 5c4ad2c6-0011-4023-bc35-9632cbf9a7c7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.737679)
Passed: ca548206-fd6d-4554-beae-cf362878a1aa.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.837129)
Passed: 9cc3f291-9725-4788-bf2f-718a82efddc2.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.591463)
Failed: 15c838f0-02c0-46f6-aead-bda68728f1e8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.762163)
Failed: c9864ce5-5801-46ad-a5fb-45d461aa176c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.635092)
Passed: 32db3966-d498-4507-a804-17c96500ef51.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.536111)
Failed: 334d22a7-f75d-47fd-9154-068601a38fa6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.729383)
Passed: 7c87a296-a639-46fa-92bc-9baeb4d9209a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.72934)
Failed: 0518ad0e-600d-47d5-b634-df15c6b10d32.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.730309)
Passed: c09ccfc0-a7d6-4638-b353-d13a70ddeeee.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.923784)
Failed: a7b438d2-c850-4086-8fed-909dc56ef124.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.799169)
Failed: 760e47b3-91f5-4ea7-9b66-7815128df9a6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.506197)
Failed: 4c7b0153-bdb9-4097-8e34-c2e4cd89a4bc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.836804)
Passed: 82ba0fd9-5610-4128-957d-26122814807c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.690584)
Test Score: 50% (7 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_6_narrowbanddrd.zip... this may take a while.
Passed: f65fa043-c2a8-4371-8fce-09610e896053.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.782135)
Passed: 16c89fdd-8cdc-433d-af77-519934a76020.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.69879)
Failed: b877fcd7-7476-4e38-9e3f-93d1fa2a27a5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.914412)
Passed: 303aed4c-3d7a-4126-9970-fa9e83c0ba2b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.581481)
Passed: d0843ede-c450-40f6-af4f-b087233d0b5c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.951193)
Passed: dc83e6b5-24d7-40c3-8e21-06482bb5b010.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.609535)
Passed: b878502b-8e95-4cbd-bf8c-caefacad9383.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.614933)
Passed: 4ddfdfff-8546-4fc7-adcf-65846fb107c3.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.666947)
Failed: 6801c8e6-5b7b-407b-a8a6-2817bc70d693.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.897737)
Passed: 718184b0-2968-4afe-9fec-9931da805b6e.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.745546)
Failed: 35cf3299-9273-4a54-86e3-dfe5559a85cf.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.78719)
Passed: 6eaae7b0-7c07-4d91-a0f8-be20d9d27dfb.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.824768)
Failed: 301dc101-cbe3-4e5d-ac6f-1dfc0c37228d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.915743)
Failed: 5c9ebdf3-cdef-4b37-8aee-e35c243fb930.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.675675)
Test Score: 64% (9 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_7_narrowbanddrd.zip... this may take a while.
Failed: 11b909c7-e6c0-417f-8501-841496b720f5.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.787126)
Failed: 73d94b03-b4d7-4d67-8b78-2d8815b92966.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.626005)
Passed: e46a0dc5-a4fe-4432-99f9-40b653c79d96.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.491593)
Passed: beb60f36-c744-4c4c-9538-d24512014e10.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.904951)
Passed: 71ea9ddc-924b-4ac3-b941-665a9b3664b1.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.87495)
Failed: 101a2c18-ba99-4df4-b3b5-8cfd75a3bd11.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.893374)
Failed: 87c1bfe9-ca6d-4d07-a44c-7438c68408f4.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.593531)
Failed: 265cb8a5-5708-4e77-bd71-e6a7840f6f70.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.895404)
Passed: 925558ca-f929-475f-af8e-03367aedc722.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.780554)
Failed: 836a9874-3566-4ca9-9c65-fb92ba10ee3a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.80507)
Passed: 1fa78fea-86da-4a2b-8c65-f9aa90bc0930.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.823065)
Failed: 76163de3-421d-4805-abc3-3e552f88f815.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.922661)
Failed: 51d274ee-969e-4d81-8c0b-8bfeb2e13170.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.909896)
Passed: 8cadb42f-1caa-4107-854c-adf01ae5e31d.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.551236)
Test Score: 42% (6 of 14 Passed)
Tested 14 images in 0.133333333333 minutes
Running test (14 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_8_narrowbanddrd.zip... this may take a while.
Passed: a1791d51-be97-49fe-8d56-046bfa8a6b40.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.847457)
Failed: ac02b44a-2541-446f-a22f-61a7279d7975.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.743389)
Passed: 1c9a4c8c-3578-42a1-95ba-bc6214b74065.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.836913)
Passed: 48e1d5a0-2168-4d87-8101-e4a4263fd742.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.892741)
Failed: 68dba3c6-eaf1-4d25-b81f-54d55413aedc.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.655917)
Failed: b3cf7396-014d-4e3b-ba0e-7fcdcd12c7be.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.881822)
Passed: 5d2174c5-19eb-4971-9900-fe2f20eb6552.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.62899)
Failed: a862241c-5e93-4875-a0e1-25fa93b923af.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.86355)
Failed: 9b74e880-0f44-488b-a7c0-8f5f93052d4c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.788192)
Failed: 901591e6-3797-4d88-b100-b267ea1001d6.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.509332)
Failed: d742df34-a64e-4c25-a717-1edecfc6577f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.511635)
Passed: d34205c7-0976-4461-9d56-95aba0780e5a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.775608)
Passed: 0d16dd1e-7d2b-43f0-975e-dac62f547359.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.53834)
Failed: ae15e124-87d9-4f4f-9c06-2227de25f31f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.619541)
Test Score: 42% (6 of 14 Passed)
Tested 14 images in 0.1 minutes
Running test (13 images) for /gpfs/fs01/user/sd2d-634b36332a0fab-8605aaf2c6e1/notebook/work/my_team_name_data_folder/zipfiles/testset_9_narrowbanddrd.zip... this may take a while.
Failed: d79f1f5f-5932-478d-bd1f-27ff8c3ce01c.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.883402)
Failed: 5925d9ba-1402-4c24-94c7-d9d86c9cf890.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.847052)
Passed: d49c6a62-1a54-458f-953b-916f7be6736a.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.882215)
Passed: e44f0f3e-a93d-46a5-a5df-ce2f67d11649.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.735598)
Passed: 1a3d8b2c-b05d-4a91-9040-a32464a8fc39.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.865206)
Passed: 19974d8c-3335-4933-8387-6ddb770a536f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.906962)
Passed: 7b637bcb-1cab-463e-b9ae-a88570459900.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.901172)
Failed: a7c09bd8-1051-42f0-a299-bdaf6bd564ee.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.452707)
Failed: be3603d4-3a6c-4b7d-a122-3c3dded7e202.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.703324)
Failed: 85e47db9-8d8d-41d8-ae47-2b7bd6c5976f.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowband (0.570322)
Passed: e7a08580-9bbb-4dcb-9cfe-8a18dbfb962b.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.85292)
Passed: b6adf79f-b85a-41d1-878c-0426061d6ea8.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.729093)
Passed: 0f42dc15-b3f8-4ea8-8b09-109a2e9961b7.dat.png - Actual: narrowbanddrd, Watson Predicted: narrowbanddrd (0.699385)
Test Score: 61% (8 of 13 Passed)
Tested 13 images in 0.133333333333 minutes
DONE.

In [37]:
import pickle
pickle.dump(results_group_by_class, open(mydatafolder + '/' + "watson_results.pickle", "w"))

In [39]:
watson_results = pickle.load(open(mydatafolder + '/' + "watson_results.pickle","r"))
# reorganize the watson_results dictionary to extract
# a list of [true_class, [scores], estimated_class] and
# use these for measuring our model's performance

class_scores = []
for k in watson_results.keys():
    class_scores += zip(watson_results[k]['uuid'], watson_results[k]['signal_classification'], watson_results[k]['scores'], watson_results[k]['watson_class'] )

In [40]:
class_scores[100]


Out[40]:
(u'dd12a6ee-99f2-490b-942f-eac012e572f6',
 'squiggle',
 [0.0291597, 0.906539, 0.0580988, 0.910706],
 u'squiggle')

In [41]:
from sklearn.metrics import classification_report
import sklearn

y_train = [x[1] for x in class_scores]
y_pred = [x[3] for x in class_scores]
y_prob = [x[2] for x in class_scores]
#we normalize the Watson score values to 1 in order to use them in the log_loss calculation even though the Watson VR scores are not true class prediction probabilities
y_prob = map(lambda x: (x, sum(x)), y_prob)
y_prob = map(lambda x: [y / x[1] for y in x[0]], y_prob)

print sklearn.metrics.classification_report(y_train,y_pred)
print sklearn.metrics.confusion_matrix(y_train,y_pred)
print("Classification accuracy: %0.6f" % sklearn.metrics.accuracy_score(y_train,y_pred) )
print("Log Loss: %0.6f" % sklearn.metrics.log_loss(y_train,y_prob) )


             precision    recall  f1-score   support

 narrowband       0.55      0.59      0.57       300
narrowbanddrd       0.55      0.52      0.53       300
      noise       1.00      1.00      1.00       300
   squiggle       1.00      0.99      1.00       623

avg / total       0.82      0.82      0.82      1523

[[177 123   0   0]
 [145 155   0   0]
 [  0   0 300   0]
 [  0   4   1 618]]
Classification accuracy: 0.820749
Log Loss: 0.479315

Generate CSV file for Scoreboard

Here's an example of what the CSV file should look like for submission to the scoreboard. Although, in this case, we only have 4 classes instead of 7.

NOTE: This uses the PNG files created in the Step 3 notebook, which only contain the BASIC4 data set. The code challenge and hackathon will be based on the Primary Data Set which contains 7 signal classes

This only shows you how to create a csv file. You'll need to take the primary test set data, create PNGs for them, package them into zips, then modify the code above to send those zip files to Watson


In [42]:
import csv
my_output_results = my_team_name_data_folder + '/' + 'watson_scores.csv'
with open(my_output_results, 'w') as csvfile:
    fwriter = csv.writer(csvfile, delimiter=',')
    for row in class_scores:
        fwriter.writerow([row[0]] + row[2])

In [43]:
!cat $my_team_name_data_folder/watson_scores.csv





















































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































In [ ]: