notebook.community

Edit and run

Parallel Forest Tutorial

This notebooke show the traing process of Parallel Random Forest. For cluster training please check https://github.com/wasit7/parallel_forest

import modules

Import all necessary modules





In [1]:



    


import numpy as np
from matplotlib import pyplot as plt
import pickle
import os
%pylab inline



    


















    






Populating the interactive namespace from numpy and matplotlib

Generating datasets





In [2]:



    


clmax=5
spc=1e2
theta_range=2
#samples is list of labels
samples=np.zeros(spc*clmax,dtype=np.uint32)
#I is fessture vector
I=np.zeros((spc*clmax,theta_range),dtype=np.float32)
marker=['bo','co','go','ro','mo','yo','ko',
        'bs','cs','gs','rs','ms','ys','ks']

# number of datasets being generated 
# 8 for training
# another one for evaluation
N=9 
path="myTrain"
if not os.path.exists(path):
    os.makedirs(path)
for n in xrange(N):
    for cl in xrange(clmax):
        xo=cl*spc
        #define label
        samples[xo:xo+spc]=cl
        phi = np.linspace(0, 2*np.pi, spc) + \
        np.random.randn(spc)*0.4*np.pi/clmax + \
        2*np.pi*cl/clmax
        r = np.linspace(0.1, 1, spc)
        I[xo:xo+spc,:]=np.transpose(np.array([r*np.cos(phi), r*np.sin(phi)]))
    with open(path+'/dataset%02d.pic'%(n), 'wb') as pickleFile:
    #write label and feature vector
        theta_dim=1
        pickle.dump((clmax,theta_dim,theta_range,len(samples),samples,I,None), pickleFile, pickle.HIGHEST_PROTOCOL)

Visualization of the dataset





In [3]:



    


z=np.random.randint( 0,spc*clmax,1000)
for i in z:
    #ax.plot(dset.I[i,0],dset.I[i,1],marker[dset2.samples[i]])
    plt.plot(I[i,0],I[i,1],marker[samples[i]])
    plt.hold(True)

Training





In [4]:



    


from pforest.master import master
m=master(dsetname='myTrain')
m.reset()
m.train()



    


















    






master>>init() dsetname: myTrain
master>> create dview
master>> init engine
Found pforest
debug:master:__init__: ['myTrain/dataset00.pic', 'myTrain/dataset01.pic', 'myTrain/dataset02.pic', 'myTrain/dataset03.pic', 'myTrain/dataset04.pic', 'myTrain/dataset05.pic', 'myTrain/dataset06.pic', 'myTrain/dataset07.pic']
master>> init local variables
master>>reset()
master>>reset() H: 2.3219
master>>reset() Q: 04000
master::train() node20*-
master::train() node19R-
master::train() node18R-
master::train() node17R-
master::train() node16R-
master::train() node15RG
master::train() node15L-
master::train() node14RG
master::train() node14LQ
master::train() node16L-
master::train() node15R-
master::train() node14RQ
master::train() node14LQ
master::train() node15LG
master::train() node17L-
master::train() node16R-
master::train() node15RG
master::train() node15LQ
master::train() node16L-
master::train() node15R-
master::train() node14RG
master::train() node14LG
master::train() node15L-
master::train() node14RG
master::train() node14L-
master::train() node13RQ
master::train() node13LQ
master::train() node18L-
master::train() node17R-
master::train() node16RG
master::train() node16L-
master::train() node15RG
master::train() node15LG
master::train() node17L-
master::train() node16R-
master::train() node15R-
master::train() node14R-
master::train() node13RG
master::train() node13L-
master::train() node12RQ
master::train() node12LQ
master::train() node14L-
master::train() node13R-
master::train() node12R-
master::train() node11RQ
master::train() node11LQ
master::train() node12L-
master::train() node11RG
master::train() node11L-
master::train() node10R-
master::train() node9RQ
master::train() node9LQ
master::train() node10LG
master::train() node13L-
master::train() node12RQ
master::train() node12LG
master::train() node15L-
master::train() node14RG
master::train() node14L-
master::train() node13RG
master::train() node13L-
master::train() node12RQ
master::train() node12LG
master::train() node16L-
master::train() node15RG
master::train() node15LQ
master::train() node19L-
master::train() node18R-
master::train() node17R-
master::train() node16R-
master::train() node15R-
master::train() node14R-
master::train() node13R-
master::train() node12R-
master::train() node11RG
master::train() node11LG
master::train() node12L-
master::train() node11R-
master::train() node10R-
master::train() node9RG
master::train() node9LQ
master::train() node10LG
master::train() node11L-
master::train() node10RG
master::train() node10LG
master::train() node13L-
master::train() node12R-
master::train() node11R-
master::train() node10RG
master::train() node10L-
master::train() node9R-
master::train() node8RG
master::train() node8LQ
master::train() node9LG
master::train() node11L-
master::train() node10RG
master::train() node10L-
master::train() node9RQ
master::train() node9LQ
master::train() node12L-
master::train() node11RG
master::train() node11LG
master::train() node14L-
master::train() node13R-
master::train() node12R-
master::train() node11R-
master::train() node10R-
master::train() node9RQ
master::train() node9LG
master::train() node10L-
master::train() node9RG
master::train() node9L-
master::train() node8RG
master::train() node8LQ
master::train() node11L-
master::train() node10RG
master::train() node10L-
master::train() node9R-
master::train() node8R-
master::train() node7RQ
master::train() node7LQ
master::train() node8LG
master::train() node9L-
master::train() node8RG
master::train() node8LG
master::train() node12L-
master::train() node11R-
master::train() node10R-
master::train() node9RG
master::train() node9L-
master::train() node8RG
master::train() node8L-
master::train() node7RQ
master::train() node7L-
master::train() node6RG
master::train() node6LQ
master::train() node10L-
master::train() node9R-
master::train() node8RG
master::train() node8LG
master::train() node9LG
master::train() node11L-
master::train() node10R-
master::train() node9RG
master::train() node9L-
master::train() node8RG
master::train() node8LG
master::train() node10L-
master::train() node9R-
master::train() node8R-
master::train() node7RG
master::train() node7LG
master::train() node8L-
master::train() node7R-
master::train() node6R-
master::train() node5RG
master::train() node5L-
master::train() node4RG
master::train() node4LQ
master::train() node6LG
master::train() node7LG
master::train() node9L-
master::train() node8RQ
master::train() node8L-
master::train() node7RG
master::train() node7LQ
master::train() node13L-
master::train() node12R-
master::train() node11R-
master::train() node10R-
master::train() node9RG
master::train() node9LG
master::train() node10L-
master::train() node9R-
master::train() node8R-
master::train() node7R-
master::train() node6RG
master::train() node6LG
master::train() node7LG
master::train() node8L-
master::train() node7R-
master::train() node6RQ
master::train() node6LQ
master::train() node7L-
master::train() node6R-
master::train() node5RG
master::train() node5LQ
master::train() node6LG
master::train() node9L-
master::train() node8R-
master::train() node7RG
master::train() node7LG
master::train() node8L-
master::train() node7R-
master::train() node6RQ
master::train() node6LG
master::train() node7LG
master::train() node11L-
master::train() node10R-
master::train() node9R-
master::train() node8RQ
master::train() node8LG
master::train() node9L-
master::train() node8RG
master::train() node8LG
master::train() node10L-
master::train() node9R-
master::train() node8R-
master::train() node7RG
master::train() node7LG
master::train() node8L-
master::train() node7RG
master::train() node7LG
master::train() node9L-
master::train() node8R-
master::train() node7RQ
master::train() node7LQ
master::train() node8L-
master::train() node7R-
master::train() node6RG
master::train() node6LG
master::train() node7LG
master::train() node12L-
master::train() node11R-
master::train() node10RG
master::train() node10L-
master::train() node9RG
master::train() node9LQ
master::train() node11L-
master::train() node10R-
master::train() node9R-
master::train() node8RG
master::train() node8LG
master::train() node9LG
master::train() node10LQ
master::train() node15L-
master::train() node14R-
master::train() node13R-
master::train() node12R-
master::train() node11RG
master::train() node11LQ
master::train() node12L-
master::train() node11RG
master::train() node11LQ
master::train() node13L-
master::train() node12R-
master::train() node11R-
master::train() node10R-
master::train() node9RG
master::train() node9L-
master::train() node8R-
master::train() node7RQ
master::train() node7LG
master::train() node8L-
master::train() node7RQ
master::train() node7LQ
master::train() node10LG
master::train() node11L-
master::train() node10RG
master::train() node10L-
master::train() node9RG
master::train() node9LG
master::train() node12LG
master::train() node14L-
master::train() node13R-
master::train() node12R-
master::train() node11RG
master::train() node11LG
master::train() node12L-
master::train() node11RG
master::train() node11LQ
master::train() node13L-
master::train() node12R-
master::train() node11R-
master::train() node10R-
master::train() node9R-
master::train() node8RG
master::train() node8LG
master::train() node9L-
master::train() node8RQ
master::train() node8LG
master::train() node10L-
master::train() node9R-
master::train() node8RG
master::train() node8LQ
master::train() node9LG
master::train() node11L-
master::train() node10R-
master::train() node9RQ
master::train() node9LG
master::train() node10LQ
master::train() node12L-
master::train() node11R-
master::train() node10RG
master::train() node10LQ
master::train() node11LG
master::train() node16L-
master::train() node15R-
master::train() node14R-
master::train() node13R-
master::train() node12R-
master::train() node11RG
master::train() node11LG
master::train() node12L-
master::train() node11RG
master::train() node11LQ
master::train() node13L-
master::train() node12RG
master::train() node12LG
master::train() node14L-
master::train() node13RG
master::train() node13L-
master::train() node12RG
master::train() node12LQ
master::train() node15L-
master::train() node14R-
master::train() node13R-
master::train() node12R-
master::train() node11RQ
master::train() node11LG
master::train() node12L-
master::train() node11RG
master::train() node11L-
master::train() node10RG
master::train() node10L-
master::train() node9RG
master::train() node9LQ
master::train() node13L-
master::train() node12RQ
master::train() node12LG
master::train() node14L-
master::train() node13R-
master::train() node12R-
master::train() node11R-
master::train() node10RG
master::train() node10LQ
master::train() node11L-
master::train() node10RG
master::train() node10LG
master::train() node12L-
master::train() node11RG
master::train() node11L-
master::train() node10R-
master::train() node9RG
master::train() node9LG
master::train() node10LG
master::train() node13L-
master::train() node12RQ
master::train() node12LG
master::train() node17L-
master::train() node16R-
master::train() node15R-
master::train() node14R-
master::train() node13RG
master::train() node13L-
master::train() node12RG
master::train() node12L-
master::train() node11RQ
master::train() node11LG
master::train() node14L-
master::train() node13R-
master::train() node12RQ
master::train() node12LG
master::train() node13LQ
master::train() node15L-
master::train() node14RG
master::train() node14LG
master::train() node16L-
master::train() node15RG
master::train() node15L-
master::train() node14RG
master::train() node14L-
master::train() node13RQ
master::train() node13LG
master::train() node18L-
master::train() node17R-
master::train() node16R-
master::train() node15RQ
master::train() node15L-
master::train() node14RG
master::train() node14L-
master::train() node13RG
master::train() node13LQ
master::train() node16L-
master::train() node15R-
master::train() node14R-
master::train() node13R-
master::train() node12RQ
master::train() node12L-
master::train() node11RQ
master::train() node11LG
master::train() node13L-
master::train() node12RG
master::train() node12LQ
master::train() node14L-
master::train() node13RG
master::train() node13L-
master::train() node12R-
master::train() node11RG
master::train() node11LG
master::train() node12L-
master::train() node11RG
master::train() node11LG
master::train() node15LG
master::train() node17L-
master::train() node16R-
master::train() node15R-
master::train() node14RQ
master::train() node14LG
master::train() node15LG
master::train() node16L-
master::train() node15R-
master::train() node14RG
master::train() node14L-
master::train() node13RG
master::train() node13LG
master::train() node15L-
master::train() node14RG
master::train() node14L-
master::train() node13RQ
master::train() node13LQ

Write and read the tree

You may need to save/load the tree to/from a pickle file





In [5]:



    


with open('out_tree.pic', 'wb') as pickleFile:
    pickle.dump(m.root, pickleFile, pickle.HIGHEST_PROTOCOL)
    
with open('out_tree.pic', 'rb') as pickleFile:
    root = pickle.load(pickleFile)

Check the file size





In [6]:



    


ls



    


















    






 Volume in drive C has no label.
 Volume Serial Number is A8BF-C894

 Directory of C:\Users\Wasit\Documents\GitHub\parallel_forest\nb

07/04/2016  18:46    <DIR>          .
07/04/2016  18:46    <DIR>          ..
07/04/2016  18:07    <DIR>          .ipynb_checkpoints
26/02/2016  11:53    <DIR>          dataset
07/04/2016  18:32    <DIR>          myTrain
07/04/2016  18:46            87,493 out_tree.pic
26/02/2016  11:53           151,180 parallel forest.ipynb
07/04/2016  18:44            55,748 parallel forest-Copy1.ipynb
26/02/2016  11:53                16 run.bat
07/12/2015  15:20    <DIR>          train
26/02/2016  11:53                78 Untitled.ipynb
               5 File(s)        294,515 bytes
               6 Dir(s)  76,390,125,568 bytes free

The result decision tree

Termination code (Q:min bag size, G:no information gain, D:reaching maximum depth)





In [7]:



    


from pforest.dataset import dataset
from pforest.tree import tree

#init the test tree
t=tree()
t.settree(root)
t.show()



    


















    






Found pforest
*- 20 H:2.322e+00,Q:004000 tau:0.537225604057 theta:[ 1.]
L- 19 H:2.312e+00,Q:003521 tau:-0.591981470585 theta:[ 0.]
L- 18 H:1.354e+00,Q:000337 tau:-0.779462456703 theta:[ 0.]
L- 17 H:5.764e-01,Q:000142 tau:0.308095276356 theta:[ 1.]
L- 16 H:2.172e-01,Q:000115 tau:-0.831742048264 theta:[ 0.]
L- 15 H:5.227e-02,Q:000095 tau:-0.954115867615 theta:[ 0.]
L- 14 H:3.333e-01,Q:000006 tau:-0.970877408981 theta:[ 0.]
LQ 13 H:5.924e-36,Q:000002 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 13 H:5.924e-36,Q:000004 (cl,P):(003,0.75) (002,0.25) (004,0.00)
RG 14 H:5.471e-37,Q:000089 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 15 H:4.448e-01,Q:000020 tau:0.133020102978 theta:[ 1.]
L- 14 H:2.578e-01,Q:000014 tau:-0.416134983301 theta:[ 1.]
LG 13 H:4.245e-36,Q:000007 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RG 13 H:2.559e-36,Q:000007 (cl,P):(004,0.71) (003,0.29) (002,0.00)
RG 14 H:4.945e-36,Q:000006 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 16 H:6.937e-01,Q:000027 tau:-0.824779570103 theta:[ 0.]
LG 15 H:2.753e-36,Q:000013 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 15 H:1.429e-01,Q:000014 tau:0.388004928827 theta:[ 1.]
LG 14 H:4.161e-36,Q:000010 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 14 H:5.924e-36,Q:000004 (cl,P):(003,0.75) (002,0.25) (004,0.00)
R- 17 H:1.030e+00,Q:000195 tau:0.33816242218 theta:[ 1.]
L- 16 H:7.237e-01,Q:000161 tau:-0.590132713318 theta:[ 1.]
LG 15 H:4.747e-36,Q:000010 (cl,P):(003,0.90) (004,0.10) (002,0.00)
R- 15 H:4.903e-01,Q:000151 tau:-0.626460254192 theta:[ 0.]
L- 14 H:2.461e-01,Q:000127 tau:0.291353493929 theta:[ 1.]
L- 13 H:1.330e-01,Q:000123 tau:-0.644930362701 theta:[ 0.]
L- 12 H:4.732e-02,Q:000112 tau:-0.762155532837 theta:[ 0.]
LG 11 H:5.085e-36,Q:000007 (cl,P):(004,0.86) (003,0.14) (002,0.00)
RG 11 H:4.647e-37,Q:000105 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 12 H:4.323e-01,Q:000011 tau:-0.6310557127 theta:[ 0.]
LG 11 H:4.945e-36,Q:000006 (cl,P):(004,0.67) (000,0.33) (003,0.00)
RG 11 H:4.749e-36,Q:000005 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 13 H:4.455e-36,Q:000004 (cl,P):(003,0.75) (004,0.25) (002,0.00)
R- 14 H:7.925e-01,Q:000024 tau:-0.610105216503 theta:[ 0.]
L- 13 H:3.245e-01,Q:000010 tau:-0.624812960625 theta:[ 0.]
LQ 12 H:5.924e-36,Q:000002 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 12 H:3.718e-36,Q:000008 (cl,P):(004,0.88) (000,0.12) (003,0.00)
R- 13 H:5.175e-01,Q:000014 tau:-0.596658527851 theta:[ 0.]
L- 12 H:1.818e-01,Q:000011 tau:-0.597814381123 theta:[ 0.]
LG 11 H:3.963e-36,Q:000009 (cl,P):(004,0.67) (000,0.33) (003,0.00)
RQ 11 H:5.924e-36,Q:000002 (cl,P):(004,0.50) (000,0.50) (003,0.00)
RQ 12 H:5.924e-36,Q:000003 (cl,P):(000,0.67) (004,0.33) (003,0.00)
R- 16 H:2.719e-01,Q:000034 tau:-0.603877961636 theta:[ 0.]
L- 15 H:1.381e-01,Q:000030 tau:0.425449609756 theta:[ 1.]
L- 14 H:2.000e-01,Q:000010 tau:0.345239758492 theta:[ 1.]
LQ 13 H:5.924e-36,Q:000001 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RG 13 H:4.618e-36,Q:000009 (cl,P):(003,0.89) (004,0.11) (002,0.00)
RG 14 H:2.094e-36,Q:000020 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 15 H:5.924e-36,Q:000004 (cl,P):(004,0.50) (003,0.50) (002,0.00)
R- 18 H:2.299e+00,Q:003184 tau:-0.675254046917 theta:[ 1.]
L- 17 H:1.060e+00,Q:000266 tau:-0.845464408398 theta:[ 1.]
L- 16 H:1.052e-01,Q:000095 tau:-0.859637379646 theta:[ 1.]
L- 15 H:5.984e-02,Q:000085 tau:-0.219613060355 theta:[ 0.]
L- 14 H:1.538e-01,Q:000013 tau:-0.223491251469 theta:[ 0.]
LG 13 H:2.983e-36,Q:000012 (cl,P):(004,0.92) (003,0.08) (002,0.00)
RQ 13 H:5.924e-36,Q:000001 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 14 H:6.747e-37,Q:000072 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 15 H:4.161e-36,Q:000010 (cl,P):(004,0.90) (000,0.10) (003,0.00)
R- 16 H:8.567e-01,Q:000171 tau:-0.276232421398 theta:[ 0.]
L- 15 H:2.209e-01,Q:000034 tau:-0.542602479458 theta:[ 0.]
LG 14 H:4.749e-36,Q:000005 (cl,P):(004,0.60) (003,0.40) (002,0.00)
RG 14 H:1.657e-36,Q:000029 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 15 H:3.565e-01,Q:000137 tau:-0.805161118507 theta:[ 1.]
L- 14 H:5.802e-01,Q:000023 tau:-0.00264290184714 theta:[ 0.]
LQ 13 H:5.924e-36,Q:000004 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 13 H:2.761e-01,Q:000019 tau:0.396377444267 theta:[ 0.]
LG 12 H:2.612e-36,Q:000016 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RQ 12 H:5.924e-36,Q:000003 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 14 H:1.384e-01,Q:000114 tau:-0.778570711613 theta:[ 1.]
L- 13 H:2.761e-01,Q:000019 tau:-0.789750277996 theta:[ 1.]
L- 12 H:1.818e-01,Q:000011 tau:0.557785928249 theta:[ 0.]
LG 11 H:3.963e-36,Q:000009 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RQ 11 H:5.924e-36,Q:000002 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 12 H:3.720e-36,Q:000008 (cl,P):(000,0.88) (004,0.12) (003,0.00)
RG 13 H:5.130e-37,Q:000095 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 17 H:2.303e+00,Q:002918 tau:-0.301000535488 theta:[ 0.]
L- 16 H:1.555e+00,Q:000492 tau:0.200303062797 theta:[ 1.]
L- 15 H:1.240e+00,Q:000366 tau:-0.431684345007 theta:[ 0.]
L- 14 H:7.111e-01,Q:000172 tau:-0.544858753681 theta:[ 1.]
L- 13 H:3.444e-01,Q:000016 tau:-0.487062990665 theta:[ 0.]
LG 12 H:3.474e-36,Q:000012 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RQ 12 H:5.924e-36,Q:000004 (cl,P):(004,0.50) (000,0.50) (003,0.00)
R- 13 H:4.231e-01,Q:000156 tau:-0.463753193617 theta:[ 0.]
L- 12 H:1.819e-01,Q:000130 tau:-0.571123898029 theta:[ 0.]
L- 11 H:4.156e-01,Q:000025 tau:-0.263386905193 theta:[ 1.]
LG 10 H:3.403e-36,Q:000007 (cl,P):(004,0.57) (000,0.43) (003,0.00)
R- 10 H:1.803e-01,Q:000018 tau:0.0272341072559 theta:[ 1.]
LG 09 H:2.983e-36,Q:000014 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 09 H:4.455e-36,Q:000004 (cl,P):(000,0.75) (004,0.25) (003,0.00)
RG 11 H:4.646e-37,Q:000105 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 12 H:5.094e-01,Q:000026 tau:-0.115425117314 theta:[ 1.]
L- 11 H:1.722e-01,Q:000016 tau:-0.176299676299 theta:[ 1.]
LG 10 H:3.664e-36,Q:000013 (cl,P):(000,0.85) (001,0.15) (004,0.00)
RG 10 H:3.965e-36,Q:000003 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 11 H:2.000e-01,Q:000010 tau:0.0225500445813 theta:[ 1.]
LQ 10 H:5.924e-36,Q:000003 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 10 H:5.085e-36,Q:000007 (cl,P):(000,0.86) (001,0.14) (004,0.00)
R- 14 H:6.579e-01,Q:000194 tau:-0.436830967665 theta:[ 1.]
L- 13 H:1.388e-01,Q:000026 tau:-0.457643985748 theta:[ 1.]
LG 12 H:1.998e-36,Q:000024 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RQ 12 H:5.924e-36,Q:000002 (cl,P):(001,0.50) (000,0.50) (004,0.00)
R- 13 H:2.427e-01,Q:000168 tau:0.12189951539 theta:[ 1.]
L- 12 H:7.246e-02,Q:000156 tau:-0.311444312334 theta:[ 0.]
L- 11 H:3.845e-02,Q:000147 tau:-0.384176909924 theta:[ 1.]
L- 10 H:3.936e-01,Q:000007 tau:-0.387196242809 theta:[ 0.]
LQ 09 H:5.924e-36,Q:000001 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 09 H:3.965e-36,Q:000006 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 10 H:3.496e-37,Q:000140 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 11 H:3.963e-36,Q:000009 (cl,P):(001,0.89) (002,0.11) (004,0.00)
R- 12 H:3.333e-01,Q:000012 tau:-0.357340723276 theta:[ 0.]
LG 11 H:4.749e-36,Q:000005 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RQ 11 H:5.924e-36,Q:000007 (cl,P):(001,0.86) (000,0.14) (004,0.00)
R- 15 H:1.123e+00,Q:000126 tau:0.31408572197 theta:[ 1.]
L- 14 H:4.752e-01,Q:000049 tau:-0.500425040722 theta:[ 0.]
L- 13 H:4.056e-01,Q:000008 tau:0.258663266897 theta:[ 1.]
LQ 12 H:5.924e-36,Q:000002 (cl,P):(004,0.50) (000,0.50) (003,0.00)
RG 12 H:3.962e-36,Q:000006 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 13 H:1.177e-36,Q:000041 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 14 H:6.143e-01,Q:000077 tau:0.342578113079 theta:[ 1.]
L- 13 H:3.237e-01,Q:000015 tau:-0.505476534367 theta:[ 0.]
LG 12 H:3.403e-36,Q:000007 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 12 H:4.453e-36,Q:000008 (cl,P):(000,0.75) (004,0.25) (003,0.00)
R- 13 H:4.037e-01,Q:000062 tau:-0.527269184589 theta:[ 0.]
L- 12 H:4.000e-01,Q:000010 tau:0.389803558588 theta:[ 1.]
LQ 11 H:5.924e-36,Q:000004 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 11 H:4.945e-36,Q:000006 (cl,P):(003,0.83) (004,0.17) (002,0.00)
R- 12 H:8.363e-02,Q:000052 tau:0.370326936245 theta:[ 1.]
LG 11 H:5.085e-36,Q:000007 (cl,P):(004,0.86) (000,0.14) (003,0.00)
RG 11 H:1.074e-36,Q:000045 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 16 H:2.309e+00,Q:002426 tau:-0.310972481966 theta:[ 1.]
L- 15 H:1.571e+00,Q:000489 tau:-0.476606339216 theta:[ 1.]
L- 14 H:9.660e-01,Q:000222 tau:0.535317361355 theta:[ 0.]
L- 13 H:5.951e-01,Q:000174 tau:-0.20736835897 theta:[ 0.]
L- 12 H:7.500e-01,Q:000016 tau:-0.60985070467 theta:[ 1.]
LG 11 H:3.718e-36,Q:000008 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 11 H:2.500e-01,Q:000008 tau:-0.274063825607 theta:[ 0.]
LQ 10 H:5.924e-36,Q:000002 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 10 H:4.945e-36,Q:000006 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 12 H:3.763e-01,Q:000158 tau:-0.650832176208 theta:[ 1.]
L- 11 H:4.444e-01,Q:000009 tau:-0.670698583126 theta:[ 1.]
LQ 10 H:5.924e-36,Q:000001 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 10 H:3.444e-01,Q:000008 tau:0.186767533422 theta:[ 0.]
LG 09 H:5.000e-01,Q:000004 (cl,P):(001,0.50) (000,0.50) (004,0.00)
RQ 09 H:5.924e-36,Q:000004 (cl,P):(000,0.75) (001,0.25) (004,0.00)
R- 11 H:2.315e-01,Q:000149 tau:-0.509464681149 theta:[ 1.]
L- 10 H:4.457e-02,Q:000125 tau:0.405346721411 theta:[ 0.]
LG 09 H:4.211e-37,Q:000116 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 09 H:2.222e-01,Q:000009 tau:-0.570442736149 theta:[ 1.]
LQ 08 H:5.924e-36,Q:000003 (cl,P):(001,0.67) (000,0.33) (004,0.00)
RG 08 H:4.945e-36,Q:000006 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 10 H:6.089e-01,Q:000024 tau:0.11608748883 theta:[ 0.]
L- 09 H:5.944e-01,Q:000008 tau:-0.0598831325769 theta:[ 0.]
LG 08 H:4.749e-36,Q:000005 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RQ 08 H:5.924e-36,Q:000003 (cl,P):(002,0.67) (001,0.33) (004,0.00)
R- 09 H:2.500e-01,Q:000016 tau:-0.49705094099 theta:[ 1.]
LG 08 H:5.085e-36,Q:000007 (cl,P):(001,0.86) (002,0.14) (004,0.00)
RG 08 H:3.960e-36,Q:000009 (cl,P):(001,0.78) (002,0.22) (004,0.00)
R- 13 H:4.677e-01,Q:000048 tau:0.571554362774 theta:[ 0.]
L- 12 H:2.500e-01,Q:000008 tau:0.559199213982 theta:[ 0.]
LQ 11 H:5.924e-36,Q:000003 (cl,P):(001,0.67) (000,0.33) (004,0.00)
RG 11 H:4.749e-36,Q:000005 (cl,P):(001,0.80) (000,0.20) (004,0.00)
R- 12 H:8.113e-02,Q:000040 tau:-0.591132462025 theta:[ 1.]
LG 11 H:2.982e-36,Q:000016 (cl,P):(000,0.94) (004,0.06) (003,0.00)
RG 11 H:1.998e-36,Q:000024 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 14 H:1.329e+00,Q:000267 tau:0.52453660965 theta:[ 0.]
L- 13 H:6.954e-01,Q:000200 tau:-0.213917002082 theta:[ 0.]
LG 12 H:2.613e-36,Q:000016 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 12 H:4.237e-01,Q:000184 tau:-0.419015794992 theta:[ 1.]
L- 11 H:5.377e-01,Q:000057 tau:0.313203185797 theta:[ 0.]
L- 10 H:3.061e-01,Q:000050 tau:-0.122509345412 theta:[ 0.]
LG 09 H:2.394e-36,Q:000005 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 09 H:1.074e-36,Q:000045 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 10 H:5.085e-36,Q:000007 (cl,P):(001,0.57) (002,0.43) (004,0.00)
R- 11 H:2.313e-01,Q:000127 tau:-0.334644466639 theta:[ 1.]
LG 10 H:4.876e-37,Q:000100 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 10 H:6.113e-01,Q:000027 tau:-0.322413831949 theta:[ 1.]
L- 09 H:6.667e-01,Q:000012 tau:-0.329995632172 theta:[ 1.]
L- 08 H:5.000e-01,Q:000004 tau:0.511892199516 theta:[ 0.]
LQ 07 H:5.924e-36,Q:000003 (cl,P):(003,0.67) (002,0.33) (004,0.00)
RQ 07 H:5.924e-36,Q:000001 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 08 H:2.500e-01,Q:000008 tau:-0.325598120689 theta:[ 1.]
LG 07 H:4.749e-36,Q:000005 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RQ 07 H:5.924e-36,Q:000003 (cl,P):(003,0.67) (002,0.33) (004,0.00)
RG 09 H:3.180e-36,Q:000015 (cl,P):(002,0.80) (003,0.20) (004,0.00)
R- 13 H:8.496e-01,Q:000067 tau:0.729095935822 theta:[ 0.]
L- 12 H:1.031e-01,Q:000035 tau:-0.455956101418 theta:[ 1.]
LQ 11 H:5.924e-36,Q:000004 (cl,P):(001,0.75) (000,0.25) (004,0.00)
RG 11 H:1.550e-36,Q:000031 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 12 H:1.014e-01,Q:000032 tau:0.729915320873 theta:[ 0.]
LQ 11 H:5.924e-36,Q:000001 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 11 H:1.360e-36,Q:000031 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 15 H:2.311e+00,Q:001937 tau:0.521329879761 theta:[ 0.]
L- 14 H:2.257e+00,Q:001605 tau:0.0630449652672 theta:[ 1.]
L- 13 H:1.810e+00,Q:000798 tau:-0.113057896495 theta:[ 0.]
L- 12 H:3.520e-01,Q:000201 tau:-0.129835635424 theta:[ 0.]
L- 11 H:1.314e-01,Q:000177 tau:-0.276997506618 theta:[ 0.]
LQ 10 H:5.924e-36,Q:000005 (cl,P):(001,0.60) (002,0.40) (004,0.00)
R- 10 H:3.372e-02,Q:000172 tau:-0.151213049889 theta:[ 0.]
LG 09 H:3.141e-37,Q:000156 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 09 H:1.250e-01,Q:000016 tau:-0.141707599163 theta:[ 0.]
LG 08 H:3.720e-36,Q:000008 (cl,P):(002,0.88) (003,0.12) (004,0.00)
RG 08 H:3.718e-36,Q:000008 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 11 H:7.133e-01,Q:000024 tau:0.00831183139235 theta:[ 1.]
L- 10 H:2.119e-01,Q:000013 tau:-0.12502348423 theta:[ 0.]
LQ 09 H:5.924e-36,Q:000003 (cl,P):(002,0.67) (003,0.33) (004,0.00)
RG 09 H:2.986e-36,Q:000010 (cl,P):(003,0.80) (002,0.20) (004,0.00)
RG 10 H:4.322e-36,Q:000011 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 12 H:1.545e+00,Q:000597 tau:-0.146304368973 theta:[ 1.]
L- 11 H:5.457e-01,Q:000238 tau:0.362527817488 theta:[ 0.]
L- 10 H:1.862e-01,Q:000208 tau:-0.179932266474 theta:[ 1.]
L- 09 H:1.016e-01,Q:000168 tau:0.335322141647 theta:[ 0.]
L- 08 H:3.641e-02,Q:000163 tau:-0.211818963289 theta:[ 1.]
LG 07 H:4.006e-37,Q:000122 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 07 H:1.061e-01,Q:000041 tau:-0.210695490241 theta:[ 1.]
LG 06 H:3.965e-36,Q:000003 (cl,P):(003,0.67) (004,0.33) (002,0.00)
RG 06 H:1.268e-36,Q:000038 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 08 H:4.000e-01,Q:000005 tau:-0.238503530622 theta:[ 1.]
LQ 07 H:5.924e-36,Q:000002 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RQ 07 H:5.924e-36,Q:000003 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 09 H:2.566e-01,Q:000040 tau:-0.166716888547 theta:[ 1.]
L- 08 H:1.176e-01,Q:000017 tau:0.320147275925 theta:[ 0.]
LG 07 H:4.161e-36,Q:000010 (cl,P):(003,0.80) (004,0.20) (002,0.00)
RG 07 H:4.245e-36,Q:000007 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 08 H:1.739e-01,Q:000023 tau:-0.159940749407 theta:[ 1.]
LG 07 H:4.618e-36,Q:000009 (cl,P):(003,0.89) (004,0.11) (002,0.00)
RG 07 H:3.404e-36,Q:000014 (cl,P):(003,0.93) (004,0.07) (002,0.00)
R- 10 H:4.966e-01,Q:000030 tau:0.430026888847 theta:[ 0.]
L- 09 H:2.755e-01,Q:000010 tau:-0.250691741705 theta:[ 1.]
LG 08 H:3.965e-36,Q:000003 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 08 H:3.403e-36,Q:000007 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 09 H:1.000e-01,Q:000020 tau:-0.177284985781 theta:[ 1.]
LG 08 H:2.325e-36,Q:000018 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RQ 08 H:5.924e-36,Q:000002 (cl,P):(003,0.50) (002,0.50) (004,0.00)
R- 11 H:1.579e+00,Q:000359 tau:0.37316775322 theta:[ 0.]
L- 10 H:1.478e+00,Q:000293 tau:0.0112176211551 theta:[ 0.]
L- 09 H:8.762e-01,Q:000065 tau:-0.0315698795021 theta:[ 1.]
L- 08 H:3.647e-01,Q:000053 tau:-0.0562909245491 theta:[ 0.]
LG 07 H:1.149e-36,Q:000042 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 07 H:1.818e-01,Q:000011 tau:-0.0940620452166 theta:[ 1.]
LG 06 H:4.618e-36,Q:000009 (cl,P):(004,0.56) (003,0.44) (002,0.00)
RQ 06 H:5.924e-36,Q:000002 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 08 H:1.667e-01,Q:000012 tau:-0.0948859453201 theta:[ 0.]
LG 07 H:4.945e-36,Q:000006 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 07 H:3.965e-36,Q:000006 (cl,P):(002,0.83) (003,0.17) (004,0.00)
R- 09 H:8.332e-01,Q:000228 tau:-0.0278333965689 theta:[ 1.]
L- 08 H:1.557e-01,Q:000143 tau:0.29146105051 theta:[ 0.]
L- 07 H:7.949e-02,Q:000139 tau:-0.0391066484153 theta:[ 1.]
LG 06 H:3.820e-37,Q:000128 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 06 H:2.504e-01,Q:000011 tau:0.206679105759 theta:[ 0.]
LQ 05 H:5.924e-36,Q:000004 (cl,P):(004,0.50) (000,0.50) (003,0.00)
RG 05 H:3.406e-36,Q:000007 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 07 H:5.000e-01,Q:000004 tau:0.303753137589 theta:[ 0.]
LQ 06 H:5.924e-36,Q:000001 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RQ 06 H:5.924e-36,Q:000003 (cl,P):(003,0.67) (004,0.33) (002,0.00)
R- 08 H:9.224e-01,Q:000085 tau:0.172727167606 theta:[ 0.]
LG 07 H:1.007e-36,Q:000048 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 07 H:2.295e-01,Q:000037 tau:0.254437416792 theta:[ 0.]
LG 06 H:4.618e-36,Q:000009 (cl,P):(004,0.67) (000,0.33) (003,0.00)
RG 06 H:1.713e-36,Q:000028 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 10 H:6.863e-02,Q:000066 tau:-0.0937743932009 theta:[ 1.]
LG 09 H:3.249e-36,Q:000011 (cl,P):(003,0.91) (002,0.09) (004,0.00)
RG 09 H:8.806e-37,Q:000055 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 13 H:2.087e+00,Q:000807 tau:0.191804111004 theta:[ 0.]
L- 12 H:1.699e+00,Q:000570 tau:0.256742656231 theta:[ 1.]
L- 11 H:1.250e+00,Q:000321 tau:0.0616450533271 theta:[ 0.]
L- 10 H:6.310e-01,Q:000219 tau:0.0894021391869 theta:[ 1.]
L- 09 H:4.533e-01,Q:000029 tau:-0.0769026130438 theta:[ 0.]
L- 08 H:2.396e-01,Q:000023 tau:-0.137933477759 theta:[ 0.]
LQ 07 H:5.924e-36,Q:000006 (cl,P):(002,0.67) (001,0.33) (004,0.00)
RG 07 H:2.462e-36,Q:000017 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RQ 08 H:5.924e-36,Q:000006 (cl,P):(002,0.67) (001,0.33) (004,0.00)
R- 09 H:2.172e-01,Q:000190 tau:0.0277486778796 theta:[ 0.]
L- 08 H:1.271e-01,Q:000171 tau:0.10835839808 theta:[ 1.]
LG 07 H:3.965e-36,Q:000009 (cl,P):(001,0.78) (002,0.22) (004,0.00)
R- 07 H:7.286e-02,Q:000162 tau:-0.263673841953 theta:[ 0.]
LG 06 H:5.085e-36,Q:000007 (cl,P):(001,0.86) (000,0.14) (004,0.00)
R- 06 H:3.786e-02,Q:000155 tau:0.136289745569 theta:[ 1.]
L- 05 H:1.148e-01,Q:000024 tau:-0.0572840385139 theta:[ 0.]
LQ 04 H:5.924e-36,Q:000007 (cl,P):(001,0.86) (002,0.14) (004,0.00)
RG 04 H:2.811e-36,Q:000017 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 05 H:3.734e-37,Q:000131 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 08 H:3.350e-01,Q:000019 tau:0.194940939546 theta:[ 1.]
LG 07 H:2.390e-36,Q:000015 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 07 H:4.455e-36,Q:000004 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 10 H:2.100e-01,Q:000102 tau:0.0898489430547 theta:[ 0.]
L- 09 H:3.061e-01,Q:000009 tau:0.220274507999 theta:[ 1.]
LG 08 H:3.570e-36,Q:000005 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 08 H:4.455e-36,Q:000004 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 09 H:5.239e-37,Q:000093 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 11 H:9.802e-01,Q:000249 tau:0.387849628925 theta:[ 1.]
L- 10 H:2.251e-01,Q:000138 tau:0.116209685802 theta:[ 0.]
LG 09 H:3.880e-37,Q:000126 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 09 H:3.333e-01,Q:000012 tau:0.296949028969 theta:[ 1.]
LG 08 H:4.749e-36,Q:000005 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 08 H:5.085e-36,Q:000007 (cl,P):(004,0.86) (000,0.14) (003,0.00)
R- 10 H:4.235e-01,Q:000111 tau:0.434794664383 theta:[ 1.]
L- 09 H:7.764e-01,Q:000025 tau:0.0861092805862 theta:[ 0.]
L- 08 H:3.673e-01,Q:000015 tau:-0.0125499470159 theta:[ 0.]
L- 07 H:2.000e-01,Q:000010 tau:0.417876154184 theta:[ 1.]
LQ 06 H:5.924e-36,Q:000005 (cl,P):(000,0.80) (004,0.20) (003,0.00)
RG 06 H:4.749e-36,Q:000005 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RQ 07 H:5.924e-36,Q:000005 (cl,P):(004,0.60) (000,0.40) (003,0.00)
RG 08 H:3.566e-36,Q:000010 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 09 H:5.660e-37,Q:000086 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 12 H:1.099e+00,Q:000237 tau:0.353462994099 theta:[ 0.]
L- 11 H:7.280e-01,Q:000141 tau:0.461486548185 theta:[ 1.]
L- 10 H:2.209e-01,Q:000120 tau:0.244549706578 theta:[ 0.]
L- 09 H:2.067e-01,Q:000023 tau:0.351293176413 theta:[ 1.]
LG 08 H:4.618e-36,Q:000009 (cl,P):(004,0.67) (000,0.33) (003,0.00)
RG 08 H:2.560e-36,Q:000014 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 09 H:1.068e-01,Q:000097 tau:0.381466597319 theta:[ 1.]
LG 08 H:5.239e-37,Q:000093 (cl,P):(004,1.00) (003,0.00) (002,0.00)
R- 08 H:5.000e-01,Q:000004 tau:0.433523625135 theta:[ 1.]
LQ 07 H:5.924e-36,Q:000002 (cl,P):(004,0.50) (003,0.50) (002,0.00)
RQ 07 H:5.924e-36,Q:000002 (cl,P):(004,0.50) (003,0.50) (002,0.00)
RG 10 H:2.279e-36,Q:000021 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 11 H:3.148e-01,Q:000096 tau:0.390237420797 theta:[ 0.]
L- 10 H:4.286e-01,Q:000014 tau:0.375321686268 theta:[ 0.]
L- 09 H:2.000e-01,Q:000010 tau:0.353895574808 theta:[ 0.]
LQ 08 H:5.924e-36,Q:000001 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RG 08 H:4.618e-36,Q:000009 (cl,P):(003,0.67) (004,0.33) (002,0.00)
RG 09 H:4.455e-36,Q:000004 (cl,P):(003,0.75) (004,0.25) (002,0.00)
R- 10 H:1.195e-01,Q:000082 tau:0.495754361153 theta:[ 1.]
LG 09 H:6.155e-37,Q:000079 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 09 H:5.924e-36,Q:000003 (cl,P):(002,0.67) (003,0.33) (004,0.00)
R- 14 H:1.528e+00,Q:000332 tau:0.70779055357 theta:[ 0.]
L- 13 H:4.286e-01,Q:000158 tau:-0.221973061562 theta:[ 1.]
L- 12 H:2.296e-01,Q:000012 tau:0.685213148594 theta:[ 0.]
LG 11 H:4.455e-36,Q:000008 (cl,P):(002,0.62) (001,0.38) (004,0.00)
RG 11 H:4.455e-36,Q:000004 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 12 H:2.157e-01,Q:000146 tau:0.541237175465 theta:[ 0.]
L- 11 H:4.755e-01,Q:000010 tau:-0.0372019223869 theta:[ 1.]
L- 10 H:5.000e-01,Q:000004 tau:0.5288169384 theta:[ 0.]
LQ 09 H:5.924e-36,Q:000001 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 09 H:5.924e-36,Q:000003 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 10 H:4.945e-36,Q:000006 (cl,P):(003,0.67) (002,0.33) (004,0.00)
R- 11 H:4.034e-02,Q:000136 tau:0.56429874897 theta:[ 0.]
L- 10 H:1.377e-01,Q:000020 tau:0.55598372221 theta:[ 0.]
LG 09 H:3.569e-36,Q:000010 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 09 H:2.000e-01,Q:000010 tau:0.55858039856 theta:[ 0.]
LQ 08 H:5.924e-36,Q:000002 (cl,P):(003,0.50) (002,0.50) (004,0.00)
RG 08 H:3.718e-36,Q:000008 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 10 H:4.211e-37,Q:000116 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 13 H:8.830e-01,Q:000174 tau:0.890117526054 theta:[ 0.]
L- 12 H:1.207e-01,Q:000128 tau:0.731888890266 theta:[ 0.]
L- 11 H:2.755e-01,Q:000010 tau:0.478832393885 theta:[ 1.]
LG 10 H:5.085e-36,Q:000007 (cl,P):(001,0.71) (002,0.29) (004,0.00)
RG 10 H:3.965e-36,Q:000003 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 11 H:4.208e-02,Q:000118 tau:0.866880118847 theta:[ 0.]
LG 10 H:4.519e-37,Q:000108 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 10 H:2.000e-01,Q:000010 tau:0.00884520541877 theta:[ 1.]
LQ 09 H:5.924e-36,Q:000001 (cl,P):(000,1.00) (004,0.00) (003,0.00)
RG 09 H:2.654e-36,Q:000009 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 12 H:9.004e-02,Q:000046 tau:0.909244477749 theta:[ 0.]
LG 11 H:4.245e-36,Q:000007 (cl,P):(000,0.86) (001,0.14) (004,0.00)
RG 11 H:1.237e-36,Q:000039 (cl,P):(000,1.00) (004,0.00) (003,0.00)
R- 19 H:1.668e+00,Q:000479 tau:0.739025056362 theta:[ 1.]
L- 18 H:1.584e+00,Q:000291 tau:0.425739228725 theta:[ 0.]
L- 17 H:1.112e+00,Q:000228 tau:-0.638173699379 theta:[ 0.]
L- 16 H:1.148e-01,Q:000024 tau:0.544123113155 theta:[ 1.]
LQ 15 H:5.924e-36,Q:000001 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RG 15 H:2.083e-36,Q:000023 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 16 H:9.353e-01,Q:000204 tau:0.58280724287 theta:[ 1.]
L- 15 H:9.088e-01,Q:000041 tau:0.18265222013 theta:[ 0.]
L- 14 H:8.367e-01,Q:000029 tau:-0.282049387693 theta:[ 0.]
L- 13 H:2.296e-01,Q:000012 tau:-0.568953037262 theta:[ 0.]
LG 12 H:4.245e-36,Q:000007 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 12 H:5.924e-36,Q:000005 (cl,P):(003,0.80) (004,0.20) (002,0.00)
RG 13 H:2.808e-36,Q:000017 (cl,P):(004,1.00) (003,0.00) (002,0.00)
RG 14 H:3.474e-36,Q:000012 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 15 H:6.561e-01,Q:000163 tau:0.269228130579 theta:[ 0.]
L- 14 H:3.249e-01,Q:000140 tau:-0.503096938133 theta:[ 0.]
L- 13 H:5.165e-01,Q:000016 tau:0.674702882767 theta:[ 1.]
LG 12 H:3.574e-36,Q:000010 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 12 H:5.924e-36,Q:000006 (cl,P):(002,0.83) (003,0.17) (004,0.00)
R- 13 H:1.708e-01,Q:000124 tau:0.236707031727 theta:[ 0.]
L- 12 H:8.775e-02,Q:000117 tau:0.612397134304 theta:[ 1.]
L- 11 H:3.396e-01,Q:000014 tau:0.596839547157 theta:[ 1.]
LG 10 H:4.245e-36,Q:000007 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 10 H:2.857e-01,Q:000007 tau:0.61032050848 theta:[ 1.]
LQ 09 H:5.924e-36,Q:000005 (cl,P):(003,0.80) (004,0.20) (002,0.00)
RQ 09 H:5.924e-36,Q:000002 (cl,P):(004,0.50) (003,0.50) (002,0.00)
RG 11 H:4.736e-37,Q:000103 (cl,P):(003,1.00) (004,0.00) (002,0.00)
R- 12 H:2.857e-01,Q:000007 tau:0.6199862957 theta:[ 1.]
LQ 11 H:5.924e-36,Q:000002 (cl,P):(003,1.00) (004,0.00) (002,0.00)
RQ 11 H:5.924e-36,Q:000005 (cl,P):(003,0.60) (002,0.40) (004,0.00)
R- 14 H:6.530e-01,Q:000023 tau:0.659650802612 theta:[ 1.]
L- 13 H:5.000e-01,Q:000008 tau:0.592103302479 theta:[ 1.]
LQ 12 H:5.924e-36,Q:000004 (cl,P):(003,0.75) (002,0.25) (004,0.00)
RQ 12 H:5.924e-36,Q:000004 (cl,P):(003,0.50) (002,0.50) (004,0.00)
RG 13 H:2.785e-36,Q:000015 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 17 H:9.396e-01,Q:000063 tau:0.559570014477 theta:[ 0.]
L- 16 H:1.119e-01,Q:000029 tau:0.664621949196 theta:[ 1.]
LG 15 H:2.082e-36,Q:000023 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 15 H:4.945e-36,Q:000006 (cl,P):(002,0.83) (001,0.17) (004,0.00)
RG 16 H:1.416e-36,Q:000034 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 18 H:9.739e-01,Q:000188 tau:0.198071986437 theta:[ 0.]
L- 17 H:5.248e-01,Q:000132 tau:0.943182706833 theta:[ 1.]
L- 16 H:2.627e-01,Q:000121 tau:0.778387367725 theta:[ 1.]
L- 15 H:6.667e-01,Q:000012 tau:0.757049441338 theta:[ 1.]
L- 14 H:3.333e-01,Q:000006 tau:-0.143495693803 theta:[ 0.]
LQ 13 H:5.924e-36,Q:000002 (cl,P):(003,0.50) (002,0.50) (004,0.00)
RQ 13 H:5.924e-36,Q:000004 (cl,P):(003,0.75) (002,0.25) (004,0.00)
RG 14 H:4.945e-36,Q:000006 (cl,P):(002,0.83) (003,0.17) (004,0.00)
R- 15 H:4.768e-02,Q:000109 tau:0.937921464443 theta:[ 1.]
LG 14 H:4.647e-37,Q:000105 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 14 H:4.455e-36,Q:000004 (cl,P):(002,0.75) (001,0.25) (004,0.00)
R- 16 H:2.504e-01,Q:000011 tau:0.954961538315 theta:[ 1.]
LQ 15 H:5.924e-36,Q:000003 (cl,P):(002,0.67) (001,0.33) (004,0.00)
RG 15 H:2.983e-36,Q:000008 (cl,P):(001,1.00) (004,0.00) (003,0.00)
R- 17 H:7.706e-01,Q:000056 tau:0.321947187185 theta:[ 0.]
L- 16 H:5.355e-01,Q:000021 tau:0.825495898724 theta:[ 1.]
LG 15 H:2.981e-36,Q:000014 (cl,P):(002,1.00) (004,0.00) (003,0.00)
R- 15 H:2.857e-01,Q:000007 tau:0.262536257505 theta:[ 0.]
LQ 14 H:5.924e-36,Q:000003 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RQ 14 H:5.924e-36,Q:000004 (cl,P):(001,0.75) (002,0.25) (004,0.00)
R- 16 H:2.229e-01,Q:000035 tau:0.805785655975 theta:[ 1.]
L- 15 H:2.504e-01,Q:000011 tau:0.456933259964 theta:[ 0.]
LQ 14 H:5.924e-36,Q:000002 (cl,P):(002,1.00) (004,0.00) (003,0.00)
RG 14 H:3.312e-36,Q:000009 (cl,P):(001,1.00) (004,0.00) (003,0.00)
RG 15 H:1.998e-36,Q:000024 (cl,P):(001,1.00) (004,0.00) (003,0.00)

Recall rate

Loading a new dataset, the last on, for computing a recall rate





In [8]:



    


#load the last dataset that never use for training
dset=dataset(8)
correct=0;
for x in xrange(dset.size):
    L=t.getL(np.array([x]),dset)
    if dset.getL(x) == L:
        correct=correct+1
    dset.setL(x,L)
print("recall rate: {}%".format(correct/float(dset.size)*100))



    


















    






recall rate: 94.84%

Labelling

The computer use the decision tree to classify the unknown feature vector u





In [9]:



    


#setup the new test-set
#load dataset     
dset=dataset(8)
d=0.05
y, x = np.mgrid[slice(-1, 1+d, d), slice(-1, 1+d, d)]

#start labeling
L=np.zeros(x.shape,dtype=int)
for r in xrange(x.shape[0]):
    for c in xrange(x.shape[1]):
        u=( x[r,c],y[r,c] )
        Prob=t.classify(u)
        L[r,c]=np.argmax(Prob)

2D space partitioning by the decision tree

Displaying the labelled result





In [10]:



    


%matplotlib inline
import matplotlib.pyplot as plt
fig, ax = plt.subplots()
ax.axis([-1,1,-1,1])
ax.pcolor(x,y,L)
ax.hold(True)

Overlay the dataset





In [11]:



    


z=np.random.randint(0,dset.size,1000)
for i in z:
    ax.plot(dset.I[i,0],dset.I[i,1],marker[dset.samples[i]])
fig



    


















    
Out[11]:
























In [12]:



    


t.classify([0.75,0.0])



    


















    
Out[12]:








array([ 0.,  1.,  0.,  0.,  0.])

















In [ ]:

Content source: wasit7/parallel_forest

Similar notebooks:

notebook.community | gallery | about