Computation of cutting planes: example 1

The set-up


In [1]:
import numpy as np
import pandas as pd
import scipy.optimize as opt
from scipy.special import expit # The logistic sigmoid function
import accpm
%load_ext autoreload
%autoreload 1
%aimport accpm

np.set_printoptions(precision=4)

$\DeclareMathOperator{\domain}{dom} \newcommand{\transpose}{\text{T}} \newcommand{\vec}[1]{\begin{pmatrix}#1\end{pmatrix}}$

Example

To test the computation of cutting planes we consider a logistic regression problem. Particularly, we consider the problem of predicting the incidence of diabetes based on various measurements (see description). We use a normalised version of the data (which can be found at mldata.org) where the label to be predicted (the incidence of diabetes) is in the first column. We have the following data processing:


In [2]:
names = ['diabetes', 'num preg', 'plasma', 'bp', 'skin fold', 'insulin', 'bmi', 'pedigree', 'age']
data = pd.read_csv('diabetes_scale.csv', header=None, names=names)
data['diabetes'].replace(-1, 0, inplace=True) # The target variable need be 1 or 0, not 1 or -1
data['ones'] = np.ones((data.shape[0], 1)) # Add a column of ones to represent the constant bias
data.head()


Out[2]:
diabetes num preg plasma bp skin fold insulin bmi pedigree age ones
0 0 -0.294118 0.487437 0.180328 -0.292929 -1.000000 0.001490 -0.531170 -0.033333 1.0
1 1 -0.882353 -0.145729 0.081967 -0.414141 -1.000000 -0.207153 -0.766866 -0.666667 1.0
2 0 -0.058824 0.839196 0.049180 -1.000000 -1.000000 -0.305514 -0.492741 -0.633333 1.0
3 1 -0.882353 -0.105528 0.081967 -0.535354 -0.777778 -0.162444 -0.923997 -1.000000 1.0
4 0 -1.000000 0.376884 -0.344262 -0.292929 -0.602837 0.284650 0.887276 -0.600000 1.0

In [3]:
np.random.seed(1)
size = data.shape[0]
index = np.arange(size)
np.random.shuffle(index)
training_index = index[:int(size/2)]
testing_index = index[int(size/2):]

In [4]:
Y = data['diabetes']
X = data[['num preg', 'plasma', 'bp', 'skin fold', 'insulin', 'bmi', 'pedigree', 'age', 'ones']]
X = np.array(X)
Y = np.array(Y)

In [5]:
X_training = X[training_index]
Y_training = Y[training_index]
X_testing = X[testing_index]
Y_testing = Y[testing_index]

This model has 9 input variables $x_0, \dots, x_8$ where $x_8$ is the dummy input variable fixed at 1. (The fixed dummy input variable could easily be $x_5$ or $x_7$, it's index is unimportant.) We set the basis functions to the simplest choice $\phi_0(\mathbf{x}) = x_0, \dots, \phi_8(\mathbf{x}) = x_8$. Our model then has the form $$ y(\mathbf{x}) = \sigma(\sum_{j=0}^{8} w_j x_j) = \sigma(\mathbf{w}^T \mathbf{x}.) $$ Here we have a dataset, $\{(\mathbf{x}_n, t_n)\}_{n=0}^{N}$ where $t_n \in \{0, 1\}$, with $N + 1 =767 + 1 = 768$ examples. We train our model by finding the parameter vector $\mathbf{w}$ which minimizes the (data-dependent) cross-entropy error function $$ E_D(\mathbf{w}) = - \sum_{n=0}^{N} \{t_n \ln \sigma(\mathbf{w}^T \mathbf{x}_n) + (1 - t_n)\ln(1 - \sigma(\mathbf{w}^T \mathbf{x}_n))\}. $$ The gradient of this function is given by $$ \nabla E(\mathbf{w}) = \sum_{i=0}^{N} (\sigma(\mathbf{w}^T \mathbf{x}_n) - t_n)\mathbf{x}_n. $$ We can then implement these as follows:


In [6]:
def cost(w, X, y, c=0):
    """
    Returns the cross-entropy error function with (optional) sum-of-squares regularization term.
    
    w -- parameters
    X -- dataset of features where each row corresponds to a single sample
    y -- dataset of labels where each row corresponds to a single sample
    c -- regularization coefficient (default = 0)
    """
    outputs = expit(X.dot(w)) # Vector of outputs (or predictions)
    return -( y.transpose().dot(np.log(outputs)) + (1-y).transpose().dot(np.log(1-outputs)) ) + c*0.5*w.dot(w)

def grad(w, X, y, c=0):
    """
    Returns the gradient of the cross-entropy error function with (optional) sum-of-squares regularization term.
    """
    outputs = expit(X.dot(w))
    return X.transpose().dot(outputs-y) + c*w
    
def train(X, y,c=0):
    """
    Returns the vector of parameters which minimizes the error function via the BFGS algorithm.
    """
    initial_values = np.zeros(X.shape[1]) # Error occurs if inital_values is set too high
    return opt.fmin_bfgs(cost, initial_values, fprime=grad, args=(X,y,c))

def predict(w, X):
    """
    Returns a vector of predictions. 
    """
    return expit(X.dot(w))

We test $\texttt{accpm}$ against the parameters attained using SciPy's $\texttt{fmin_bfgs}$ function via the $\texttt{train}$ function. The latter produces the following:


In [7]:
theta_best1 = train(X_training, Y_training)
print('---------------- Results ----------------')
print("The parameters attained using SciPy's fmin_bfgs are\n", theta_best1)
print('With these parameters the gradient is\n', grad(theta_best1, X_training, Y_training))
print('With these parameters the norm of the gradient is', np.linalg.norm(grad(theta_best1, X_training, Y_training)))


Optimization terminated successfully.
         Current function value: 175.645824
         Iterations: 18
         Function evaluations: 28
         Gradient evaluations: 28
---------------- Results ----------------
The parameters attained using SciPy's fmin_bfgs are
 [-1.3568 -4.0959  0.351  -0.4339  0.9395 -2.4337 -1.8708 -0.1914 -0.0497]
With these parameters the gradient is
 [ -3.7389e-07   1.0650e-07   4.6996e-08  -3.5702e-07  -5.5176e-07
  -4.4994e-08  -4.5631e-07  -3.5282e-07   7.3335e-07]
With these parameters the norm of the gradient is 1.20738543223e-06

We now compute the accuracy from the parameter vector attained using SciPy's $\texttt{fmin_bfgs}$


In [8]:
predictions_sp = predict(theta_best1, X_testing).round()
results_sp = predictions_sp == Y_testing
correct_sp = np.count_nonzero(results_sp)
accuracy_sp = correct_sp/X_testing.shape[0]
print(accuracy_sp)


0.765625

The former gives the following where we take the initial polyhedron to be the 9-dimensional cube centered at the origin with side length 20:


In [10]:
A = []
b = []
for i in range(X.shape[1]):
    a_upper = [0]*X.shape[1]
    a_lower = [0]*X.shape[1]
    a_upper[i] = 1
    a_lower[i] = -1
    A.append(a_upper)
    A.append(a_lower)
    b.append(10)
    b.append(10)

A = np.array(A, dtype = accpm.myfloat)
b = np.array(b, dtype = accpm.myfloat)

theta_best2 = accpm.accpm(A, b, cost, grad, args = (X_training, Y_training),
                          alpha=0.01, beta=0.7, start=1, maxiter = 300, 
                          summary=1, testing=1)[1]


-------- Starting ACCPM --------
Initially: b = [ 10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.
  10.  10.  10.] and A =
 [[ 1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [-1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0. -1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0. -1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0. -1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0. -1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0. -1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0. -1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0. -1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  0.  1.]
 [ 0.  0.  0.  0.  0.  0.  0.  0. -1.]]
--------------------------------
Entering iteration 0
At iteration 0 AC computation SUCCEEDED with AC [ 0.  0.  0.  0.  0.  0.  0.  0.  0.] where
        a_cp = [ 0.3882  0.1447  0.0127  0.3132  0.4131  0.1231  0.3884  0.4316 -0.4552] and b_cp = [ 0.]
--------------------------------
Entering iteration 1
At iteration 1 AC computation SUCCEEDED with AC [-2.6527 -1.0517 -0.0934 -2.1917 -2.7985 -0.8977 -2.6536 -2.9045  3.0371] where
        a_cp = [-0.2419  0.2539  0.1245 -0.3116 -0.4499  0.0256 -0.3521 -0.2727  0.6025] and b_cp = [ 1.1584]
--------------------------------
Entering iteration 2
At iteration 2 AC computation FAILED with AC [-4.1322 -0.7374  0.0726 -2.1675 -2.0407 -0.3869 -1.0317 -0.5889  0.0746] where
        a_cp = [-0.2624  0.2506  0.1212 -0.3145 -0.4501  0.0247 -0.3471 -0.2797  0.594 ] and b_cp = [ 1.1128]
--------------------------------
Entering iteration 3
At iteration 3 AC computation FAILED with AC [-5.1155 -0.4555  0.219  -2.1355 -1.468  -0.0616  0.0909  0.9203 -1.8211] where
        a_cp = [-0.3847  0.2867  0.1069 -0.3221 -0.426   0.0407 -0.2832 -0.2928  0.5528] and b_cp = [ 1.2043]
--------------------------------
Entering iteration 4
At iteration 4 AC computation FAILED with AC [-7.2136 -2.0243  0.5725 -4.5855 -2.7293  0.6718  2.4822  3.8895 -4.7483] where
        a_cp = [ 0.1957  0.0149 -0.038   0.2032  0.3723  0.086   0.5168  0.448  -0.5522] and b_cp = [ 0.9574]
--------------------------------
Entering iteration 5
At iteration 5 AC computation SUCCEEDED with AC [-0.1337 -6.8949 -3.5352  1.982   1.7676 -4.2284 -3.8922 -4.6877 -2.8607] where
        a_cp = [ 0.2842 -0.1361 -0.1631  0.3541  0.4544  0.0189  0.3754  0.2615 -0.5767] and b_cp = [ 0.8884]
--------------------------------
Entering iteration 6
At iteration 6 AC computation FAILED with AC [ 0.6099 -2.6154 -1.0494  0.481  -0.1449 -1.2843 -2.1486 -1.9096 -0.1688] where
        a_cp = [-0.0776  0.2315  0.0182 -0.2395 -0.4744  0.0591 -0.4129 -0.4172  0.5564] and b_cp = [ 0.7957]
--------------------------------
Entering iteration 7
At iteration 7 AC computation SUCCEEDED with AC [-3.1047 -7.4201  0.9824 -1.3044  1.8606 -5.2626 -3.8582 -1.0578 -2.3476] where
        a_cp = [ 0.0981 -0.3113 -0.183   0.2936  0.4427 -0.0779  0.3719  0.0961 -0.6513] and b_cp = [ 2.3817]
--------------------------------
Entering iteration 8
At iteration 8 AC computation SUCCEEDED with AC [-0.4838 -7.1577  1.9407 -1.1393  1.3351 -4.699  -4.6118  2.655   0.396 ] where
        a_cp = [ 0.6361 -0.0851  0.0878  0.0466  0.1345 -0.065   0.0517  0.6693 -0.3245] and b_cp = [ 1.3731]
--------------------------------
Entering iteration 9
At iteration 9 AC computation SUCCEEDED with AC [-3.5862 -6.8179  1.5597  1.3079  3.1396 -3.2426 -3.0259 -0.2867  1.5765] where
        a_cp = [-0.6665  0.0721  0.1858  0.2247  0.0629  0.114  -0.1985 -0.5029  0.3954] and b_cp = [ 2.9682]
--------------------------------
Entering iteration 10
At iteration 10 AC computation SUCCEEDED with AC [-1.7247 -6.7868 -1.5117 -2.7301  0.8087 -3.978  -1.4022  0.1978  0.3042] where
        a_cp = [-0.1246 -0.1185 -0.155  -0.61   -0.5813 -0.1637 -0.1834 -0.2008  0.3683] and b_cp = [ 3.0512]
--------------------------------
Entering iteration 11
At iteration 11 AC computation SUCCEEDED with AC [-1.2885 -5.7725  0.884  -0.1877  2.1135 -3.0353 -2.9621 -0.2157  0.3988] where
        a_cp = [ 0.2997 -0.2512 -0.0229  0.4269  0.5308  0.0101  0.2375  0.255  -0.5108] and b_cp = [ 1.0926]
--------------------------------
Entering iteration 12
At iteration 12 AC computation SUCCEEDED with AC [-2.7515 -4.2468  0.1006 -0.7761  0.3108 -3.1388 -1.7472  0.4934 -0.6999] where
        a_cp = [-0.5393  0.0997 -0.0234 -0.4073 -0.4838 -0.0829 -0.2243 -0.2423  0.4276] and b_cp = [ 1.4538]
--------------------------------
Entering iteration 13
At iteration 13 AC computation SUCCEEDED with AC [ 0.1871 -4.2105  1.4834 -1.3003  1.3551 -2.4591 -0.4016 -1.7804  0.4156] where
        a_cp = [ 0.6624 -0.1554  0.1876  0.0213  0.2289  0.0111  0.5676 -0.0347 -0.3544] and b_cp = [ 0.5473]
--------------------------------
Entering iteration 14
At iteration 14 AC computation SUCCEEDED with AC [-1.5904 -3.4319 -2.1698  0.1714  1.6823 -2.0177 -3.8215  0.9102  0.3501] where
        a_cp = [ 0.1846  0.4527 -0.4118  0.1956  0.4189  0.0384 -0.4352  0.4301 -0.0421] and b_cp = [ 0.6787]
--------------------------------
Entering iteration 15
At iteration 15 AC computation SUCCEEDED with AC [-1.7206 -5.4791  1.1335  1.7315 -1.8447 -1.2634 -1.925   0.2869 -0.6302] where
        a_cp = [ 0.1076 -0.4029  0.3741  0.5117 -0.5269  0.3349  0.1158  0.1456 -0.0028] and b_cp = [ 2.1239]
--------------------------------
Entering iteration 16
At iteration 16 AC computation SUCCEEDED with AC [-1.5617 -4.2028  1.0613 -1.8104  2.5359 -3.5087 -2.507  -0.8658 -0.4121] where
        a_cp = [-0.3995  0.28    0.0922 -0.4632 -0.0594 -0.1028 -0.3826 -0.4421  0.4278] and b_cp = [ 1.6038]
--------------------------------
Entering iteration 17
At iteration 17 AC computation SUCCEEDED with AC [-1.2406 -4.6024 -1.1383  0.5496  0.6308 -3.6755 -0.6299  0.1774  1.4908] where
        a_cp = [ 0.2838 -0.2192 -0.2693  0.364   0.3261 -0.0832  0.4929  0.2937 -0.4732] and b_cp = [ 0.5316]
--------------------------------
Entering iteration 18
At iteration 18 AC computation SUCCEEDED with AC [-1.5599 -4.6804  0.9848 -1.2013  0.7217 -1.0851 -3.0464 -0.0918 -1.326 ] where
        a_cp = [-0.0567  0.0017  0.3223 -0.4238 -0.478   0.2884 -0.5724 -0.0577  0.2658] and b_cp = [ 1.6458]
--------------------------------
Entering iteration 19
At iteration 19 AC computation SUCCEEDED with AC [-1.4908 -3.8015  1.0781  0.4607  0.8431 -4.297  -1.7503 -0.1485  0.3196] where
        a_cp = [-0.2949  0.3168  0.3498  0.0068 -0.3166 -0.21   -0.3331 -0.2039  0.6272] and b_cp = [ 1.0647]
--------------------------------
Entering iteration 20
At iteration 20 AC computation SUCCEEDED with AC [-1.504  -4.7481 -0.8355 -1.1986  1.5594 -0.6778 -1.4751 -0.5331  0.2816] where
        a_cp = [-0.0776 -0.2332 -0.3704  0.2348  0.4884  0.2306  0.4484 -0.146  -0.483 ] and b_cp = [ 0.8932]
--------------------------------
Entering iteration 21
At iteration 21 AC computation SUCCEEDED with AC [-1.1124 -4.3032  0.3261 -0.7875  0.6437 -3.3492 -2.2644  0.064  -0.4729] where
        a_cp = [ 0.6374 -0.1513 -0.1271 -0.2377 -0.1005 -0.264   0.0546  0.5467 -0.3413] and b_cp = [ 0.98]
--------------------------------
Entering iteration 22
At iteration 22 AC computation SUCCEEDED with AC [-1.7357 -4.2659  0.6445 -0.3245  1.3129 -1.9882 -1.6251  0.0633  0.4708] where
        a_cp = [-0.6477  0.2195  0.3682  0.132   0.0608  0.2708 -0.1057 -0.2301  0.488 ] and b_cp = [ 0.3106]
--------------------------------
Entering iteration 23
At iteration 23 AC computation SUCCEEDED with AC [-1.0715 -3.6277 -0.0037  0.3588 -0.0608 -3.2278 -2.702  -1.533  -1.5549] where
        a_cp = [-0.2007 -0.0523 -0.2968  0.1244 -0.2987 -0.0931 -0.2614 -0.829   0.0017] and b_cp = [ 2.01]
--------------------------------
Entering iteration 24
At iteration 24 AC computation SUCCEEDED with AC [-1.1742 -4.525   0.1336 -0.9096  1.4246 -2.3658 -1.6018  0.2222  0.7262] where
        a_cp = [ 0.496  -0.0283 -0.0668 -0.5394 -0.0962 -0.1234  0.0141  0.6074  0.2532] and b_cp = [ 0.4786]
--------------------------------
Entering iteration 25
At iteration 25 AC computation SUCCEEDED with AC [-1.9153 -3.1108  1.0402 -0.417   0.3051 -2.7415 -1.9417 -0.2116 -1.6415] where
        a_cp = [ 0.2202 -0.0538 -0.0252  0.3242  0.4497  0.0117  0.3903  0.3382 -0.6114] and b_cp = [-0.3126]
--------------------------------
Entering iteration 26
At iteration 26 AC computation SUCCEEDED with AC [-1.297  -4.9423  0.2433 -0.1849  0.9274 -2.5732 -2.2739 -0.3436  0.2664] where
        a_cp = [-0.2655  0.0214  0.066  -0.2697 -0.4793 -0.0078 -0.397  -0.383   0.5638] and b_cp = [ 0.9932]
--------------------------------
Entering iteration 27
At iteration 27 AC computation SUCCEEDED with AC [-1.2983 -3.7304  0.1793 -0.4014  0.9484 -2.4528 -1.8862 -0.2979 -0.1761] where
        a_cp = [ 0.2255  0.1396 -0.2393  0.3162  0.5754 -0.0157  0.3027  0.2045 -0.5546] and b_cp = [-0.9333]
--------------------------------
Entering iteration 28
At iteration 28 AC computation SUCCEEDED with AC [-1.6613 -4.8658  1.0344 -0.6154  0.6889 -2.6366 -1.6361 -0.1033 -0.2593] where
        a_cp = [ 0.0888 -0.5985  0.2545  0.1163 -0.0792 -0.0174  0.5303  0.2207 -0.4681] and b_cp = [ 1.8024]
--------------------------------
Entering iteration 29
At iteration 29 AC computation SUCCEEDED with AC [-1.2828 -4.1307  0.2697 -0.2219  0.91   -2.1103 -2.2753  0.1023  0.1072] where
        a_cp = [-0.0906  0.2097  0.1677 -0.2275 -0.4323  0.0817 -0.5544 -0.0606  0.6028] and b_cp = [ 0.0084]
--------------------------------
Entering iteration 30
At iteration 30 AC computation SUCCEEDED with AC [-1.4236 -4.425   0.2686 -0.696   1.396  -2.9304 -1.5328 -0.4405  0.3507] where
        a_cp = [-0.5143 -0.0379 -0.1471 -0.3168 -0.1031 -0.1725 -0.0125 -0.6403  0.402 ] and b_cp = [ 1.6939]
--------------------------------
Entering iteration 31
At iteration 31 AC computation SUCCEEDED with AC [-1.2385 -4.0345  0.2643 -0.3264  0.5899 -2.0834 -1.7261 -0.2068 -0.1679] where
        a_cp = [ 0.4265 -0.2359 -0.0939  0.3269  0.1732  0.1129  0.4259  0.3346 -0.5573] and b_cp = [-0.5776]
--------------------------------
Entering iteration 32
At iteration 32 AC computation SUCCEEDED with AC [-1.743  -4.2645  0.7786 -0.6281  1.2147 -3.0298 -2.4751 -0.0179 -0.481 ] where
        a_cp = [-0.3718  0.2299  0.3601 -0.2013  0.4016 -0.2906 -0.517   0.3129 -0.1666] and b_cp = [ 2.4099]
--------------------------------
Entering iteration 33
At iteration 33 AC computation SUCCEEDED with AC [-1.1656 -3.8073  0.4992 -0.3836  0.8773 -2.5354 -1.4849 -0.3339  0.1853] where
        a_cp = [-0.2024  0.259   0.1964 -0.3048 -0.4482 -0.0177 -0.2596 -0.3135  0.6274] and b_cp = [-0.3125]
--------------------------------
Entering iteration 34
At iteration 34 AC computation SUCCEEDED with AC [-1.637  -4.7178 -0.2056 -0.2409  1.1933 -2.308  -2.206   0.1415  0.2523] where
        a_cp = [ 0.1055 -0.2934 -0.2997  0.4266  0.4797  0.0362  0.276   0.259  -0.5062] and b_cp = [ 0.8138]
--------------------------------
Entering iteration 35
At iteration 35 AC computation SUCCEEDED with AC [-1.2049 -4.1731  0.4744 -0.9247  1.0894 -2.0228 -2.0602 -0.4675 -0.3872] where
        a_cp = [-0.0149  0.0305  0.0853 -0.6669 -0.2876  0.1752 -0.4118 -0.4642  0.2197] and b_cp = [ 0.7232]
--------------------------------
Entering iteration 36
At iteration 36 AC computation SUCCEEDED with AC [-1.5529 -3.9984  0.269  -0.1001  0.6603 -2.9861 -1.7926  0.0409 -0.0172] where
        a_cp = [-0.0877  0.0072 -0.1938  0.3685 -0.2412 -0.5283  0.3032  0.6097 -0.1344] and b_cp = [ 0.7755]
--------------------------------
Entering iteration 37
At iteration 37 AC computation FAILED with AC [-1.3911 -3.0229  0.3308  0.0861  0.0685 -1.7767 -1.8013 -0.4159 -0.6318] where
        a_cp = [-0.3385  0.3082  0.1451 -0.1688 -0.454   0.1185 -0.3499 -0.3554  0.5216] and b_cp = [-0.4272]
--------------------------------
Entering iteration 38
At iteration 38 AC computation SUCCEEDED with AC [-0.842  -4.5279  0.7707 -0.346   1.5893 -2.711  -1.9009 -0.4327  0.5157] where
        a_cp = [ 0.4338 -0.1534  0.038   0.3801  0.5106  0.0054  0.3041  0.2874 -0.4544] and b_cp = [-0.0546]
--------------------------------
Entering iteration 39
At iteration 39 AC computation SUCCEEDED with AC [-1.5576 -4.1852  0.2094 -0.6945  1.0232 -2.218  -1.7672  0.0179  0.0107] where
        a_cp = [-0.5857  0.0762 -0.2152 -0.6911 -0.1791  0.0835  0.0666  0.1686  0.2349] and b_cp = [ 0.5475]
--------------------------------
Entering iteration 40
At iteration 40 AC computation SUCCEEDED with AC [-1.2505 -4.2101  0.4103 -0.2882  0.9134 -2.6667 -2.0677 -0.4083 -0.1616] where
        a_cp = [ 0.0691 -0.3385 -0.0532  0.2374 -0.2221 -0.1776 -0.3865 -0.7641  0.0855] and b_cp = [ 2.6163]
--------------------------------
Entering iteration 41
At iteration 41 AC computation SUCCEEDED with AC [-1.3656 -4.098   0.4347 -0.4721  1.0356 -2.3776 -1.8052 -0.1283  0.0407] where
        a_cp = [ 0.2531 -0.0146  0.1126  0.3053  0.5324  0.0815  0.3787  0.4542 -0.4359] and b_cp = [-0.783]
--------------------------------
Entering iteration 42
At iteration 42 AC computation SUCCEEDED with AC [-1.3386 -4.0538  0.1379 -0.4718  0.7899 -2.4918 -1.9285 -0.2048 -0.1551] where
        a_cp = [-0.1679  0.0809 -0.1342 -0.4462 -0.5623 -0.1016 -0.3673 -0.2821  0.4551] and b_cp = [ 0.5547]
--------------------------------
Entering iteration 43
At iteration 43 AC computation SUCCEEDED with AC [-1.5025 -4.1153  0.4049 -0.307   0.8935 -2.3276 -1.8988 -0.2713 -0.1418] where
        a_cp = [ -6.9200e-01  -1.9535e-04   1.0204e-01   2.5754e-01  -2.4213e-02
   2.0320e-01  -7.8156e-02  -6.0101e-01   1.8759e-01] and b_cp = [ 0.7262]
--------------------------------
Entering iteration 44
At iteration 44 AC computation FAILED with AC [-0.3474 -3.4123 -0.1149 -0.3554  0.9905 -2.3057 -1.6054 -0.4627  0.4386] where
        a_cp = [ 0.8335  0.2075 -0.1447  0.0753  0.2026 -0.0355  0.1115  0.3861 -0.1784] and b_cp = [-1.5831]
--------------------------------
Entering iteration 45
At iteration 45 AC computation FAILED with AC [-1.1863 -2.7315  1.3876 -0.4241 -0.4019 -3.2098 -2.0492 -0.7352 -2.0134] where
        a_cp = [ 0.5239  0.3043  0.3529 -0.0609 -0.1525 -0.1498  0.1571  0.3754 -0.5417] and b_cp = [-0.8856]
--------------------------------
Entering iteration 46
At iteration 46 AC computation FAILED with AC [-0.585  -2.9203  0.7865 -0.2854  0.3305 -2.4306 -1.1839 -1.3079 -0.6949] where
        a_cp = [ 0.4439  0.0969  0.0425  0.3404  0.321   0.045   0.5146 -0.0251 -0.5527] and b_cp = [-1.3084]
--------------------------------
Entering iteration 47
At iteration 47 AC computation SUCCEEDED with AC [-1.3663 -4.4362  0.3443 -0.4818  1.116  -2.5699 -1.9667 -0.0679  0.1545] where
        a_cp = [ 0.3143 -0.5923 -0.0365 -0.2944 -0.1682 -0.2891 -0.3246  0.3768  0.3213] and b_cp = [ 3.4316]
--------------------------------
Entering iteration 48
At iteration 48 AC computation SUCCEEDED with AC [-1.3931 -4.0222  0.3555 -0.4607  0.9011 -2.4528 -1.8872 -0.1892 -0.1536] where
        a_cp = [ 0.1274  0.0772 -0.1484  0.1211  0.418  -0.0676  0.3529  0.3677 -0.7086] and b_cp = [-0.681]
--------------------------------
Entering iteration 49
At iteration 49 AC computation SUCCEEDED with AC [-1.2355 -4.1471  0.2205 -0.3679  1.0082 -2.2625 -1.7529 -0.2236  0.2254] where
        a_cp = [-0.1587  0.0792 -0.0087 -0.1036 -0.3592  0.1586 -0.276  -0.448   0.7257] and b_cp = [-0.136]
--------------------------------
Entering iteration 50
At iteration 50 AC computation SUCCEEDED with AC [-1.3619 -4.1691  0.5393 -0.4167  0.8901 -2.5297 -1.9094 -0.1977 -0.1031] where
        a_cp = [ -1.4124e-01   3.0299e-04   4.0096e-01  -2.7103e-01  -5.5988e-01
  -3.8831e-02  -3.7087e-01  -1.9444e-01   5.0547e-01] and b_cp = [ 0.7799]
--------------------------------
Entering iteration 51
At iteration 51 AC computation SUCCEEDED with AC [-1.3614 -4.1556  0.2466 -0.4213  1.0334 -2.4617 -1.9045 -0.1911  0.0143] where
        a_cp = [ 0.1867 -0.1723 -0.2742  0.3594  0.559  -0.0273  0.3246  0.1867 -0.5269] and b_cp = [ 0.2103]
--------------------------------
Entering iteration 52
At iteration 52 AC computation SUCCEEDED with AC [-1.3775 -4.0677  0.3253 -0.4696  0.9167 -2.3274 -1.8409 -0.1366 -0.0286] where
        a_cp = [-0.2756  0.2132  0.112  -0.3978 -0.4772  0.0774 -0.3448 -0.1484  0.5772] and b_cp = [-0.2493]
--------------------------------
Entering iteration 53
At iteration 53 AC computation SUCCEEDED with AC [-1.2712 -4.0702  0.4027 -0.425   0.9096 -2.5323 -1.762  -0.2985 -0.0466] where
        a_cp = [ 0.4191 -0.2235 -0.0641  0.2759  0.2994 -0.1078  0.54    0.0932 -0.541 ] and b_cp = [-0.2012]
--------------------------------
Entering iteration 54
At iteration 54 AC computation SUCCEEDED with AC [-1.3547 -4.0662  0.3582 -0.3435  0.9527 -2.4365 -2.0589 -0.1748 -0.1058] where
        a_cp = [ -1.5686e-02   3.5178e-01   1.9349e-01   2.4363e-01   4.4650e-02
   1.0979e-01  -8.1782e-01  -1.7951e-05   3.1039e-01] and b_cp = [-0.0603]
--------------------------------
Entering iteration 55
At iteration 55 AC computation SUCCEEDED with AC [-1.4334 -4.1903  0.3585 -0.4767  0.9532 -2.4366 -1.8364 -0.1664 -0.0422] where
        a_cp = [-0.7049 -0.4827 -0.1073 -0.1566 -0.0955 -0.0176  0.3691 -0.2883 -0.0723] and b_cp = [ 2.3752]
--------------------------------
Entering iteration 56
At iteration 56 AC computation FAILED with AC [-1.217  -3.9074  0.4142 -0.6301  1.2353 -2.53   -1.7657 -0.3477  0.0918] where
        a_cp = [-0.1944  0.4809  0.1179 -0.4317  0.0063 -0.0736 -0.3005 -0.3651  0.5492] and b_cp = [-0.5457]
--------------------------------
Entering iteration 57
At iteration 57 AC computation SUCCEEDED with AC [-1.3334 -4.0965  0.2915 -0.3431  0.8158 -2.38   -1.8814 -0.1196 -0.0624] where
        a_cp = [ 0.4621 -0.2008 -0.104   0.3363  0.1864  0.03    0.3041  0.4901 -0.5039] and b_cp = [-0.4809]
--------------------------------
Entering iteration 58
At iteration 58 AC computation SUCCEEDED with AC [-1.3428 -4.0822  0.3653 -0.4527  0.9717 -2.462  -1.8887 -0.2301 -0.0569] where
        a_cp = [-0.3015  0.2151  0.0831 -0.3323 -0.2836 -0.0476 -0.4137 -0.4596  0.5295] and b_cp = [ 0.4059]
--------------------------------
Entering iteration 59
At iteration 59 AC computation SUCCEEDED with AC [-1.3792 -4.0849  0.3528 -0.3925  0.9216 -2.441  -1.8416 -0.1543 -0.0224] where
        a_cp = [ 0.1517 -0.0673  0.0146  0.4776  0.3945  0.0342  0.4354  0.4536 -0.4383] and b_cp = [-0.6986]
--------------------------------
Entering iteration 60
At iteration 60 AC computation SUCCEEDED with AC [-1.2941 -4.1812  0.3635 -0.5636  0.9699 -2.2283 -1.9408 -0.2411 -0.1356] where
        a_cp = [ 0.523  -0.3348 -0.0739  0.0427  0.2952  0.2115  0.2084  0.2304 -0.6154] and b_cp = [ 0.0503]
--------------------------------
Entering iteration 61
At iteration 61 AC computation SUCCEEDED with AC [-1.3575 -4.1005  0.3098 -0.4222  0.91   -2.4963 -1.8772 -0.1756 -0.0468] where
        a_cp = [-0.0854  0.0272 -0.1714 -0.4271 -0.6069 -0.2435 -0.3407 -0.1408  0.4654] and b_cp = [ 0.8251]
--------------------------------
Entering iteration 62
At iteration 62 AC computation SUCCEEDED with AC [-1.3564 -4.0876  0.3742 -0.438   0.944  -2.3728 -1.8676 -0.2179 -0.0702] where
        a_cp = [-0.1016 -0.058   0.1646  0.473   0.5157  0.3748  0.3193 -0.1793 -0.4415] and b_cp = [-0.6996]
--------------------------------
Entering iteration 63
At iteration 63 AC computation SUCCEEDED with AC [-1.3468 -4.1207  0.3725 -0.4751  0.9928 -2.4642 -1.8731 -0.1632 -0.014 ] where
        a_cp = [ 0.51   -0.0111  0.0782 -0.0904  0.4018 -0.1433  0.1634  0.6574 -0.2908] and b_cp = [-0.233]
--------------------------------
Entering iteration 64
At iteration 64 AC computation SUCCEEDED with AC [-1.3672 -4.0781  0.3272 -0.3955  0.8995 -2.434  -1.8737 -0.2042 -0.0688] where
        a_cp = [-0.4642  0.0682 -0.088  -0.0299 -0.4656  0.0244 -0.2766 -0.5455  0.424 ] and b_cp = [ 0.4619]
--------------------------------
Entering iteration 65
At iteration 65 AC computation FAILED with AC [-1.1449 -2.633   0.0985 -0.3968  0.4235 -1.3051 -1.359  -0.0638 -0.2031] where
        a_cp = [ 0.0826  0.8099  0.1828 -0.1145 -0.1329  0.3422 -0.0524  0.2797  0.2738] and b_cp = [-3.3891]
--------------------------------
Entering iteration 66
At iteration 66 AC computation FAILED with AC [-1.2946 -3.6057 -0.0262 -0.2659  0.6812 -2.155  -1.5535 -0.0735  0.08  ] where
        a_cp = [ 0.2584  0.4645 -0.3496  0.2615  0.1369  0.1479  0.4474  0.4993 -0.1918] and b_cp = [-3.3315]
--------------------------------
Entering iteration 67
At iteration 67 AC computation FAILED with AC [-1.0039 -3.1836 -0.0095 -0.2264  0.5945 -1.6999 -1.3757 -0.2606  0.169 ] where
        a_cp = [-0.0567  0.5528  0.0791 -0.1837 -0.4005  0.2122 -0.2301 -0.162   0.6054] and b_cp = [-2.1483]
--------------------------------
Entering iteration 68
At iteration 68 AC computation SUCCEEDED with AC [-1.3672 -4.1428  0.3777 -0.4453  0.9547 -2.457  -1.8982 -0.1904 -0.0628] where
        a_cp = [ 0.2241 -0.5842  0.0936  0.1961  0.3368 -0.112   0.1751  0.221  -0.5965] and b_cp = [ 2.3217]
--------------------------------
Entering iteration 69
At iteration 69 AC computation SUCCEEDED with AC [-1.3355 -4.0627  0.3287 -0.4488  0.9455 -2.4134 -1.8311 -0.1975 -0.0241] where
        a_cp = [ 0.3689  0.5861 -0.3091 -0.4318  0.116   0.0312  0.4079  0.1269  0.2038] and b_cp = [-3.5265]
--------------------------------
Entering iteration 70
At iteration 70 AC computation SUCCEEDED with AC [-1.3705 -4.0917  0.358  -0.4214  0.9367 -2.4367 -1.8961 -0.1753 -0.0586] where
        a_cp = [-0.3326  0.29    0.2434 -0.1352 -0.3147  0.0411 -0.5832 -0.0485  0.5334] and b_cp = [ 0.1015]
--------------------------------
Entering iteration 71
At iteration 71 AC computation SUCCEEDED with AC [-1.3436 -4.109   0.3501 -0.4385  0.9352 -2.438  -1.8482 -0.2103 -0.0451] where
        a_cp = [ 0.3251 -0.3813 -0.181   0.2307  0.2461 -0.0469  0.5484  0.0358 -0.5461] and b_cp = [ 0.3115]
--------------------------------
Entering iteration 72
At iteration 72 AC computation SUCCEEDED with AC [-1.3697 -4.0978  0.3356 -0.4486  0.9535 -2.4227 -1.8763 -0.1836 -0.0502] where
        a_cp = [-0.5388  0.1492 -0.497  -0.206   0.5764  0.0664  0.048   0.0243 -0.2417] and b_cp = [ 0.3586]
--------------------------------
Entering iteration 73
At iteration 73 AC computation SUCCEEDED with AC [-1.324  -4.0753  0.385  -0.4142  0.9185 -2.4499 -1.8634 -0.2078 -0.0508] where
        a_cp = [ 0.3885  0.1851  0.4735 -0.1031 -0.5224 -0.0325 -0.3055 -0.0274  0.4603] and b_cp = [-0.9075]
--------------------------------
Entering iteration 74
At iteration 74 AC computation SUCCEEDED with AC [-1.362  -4.1096  0.349  -0.4234  0.9429 -2.4388 -1.8642 -0.1849 -0.0306] where
        a_cp = [-0.5399 -0.1729  0.097   0.1502 -0.3162  0.005  -0.1044 -0.3351  0.6507] and b_cp = [ 1.3427]
--------------------------------
Entering iteration 75
At iteration 75 AC computation SUCCEEDED with AC [-1.3514 -4.0663  0.3511 -0.4439  0.9106 -2.4256 -1.895  -0.2015 -0.1106] where
        a_cp = [ 0.4459 -0.0649 -0.1381  0.1433  0.2794 -0.01    0.2354  0.3693 -0.6981] and b_cp = [-0.6257]
--------------------------------
Entering iteration 76
At iteration 76 AC computation SUCCEEDED with AC [-1.3564 -4.0899  0.3674 -0.4496  0.9481 -2.4377 -1.8633 -0.2003 -0.0531] where
        a_cp = [-0.3405  0.2428  0.2354 -0.4441 -0.3038 -0.0215 -0.2719 -0.3761  0.5142] and b_cp = [ 0.0728]
--------------------------------
Entering iteration 77
At iteration 77 AC computation SUCCEEDED with AC [-1.3281 -4.1083  0.317  -0.4196  0.9554 -2.4069 -1.8956 -0.1919 -0.026 ] where
        a_cp = [ 0.5796 -0.1528 -0.2496  0.3873  0.4204  0.0907  0.0557  0.3054 -0.3834] and b_cp = [-0.3682]
--------------------------------
Entering iteration 78
At iteration 78 AC computation SUCCEEDED with AC [-1.3708 -4.0866  0.3492 -0.4275  0.9198 -2.445  -1.8627 -0.1788 -0.0611] where
        a_cp = [ 0.1301 -0.114  -0.1209  0.2519  0.1983 -0.0988  0.4944  0.5018 -0.5888] and b_cp = [-0.4158]
--------------------------------
Entering iteration 79
At iteration 79 AC computation SUCCEEDED with AC [-1.3524 -4.1057  0.3476 -0.4373  0.9398 -2.4153 -1.8803 -0.1974 -0.0526] where
        a_cp = [-0.2205 -0.0068  0.0473 -0.2916 -0.4591  0.1173 -0.4416 -0.4367  0.5038] and b_cp = [ 0.6451]
--------------------------------
Entering iteration 80
At iteration 80 AC computation FAILED with AC [-1.3639 -4.068   0.3674 -0.4105  0.9422 -2.4946 -1.8805 -0.2148 -0.0733] where
        a_cp = [ 0.0057  0.041  -0.0694  0.4825  0.5999 -0.1427  0.3053 -0.001  -0.5359] and b_cp = [-0.0254]
--------------------------------
Entering iteration 81
At iteration 81 AC computation FAILED with AC [-1.3722 -4.0914  0.3621 -0.4492  0.9038 -2.397  -1.8547 -0.175  -0.0723] where
        a_cp = [-0.2529  0.0574  0.208  -0.452  -0.6765  0.1095 -0.1873 -0.0608  0.4203] and b_cp = [-0.1676]
--------------------------------
Entering iteration 82
At iteration 82 AC computation SUCCEEDED with AC [-1.3472 -4.1008  0.3491 -0.4378  0.9607 -2.4459 -1.8678 -0.1857 -0.0269] where
        a_cp = [ 0.4574 -0.0439 -0.0743  0.2213  0.5254 -0.087   0.2823  0.4645 -0.3941] and b_cp = [-0.4468]
--------------------------------
Entering iteration 83
At iteration 83 AC computation FAILED with AC [-1.3642 -4.0934  0.3518 -0.4308  0.9315 -2.4405 -1.8725 -0.196  -0.0607] where
        a_cp = [-0.5319  0.0649  0.0054 -0.2105 -0.4184 -0.0473 -0.2574 -0.525   0.3865] and b_cp = [ 0.8399]
--------------------------------
Entering iteration 84
At iteration 84 AC computation SUCCEEDED with AC [-1.3525 -4.0919  0.3525 -0.4319  0.9435 -2.4092 -1.8649 -0.1896 -0.0427] where
        a_cp = [ 0.2815 -0.0543  0.0296  0.4129  0.4969  0.1829  0.3609  0.3356 -0.4724] and b_cp = [-1.0169]
--------------------------------
Entering iteration 85
At iteration 85 AC computation SUCCEEDED with AC [-1.3508 -4.1002  0.3415 -0.4368  0.9399 -2.4473 -1.8747 -0.1867 -0.0428] where
        a_cp = [ 0.0481  0.0768 -0.0747 -0.4831 -0.5243 -0.1893 -0.4127 -0.0694  0.5167] and b_cp = [ 0.5383]
--------------------------------
Entering iteration 86
At iteration 86 AC computation SUCCEEDED with AC [-1.358  -4.1025  0.3565 -0.4354  0.9456 -2.4372 -1.875  -0.1932 -0.0513] where
        a_cp = [ 0.2106 -0.2215 -0.0163  0.361   0.5409  0.0007  0.325   0.2154 -0.5757] and b_cp = [ 0.3482]
--------------------------------
Entering iteration 87
At iteration 87 AC computation FAILED with AC [-1.373  -4.0728  0.3491 -0.4161  0.8996 -2.4279 -1.87   -0.1832 -0.0771] where
        a_cp = [-0.4614  0.2056  0.1057 -0.1386 -0.6902  0.064  -0.2529 -0.1726  0.3744] and b_cp = [-0.422]
--------------------------------
Entering iteration 88
At iteration 88 AC computation SUCCEEDED with AC [-1.349  -4.0858  0.3396 -0.4336  0.9436 -2.4282 -1.8586 -0.1966 -0.0363] where
        a_cp = [-0.2366  0.3537 -0.1421 -0.2723 -0.24    0.0243 -0.1916 -0.4679  0.6409] and b_cp = [-0.921]
--------------------------------
Entering iteration 89
At iteration 89 AC computation FAILED with AC [-1.3566 -4.1155  0.3648 -0.4465  0.9514 -2.4334 -1.8795 -0.1876 -0.0479] where
        a_cp = [ 0.2274 -0.2968  0.4935 -0.5172 -0.2275  0.0017 -0.4112  0.2266  0.2774] and b_cp = [ 1.8124]
--------------------------------
Entering iteration 90
At iteration 90 AC computation FAILED with AC [-1.356  -4.0927  0.343  -0.4212  0.934  -2.441  -1.8781 -0.1935 -0.0543] where
        a_cp = [ 0.2646 -0.151  -0.2392  0.4936  0.4171 -0.0441  0.2663  0.1961 -0.5667] and b_cp = [-0.0428]
--------------------------------
Entering iteration 91
At iteration 91 AC computation FAILED with AC [-1.3589 -4.094   0.3523 -0.4369  0.9404 -2.4309 -1.8643 -0.1884 -0.0461] where
        a_cp = [-0.4563  0.3484  0.2826 -0.4401 -0.2711  0.0933  0.0701  0.0534  0.554 ] and b_cp = [-1.1625]
--------------------------------
Entering iteration 92
At iteration 92 AC computation FAILED with AC [-1.351  -4.0975  0.3468 -0.4327  0.9348 -2.4323 -1.8773 -0.1996 -0.0577] where
        a_cp = [ 0.4365 -0.4357 -0.423   0.0364 -0.2526 -0.033  -0.1614 -0.4887 -0.331 ] and b_cp = [ 1.2922]
--------------------------------
Entering iteration 93
At iteration 93 AC computation FAILED with AC [-1.3609 -4.0947  0.3538 -0.4226  0.9447 -2.4483 -1.8772 -0.185  -0.0423] where
        a_cp = [-0.3031  0.4096  0.2769  0.3574  0.1985 -0.1517 -0.4681  0.1331  0.4865] and b_cp = [ 0.0674]
--------------------------------
Entering iteration 94
At iteration 94 AC computation FAILED with AC [-1.3557 -4.1021  0.3505 -0.4403  0.9437 -2.4285 -1.861  -0.1945 -0.045 ] where
        a_cp = [ 0.2059 -0.2752 -0.135   0.2387  0.4237  0.0375  0.5437  0.1591 -0.5522] and b_cp = [-0.0135]
--------------------------------
Entering iteration 95
At iteration 95 AC computation FAILED with AC [-1.3565 -4.0919  0.3506 -0.4373  0.9389 -2.4282 -1.8752 -0.1901 -0.0541] where
        a_cp = [-0.104   0.3274  0.1219 -0.4534 -0.3851  0.0781 -0.5348 -0.0591  0.4665] and b_cp = [-0.5203]
--------------------------------
Entering iteration 96
At iteration 96 AC computation FAILED with AC [-1.3572 -4.1034  0.352  -0.4319  0.9387 -2.4412 -1.8605 -0.1921 -0.0419] where
        a_cp = [ 0.1087 -0.4917 -0.1125  0.292   0.1367 -0.1481  0.6842  0.0485 -0.3706] and b_cp = [ 0.9245]
--------------------------------
Entering iteration 97
At iteration 97 AC computation FAILED with AC [-1.3561 -4.0919  0.3533 -0.4315  0.9371 -2.4349 -1.8723 -0.1927 -0.0527] where
        a_cp = [-0.1508  0.3912  0.337  -0.085  -0.4007  0.0241 -0.4932 -0.2462  0.4883] and b_cp = [-0.7294]
--------------------------------
Entering iteration 98
At iteration 98 AC computation FAILED with AC [-1.3627 -4.1052  0.3378 -0.4396  0.9464 -2.4205 -1.8749 -0.1825 -0.0448] where
        a_cp = [ 0.0739 -0.2398 -0.3985  0.1777  0.5003  0.125   0.2703  0.3849 -0.5095] and b_cp = [ 0.2825]
--------------------------------
Entering iteration 99
At iteration 99 AC computation FAILED with AC [-1.3559 -4.0946  0.3536 -0.4387  0.9429 -2.4406 -1.8703 -0.1955 -0.0522] where
        a_cp = [-0.0787  0.1774 -0.0985 -0.6412  0.245  -0.4953  0.0653 -0.4671 -0.1172] and b_cp = [ 1.0388]
--------------------------------
Entering iteration 100
At iteration 100 AC computation FAILED with AC [-1.3545 -4.0988  0.3495 -0.4263  0.9323 -2.4196 -1.8689 -0.1867 -0.045 ] where
        a_cp = [ 0.4285 -0.2825  0.2036  0.5121 -0.2163  0.4096  0.142   0.4398 -0.0686] and b_cp = [-1.1134]
--------------------------------
Entering iteration 101
At iteration 101 AC computation SUCCEEDED with AC [-1.3595 -4.0987  0.3481 -0.4329  0.9391 -2.436  -1.8719 -0.1882 -0.0477] where
        a_cp = [-0.3663  0.0496 -0.0389 -0.3218 -0.4881 -0.0811 -0.3772 -0.2267  0.5655] and b_cp = [ 0.8813]
--------------------------------
Entering iteration 102
At iteration 102 AC computation FAILED with AC [-1.3567 -4.0914  0.3532 -0.4329  0.9404 -2.4289 -1.8704 -0.1946 -0.0531] where
        a_cp = [ 0.1632 -0.0472 -0.0274  0.4209  0.5473  0.1038  0.3697  0.1823 -0.5595] and b_cp = [-0.6558]
--------------------------------
Entering iteration 103
At iteration 103 AC computation FAILED with AC [-1.3558 -4.0957  0.3505 -0.4341  0.9385 -2.4345 -1.8708 -0.1901 -0.0496] where
        a_cp = [ 0.6491 -0.0972 -0.0623 -0.0265  0.0083 -0.1234  0.1655  0.6423 -0.3308] and b_cp = [-0.5994]
--------------------------------
Entering iteration 104
At iteration 104 AC computation FAILED with AC [-1.3846 -4.0773  0.354  -0.4105  0.9019 -2.4573 -1.8675 -0.1946 -0.0855] where
        a_cp = [-0.7319 -0.0555 -0.1033  0.3378 -0.1726 -0.1007  0.2832 -0.3811 -0.2667] and b_cp = [ 0.7003]
--------------------------------
Entering iteration 105
At iteration 105 AC computation FAILED with AC [-1.3556 -4.1009  0.3518 -0.4349  0.9477 -2.4269 -1.8724 -0.1959 -0.0437] where
        a_cp = [-0.3977  0.1064  0.1154 -0.169  -0.2233  0.1121 -0.3706 -0.5196  0.5647] and b_cp = [ 0.5022]
--------------------------------
Entering iteration 106
At iteration 106 AC computation FAILED with AC [-1.356  -4.095   0.3504 -0.4348  0.9419 -2.4307 -1.8705 -0.1927 -0.0487] where
        a_cp = [-0.016   0.1819 -0.0789  0.3458  0.7821  0.2939  0.1978 -0.1447 -0.2875] and b_cp = [-1.2071]
--------------------------------
Entering iteration 107
At iteration 107 AC computation FAILED with AC [-1.3593 -4.0979  0.3537 -0.4353  0.9367 -2.4372 -1.8712 -0.1894 -0.0528] where
        a_cp = [-0.1681 -0.131   0.196  -0.5194 -0.6957 -0.2015 -0.1967  0.0702  0.2798] and b_cp = [ 1.2388]
--------------------------------
Entering iteration 108
At iteration 108 AC computation FAILED with AC [-1.3534 -4.0928  0.3476 -0.4305  0.9385 -2.4364 -1.8685 -0.1926 -0.0462] where
        a_cp = [ 0.6992  0.256  -0.4472  0.337  -0.0147 -0.2957  0.1266  0.0497  0.1609] and b_cp = [-1.8439]
--------------------------------
Entering iteration 109
At iteration 109 AC computation FAILED with AC [-1.3622 -4.1019  0.3544 -0.4355  0.9426 -2.4321 -1.8767 -0.1891 -0.0529] where
        a_cp = [-0.3477 -0.309   0.1568  0.3604  0.5651  0.1838  0.0454  0.1542 -0.5002] and b_cp = [ 1.6344]
--------------------------------
Entering iteration 110
At iteration 110 AC computation FAILED with AC [-1.3556 -4.0936  0.3526 -0.4398  0.9384 -2.4267 -1.8675 -0.193  -0.0524] where
        a_cp = [-0.0696  0.1752  0.212  -0.7094 -0.4888  0.2201 -0.0539 -0.1905  0.2994] and b_cp = [-1.11]
--------------------------------
Entering iteration 111
At iteration 111 AC computation FAILED with AC [-1.3585 -4.0969  0.3503 -0.4315  0.9394 -2.4374 -1.8724 -0.1904 -0.0495] where
        a_cp = [-0.4074 -0.2145 -0.2822  0.6652  0.2988 -0.3679 -0.0585  0.0323 -0.1916] and b_cp = [ 2.3363]
--------------------------------
Entering iteration 112
At iteration 112 AC computation FAILED with AC [-1.3525 -4.0966  0.3542 -0.4363  0.9423 -2.431  -1.8695 -0.1934 -0.0473] where
        a_cp = [ 0.7727  0.0416  0.5204 -0.1833  0.0744  0.1968 -0.0492  0.1422  0.173 ] and b_cp = [-1.3053]
--------------------------------
Entering iteration 113
At iteration 113 AC computation FAILED with AC [-1.3601 -4.0931  0.3449 -0.4357  0.9373 -2.4298 -1.8701 -0.189  -0.0521] where
        a_cp = [-0.4766  0.1678 -0.7189 -0.3164 -0.0225  0.0586  0.2008  0.1146 -0.2653] and b_cp = [-0.6989]
--------------------------------
Entering iteration 114
At iteration 114 AC computation FAILED with AC [-1.3565 -4.0954  0.3545 -0.4317  0.9371 -2.4359 -1.8695 -0.194  -0.0514] where
        a_cp = [-0.2845 -0.1458  0.4451  0.2702 -0.4018 -0.0023  0.0861 -0.6506  0.1859] and b_cp = [ 0.6077]
--------------------------------
Entering iteration 115
At iteration 115 AC computation FAILED with AC [-1.3564 -4.0973  0.3496 -0.435   0.9417 -2.4338 -1.8726 -0.1899 -0.048 ] where
        a_cp = [ 0.2246  0.1459 -0.112  -0.4639 -0.1355 -0.1143 -0.6069  0.2888  0.4662] and b_cp = [ 0.4702]
--------------------------------
Entering iteration 116
At iteration 116 AC computation FAILED with AC [-1.357  -4.0944  0.3522 -0.4337  0.9394 -2.4334 -1.8691 -0.1917 -0.0504] where
        a_cp = [ 0.238  -0.0957 -0.0359  0.3513  0.4708  0.0298  0.4253  0.3032 -0.5605] and b_cp = [-0.5513]
--------------------------------
Entering iteration 117
At iteration 117 AC computation FAILED with AC [-1.3571 -4.0962  0.3502 -0.4336  0.9387 -2.4331 -1.8702 -0.1918 -0.0494] where
        a_cp = [-0.3587  0.0675  0.0308 -0.2791 -0.4794  0.0163 -0.3023 -0.4176  0.5405] and b_cp = [ 0.4713]
--------------------------------
Entering iteration 118
At iteration 118 AC computation FAILED with AC [-1.3565 -4.0942  0.3524 -0.434   0.9397 -2.4342 -1.871  -0.1915 -0.0513] where
        a_cp = [ 0.3188 -0.0635 -0.0243  0.3131  0.4688  0.0062  0.3478  0.3681 -0.5652] and b_cp = [-0.584]
--------------------------------
Entering iteration 119
At iteration 119 AC computation FAILED with AC [-1.3571 -4.0963  0.3506 -0.4339  0.9392 -2.4335 -1.8706 -0.1915 -0.0494] where
        a_cp = [-0.3455  0.067   0.0418 -0.3059 -0.4747  0.0016 -0.3244 -0.386   0.5489] and b_cp = [ 0.5457]
--------------------------------
Entering iteration 120
At iteration 120 AC computation FAILED with AC [-1.3563 -4.0948  0.352  -0.4341  0.9401 -2.434  -1.8711 -0.1915 -0.0506] where
        a_cp = [ 0.3397 -0.0654 -0.0286  0.3074  0.4778  0.006   0.3328  0.3714 -0.555 ] and b_cp = [-0.5676]
--------------------------------
Entering iteration 121
At iteration 121 AC computation FAILED with AC [-1.3571 -4.0962  0.3507 -0.4339  0.9393 -2.4335 -1.8706 -0.1914 -0.0495] where
        a_cp = [ -3.4828e-01   7.0279e-02   4.1501e-02  -3.1415e-01  -4.7742e-01
   4.8524e-04  -3.2901e-01  -3.6373e-01   5.5216e-01] and b_cp = [ 0.5438]
--------------------------------
Entering iteration 122
At iteration 122 AC computation FAILED with AC [-1.3561 -4.095   0.3518 -0.4341  0.9402 -2.4339 -1.8711 -0.1916 -0.0503] where
        a_cp = [ 0.3518 -0.0701 -0.0353  0.3092  0.4822  0.0061  0.3292  0.3598 -0.5515] and b_cp = [-0.5557]
--------------------------------
Entering iteration 123
At iteration 123 AC computation FAILED with AC [-1.3571 -4.0961  0.3507 -0.4339  0.9393 -2.4336 -1.8707 -0.1913 -0.0496] where
        a_cp = [-0.3614  0.0802  0.0436 -0.3163 -0.4849 -0.0036 -0.3256 -0.3451  0.5485] and b_cp = [ 0.5156]
--------------------------------
Entering iteration 124
At iteration 124 AC computation FAILED with AC [-1.356  -4.0954  0.3516 -0.4341  0.9404 -2.4338 -1.871  -0.1918 -0.0499] where
        a_cp = [ 0.3646 -0.0852 -0.0445  0.3136  0.4902  0.0082  0.3274  0.3355 -0.5471] and b_cp = [-0.5061]
--------------------------------
Entering iteration 125
At iteration 125 AC computation FAILED with AC [-1.3572 -4.0959  0.3508 -0.4339  0.9392 -2.4337 -1.8707 -0.1912 -0.0498] where
        a_cp = [-0.3729  0.1174  0.066  -0.3198 -0.4964 -0.0078 -0.3303 -0.2976  0.5444] and b_cp = [ 0.3876]
--------------------------------
Entering iteration 126
At iteration 126 AC computation FAILED with AC [-1.3557 -4.0964  0.3511 -0.4343  0.9408 -2.4336 -1.8709 -0.1922 -0.0492] where
        a_cp = [ 0.3735 -0.1551 -0.0865  0.3204  0.5065  0.0123  0.339   0.255  -0.5382] and b_cp = [-0.2509]
--------------------------------
Entering iteration 127
At iteration 127 AC computation FAILED with AC [-1.3574 -4.095   0.3511 -0.4336  0.9386 -2.4339 -1.8708 -0.191  -0.0504] where
        a_cp = [-0.3482  0.3398  0.1786 -0.2996 -0.5157 -0.0236 -0.3616 -0.0516  0.4916] and b_cp = [-0.4916]
--------------------------------
Entering iteration 128
At iteration 128 AC computation FAILED with AC [-1.3552 -4.1008  0.3497 -0.4354  0.9431 -2.4327 -1.8704 -0.1932 -0.0463] where
        a_cp = [ 0.1657 -0.6346 -0.3333  0.1479  0.364   0.0358  0.281  -0.4209 -0.2167] and b_cp = [ 2.0165]
--------------------------------
Entering iteration 129
At iteration 129 AC computation FAILED with AC [-1.357  -4.0916  0.3519 -0.4326  0.9371 -2.4344 -1.8709 -0.1909 -0.0524] where
        a_cp = [ 0.3264  0.1758  0.0601  0.3259  0.3546 -0.0036  0.2829  0.5112 -0.5345] and b_cp = [-1.5408]
--------------------------------
Entering iteration 130
At iteration 130 AC computation FAILED with AC [-1.358  -4.0942  0.3524 -0.4349  0.9388 -2.4332 -1.8711 -0.1909 -0.0516] where
        a_cp = [-0.3552  0.2898  0.2206 -0.3849 -0.403   0.0288 -0.376  -0.1936  0.5009] and b_cp = [-0.1932]
--------------------------------
Entering iteration 131
At iteration 131 AC computation FAILED with AC [-1.3565 -4.0975  0.3501 -0.4337  0.9399 -2.4339 -1.8707 -0.1911 -0.0485] where
        a_cp = [ 0.4314 -0.4823 -0.2784  0.2727  0.2322 -0.0678  0.3464  0.2774 -0.4172] and b_cp = [ 0.8773]
--------------------------------
Entering iteration 132
At iteration 132 AC computation FAILED with AC [-1.3574 -4.0903  0.3524 -0.4332  0.9377 -2.4327 -1.8714 -0.1934 -0.0541] where
        a_cp = [-0.5084  0.583   0.2148 -0.0098 -0.0413  0.1495 -0.2756 -0.4563  0.2174] and b_cp = [-1.4268]
--------------------------------
Entering iteration 133
At iteration 133 AC computation FAILED with AC [-1.357  -4.098   0.3512 -0.435   0.9411 -2.4348 -1.8695 -0.1901 -0.047 ] where
        a_cp = [  1.8063e-02  -1.7342e-01   1.4593e-01  -5.8063e-01  -3.2924e-01
  -2.4913e-01   2.8202e-04   2.9855e-01   5.9294e-01] and b_cp = [ 1.2003]
--------------------------------
Entering iteration 134
At iteration 134 AC computation FAILED with AC [-1.3556 -4.0948  0.3493 -0.4323  0.9365 -2.4308 -1.8751 -0.1933 -0.0546] where
        a_cp = [ 0.4581 -0.2245 -0.2922  0.4204  0.107   0.1861 -0.1239 -0.0312 -0.6444] and b_cp = [-0.067]
--------------------------------
Entering iteration 135
At iteration 135 AC computation FAILED with AC [-1.3577 -4.0953  0.3511 -0.4332  0.9405 -2.4345 -1.8689 -0.1913 -0.048 ] where
        a_cp = [-0.5152  0.1693  0.0314  0.4322  0.5396  0.0202  0.4477 -0.1574 -0.0371] and b_cp = [-0.5174]
--------------------------------
Entering iteration 136
At iteration 136 AC computation FAILED with AC [-1.356  -4.0956  0.3522 -0.4365  0.9385 -2.4342 -1.873  -0.1916 -0.0534] where
        a_cp = [ 0.507  -0.0058  0.0711 -0.6058 -0.3797 -0.1543 -0.2966  0.3203 -0.1113] and b_cp = [ 0.1432]
--------------------------------
Entering iteration 137
At iteration 137 AC computation FAILED with AC [-1.3571 -4.0967  0.3499 -0.4323  0.9391 -2.4317 -1.8705 -0.1908 -0.048 ] where
        a_cp = [ -4.3112e-01   5.9902e-04   6.8653e-02   1.2803e-01  -3.8016e-01
   2.4103e-01  -2.8944e-01  -3.5852e-01   6.1490e-01] and b_cp = [ 0.1877]
--------------------------------
Entering iteration 138
At iteration 138 AC computation FAILED with AC [-1.3562 -4.095   0.351  -0.4344  0.9399 -2.4359 -1.8703 -0.1926 -0.0502] where
        a_cp = [ 0.3266 -0.0677 -0.209   0.1757  0.484  -0.2047  0.4162  0.1298 -0.5899] and b_cp = [-0.1362]
--------------------------------
Entering iteration 139
******** ACCPM SUCCEEDED ********
    Solution point: [-1.3574 -4.0965  0.3513 -0.434   0.9398 -2.4328 -1.8714 -0.1906 -0.0496]
    Objective value: 175.645828149
    Iterations: 140

In [11]:
A = []
b = []
for i in range(X.shape[1]):
    a_upper = [0]*X.shape[1]
    a_lower = [0]*X.shape[1]
    a_upper[i] = 1
    a_lower[i] = -1
    A.append(a_upper)
    A.append(a_lower)
    b.append(10)
    b.append(10)

A = np.array(A, dtype = accpm.myfloat)
b = np.array(b, dtype = accpm.myfloat)

theta_all = accpm.accpm(A, b, cost, grad, args = (X_training, Y_training),
                          alpha=0.01, beta=0.7, start=1, maxiter = 300, 
                          summary=1, testing=3)[2]


-------- Starting ACCPM --------
Initially: b = [ 10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.  10.
  10.  10.  10.] and A =
 [[ 1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [-1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0. -1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0. -1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0. -1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0. -1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0. -1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0. -1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0. -1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  0.  1.]
 [ 0.  0.  0.  0.  0.  0.  0.  0. -1.]]
--------------------------------
Entering iteration 0
Entering iteration 1
Entering iteration 2
Entering iteration 3
Entering iteration 4
Entering iteration 5
Entering iteration 6
Entering iteration 7
Entering iteration 8
Entering iteration 9
Entering iteration 10
Entering iteration 11
Entering iteration 12
Entering iteration 13
Entering iteration 14
Entering iteration 15
Entering iteration 16
Entering iteration 17
Entering iteration 18
Entering iteration 19
Entering iteration 20
Entering iteration 21
Entering iteration 22
Entering iteration 23
Entering iteration 24
Entering iteration 25
Entering iteration 26
Entering iteration 27
Entering iteration 28
Entering iteration 29
Entering iteration 30
Entering iteration 31
Entering iteration 32
Entering iteration 33
Entering iteration 34
Entering iteration 35
Entering iteration 36
Entering iteration 37
Entering iteration 38
Entering iteration 39
Entering iteration 40
Entering iteration 41
Entering iteration 42
Entering iteration 43
Entering iteration 44
Entering iteration 45
Entering iteration 46
Entering iteration 47
Entering iteration 48
Entering iteration 49
Entering iteration 50
Entering iteration 51
Entering iteration 52
Entering iteration 53
Entering iteration 54
Entering iteration 55
Entering iteration 56
Entering iteration 57
Entering iteration 58
Entering iteration 59
Entering iteration 60
Entering iteration 61
Entering iteration 62
Entering iteration 63
Entering iteration 64
Entering iteration 65
Entering iteration 66
Entering iteration 67
Entering iteration 68
Entering iteration 69
Entering iteration 70
Entering iteration 71
Entering iteration 72
Entering iteration 73
Entering iteration 74
Entering iteration 75
Entering iteration 76
Entering iteration 77
Entering iteration 78
Entering iteration 79
Entering iteration 80
Entering iteration 81
Entering iteration 82
Entering iteration 83
Entering iteration 84
Entering iteration 85
Entering iteration 86
Entering iteration 87
Entering iteration 88
Entering iteration 89
Entering iteration 90
Entering iteration 91
Entering iteration 92
Entering iteration 93
Entering iteration 94
Entering iteration 95
Entering iteration 96
Entering iteration 97
Entering iteration 98
Entering iteration 99
Entering iteration 100
Entering iteration 101
Entering iteration 102
Entering iteration 103
Entering iteration 104
Entering iteration 105
Entering iteration 106
Entering iteration 107
Entering iteration 108
Entering iteration 109
Entering iteration 110
Entering iteration 111
Entering iteration 112
Entering iteration 113
Entering iteration 114
Entering iteration 115
Entering iteration 116
Entering iteration 117
Entering iteration 118
Entering iteration 119
Entering iteration 120
Entering iteration 121
Entering iteration 122
Entering iteration 123
Entering iteration 124
Entering iteration 125
Entering iteration 126
Entering iteration 127
Entering iteration 128
Entering iteration 129
Entering iteration 130
Entering iteration 131
Entering iteration 132
Entering iteration 133
Entering iteration 134
Entering iteration 135
Entering iteration 136
Entering iteration 137
Entering iteration 138
Entering iteration 139
******** ACCPM SUCCEEDED ********
    Solution point: [-1.3574 -4.0965  0.3513 -0.434   0.9398 -2.4328 -1.8714 -0.1906 -0.0496]
    Objective value: 175.645828149
    Iterations: 140

In [12]:
np.array(theta_all).shape


Out[12]:
(140, 9)

In [13]:
print(theta_all)


[array([ 0.,  0.,  0.,  0.,  0.,  0.,  0.,  0.,  0.]), array([-2.6527, -1.0517, -0.0934, -2.1917, -2.7985, -0.8977, -2.6536,
       -2.9045,  3.0371]), array([-4.1322, -0.7374,  0.0726, -2.1675, -2.0407, -0.3869, -1.0317,
       -0.5889,  0.0746]), array([-5.1155, -0.4555,  0.219 , -2.1355, -1.468 , -0.0616,  0.0909,
        0.9203, -1.8211]), array([-7.2136, -2.0243,  0.5725, -4.5855, -2.7293,  0.6718,  2.4822,
        3.8895, -4.7483]), array([-0.1337, -6.8949, -3.5352,  1.982 ,  1.7676, -4.2284, -3.8922,
       -4.6877, -2.8607]), array([ 0.6099, -2.6154, -1.0494,  0.481 , -0.1449, -1.2843, -2.1486,
       -1.9096, -0.1688]), array([-3.1047, -7.4201,  0.9824, -1.3044,  1.8606, -5.2626, -3.8582,
       -1.0578, -2.3476]), array([-0.4838, -7.1577,  1.9407, -1.1393,  1.3351, -4.699 , -4.6118,
        2.655 ,  0.396 ]), array([-3.5862, -6.8179,  1.5597,  1.3079,  3.1396, -3.2426, -3.0259,
       -0.2867,  1.5765]), array([-1.7247, -6.7868, -1.5117, -2.7301,  0.8087, -3.978 , -1.4022,
        0.1978,  0.3042]), array([-1.2885, -5.7725,  0.884 , -0.1877,  2.1135, -3.0353, -2.9621,
       -0.2157,  0.3988]), array([-2.7515, -4.2468,  0.1006, -0.7761,  0.3108, -3.1388, -1.7472,
        0.4934, -0.6999]), array([ 0.1871, -4.2105,  1.4834, -1.3003,  1.3551, -2.4591, -0.4016,
       -1.7804,  0.4156]), array([-1.5904, -3.4319, -2.1698,  0.1714,  1.6823, -2.0177, -3.8215,
        0.9102,  0.3501]), array([-1.7206, -5.4791,  1.1335,  1.7315, -1.8447, -1.2634, -1.925 ,
        0.2869, -0.6302]), array([-1.5617, -4.2028,  1.0613, -1.8104,  2.5359, -3.5087, -2.507 ,
       -0.8658, -0.4121]), array([-1.2406, -4.6024, -1.1383,  0.5496,  0.6308, -3.6755, -0.6299,
        0.1774,  1.4908]), array([-1.5599, -4.6804,  0.9848, -1.2013,  0.7217, -1.0851, -3.0464,
       -0.0918, -1.326 ]), array([-1.4908, -3.8015,  1.0781,  0.4607,  0.8431, -4.297 , -1.7503,
       -0.1485,  0.3196]), array([-1.504 , -4.7481, -0.8355, -1.1986,  1.5594, -0.6778, -1.4751,
       -0.5331,  0.2816]), array([-1.1124, -4.3032,  0.3261, -0.7875,  0.6437, -3.3492, -2.2644,
        0.064 , -0.4729]), array([-1.7357, -4.2659,  0.6445, -0.3245,  1.3129, -1.9882, -1.6251,
        0.0633,  0.4708]), array([-1.0715, -3.6277, -0.0037,  0.3588, -0.0608, -3.2278, -2.702 ,
       -1.533 , -1.5549]), array([-1.1742, -4.525 ,  0.1336, -0.9096,  1.4246, -2.3658, -1.6018,
        0.2222,  0.7262]), array([-1.9153, -3.1108,  1.0402, -0.417 ,  0.3051, -2.7415, -1.9417,
       -0.2116, -1.6415]), array([-1.297 , -4.9423,  0.2433, -0.1849,  0.9274, -2.5732, -2.2739,
       -0.3436,  0.2664]), array([-1.2983, -3.7304,  0.1793, -0.4014,  0.9484, -2.4528, -1.8862,
       -0.2979, -0.1761]), array([-1.6613, -4.8658,  1.0344, -0.6154,  0.6889, -2.6366, -1.6361,
       -0.1033, -0.2593]), array([-1.2828, -4.1307,  0.2697, -0.2219,  0.91  , -2.1103, -2.2753,
        0.1023,  0.1072]), array([-1.4236, -4.425 ,  0.2686, -0.696 ,  1.396 , -2.9304, -1.5328,
       -0.4405,  0.3507]), array([-1.2385, -4.0345,  0.2643, -0.3264,  0.5899, -2.0834, -1.7261,
       -0.2068, -0.1679]), array([-1.743 , -4.2645,  0.7786, -0.6281,  1.2147, -3.0298, -2.4751,
       -0.0179, -0.481 ]), array([-1.1656, -3.8073,  0.4992, -0.3836,  0.8773, -2.5354, -1.4849,
       -0.3339,  0.1853]), array([-1.637 , -4.7178, -0.2056, -0.2409,  1.1933, -2.308 , -2.206 ,
        0.1415,  0.2523]), array([-1.2049, -4.1731,  0.4744, -0.9247,  1.0894, -2.0228, -2.0602,
       -0.4675, -0.3872]), array([-1.5529, -3.9984,  0.269 , -0.1001,  0.6603, -2.9861, -1.7926,
        0.0409, -0.0172]), array([-1.3911, -3.0229,  0.3308,  0.0861,  0.0685, -1.7767, -1.8013,
       -0.4159, -0.6318]), array([-0.842 , -4.5279,  0.7707, -0.346 ,  1.5893, -2.711 , -1.9009,
       -0.4327,  0.5157]), array([-1.5576, -4.1852,  0.2094, -0.6945,  1.0232, -2.218 , -1.7672,
        0.0179,  0.0107]), array([-1.2505, -4.2101,  0.4103, -0.2882,  0.9134, -2.6667, -2.0677,
       -0.4083, -0.1616]), array([-1.3656, -4.098 ,  0.4347, -0.4721,  1.0356, -2.3776, -1.8052,
       -0.1283,  0.0407]), array([-1.3386, -4.0538,  0.1379, -0.4718,  0.7899, -2.4918, -1.9285,
       -0.2048, -0.1551]), array([-1.5025, -4.1153,  0.4049, -0.307 ,  0.8935, -2.3276, -1.8988,
       -0.2713, -0.1418]), array([-0.3474, -3.4123, -0.1149, -0.3554,  0.9905, -2.3057, -1.6054,
       -0.4627,  0.4386]), array([-1.1863, -2.7315,  1.3876, -0.4241, -0.4019, -3.2098, -2.0492,
       -0.7352, -2.0134]), array([-0.585 , -2.9203,  0.7865, -0.2854,  0.3305, -2.4306, -1.1839,
       -1.3079, -0.6949]), array([-1.3663, -4.4362,  0.3443, -0.4818,  1.116 , -2.5699, -1.9667,
       -0.0679,  0.1545]), array([-1.3931, -4.0222,  0.3555, -0.4607,  0.9011, -2.4528, -1.8872,
       -0.1892, -0.1536]), array([-1.2355, -4.1471,  0.2205, -0.3679,  1.0082, -2.2625, -1.7529,
       -0.2236,  0.2254]), array([-1.3619, -4.1691,  0.5393, -0.4167,  0.8901, -2.5297, -1.9094,
       -0.1977, -0.1031]), array([-1.3614, -4.1556,  0.2466, -0.4213,  1.0334, -2.4617, -1.9045,
       -0.1911,  0.0143]), array([-1.3775, -4.0677,  0.3253, -0.4696,  0.9167, -2.3274, -1.8409,
       -0.1366, -0.0286]), array([-1.2712, -4.0702,  0.4027, -0.425 ,  0.9096, -2.5323, -1.762 ,
       -0.2985, -0.0466]), array([-1.3547, -4.0662,  0.3582, -0.3435,  0.9527, -2.4365, -2.0589,
       -0.1748, -0.1058]), array([-1.4334, -4.1903,  0.3585, -0.4767,  0.9532, -2.4366, -1.8364,
       -0.1664, -0.0422]), array([-1.217 , -3.9074,  0.4142, -0.6301,  1.2353, -2.53  , -1.7657,
       -0.3477,  0.0918]), array([-1.3334, -4.0965,  0.2915, -0.3431,  0.8158, -2.38  , -1.8814,
       -0.1196, -0.0624]), array([-1.3428, -4.0822,  0.3653, -0.4527,  0.9717, -2.462 , -1.8887,
       -0.2301, -0.0569]), array([-1.3792, -4.0849,  0.3528, -0.3925,  0.9216, -2.441 , -1.8416,
       -0.1543, -0.0224]), array([-1.2941, -4.1812,  0.3635, -0.5636,  0.9699, -2.2283, -1.9408,
       -0.2411, -0.1356]), array([-1.3575, -4.1005,  0.3098, -0.4222,  0.91  , -2.4963, -1.8772,
       -0.1756, -0.0468]), array([-1.3564, -4.0876,  0.3742, -0.438 ,  0.944 , -2.3728, -1.8676,
       -0.2179, -0.0702]), array([-1.3468, -4.1207,  0.3725, -0.4751,  0.9928, -2.4642, -1.8731,
       -0.1632, -0.014 ]), array([-1.3672, -4.0781,  0.3272, -0.3955,  0.8995, -2.434 , -1.8737,
       -0.2042, -0.0688]), array([-1.1449, -2.633 ,  0.0985, -0.3968,  0.4235, -1.3051, -1.359 ,
       -0.0638, -0.2031]), array([-1.2946, -3.6057, -0.0262, -0.2659,  0.6812, -2.155 , -1.5535,
       -0.0735,  0.08  ]), array([-1.0039, -3.1836, -0.0095, -0.2264,  0.5945, -1.6999, -1.3757,
       -0.2606,  0.169 ]), array([-1.3672, -4.1428,  0.3777, -0.4453,  0.9547, -2.457 , -1.8982,
       -0.1904, -0.0628]), array([-1.3355, -4.0627,  0.3287, -0.4488,  0.9455, -2.4134, -1.8311,
       -0.1975, -0.0241]), array([-1.3705, -4.0917,  0.358 , -0.4214,  0.9367, -2.4367, -1.8961,
       -0.1753, -0.0586]), array([-1.3436, -4.109 ,  0.3501, -0.4385,  0.9352, -2.438 , -1.8482,
       -0.2103, -0.0451]), array([-1.3697, -4.0978,  0.3356, -0.4486,  0.9535, -2.4227, -1.8763,
       -0.1836, -0.0502]), array([-1.324 , -4.0753,  0.385 , -0.4142,  0.9185, -2.4499, -1.8634,
       -0.2078, -0.0508]), array([-1.362 , -4.1096,  0.349 , -0.4234,  0.9429, -2.4388, -1.8642,
       -0.1849, -0.0306]), array([-1.3514, -4.0663,  0.3511, -0.4439,  0.9106, -2.4256, -1.895 ,
       -0.2015, -0.1106]), array([-1.3564, -4.0899,  0.3674, -0.4496,  0.9481, -2.4377, -1.8633,
       -0.2003, -0.0531]), array([-1.3281, -4.1083,  0.317 , -0.4196,  0.9554, -2.4069, -1.8956,
       -0.1919, -0.026 ]), array([-1.3708, -4.0866,  0.3492, -0.4275,  0.9198, -2.445 , -1.8627,
       -0.1788, -0.0611]), array([-1.3524, -4.1057,  0.3476, -0.4373,  0.9398, -2.4153, -1.8803,
       -0.1974, -0.0526]), array([-1.3639, -4.068 ,  0.3674, -0.4105,  0.9422, -2.4946, -1.8805,
       -0.2148, -0.0733]), array([-1.3722, -4.0914,  0.3621, -0.4492,  0.9038, -2.397 , -1.8547,
       -0.175 , -0.0723]), array([-1.3472, -4.1008,  0.3491, -0.4378,  0.9607, -2.4459, -1.8678,
       -0.1857, -0.0269]), array([-1.3642, -4.0934,  0.3518, -0.4308,  0.9315, -2.4405, -1.8725,
       -0.196 , -0.0607]), array([-1.3525, -4.0919,  0.3525, -0.4319,  0.9435, -2.4092, -1.8649,
       -0.1896, -0.0427]), array([-1.3508, -4.1002,  0.3415, -0.4368,  0.9399, -2.4473, -1.8747,
       -0.1867, -0.0428]), array([-1.358 , -4.1025,  0.3565, -0.4354,  0.9456, -2.4372, -1.875 ,
       -0.1932, -0.0513]), array([-1.373 , -4.0728,  0.3491, -0.4161,  0.8996, -2.4279, -1.87  ,
       -0.1832, -0.0771]), array([-1.349 , -4.0858,  0.3396, -0.4336,  0.9436, -2.4282, -1.8586,
       -0.1966, -0.0363]), array([-1.3566, -4.1155,  0.3648, -0.4465,  0.9514, -2.4334, -1.8795,
       -0.1876, -0.0479]), array([-1.356 , -4.0927,  0.343 , -0.4212,  0.934 , -2.441 , -1.8781,
       -0.1935, -0.0543]), array([-1.3589, -4.094 ,  0.3523, -0.4369,  0.9404, -2.4309, -1.8643,
       -0.1884, -0.0461]), array([-1.351 , -4.0975,  0.3468, -0.4327,  0.9348, -2.4323, -1.8773,
       -0.1996, -0.0577]), array([-1.3609, -4.0947,  0.3538, -0.4226,  0.9447, -2.4483, -1.8772,
       -0.185 , -0.0423]), array([-1.3557, -4.1021,  0.3505, -0.4403,  0.9437, -2.4285, -1.861 ,
       -0.1945, -0.045 ]), array([-1.3565, -4.0919,  0.3506, -0.4373,  0.9389, -2.4282, -1.8752,
       -0.1901, -0.0541]), array([-1.3572, -4.1034,  0.352 , -0.4319,  0.9387, -2.4412, -1.8605,
       -0.1921, -0.0419]), array([-1.3561, -4.0919,  0.3533, -0.4315,  0.9371, -2.4349, -1.8723,
       -0.1927, -0.0527]), array([-1.3627, -4.1052,  0.3378, -0.4396,  0.9464, -2.4205, -1.8749,
       -0.1825, -0.0448]), array([-1.3559, -4.0946,  0.3536, -0.4387,  0.9429, -2.4406, -1.8703,
       -0.1955, -0.0522]), array([-1.3545, -4.0988,  0.3495, -0.4263,  0.9323, -2.4196, -1.8689,
       -0.1867, -0.045 ]), array([-1.3595, -4.0987,  0.3481, -0.4329,  0.9391, -2.436 , -1.8719,
       -0.1882, -0.0477]), array([-1.3567, -4.0914,  0.3532, -0.4329,  0.9404, -2.4289, -1.8704,
       -0.1946, -0.0531]), array([-1.3558, -4.0957,  0.3505, -0.4341,  0.9385, -2.4345, -1.8708,
       -0.1901, -0.0496]), array([-1.3846, -4.0773,  0.354 , -0.4105,  0.9019, -2.4573, -1.8675,
       -0.1946, -0.0855]), array([-1.3556, -4.1009,  0.3518, -0.4349,  0.9477, -2.4269, -1.8724,
       -0.1959, -0.0437]), array([-1.356 , -4.095 ,  0.3504, -0.4348,  0.9419, -2.4307, -1.8705,
       -0.1927, -0.0487]), array([-1.3593, -4.0979,  0.3537, -0.4353,  0.9367, -2.4372, -1.8712,
       -0.1894, -0.0528]), array([-1.3534, -4.0928,  0.3476, -0.4305,  0.9385, -2.4364, -1.8685,
       -0.1926, -0.0462]), array([-1.3622, -4.1019,  0.3544, -0.4355,  0.9426, -2.4321, -1.8767,
       -0.1891, -0.0529]), array([-1.3556, -4.0936,  0.3526, -0.4398,  0.9384, -2.4267, -1.8675,
       -0.193 , -0.0524]), array([-1.3585, -4.0969,  0.3503, -0.4315,  0.9394, -2.4374, -1.8724,
       -0.1904, -0.0495]), array([-1.3525, -4.0966,  0.3542, -0.4363,  0.9423, -2.431 , -1.8695,
       -0.1934, -0.0473]), array([-1.3601, -4.0931,  0.3449, -0.4357,  0.9373, -2.4298, -1.8701,
       -0.189 , -0.0521]), array([-1.3565, -4.0954,  0.3545, -0.4317,  0.9371, -2.4359, -1.8695,
       -0.194 , -0.0514]), array([-1.3564, -4.0973,  0.3496, -0.435 ,  0.9417, -2.4338, -1.8726,
       -0.1899, -0.048 ]), array([-1.357 , -4.0944,  0.3522, -0.4337,  0.9394, -2.4334, -1.8691,
       -0.1917, -0.0504]), array([-1.3571, -4.0962,  0.3502, -0.4336,  0.9387, -2.4331, -1.8702,
       -0.1918, -0.0494]), array([-1.3565, -4.0942,  0.3524, -0.434 ,  0.9397, -2.4342, -1.871 ,
       -0.1915, -0.0513]), array([-1.3571, -4.0963,  0.3506, -0.4339,  0.9392, -2.4335, -1.8706,
       -0.1915, -0.0494]), array([-1.3563, -4.0948,  0.352 , -0.4341,  0.9401, -2.434 , -1.8711,
       -0.1915, -0.0506]), array([-1.3571, -4.0962,  0.3507, -0.4339,  0.9393, -2.4335, -1.8706,
       -0.1914, -0.0495]), array([-1.3561, -4.095 ,  0.3518, -0.4341,  0.9402, -2.4339, -1.8711,
       -0.1916, -0.0503]), array([-1.3571, -4.0961,  0.3507, -0.4339,  0.9393, -2.4336, -1.8707,
       -0.1913, -0.0496]), array([-1.356 , -4.0954,  0.3516, -0.4341,  0.9404, -2.4338, -1.871 ,
       -0.1918, -0.0499]), array([-1.3572, -4.0959,  0.3508, -0.4339,  0.9392, -2.4337, -1.8707,
       -0.1912, -0.0498]), array([-1.3557, -4.0964,  0.3511, -0.4343,  0.9408, -2.4336, -1.8709,
       -0.1922, -0.0492]), array([-1.3574, -4.095 ,  0.3511, -0.4336,  0.9386, -2.4339, -1.8708,
       -0.191 , -0.0504]), array([-1.3552, -4.1008,  0.3497, -0.4354,  0.9431, -2.4327, -1.8704,
       -0.1932, -0.0463]), array([-1.357 , -4.0916,  0.3519, -0.4326,  0.9371, -2.4344, -1.8709,
       -0.1909, -0.0524]), array([-1.358 , -4.0942,  0.3524, -0.4349,  0.9388, -2.4332, -1.8711,
       -0.1909, -0.0516]), array([-1.3565, -4.0975,  0.3501, -0.4337,  0.9399, -2.4339, -1.8707,
       -0.1911, -0.0485]), array([-1.3574, -4.0903,  0.3524, -0.4332,  0.9377, -2.4327, -1.8714,
       -0.1934, -0.0541]), array([-1.357 , -4.098 ,  0.3512, -0.435 ,  0.9411, -2.4348, -1.8695,
       -0.1901, -0.047 ]), array([-1.3556, -4.0948,  0.3493, -0.4323,  0.9365, -2.4308, -1.8751,
       -0.1933, -0.0546]), array([-1.3577, -4.0953,  0.3511, -0.4332,  0.9405, -2.4345, -1.8689,
       -0.1913, -0.048 ]), array([-1.356 , -4.0956,  0.3522, -0.4365,  0.9385, -2.4342, -1.873 ,
       -0.1916, -0.0534]), array([-1.3571, -4.0967,  0.3499, -0.4323,  0.9391, -2.4317, -1.8705,
       -0.1908, -0.048 ]), array([-1.3562, -4.095 ,  0.351 , -0.4344,  0.9399, -2.4359, -1.8703,
       -0.1926, -0.0502]), array([-1.3574, -4.0965,  0.3513, -0.434 ,  0.9398, -2.4328, -1.8714,
       -0.1906, -0.0496])]

The algorithm converged in 140 iterations and we observe that


In [14]:
difference = np.abs(theta_all[1]-theta_best2)
print("The absolute element wise difference between the parameters attained via SciPy's", 
      "fmin_bfgs function and the ACCPM are\n", difference)
print("The norm value of this difference is", np.linalg.norm(difference))


The absolute element wise difference between the parameters attained via SciPy's fmin_bfgs function and the ACCPM are
 [ 1.2953  3.0448  0.4447  1.7577  3.7383  1.5351  0.7822  2.7139  3.0867]
The norm value of this difference is 6.93339259879

and so the results of the two functions are comparable.

Indeed, having gathered the parameter collected at each iteration we can see how the accuracy improved over time


In [15]:
import matplotlib.pyplot as plt
%matplotlib inline

In [16]:
theta_all = np.array(theta_all)
queries = np.arange(1, theta_all.shape[0] + 1)
accuracies = []

for i in range(theta_all.shape[0]):
    predictions = predict(theta_all[i], X_testing).round()
    results = predictions == Y_testing
    correct = np.count_nonzero(results)
    accuracy = correct/X_testing.shape[0]
    accuracies.append(accuracy)

accuracies = np.array(accuracies)

In [17]:
accuracies[-1]


Out[17]:
0.765625

In [18]:
accuracies.shape


Out[18]:
(140,)

In [19]:
plt.figure(figsize=(12,7))

plt.plot(queries, accuracies, 'mx-', label='LR', 
         markevery=5,
         lw=1.5, ms=10, markerfacecolor='none', markeredgewidth=1.5,
         markeredgecolor = 'm')

plt.xlabel('Number of iterations')
plt.ylabel('Accuracy on testing data sat')
plt.title('Accuracy of logistic regression as a single run of ACCPM converges (diabetes data set)')
plt.legend(loc='best')

plt.savefig('accpm_experiment.png', dpi=600, bbox_inches='tight', transparent=True)
plt.show()


Below we run some more tests and observe that the algorithm converges for smaller initial polyhedrons but fails entirely for larger polyhedrons.


In [22]:
A = []
b = []
for i in range(X.shape[1]):
    a_upper = [0]*X.shape[1]
    a_lower = [0]*X.shape[1]
    a_upper[i] = 1
    a_lower[i] = -1
    A.append(a_upper)
    A.append(a_lower)
    b.append(5)
    b.append(5)

A = np.array(A, dtype = accpm.myfloat)
b = np.array(b, dtype = accpm.myfloat)

theta_best3 = accpm.accpm(A, b, cost, grad, args = (X, Y),
                          alpha=0.01, beta=0.7, start=1, maxiter = 300, 
                          summary=1, testing=1)[1]


-------- Starting ACCPM --------
Initially: b = [ 5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.  5.] and A =
 [[ 1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [-1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0. -1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0. -1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0. -1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0. -1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0. -1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0. -1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0. -1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  0.  1.]
 [ 0.  0.  0.  0.  0.  0.  0.  0. -1.]]
--------------------------------
Entering iteration 0
At iteration 0 AC computation SUCCEEDED with AC [ 0.  0.  0.  0.  0.  0.  0.  0.  0.] where
        a_cp = [ 0.386   0.1206 -0.0317  0.3093  0.4321  0.1232  0.3831  0.4149 -0.4679] and b_cp = [ 0.]
--------------------------------
Entering iteration 1
At iteration 1 AC computation SUCCEEDED with AC [-1.3207 -0.4402  0.1165 -1.0842 -1.4547 -0.4495 -1.3119 -1.4051  1.5543] where
        a_cp = [-0.2553  0.2471  0.0942 -0.3282 -0.4539  0.0282 -0.3544 -0.277   0.5899] and b_cp = [ 1.1327]
--------------------------------
Entering iteration 2
At iteration 2 AC computation FAILED with AC [-2.87   -0.3999  0.1564 -1.2197 -0.9338 -0.1083 -0.0384  0.3725 -0.9832] where
        a_cp = [-0.3664  0.3088  0.075  -0.3418 -0.4343  0.0597 -0.2964 -0.2684  0.544 ] and b_cp = [ 1.0436]
--------------------------------
Entering iteration 3
At iteration 3 AC computation SUCCEEDED with AC [-0.8578 -3.0475 -0.6394  0.3441  0.1937 -1.7709 -0.648  -1.5314 -1.1906] where
        a_cp = [ 0.2707 -0.117  -0.1406  0.3555  0.4675  0.0409  0.3974  0.2535 -0.5697] and b_cp = [ 0.387]
--------------------------------
Entering iteration 4
At iteration 4 AC computation SUCCEEDED with AC [-0.2881 -3.072   0.3326 -0.2243 -0.3858 -1.9616 -1.3518 -0.9223 -0.5038] where
        a_cp = [-0.0194  0.1534 -0.024  -0.4023 -0.5718  0.0646 -0.4007 -0.29    0.4876] and b_cp = [ 0.2738]
--------------------------------
Entering iteration 5
At iteration 5 AC computation SUCCEEDED with AC [-2.2188 -3.1075  1.4957  0.5939  1.024  -2.4165 -0.9166 -0.5948 -0.1185] where
        a_cp = [-0.0443 -0.021   0.0356  0.5013  0.5633  0.1283  0.3931  0.1043 -0.4959] and b_cp = [ 0.101]
--------------------------------
Entering iteration 6
At iteration 6 AC computation SUCCEEDED with AC [-1.1695 -3.4501  0.8109 -1.0604  0.3736 -3.1423 -1.1026  1.1919  0.0279] where
        a_cp = [ 0.4434 -0.0503 -0.0375  0.0604  0.2853 -0.0446  0.2942  0.6367 -0.4696] and b_cp = [-0.1021]
--------------------------------
Entering iteration 7
At iteration 7 AC computation SUCCEEDED with AC [-1.6591 -3.642   0.2041  0.021   0.8185 -3.2535 -1.1545 -1.0819  0.3581] where
        a_cp = [-0.453   0.1402 -0.0326 -0.2583 -0.347   0.0081 -0.3184 -0.4766  0.5083] and b_cp = [ 0.8508]
--------------------------------
Entering iteration 8
At iteration 8 AC computation SUCCEEDED with AC [-0.1468 -3.7252  1.6767  0.8536  0.1772 -3.195  -1.359  -0.7936  0.3737] where
        a_cp = [ 0.5974 -0.1278  0.2663  0.4828  0.2729  0.0784  0.1932  0.2891 -0.3483] and b_cp = [ 0.3426]
--------------------------------
Entering iteration 9
At iteration 9 AC computation SUCCEEDED with AC [-1.4698 -3.721   0.2201 -0.6827  0.313  -3.2467 -0.8391 -0.482  -0.411 ] where
        a_cp = [ 0.0911 -0.2453 -0.3993  0.0499  0.3356 -0.0928  0.4623  0.1997 -0.6283] and b_cp = [ 0.8376]
--------------------------------
Entering iteration 10
At iteration 10 AC computation SUCCEEDED with AC [-1.5259 -3.5488  1.5073 -0.0117  0.9431 -3.1157 -1.7348  0.4026  0.6394] where
        a_cp = [-0.2787  0.2312  0.2207 -0.3073 -0.4074  0.0108 -0.4421 -0.1361  0.5879] and b_cp = [ 0.5009]
--------------------------------
Entering iteration 11
At iteration 11 AC computation SUCCEEDED with AC [-0.5919 -3.642   0.505   0.1533  0.8263 -3.1842 -1.0332 -0.8823  0.5804] where
        a_cp = [ 0.3642 -0.1847 -0.216   0.4053  0.5105 -0.006   0.3574  0.0295 -0.4828] and b_cp = [ 0.1754]
--------------------------------
Entering iteration 12
At iteration 12 AC computation SUCCEEDED with AC [-1.6736 -3.7262  1.5752  0.0579 -0.7858 -3.0345 -0.3784 -0.2053 -0.4499] where
        a_cp = [-0.4188 -0.0173  0.3446 -0.2781 -0.693   0.0398 -0.0163 -0.0991  0.3692] and b_cp = [ 1.1651]
--------------------------------
Entering iteration 13
At iteration 13 AC computation SUCCEEDED with AC [-1.2956 -3.5119  0.5965 -0.3065  1.0954 -3.0364 -2.3641 -0.1288 -0.2656] where
        a_cp = [ 0.0576  0.187  -0.2296 -0.1262  0.4504 -0.055  -0.6521  0.4415 -0.2587] and b_cp = [ 1.0118]
--------------------------------
Entering iteration 14
At iteration 14 AC computation SUCCEEDED with AC [-0.8081 -3.4747  0.9341 -0.4227  0.9098 -3.1218 -0.2328 -0.4812  1.0513] where
        a_cp = [-0.1341  0.28    0.1634 -0.4832 -0.3715 -0.0421 -0.0542 -0.2235  0.6714] and b_cp = [ 0.0431]
--------------------------------
Entering iteration 15
At iteration 15 AC computation SUCCEEDED with AC [-1.3407 -3.6928  0.3041  1.0865 -0.3698 -3.079  -1.5321 -0.1281 -0.0155] where
        a_cp = [-0.0807 -0.3359 -0.3291  0.7824 -0.0565  0.0891  0.0352  0.1989 -0.329 ] and b_cp = [ 1.4347]
--------------------------------
Entering iteration 16
At iteration 16 AC computation SUCCEEDED with AC [-0.9315 -3.6598  1.9115 -0.9083  0.7166 -3.0864 -1.4799 -1.3319 -0.9758] where
        a_cp = [ 0.125  -0.1668  0.5103 -0.1469  0.3592  0.0378  0.0955 -0.4562 -0.5717] and b_cp = [ 2.1516]
--------------------------------
Entering iteration 17
At iteration 17 AC computation SUCCEEDED with AC [-1.1117 -3.5802  0.586   0.0081  0.601  -3.0518 -1.023  -0.1581  0.5213] where
        a_cp = [ 0.2368 -0.0534 -0.3785  0.0336  0.1954 -0.1169  0.2422  0.8201 -0.1165] and b_cp = [-0.2576]
--------------------------------
Entering iteration 18
At iteration 18 AC computation SUCCEEDED with AC [-0.9696 -3.3118  1.0361  0.1298  0.3073 -3.0651 -1.2646 -0.8732 -0.1685] where
        a_cp = [-0.3343  0.164   0.163  -0.1467 -0.3697  0.0435 -0.3653 -0.572   0.4626] and b_cp = [ 0.4971]
--------------------------------
Entering iteration 19
At iteration 19 AC computation SUCCEEDED with AC [-1.0059 -3.665   1.0778 -0.3368  0.4867 -2.7544 -1.065  -0.4448 -0.1014] where
        a_cp = [ 0.3472 -0.1847 -0.0077  0.2525  0.408   0.0268  0.3828  0.3599 -0.5816] and b_cp = [-0.2029]
--------------------------------
Entering iteration 20
At iteration 20 AC computation SUCCEEDED with AC [-1.094  -3.6704  0.7015 -0.1912  0.6166 -3.2934 -1.1786 -0.5012  0.2405] where
        a_cp = [-0.3119  0.0694 -0.05   -0.419  -0.4321 -0.0903 -0.3726 -0.3485  0.5144] and b_cp = [ 0.8798]
--------------------------------
Entering iteration 21
At iteration 21 AC computation SUCCEEDED with AC [-1.1165 -3.0015  0.884   0.327   0.5724 -2.879  -1.006  -0.3436  0.3545] where
        a_cp = [ 0.0764  0.2597  0.1409  0.5635  0.5457  0.1408  0.3147  0.2623 -0.3222] and b_cp = [-1.3139]
--------------------------------
Entering iteration 22
At iteration 22 AC computation FAILED with AC [-0.3159 -3.3563  0.5602  0.1786 -0.3636 -2.8787 -1.0214 -0.7153 -0.1124] where
        a_cp = [ 0.8553 -0.156  -0.1493 -0.0477 -0.3438 -0.0228  0.0894  0.2475 -0.178 ] and b_cp = [-0.309]
--------------------------------
Entering iteration 23
At iteration 23 AC computation FAILED with AC [-0.8287 -4.143   0.378  -1.0741  1.2502 -0.0244 -0.9389 -0.6717  0.6055] where
        a_cp = [-0.175  -0.0588 -0.1426 -0.1808  0.062   0.7882 -0.0334 -0.4868  0.223 ] and b_cp = [-0.2584]
--------------------------------
Entering iteration 24
At iteration 24 AC computation SUCCEEDED with AC [-1.4015 -3.9163  1.1944  0.1932  0.654  -3.7112 -1.2132 -0.3098  0.2832] where
        a_cp = [-0.2129 -0.3486  0.2472  0.5186  0.449  -0.1641  0.2605  0.192  -0.412 ] and b_cp = [ 2.2591]
--------------------------------
Entering iteration 25
At iteration 25 AC computation FAILED with AC [-1.154  -3.1396  0.6896 -0.1969  0.342  -2.9406 -1.1    -0.4487 -0.1668] where
        a_cp = [-0.3182  0.5721 -0.427  -0.5342 -0.0741 -0.07    0.0997  0.1031 -0.2699] and b_cp = [-1.5997]
--------------------------------
Entering iteration 26
At iteration 26 AC computation SUCCEEDED with AC [ -7.9733e-01  -3.8875e+00   9.1745e-01   1.3113e-05   8.1021e-01
  -2.7506e+00  -1.2430e+00  -4.1004e-01   6.5667e-01] where
        a_cp = [ 0.143  -0.0389  0.3121 -0.1503 -0.3341  0.1444 -0.5142 -0.156   0.6609] and b_cp = [ 0.6821]
--------------------------------
Entering iteration 27
At iteration 27 AC computation SUCCEEDED with AC [-1.0655 -3.5626  0.7047  0.0957  0.3968 -3.1541 -0.8571 -0.5532  0.2801] where
        a_cp = [ 0.0299 -0.2814 -0.2743  0.4075  0.3277 -0.0412  0.5811 -0.0843 -0.474 ] and b_cp = [ 0.492]
--------------------------------
Entering iteration 28
At iteration 28 AC computation SUCCEEDED with AC [-1.0244 -3.3967  0.962  -0.0414  0.4814 -3.2232 -1.3437 -0.3601  0.0374] where
        a_cp = [ 0.1915  0.2898  0.3334 -0.3609 -0.3326 -0.1615 -0.5502  0.32    0.31  ] and b_cp = [ 0.1511]
--------------------------------
Entering iteration 29
At iteration 29 AC computation SUCCEEDED with AC [-1.201  -3.6522  0.7474 -0.1551  0.6355 -2.5696 -1.1432 -0.3939  0.2173] where
        a_cp = [-0.75   -0.0965 -0.0938 -0.0607  0.017   0.4062 -0.1532 -0.4233  0.2186] and b_cp = [ 0.549]
--------------------------------
Entering iteration 30
At iteration 30 AC computation SUCCEEDED with AC [-0.9038 -3.4191  0.8292 -0.0261  0.5632 -3.2533 -0.9999 -0.5381  0.3038] where
        a_cp = [ 0.6908  0.1145 -0.0385  0.1058  0.3822 -0.2987  0.4061  0.158  -0.2681] and b_cp = [-0.436]
--------------------------------
Entering iteration 31
At iteration 31 AC computation SUCCEEDED with AC [-1.144  -3.5507  0.7863  0.1274  0.1943 -2.9168 -1.1853 -0.3403  0.0294] where
        a_cp = [-0.2986 -0.1407  0.0661 -0.0963 -0.7859  0.0957 -0.366   0.0034  0.3416] and b_cp = [ 0.8443]
--------------------------------
Entering iteration 32
At iteration 32 AC computation SUCCEEDED with AC [-1.0802 -3.5351  0.8017 -0.1367  0.7395 -2.9951 -1.2119 -0.4765  0.2079] where
        a_cp = [ 0.0422 -0.0642 -0.1587  0.2657  0.7642  0.0191  0.1959  0.0633 -0.5211] and b_cp = [ 0.1497]
--------------------------------
Entering iteration 33
At iteration 33 AC computation SUCCEEDED with AC [-1.0647 -3.4916  0.9521 -0.1393  0.4579 -2.9084 -0.8373 -0.411   0.3064] where
        a_cp = [-0.2678  0.1809  0.2644 -0.4038 -0.5118  0.0423 -0.1501 -0.1904  0.5832] and b_cp = [-0.0462]
--------------------------------
Entering iteration 34
At iteration 34 AC computation SUCCEEDED with AC [-0.9683 -3.4638  0.6609  0.1151  0.4245 -3.0346 -1.2401 -0.4762  0.1473] where
        a_cp = [ 0.4651 -0.1695 -0.4016  0.4693  0.31   -0.0207  0.0648  0.1717 -0.4932] and b_cp = [-0.1147]
--------------------------------
Entering iteration 35
At iteration 35 AC computation SUCCEEDED with AC [-1.1061 -3.5504  0.8897 -0.0683  0.5082 -3.0964 -1.0932 -0.431   0.1599] where
        a_cp = [-0.2262 -0.3912  0.3378 -0.0508  0.2112 -0.2668  0.4295  0.3274 -0.5212] and b_cp = [ 2.1826]
--------------------------------
Entering iteration 36
At iteration 36 AC computation SUCCEEDED with AC [-0.9736 -3.389   0.7052 -0.0088  0.5264 -2.8062 -1.0801 -0.4513  0.2937] where
        a_cp = [-0.1863  0.3439 -0.0021 -0.2395 -0.3629  0.1509 -0.3702 -0.313   0.6326] and b_cp = [-0.9054]
--------------------------------
Entering iteration 37
At iteration 37 AC computation SUCCEEDED with AC [-0.9927 -3.5505  0.7986 -0.0363  0.4867 -2.9826 -1.1221 -0.4749  0.1767] where
        a_cp = [ 0.4671 -0.295  -0.1257  0.2778  0.3403  0.0103  0.3228  0.2639 -0.5587] and b_cp = [ 0.0217]
--------------------------------
Entering iteration 38
At iteration 38 AC computation SUCCEEDED with AC [-1.1506 -3.3915  0.7809  0.1222  0.4882 -3.2168 -1.1376 -0.4017  0.2181] where
        a_cp = [-0.5689  0.3329  0.0286 -0.0496 -0.2584 -0.1004 -0.3492 -0.3044  0.5204] and b_cp = [ 0.3245]
--------------------------------
Entering iteration 39
At iteration 39 AC computation SUCCEEDED with AC [-1.0489 -3.4852  0.8256 -0.1303  0.5277 -2.935  -1.1209 -0.438   0.1556] where
        a_cp = [-0.172   0.2146  0.1051 -0.6186 -0.4147  0.0367 -0.3794 -0.1083  0.4491] and b_cp = [-0.1838]
--------------------------------
Entering iteration 40
At iteration 40 AC computation SUCCEEDED with AC [-1.0509 -3.5466  0.8466  0.0646  0.528  -2.9952 -1.027  -0.4431  0.3177] where
        a_cp = [ 0.0941 -0.1682  0.1217  0.6273  0.4603  0.1255  0.4543  0.0984 -0.3329] and b_cp = [-0.1311]
--------------------------------
Entering iteration 41
At iteration 41 AC computation SUCCEEDED with AC [-1.0452 -3.479   0.7499 -0.0193  0.4504 -3.1066 -1.1068 -0.4692  0.1578] where
        a_cp = [-0.2328  0.0384 -0.3469 -0.4205 -0.5163 -0.244  -0.2626 -0.3603  0.3497] and b_cp = [ 0.8931]
--------------------------------
Entering iteration 42
At iteration 42 AC computation SUCCEEDED with AC [ -1.0476e+00  -3.4496e+00   8.6798e-01   6.9977e-04   5.0473e-01
  -2.9919e+00  -1.1970e+00  -4.0904e-01   1.3725e-01] where
        a_cp = [ 0.3684  0.0417  0.184   0.3743  0.4372  0.0615  0.1156  0.5036 -0.4761] and b_cp = [-0.7564]
--------------------------------
Entering iteration 43
At iteration 43 AC computation SUCCEEDED with AC [-1.0531 -3.5973  0.7951 -0.064   0.5792 -2.9785 -1.0873 -0.4515  0.2851] where
        a_cp = [-0.3948 -0.082  -0.0262 -0.3071 -0.325   0.0356 -0.2918 -0.4735  0.571 ] and b_cp = [ 1.1078]
--------------------------------
Entering iteration 44
At iteration 44 AC computation SUCCEEDED with AC [-1.0575 -3.378   0.809  -0.0413  0.4155 -2.9675 -1.0164 -0.4792  0.1017] where
        a_cp = [ 0.1806  0.0128 -0.0915  0.2933  0.3918  0.0459  0.5522  0.2204 -0.603 ] and b_cp = [-1.039]
--------------------------------
Entering iteration 45
At iteration 45 AC computation SUCCEEDED with AC [ -1.0136e+00  -3.5265e+00   8.3145e-01   9.3017e-04   4.9917e-01
  -3.0773e+00  -1.1247e+00  -4.1877e-01   2.4671e-01] where
        a_cp = [ 0.0677  0.0897  0.2056 -0.3145 -0.5274 -0.11   -0.4496  0.005   0.5948] and b_cp = [ 0.5112]
--------------------------------
Entering iteration 46
At iteration 46 AC computation SUCCEEDED with AC [-1.0804 -3.4989  0.8018 -0.034   0.5123 -2.9714 -1.1622 -0.4694  0.1297] where
        a_cp = [-0.3848 -0.1348 -0.2189  0.3817  0.4964  0.1658  0.0337 -0.3373 -0.5013] and b_cp = [ 0.5147]
--------------------------------
Entering iteration 47
At iteration 47 AC computation SUCCEEDED with AC [-1.0561 -3.5078  0.7559 -0.0568  0.5558 -3.0188 -1.0444 -0.3679  0.2959] where
        a_cp = [ 0.3197 -0.0777 -0.1832  0.1589  0.413  -0.0549  0.4199  0.5454 -0.4308] and b_cp = [-0.598]
--------------------------------
Entering iteration 48
At iteration 48 AC computation SUCCEEDED with AC [-0.9938 -3.4646  0.8941 -0.0264  0.4594 -3.0337 -1.0911 -0.5458  0.1391] where
        a_cp = [-0.1666  0.1524  0.28   -0.2379 -0.4469  0.014  -0.3019 -0.5319  0.4899] and b_cp = [ 0.3167]
--------------------------------
Entering iteration 49
At iteration 49 AC computation SUCCEEDED with AC [-1.0705 -3.5145  0.7938 -0.0113  0.4656 -2.9761 -1.1138 -0.4102  0.1878] where
        a_cp = [-0.3426 -0.162  -0.0618 -0.1383 -0.722   0.158  -0.3013  0.2701  0.3515] and b_cp = [ 0.373]
--------------------------------
Entering iteration 50
At iteration 50 AC computation SUCCEEDED with AC [-1.0157 -3.4827  0.8234 -0.0595  0.5888 -3.0816 -1.1117 -0.4833  0.2256] where
        a_cp = [ 0.3585  0.0852 -0.0702  0.1849  0.7429 -0.1771  0.2573  0.0454 -0.4166] and b_cp = [-0.17]
--------------------------------
Entering iteration 51
At iteration 51 AC computation SUCCEEDED with AC [-1.0424 -3.4954  0.8188 -0.0346  0.4931 -2.9986 -1.091  -0.4552  0.1907] where
        a_cp = [-0.1196  0.0391  0.3443 -0.255  -0.5633  0.1964  0.2329 -0.5295  0.3319] and b_cp = [-0.5377]
--------------------------------
Entering iteration 52
At iteration 52 AC computation SUCCEEDED with AC [-1.0601 -3.5115  0.7906 -0.0149  0.5306 -3.0431 -1.1616 -0.4228  0.2009] where
        a_cp = [-0.0508 -0.0159 -0.3732  0.1483  0.3523 -0.2601 -0.6979  0.3941 -0.041 ] and b_cp = [ 1.393]
--------------------------------
Entering iteration 53
At iteration 53 AC computation SUCCEEDED with AC [-1.0539 -3.4935  0.8039 -0.0353  0.5157 -3.0069 -1.0968 -0.4342  0.2065] where
        a_cp = [ 0.1971 -0.0369 -0.1265  0.2743  0.5145  0.0015  0.4261  0.4096 -0.5045] and b_cp = [-0.6798]
--------------------------------
Entering iteration 54
At iteration 54 AC computation SUCCEEDED with AC [-1.0317 -3.5132  0.8177 -0.0236  0.4937 -3.0212 -1.1363 -0.4644  0.1784] where
        a_cp = [-0.1264  0.0057  0.0871 -0.2871 -0.4962 -0.0333 -0.5009 -0.3897  0.4939] and b_cp = [ 0.876]
--------------------------------
Entering iteration 55
At iteration 55 AC computation FAILED with AC [-1.0421 -3.4738  0.8034 -0.0089  0.478  -3.047  -1.087  -0.4427  0.1979] where
        a_cp = [ 0.4118  0.3169 -0.1697  0.1418 -0.2406 -0.4185  0.4545  0.4825 -0.0931] and b_cp = [-1.2504]
--------------------------------
Entering iteration 56
At iteration 56 AC computation FAILED with AC [-1.0554 -3.5416  0.8385 -0.0699  0.5581 -2.9346 -1.1274 -0.439   0.2101] where
        a_cp = [-0.2618 -0.1907  0.5615 -0.0556  0.3766  0.55   -0.3146 -0.0993  0.1536] and b_cp = [ 0.4083]
--------------------------------
Entering iteration 57
At iteration 57 AC computation FAILED with AC [-1.0544 -3.4974  0.7912 -0.0514  0.5014 -2.9944 -1.1158 -0.4603  0.1646] where
        a_cp = [-0.3193 -0.1913 -0.6451 -0.224   0.1377  0.0046  0.0938 -0.4441 -0.4123] and b_cp = [ 0.5799]
--------------------------------
Entering iteration 58
At iteration 58 AC computation SUCCEEDED with AC [ -1.0649e+00  -3.5060e+00   8.3665e-01  -2.2697e-04   5.1151e-01
  -3.0293e+00  -1.1057e+00  -4.3799e-01   2.1704e-01] where
        a_cp = [-0.5208  0.1624  0.397   0.1299 -0.2098  0.0515 -0.2849 -0.3128  0.5498] and b_cp = [ 0.6132]
--------------------------------
Entering iteration 59
At iteration 59 AC computation FAILED with AC [-0.9988 -3.4884  0.8057 -0.0494  0.5018 -2.9637 -1.1253 -0.4427  0.1881] where
        a_cp = [ 0.6946 -0.0664 -0.0138  0.0958  0.2424  0.0473  0.1509  0.5027 -0.409 ] and b_cp = [-0.9818]
--------------------------------
Entering iteration 60
At iteration 60 AC computation SUCCEEDED with AC [-1.0533 -3.528   0.8149 -0.0436  0.5154 -3.0299 -1.0955 -0.4381  0.215 ] where
        a_cp = [-0.2652 -0.1953  0.0179 -0.5425 -0.4877 -0.1971 -0.1922 -0.1358  0.5146] and b_cp = [ 1.7271]
--------------------------------
Entering iteration 61
At iteration 61 AC computation FAILED with AC [-1.0266 -3.4602  0.7859  0.0051  0.4929 -2.9632 -1.1192 -0.4619  0.1922] where
        a_cp = [ 0.2125  0.2407 -0.1455  0.7017  0.4308  0.3278  0.0743 -0.1535 -0.2474] and b_cp = [-2.0051]
--------------------------------
Entering iteration 62
At iteration 62 AC computation FAILED with AC [-1.0507 -3.4888  0.8347 -0.0432  0.5081 -3.0266 -1.1127 -0.4498  0.1738] where
        a_cp = [ 0.2801  0.0324  0.2434  0.1424  0.4876 -0.099   0.2936  0.3839 -0.5999] and b_cp = [-0.2707]
--------------------------------
Entering iteration 63
At iteration 63 AC computation FAILED with AC [-1.0417 -3.5076  0.7886 -0.0222  0.5102 -2.9906 -1.0975 -0.4409  0.2261] where
        a_cp = [-0.273   0.0717 -0.1635 -0.1955 -0.4193  0.0997 -0.3039 -0.3543  0.6721] and b_cp = [ 0.0337]
--------------------------------
Entering iteration 64
At iteration 64 AC computation FAILED with AC [-1.0477 -3.5127  0.8145 -0.0232  0.4987 -3.0134 -1.1077 -0.4469  0.1911] where
        a_cp = [ 0.2813 -0.2692 -0.0647  0.3814  0.4006  0.0046  0.3757  0.2679 -0.5704] and b_cp = [ 0.1295]
--------------------------------
Entering iteration 65
At iteration 65 AC computation FAILED with AC [-1.0557 -3.4696  0.8102 -0.0476  0.5041 -2.9989 -1.1113 -0.438   0.185 ] where
        a_cp = [-0.3048  0.272   0.0865 -0.3984 -0.4217 -0.0015 -0.383  -0.2201  0.5422] and b_cp = [-0.1236]
--------------------------------
Entering iteration 66
At iteration 66 AC computation FAILED with AC [-1.0396 -3.5059  0.8124 -0.0358  0.5142 -3.0144 -1.0991 -0.4499  0.2068] where
        a_cp = [ 0.4538 -0.2249 -0.0738  0.2184  0.4742 -0.0601  0.4454  0.2286 -0.4595] and b_cp = [-0.0135]
--------------------------------
Entering iteration 67
At iteration 67 AC computation SUCCEEDED with AC [-1.0628 -3.4873  0.8095 -0.0183  0.4776 -3.0026 -1.12   -0.4387  0.1668] where
        a_cp = [-0.5889  0.1769  0.0584 -0.0876 -0.5686  0.0948 -0.4273 -0.133   0.2797] and b_cp = [ 0.0768]
--------------------------------
Entering iteration 68
At iteration 68 AC computation FAILED with AC [-1.0378 -3.4939  0.8119 -0.0444  0.5199 -3.0091 -1.1021 -0.451   0.2065] where
        a_cp = [-0.1153  0.2851  0.0902 -0.485  -0.3143 -0.0368 -0.3474 -0.2894  0.5979] and b_cp = [-0.1996]
--------------------------------
Entering iteration 69
At iteration 69 AC computation FAILED with AC [-1.0376 -3.5317  0.7952 -0.0271  0.5205 -2.9934 -1.0674 -0.4307  0.2532] where
        a_cp = [ 0.3356 -0.2478 -0.1223  0.3262  0.4001  0.0314  0.4774  0.3447 -0.4436] and b_cp = [-0.2445]
--------------------------------
Entering iteration 70
At iteration 70 AC computation FAILED with AC [-1.0476 -3.4969  0.8175 -0.0231  0.4959 -3.0245 -1.1181 -0.4567  0.1771] where
        a_cp = [-0.128  -0.2348  0.0785  0.4801  0.1336 -0.1867 -0.1649 -0.6205 -0.4764] and b_cp = [ 2.0182]
--------------------------------
Entering iteration 71
At iteration 71 AC computation FAILED with AC [-1.0522 -3.4957  0.8076 -0.0376  0.5052 -2.9903 -1.1053 -0.4333  0.1971] where
        a_cp = [-0.0375  0.313   0.0611 -0.3605 -0.1169  0.2787 -0.0442  0.8107  0.1281] and b_cp = [-2.1646]
--------------------------------
Entering iteration 72
At iteration 72 AC computation FAILED with AC [-1.0459 -3.4998  0.8093 -0.0294  0.5071 -3.0146 -1.1043 -0.4507  0.1993] where
        a_cp = [-0.3987  0.0743 -0.0931 -0.1606 -0.2354 -0.0701 -0.2078 -0.6704  0.4981] and b_cp = [ 0.809]
--------------------------------
Entering iteration 73
At iteration 73 AC computation FAILED with AC [-1.0244 -3.5093  0.8173 -0.039   0.4926 -3.0072 -1.1082 -0.4502  0.1886] where
        a_cp = [ 0.7358 -0.271   0.0239  0.0034  0.0427 -0.0496  0.1931  0.432  -0.3954] and b_cp = [-0.1052]
--------------------------------
Entering iteration 74
At iteration 74 AC computation FAILED with AC [-1.056  -3.4975  0.8134 -0.025   0.5067 -3.0139 -1.1041 -0.4408  0.1983] where
        a_cp = [-0.1297 -0.024   0.0323  0.5015  0.544   0.0251  0.4059  0.2627 -0.4469] and b_cp = [-0.2196]
--------------------------------
Entering iteration 75
At iteration 75 AC computation SUCCEEDED with AC [-1.0448 -3.4956  0.8074 -0.0293  0.4974 -3.003  -1.1166 -0.4446  0.1865] where
        a_cp = [ 0.0504  0.1425 -0.0276 -0.3413 -0.563   0.0561 -0.6256 -0.0133  0.385 ] and b_cp = [-0.2375]
--------------------------------
Entering iteration 76
At iteration 76 AC computation FAILED with AC [-1.0493 -3.5023  0.8143 -0.0348  0.5088 -3.0127 -1.1009 -0.4469  0.1992] where
        a_cp = [-0.6202 -0.1206  0.1945 -0.304   0.13   -0.1362  0.4454 -0.4393  0.209 ] and b_cp = [ 1.4664]
--------------------------------
Entering iteration 77
At iteration 77 AC computation FAILED with AC [-1.0416 -3.49    0.8074 -0.0248  0.5002 -3.0057 -1.1084 -0.4487  0.1923] where
        a_cp = [ 0.4331  0.0325 -0.1039  0.4504  0.4352  0.0731  0.2883  0.2526 -0.5061] and b_cp = [-1.1928]
--------------------------------
Entering iteration 78
At iteration 78 AC computation SUCCEEDED with AC [-1.0508 -3.5051  0.8136 -0.0301  0.5001 -3.0116 -1.1091 -0.4416  0.1937] where
        a_cp = [-0.2726 -0.0692  0.1541 -0.3623 -0.6046 -0.0501 -0.3936 -0.0625  0.489 ] and b_cp = [ 1.0718]
--------------------------------
Entering iteration 79
At iteration 79 AC computation FAILED with AC [-1.0393 -3.4902  0.8046 -0.0343  0.5088 -3.0071 -1.1071 -0.4527  0.195 ] where
        a_cp = [ 0.5087  0.2882 -0.4426  0.0341  0.545  -0.0155  0.1716 -0.135  -0.3407] and b_cp = [-1.7676]
--------------------------------
Entering iteration 80
At iteration 80 AC computation FAILED with AC [-1.0492 -3.5029  0.8127 -0.0268  0.502  -3.005  -1.1082 -0.4437  0.1956] where
        a_cp = [-0.1113 -0.4276  0.3244  0.6903  0.07    0.345   0.083   0.2243 -0.2046] and b_cp = [ 0.6268]
--------------------------------
Entering iteration 81
At iteration 81 AC computation FAILED with AC [-1.0507 -3.4929  0.8111 -0.0359  0.5036 -3.0246 -1.1086 -0.4433  0.1888] where
        a_cp = [-0.1621  0.3127 -0.0988 -0.6717 -0.3154 -0.4035 -0.268   0.1861  0.2153] and b_cp = [ 0.3344]
--------------------------------
Entering iteration 82
At iteration 82 AC computation FAILED with AC [-1.0431 -3.4999  0.8101 -0.0295  0.503  -3.0065 -1.1035 -0.4494  0.1982] where
        a_cp = [ 0.0482 -0.065   0.0144 -0.0943 -0.4729  0.1442 -0.0966 -0.6507  0.5543] and b_cp = [ 0.0289]
--------------------------------
Entering iteration 83
At iteration 83 AC computation FAILED with AC [-1.0496 -3.5002  0.8118 -0.0306  0.5108 -3.0144 -1.1114 -0.4423  0.1968] where
        a_cp = [ 0.2307 -0.0903 -0.0474  0.3283  0.5667 -0.0481  0.2518  0.4113 -0.5221] and b_cp = [-0.1056]
--------------------------------
Entering iteration 84
At iteration 84 AC computation FAILED with AC [-1.0506 -3.4956  0.8109 -0.0332  0.5017 -3.005  -1.1074 -0.4464  0.189 ] where
        a_cp = [-0.5948  0.2375  0.0089 -0.3582 -0.3651  0.0997 -0.267  -0.3683  0.3336] and b_cp = [-0.1462]
--------------------------------
Entering iteration 85
At iteration 85 AC computation FAILED with AC [-1.0389 -3.5045  0.8163 -0.0283  0.5061 -3.0232 -1.1049 -0.4455  0.2033] where
        a_cp = [ 0.6667 -0.208   0.1109  0.1831  0.2271 -0.162   0.2468  0.4688 -0.3286] and b_cp = [ 0.1747]
--------------------------------
Entering iteration 86
At iteration 86 AC computation FAILED with AC [-1.0497 -3.4991  0.8055 -0.0277  0.5043 -3.0097 -1.1079 -0.4438  0.1972] where
        a_cp = [-0.6552  0.0261 -0.605   0.1061 -0.0772 -0.0158 -0.2165 -0.2516  0.2764] and b_cp = [ 0.5207]
--------------------------------
Entering iteration 87
At iteration 87 AC computation FAILED with AC [-1.0435 -3.4939  0.8246 -0.0365  0.5059 -3.005  -1.1087 -0.451   0.188 ] where
        a_cp = [ 0.1785  0.3576  0.8218 -0.1897 -0.0512  0.1635 -0.2403 -0.0885  0.1843] and b_cp = [-0.9336]
--------------------------------
Entering iteration 88
At iteration 88 AC computation FAILED with AC [-1.0457 -3.505   0.8061 -0.035   0.4971 -3.0085 -1.0991 -0.4458  0.1924] where
        a_cp = [ 0.3429 -0.299  -0.212   0.169   0.2694 -0.0393  0.4611  0.3215 -0.574 ] and b_cp = [ 0.0016]
--------------------------------
Entering iteration 89
At iteration 89 AC computation FAILED with AC [-1.047  -3.4986  0.8117 -0.03    0.5058 -3.01   -1.1083 -0.4453  0.1971] where
        a_cp = [-0.2646  0.2091  0.1501 -0.285  -0.3919 -0.0009 -0.4468 -0.2498  0.6057] and b_cp = [ 0.2062]
--------------------------------
Entering iteration 90
At iteration 90 AC computation FAILED with AC [-1.0463 -3.5007  0.8083 -0.0304  0.4994 -3.0112 -1.1005 -0.4465  0.1948] where
        a_cp = [ 0.3073 -0.2481 -0.1829  0.2619  0.3197 -0.0376  0.4891  0.2845 -0.5641] and b_cp = [-0.1124]
--------------------------------
Entering iteration 91
At iteration 91 AC computation FAILED with AC [-1.0477 -3.4986  0.812  -0.0311  0.5059 -3.0085 -1.1094 -0.4465  0.1939] where
        a_cp = [-0.4586  0.2483  0.2287 -0.0988 -0.0165  0.124  -0.5743 -0.4148  0.3853] and b_cp = [ 0.3163]
--------------------------------
Entering iteration 92
At iteration 92 AC computation FAILED with AC [-1.0426 -3.4992  0.8061 -0.0304  0.4927 -3.0122 -1.0918 -0.4461  0.1983] where
        a_cp = [ 0.4694 -0.2738 -0.2662 -0.0482 -0.1681 -0.1296  0.6131  0.3278 -0.3213] and b_cp = [-0.323]
--------------------------------
Entering iteration 93
At iteration 93 AC computation FAILED with AC [-1.0472 -3.4973  0.8112 -0.0279  0.5036 -3.0121 -1.107  -0.4448  0.1964] where
        a_cp = [ 0.0535  0.4971  0.3485  0.4278 -0.061  -0.1711 -0.2334  0.4549  0.3888] and b_cp = [-0.9067]
--------------------------------
Entering iteration 94
At iteration 94 AC computation FAILED with AC [-1.0462 -3.5163  0.8078 -0.0487  0.5175 -2.993  -1.1125 -0.4494  0.1941] where
        a_cp = [ 0.2097 -0.5297 -0.3216 -0.0753  0.4487  0.108   0.2076  0.0136 -0.5569] and b_cp = [ 0.9418]
--------------------------------
Entering iteration 95
At iteration 95 AC computation FAILED with AC [-1.0488 -3.4977  0.8113 -0.0332  0.5017 -3.0061 -1.1054 -0.4481  0.1901] where
        a_cp = [-0.6055 -0.0906 -0.1707 -0.2088 -0.1126  0.1736  0.3131 -0.5744 -0.2858] and b_cp = [ 0.097]
--------------------------------
Entering iteration 96
At iteration 96 AC computation FAILED with AC [-1.0441 -3.5012  0.8106 -0.031   0.5067 -3.0109 -1.1091 -0.446   0.198 ] where
        a_cp = [ 0.2549  0.0116  0.0559 -0.3849 -0.3804 -0.1059 -0.5571 -0.0695  0.559 ] and b_cp = [ 0.6354]
--------------------------------
Entering iteration 97
At iteration 97 AC computation FAILED with AC [-1.0473 -3.4969  0.8107 -0.0271  0.504  -3.0106 -1.103  -0.446   0.1982] where
        a_cp = [ 0.1516 -0.0392 -0.0345  0.5067  0.4902  0.0362  0.4841  0.2027 -0.4478] and b_cp = [-0.639]
--------------------------------
Entering iteration 98
At iteration 98 AC computation FAILED with AC [-1.0479 -3.499   0.8114 -0.0317  0.5034 -3.0094 -1.1078 -0.4449  0.1935] where
        a_cp = [-0.1691  0.0824  0.0978 -0.5664 -0.5466 -0.0772 -0.4244  0.1597  0.352 ] and b_cp = [ 0.4104]
--------------------------------
Entering iteration 99
At iteration 99 AC computation FAILED with AC [-1.0449 -3.4985  0.81   -0.0264  0.5063 -3.0106 -1.1042 -0.4492  0.2002] where
        a_cp = [ 0.0184 -0.032  -0.075   0.6587  0.5078  0.0865  0.3452 -0.3912 -0.1471] and b_cp = [-0.2257]
--------------------------------
Entering iteration 100
At iteration 100 AC computation FAILED with AC [-1.0474 -3.4988  0.8112 -0.0329  0.5048 -3.0078 -1.1073 -0.4447  0.194 ] where
        a_cp = [ 0.3725 -0.0849 -0.0419  0.0338  0.3766  0.0157  0.2779  0.5823 -0.541 ] and b_cp = [-0.6572]
--------------------------------
Entering iteration 101
At iteration 101 AC computation FAILED with AC [-1.0481 -3.4989  0.8117 -0.0289  0.5013 -3.014  -1.1057 -0.4469  0.195 ] where
        a_cp = [-0.3352  0.1149  0.0758 -0.3047 -0.492  -0.0515 -0.3322 -0.3494  0.5465] and b_cp = [ 0.5574]
--------------------------------
Entering iteration 102
At iteration 102 AC computation FAILED with AC [-1.0468 -3.4987  0.8109 -0.0299  0.5032 -3.0095 -1.1079 -0.4468  0.1935] where
        a_cp = [ 0.2991 -0.2382 -0.1299  0.4517  0.3976  0.0262  0.2426  0.121  -0.633 ] and b_cp = [ 0.0772]
--------------------------------
Entering iteration 103
At iteration 103 AC computation FAILED with AC [-1.0482 -3.4983  0.8106 -0.0327  0.5072 -3.0084 -1.1019 -0.4434  0.2019] where
        a_cp = [ -3.3065e-01   2.3148e-01   1.0106e-01  -3.7998e-01  -4.0727e-01
   4.5741e-04  -2.7497e-01  -2.1145e-01   6.2952e-01] and b_cp = [-0.0541]
--------------------------------
Entering iteration 104
At iteration 104 AC computation FAILED with AC [-1.0469 -3.4991  0.8113 -0.0312  0.5048 -3.0093 -1.1068 -0.4459  0.1953] where
        a_cp = [ 0.3746 -0.1391  0.0033  0.1731  0.5153  0.0013  0.3441  0.4122 -0.5065] and b_cp = [-0.3156]
--------------------------------
Entering iteration 105
At iteration 105 AC computation FAILED with AC [-1.0482 -3.4969  0.8104 -0.0274  0.4986 -3.0126 -1.1052 -0.4465  0.1936] where
        a_cp = [-0.3486  0.1392  0.0457 -0.2722 -0.5379 -0.0402 -0.3067 -0.3363  0.5337] and b_cp = [ 0.3676]
--------------------------------
Entering iteration 106
At iteration 106 AC computation FAILED with AC [-1.0468 -3.4984  0.8104 -0.0298  0.5033 -3.0087 -1.1078 -0.4465  0.194 ] where
        a_cp = [ 0.241  -0.1472 -0.3103  0.6085  0.3102  0.1798  0.0035 -0.0597 -0.5671] and b_cp = [-0.4793]
--------------------------------
Entering iteration 107
At iteration 107 AC computation FAILED with AC [-1.0487 -3.5016  0.8139 -0.0347  0.5107 -3.0133 -1.1021 -0.4435  0.2027] where
        a_cp = [-0.3502  0.1898  0.2444 -0.4942 -0.2573 -0.1204 -0.1605 -0.0919  0.65  ] and b_cp = [ 0.4967]
--------------------------------
Entering iteration 108
At iteration 108 AC computation FAILED with AC [-1.0467 -3.4986  0.8122 -0.0315  0.5034 -3.0102 -1.1055 -0.4463  0.1946] where
        a_cp = [ 0.5067 -0.0956  0.2657 -0.1481  0.0104 -0.1461  0.5217  0.4404 -0.3925] and b_cp = [-0.3805]
--------------------------------
Entering iteration 109
At iteration 109 AC computation FAILED with AC [-1.0491 -3.501   0.8075 -0.0289  0.5063 -3.0083 -1.109  -0.444   0.198 ] where
        a_cp = [-0.56    0.0265 -0.236  -0.0791 -0.2128  0.0537 -0.449  -0.3261  0.5174] and b_cp = [ 0.7804]
--------------------------------
Entering iteration 110
At iteration 110 AC computation FAILED with AC [-1.0459 -3.4967  0.8112 -0.0301  0.5036 -3.0087 -1.1073 -0.4473  0.1938] where
        a_cp = [ 0.4856  0.4994  0.1737  0.431   0.3734  0.2012 -0.0158 -0.206  -0.2761] and b_cp = [-2.4886]
--------------------------------
Entering iteration 111
At iteration 111 AC computation FAILED with AC [-1.0503 -3.5084  0.8113 -0.032   0.5079 -3.0129 -1.1082 -0.4427  0.1987] where
        a_cp = [-0.0218 -0.7213 -0.1662  0.1074  0.2879 -0.1644  0.2019  0.3686 -0.3919] and b_cp = [ 2.5879]
--------------------------------
Entering iteration 112
At iteration 112 AC computation FAILED with AC [-1.0486 -3.4963  0.8085 -0.0309  0.5024 -3.0069 -1.1019 -0.4436  0.1978] where
        a_cp = [-0.3943  0.2733 -0.0228 -0.374  -0.4901  0.0316 -0.1477 -0.1536  0.5856] and b_cp = [-0.5449]
--------------------------------
Entering iteration 113
At iteration 113 AC computation FAILED with AC [-1.0471 -3.4998  0.8117 -0.0312  0.5043 -3.0107 -1.1078 -0.4467  0.1939] where
        a_cp = [ 0.0825 -0.658   0.0185 -0.2082  0.0715 -0.3482 -0.2776 -0.3305 -0.4515] and b_cp = [ 3.6893]
--------------------------------
Entering iteration 114
At iteration 114 AC computation FAILED with AC [-1.0473 -3.4948  0.8072 -0.0287  0.5018 -3.0021 -1.1011 -0.4422  0.1994] where
        a_cp = [ 0.1785  0.2499 -0.1289  0.3226  0.1897  0.2724  0.553   0.5838 -0.1676] and b_cp = [-2.801]
--------------------------------
Entering iteration 115
At iteration 115 AC computation FAILED with AC [-1.047  -3.4957  0.8107 -0.0298  0.5043 -3.0104 -1.1054 -0.4466  0.1963] where
        a_cp = [-0.3463  0.3376  0.0864 -0.2568 -0.3532 -0.0077 -0.3042 -0.3547  0.5912] and b_cp = [-0.2845]
--------------------------------
Entering iteration 116
At iteration 116 AC computation FAILED with AC [-1.0466 -3.4993  0.8108 -0.0304  0.5045 -3.0075 -1.1069 -0.4454  0.196 ] where
        a_cp = [ 0.4322 -0.1474  0.0101  0.3642  0.4022  0.1429  0.2828  0.4566 -0.4337] and b_cp = [-0.7678]
--------------------------------
Entering iteration 117
At iteration 117 AC computation FAILED with AC [-1.0483 -3.4967  0.8111 -0.0298  0.5028 -3.0134 -1.106  -0.4469  0.1937] where
        a_cp = [-0.5096  0.2509 -0.0151 -0.2715 -0.378  -0.1599 -0.2195 -0.4398  0.4397] and b_cp = [ 0.4681]
--------------------------------
Entering iteration 118
At iteration 118 AC computation FAILED with AC [-1.046  -3.5004  0.8109 -0.0315  0.5053 -3.0062 -1.1073 -0.4456  0.1964] where
        a_cp = [ 0.6728 -0.2961  0.1875 -0.1147 -0.036   0.4215 -0.2716  0.359   0.1725] and b_cp = [-0.6237]
--------------------------------
Entering iteration 119
At iteration 119 AC computation FAILED with AC [-1.0498 -3.4958  0.8107 -0.028   0.5019 -3.0171 -1.1058 -0.4463  0.1923] where
        a_cp = [ 0.0207 -0.0551 -0.1665  0.385   0.4576 -0.1502  0.446   0.197  -0.5924] and b_cp = [ 0.0116]
--------------------------------
Entering iteration 120
At iteration 120 AC computation FAILED with AC [-1.0487 -3.4964  0.8116 -0.0289  0.5021 -3.0152 -1.1058 -0.4468  0.1935] where
        a_cp = [-0.5398  0.2522  0.0391 -0.2118 -0.3918 -0.1974 -0.1981 -0.4201  0.4364] and b_cp = [ 0.6104]
--------------------------------
Entering iteration 121
At iteration 121 AC computation FAILED with AC [-1.0468 -3.4984  0.8105 -0.0315  0.5048 -3.0088 -1.107  -0.4463  0.1948] where
        a_cp = [ 0.3062 -0.0329 -0.2517  0.1351  0.575   0.0278  0.3154  0.2367 -0.5803] and b_cp = [-0.7751]
--------------------------------
Entering iteration 122
At iteration 122 AC computation FAILED with AC [-1.0474 -3.4997  0.8134 -0.0279  0.5004 -3.0108 -1.1061 -0.446   0.1945] where
        a_cp = [-0.2644  0.0364  0.267  -0.1807 -0.5966  0.0047 -0.3144 -0.2712  0.5445] and b_cp = [ 0.6326]
--------------------------------
Entering iteration 123
At iteration 123 AC computation FAILED with AC [-1.047  -3.499   0.8106 -0.0306  0.5048 -3.0097 -1.107  -0.4458  0.1957] where
        a_cp = [ 0.2698 -0.1091 -0.2338  0.3234  0.5792 -0.05    0.2849  0.3369 -0.4726] and b_cp = [-0.2155]
--------------------------------
Entering iteration 124
At iteration 124 AC computation FAILED with AC [-1.0475 -3.4984  0.813  -0.0304  0.5014 -3.0088 -1.1061 -0.4465  0.1931] where
        a_cp = [-0.3062  0.1166  0.2389 -0.2965 -0.5574  0.0386 -0.2984 -0.303   0.5047] and b_cp = [ 0.2826]
--------------------------------
Entering iteration 125
At iteration 125 AC computation FAILED with AC [-1.0468 -3.4987  0.8106 -0.031   0.5042 -3.0092 -1.1068 -0.4462  0.1949] where
        a_cp = [ 0.4433 -0.1437 -0.4437  0.0368  0.4071  0.0025  0.3112  0.156  -0.5456] and b_cp = [-0.6446]
--------------------------------
Entering iteration 126
At iteration 126 AC computation FAILED with AC [-1.0492 -3.4993  0.8151 -0.0277  0.5027 -3.0119 -1.1068 -0.4449  0.1948] where
        a_cp = [-0.4443  0.0536  0.7446  0.3666 -0.1795  0.0422 -0.0975  0.0111  0.2593] and b_cp = [ 0.809]
--------------------------------
Entering iteration 127
At iteration 127 AC computation FAILED with AC [-1.0461 -3.4982  0.8088 -0.0325  0.5051 -3.0088 -1.1069 -0.4465  0.1957] where
        a_cp = [-0.1823  0.1797 -0.1343 -0.488  -0.4137 -0.0451 -0.3744 -0.2928  0.5284] and b_cp = [ 0.0442]
--------------------------------
Entering iteration 128
At iteration 128 AC computation FAILED with AC [-1.0454 -3.4988  0.8099 -0.0306  0.5043 -3.01   -1.1059 -0.447   0.1961] where
        a_cp = [ 0.5389 -0.174  -0.2738  0.2277  0.3691 -0.0724  0.4069  0.1797 -0.4617] and b_cp = [-0.4006]
--------------------------------
Entering iteration 129
At iteration 129 AC computation FAILED with AC [-1.0493 -3.4986  0.8118 -0.0312  0.5042 -3.0076 -1.1082 -0.4447  0.1933] where
        a_cp = [-0.7333  0.1608  0.2939  0.1183  0.2618  0.2873 -0.1482  0.3311 -0.2312] and b_cp = [-0.3198]
--------------------------------
Entering iteration 130
At iteration 130 AC computation FAILED with AC [-1.043  -3.499   0.8103 -0.0302  0.5028 -3.0125 -1.1049 -0.4491  0.1969] where
        a_cp = [-0.0135  0.0687  0.003  -0.366  -0.5329 -0.0959 -0.305  -0.3997  0.5614] and b_cp = [ 0.4341]
--------------------------------
Entering iteration 131
At iteration 131 AC computation FAILED with AC [-1.044  -3.4992  0.8103 -0.0294  0.5037 -3.0123 -1.105  -0.4478  0.1973] where
        a_cp = [ 0.8101 -0.2462 -0.2162  0.1803  0.0409 -0.2412  0.3495 -0.0581 -0.1359] and b_cp = [ 0.1933]
--------------------------------
Entering iteration 132
At iteration 132 AC computation FAILED with AC [-1.0487 -3.499   0.8109 -0.031   0.505  -3.0083 -1.1076 -0.4448  0.1948] where
        a_cp = [-0.349  -0.002  -0.0604  0.3256  0.6011  0.161   0.1684  0.3834 -0.4538] and b_cp = [-0.313]
--------------------------------
Entering iteration 133
At iteration 133 AC computation FAILED with AC [-1.0461 -3.4975  0.812  -0.032   0.5021 -3.0091 -1.1064 -0.4473  0.1929] where
        a_cp = [-0.1615  0.1653  0.1267 -0.4364 -0.5402 -0.0173 -0.337  -0.287   0.5021] and b_cp = [ 0.0861]
--------------------------------
Entering iteration 134
At iteration 134 AC computation FAILED with AC [-1.0467 -3.4989  0.8113 -0.0301  0.5035 -3.0097 -1.1069 -0.4464  0.1947] where
        a_cp = [ 0.445  -0.2768  0.0305  0.448   0.2661  0.0083  0.3353  0.2136 -0.5429] and b_cp = [ 0.0506]
--------------------------------
Entering iteration 135
At iteration 135 AC computation FAILED with AC [-1.0474 -3.498   0.8099 -0.0327  0.5074 -3.0098 -1.1064 -0.4459  0.1973] where
        a_cp = [-0.3649  0.2706 -0.0232 -0.4171 -0.2667 -0.0401 -0.3444 -0.3159  0.5727] and b_cp = [ 0.0499]
--------------------------------
Entering iteration 136
At iteration 136 AC computation FAILED with AC [-1.0473 -3.499   0.8109 -0.0304  0.5035 -3.0091 -1.1068 -0.4456  0.1947] where
        a_cp = [ 0.2912 -0.2559 -0.0854  0.3087  0.2285  0.0402  0.3642  0.4978 -0.5593] and b_cp = [-0.2278]
--------------------------------
Entering iteration 137
At iteration 137 AC computation FAILED with AC [-1.0469 -3.4983  0.8115 -0.0316  0.5065 -3.0102 -1.107  -0.4471  0.1961] where
        a_cp = [-0.3634  0.2484  0.0944 -0.3021 -0.2323 -0.0174 -0.365  -0.4563  0.5571] and b_cp = [ 0.2492]
--------------------------------
Entering iteration 138
At iteration 138 AC computation FAILED with AC [-1.0469 -3.4987  0.8111 -0.0306  0.5037 -3.0094 -1.1069 -0.4461  0.1946] where
        a_cp = [ 0.5022 -0.1695 -0.0479  0.2582  0.25   -0.0085  0.32    0.3879 -0.5785] and b_cp = [-0.4678]
--------------------------------
Entering iteration 139
At iteration 139 AC computation FAILED with AC [-1.0478 -3.4997  0.8107 -0.0307  0.5058 -3.0098 -1.1063 -0.4458  0.1971] where
        a_cp = [-0.49    0.125   0.0256 -0.2354 -0.2805  0.0028 -0.3064 -0.4153  0.5858] and b_cp = [ 0.5928]
--------------------------------
Entering iteration 140
At iteration 140 AC computation FAILED with AC [-1.0469 -3.4984  0.8112 -0.0309  0.5041 -3.0094 -1.107  -0.4461  0.1947] where
        a_cp = [ 0.4472  0.0381  0.0324  0.174   0.4426 -0.0146  0.2548  0.4532 -0.5485] and b_cp = [-0.9044]
--------------------------------
Entering iteration 141
At iteration 141 AC computation FAILED with AC [-1.0478 -3.5003  0.8102 -0.0297  0.503  -3.009  -1.1058 -0.446   0.1959] where
        a_cp = [-0.4322 -0.0381 -0.0273 -0.2168 -0.504   0.0274 -0.249  -0.4156  0.5239] and b_cp = [ 0.7973]
--------------------------------
Entering iteration 142
At iteration 142 AC computation FAILED with AC [-1.0469 -3.4988  0.8111 -0.0306  0.5048 -3.0099 -1.107  -0.4462  0.1955] where
        a_cp = [ 0.3041 -0.0048  0.0178  0.4188  0.6935 -0.0427  0.2101  0.1995 -0.4064] and b_cp = [-0.2228]
--------------------------------
Entering iteration 143
At iteration 143 AC computation FAILED with AC [-1.0478 -3.4985  0.8103 -0.0314  0.5005 -3.0076 -1.1056 -0.4455  0.1929] where
        a_cp = [-0.256   0.0299 -0.0265 -0.4658 -0.6893  0.014  -0.2119 -0.1517  0.4155] and b_cp = [ 0.1507]
--------------------------------
Entering iteration 144
At iteration 144 AC computation FAILED with AC [-1.047  -3.499   0.8112 -0.0303  0.5042 -3.0094 -1.1069 -0.4463  0.1951] where
        a_cp = [ 0.0025 -0.2164  0.068   0.6756  0.5012  0.1384  0.2182 -0.1821 -0.3756] and b_cp = [ 0.3918]
--------------------------------
Entering iteration 145
At iteration 145 AC computation FAILED with AC [-1.047  -3.4972  0.8101 -0.0333  0.5043 -3.0098 -1.1065 -0.4447  0.1946] where
        a_cp = [ 0.0198  0.285  -0.069  -0.6871 -0.4085 -0.145  -0.2708  0.2083  0.37  ] and b_cp = [-0.5422]
--------------------------------
Entering iteration 146
At iteration 146 AC computation FAILED with AC [-1.0471 -3.4991  0.8111 -0.0302  0.5032 -3.0093 -1.1064 -0.4462  0.1947] where
        a_cp = [-0.0567 -0.5339  0.0269  0.4545 -0.2657  0.1314  0.5171 -0.1625 -0.3506] and b_cp = [ 0.8383]
--------------------------------
Entering iteration 147
At iteration 147 AC computation FAILED with AC [-1.0464 -3.4972  0.8104 -0.0322  0.5084 -3.011  -1.1091 -0.4456  0.1965] where
        a_cp = [-0.0202  0.5246 -0.0146 -0.4057  0.1412 -0.1434 -0.5667  0.0183  0.4444] and b_cp = [-0.6032]
--------------------------------
Entering iteration 148
At iteration 148 AC computation FAILED with AC [-1.0469 -3.4989  0.8112 -0.0313  0.5047 -3.009  -1.1065 -0.446   0.1953] where
        a_cp = [ 0.3467 -0.0927  0.0066  0.1467  0.5247  0.0588  0.4456  0.3551 -0.4963] and b_cp = [-0.6983]
--------------------------------
Entering iteration 149
At iteration 149 AC computation FAILED with AC [-1.0477 -3.4984  0.8101 -0.029   0.5018 -3.011  -1.1084 -0.4453  0.1936] where
        a_cp = [-0.2688  0.0917 -0.0416 -0.2799 -0.5916 -0.0879 -0.4735 -0.1668  0.4791] and b_cp = [ 0.5944]
--------------------------------
Entering iteration 150
At iteration 150 AC computation FAILED with AC [-1.0469 -3.4989  0.8114 -0.0305  0.5046 -3.0094 -1.1063 -0.4467  0.1955] where
        a_cp = [-0.1642 -0.0794  0.1564  0.51    0.5061  0.1538  0.3697 -0.4798 -0.1883] and b_cp = [ 0.122]
--------------------------------
Entering iteration 151
At iteration 151 AC computation FAILED with AC [-1.0471 -3.498   0.8098 -0.0311  0.5024 -3.0095 -1.1081 -0.4444  0.1934] where
        a_cp = [ 0.3234  0.0698 -0.1859 -0.4654 -0.4248 -0.1463 -0.2783  0.5996  0.0232] and b_cp = [-0.4469]
--------------------------------
Entering iteration 152
At iteration 152 AC computation FAILED with AC [-1.0473 -3.4994  0.8112 -0.0304  0.5047 -3.0097 -1.1067 -0.4462  0.1958] where
        a_cp = [-0.5721 -0.0221  0.1484  0.0323 -0.1343  0.0428 -0.2201 -0.5569  0.5203] and b_cp = [ 1.193]
--------------------------------
Entering iteration 153
At iteration 153 AC computation FAILED with AC [-1.0454 -3.4953  0.8111 -0.0315  0.5012 -3.0089 -1.106  -0.4475  0.1914] where
        a_cp = [ 0.4984  0.004  -0.0835  0.1505  0.2842 -0.0172  0.4028  0.3403 -0.6023] and b_cp = [-1.1272]
--------------------------------
Entering iteration 154
At iteration 154 AC computation FAILED with AC [-1.0473 -3.4994  0.8107 -0.0307  0.5044 -3.0092 -1.1074 -0.4454  0.1955] where
        a_cp = [-0.206   0.0135 -0.0233 -0.3652 -0.4349 -0.0007 -0.5556  0.0546  0.568 ] and b_cp = [ 0.6453]
--------------------------------
Entering iteration 155
At iteration 155 AC computation FAILED with AC [-1.0466 -3.4971  0.8119 -0.0305  0.5033 -3.0108 -1.1051 -0.4477  0.1939] where
        a_cp = [ 0.2377 -0.0472 -0.0199  0.3566  0.4591 -0.0264  0.5137  0.1006 -0.5729] and b_cp = [-0.5247]
--------------------------------
Entering iteration 156
At iteration 156 AC computation FAILED with AC [-1.0472 -3.4988  0.8111 -0.0308  0.5041 -3.009  -1.107  -0.4461  0.1948] where
        a_cp = [-0.3455  0.1304  0.1065 -0.3341 -0.4357  0.0667 -0.3938 -0.3412  0.5243] and b_cp = [ 0.2722]
--------------------------------
Entering iteration 157
At iteration 157 AC computation FAILED with AC [-1.0462 -3.498   0.8108 -0.0297  0.5033 -3.0114 -1.1059 -0.4465  0.1951] where
        a_cp = [ 0.3873 -0.1261 -0.1015  0.3369  0.3922 -0.0654  0.4175  0.3002 -0.5363] and b_cp = [-0.3629]
--------------------------------
Entering iteration 158
At iteration 158 AC computation FAILED with AC [-1.0474 -3.4992  0.811  -0.0308  0.5046 -3.0091 -1.1071 -0.4457  0.1954] where
        a_cp = [-0.46    0.0672  0.0709 -0.3167 -0.3012  0.0713 -0.4634 -0.2064  0.5704] and b_cp = [ 0.6637]
--------------------------------
Entering iteration 159
At iteration 159 AC computation FAILED with AC [-1.0456 -3.4962  0.8114 -0.0299  0.5015 -3.011  -1.1055 -0.4479  0.1928] where
        a_cp = [ 0.4842 -0.0136 -0.051   0.2859  0.2626 -0.0794  0.4813  0.1682 -0.5881] and b_cp = [-0.8596]
--------------------------------
Entering iteration 160
******** ACCPM SUCCEEDED ********
    Solution point: [-1.0474 -3.4997  0.8108 -0.0307  0.5049 -3.0092 -1.1071 -0.4454  0.196 ]
    Objective value: 361.722699645
    Iterations: 161

In [23]:
A = []
b = []
for i in range(X.shape[1]):
    a_upper = [0]*X.shape[1]
    a_lower = [0]*X.shape[1]
    a_lower[i] = -1
    A.append(a_upper)
    A.append(a_lower)
    b.append(20)
    b.append(20)

A = np.array(A, dtype = accpm.myfloat)
b = np.array(b, dtype = accpm.myfloat)

theta_best4 = accpm.accpm(A, b, cost, grad, args = (X, Y),
                          alpha=0.01, beta=0.7, start=1, maxiter = 300, 
                          summary=1, testing=1)[1]


-------- Starting ACCPM --------
Initially: b = [ inf  20.  inf  20.  inf  20.  inf  20.  inf  20.  inf  20.  inf  20.  inf
  20.  inf  20.] and A =
 [[ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [ -1.   0.   0.   0.   0.   0.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.  -1.   0.   0.   0.   0.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.  -1.   0.   0.   0.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.  -1.   0.   0.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.   0.  -1.   0.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.   0.   0.  -1.   0.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.   0.   0.   0.  -1.   0.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.   0.   0.   0.   0.  -1.   0.]
 [ nan  nan  nan  nan  nan  nan  nan  nan  nan]
 [  0.   0.   0.   0.   0.   0.   0.   0.  -1.]]
--------------------------------
Entering iteration 0
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-23-9d35c04357ff> in <module>()
     15 theta_best4 = accpm.accpm(A, b, cost, grad, args = (X, Y),
     16                           alpha=0.01, beta=0.7, start=1, maxiter = 300,
---> 17                           summary=1, testing=1)[1]

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in accpm(A, b, func, grad_func, constr, grad_constr, args, alpha, beta, x0, y0, start, tol, maxiter, summary, testing)
    332         ac = analytic_center(A, b, x0=x0, y0=y0,
    333                              alpha=alpha, beta=beta, start=start,
--> 334                              testing=testing)
    335         queries.append(ac)
    336         (x0, y0) = (ac, None)

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in analytic_center(A, b, x0, y0, rtol, etol, start, alpha, beta, testing, maxiter)
    142     while i < maxiter:
    143         (delta_x, delta_y, delta_v) = newton_step(x, y, v, A, b,
--> 144                                                   testing=testing)
    145         # print('at iteration', i,'delta_x is\n', delta_x)
    146         # print('    delta_x=', delta_x)

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in newton_step(x, y, v, A, b, testing)
    108     b_chol = np.dot(np.transpose(A), g) - \
    109              np.dot(np.transpose(A), np.dot(H, r_p))
--> 110     L = splinalg.cholesky(A_chol, lower=True)
    111     if np.linalg.norm(A_chol - np.dot(L, np.transpose(L))) > 10e-6:
    112         print('**** Cholesky factorization FAILED or INACCURATE ****')

/Users/davidjwu/anaconda/lib/python3.5/site-packages/scipy/linalg/decomp_cholesky.py in cholesky(a, lower, overwrite_a, check_finite)
     79     """
     80     c, lower = _cholesky(a, lower=lower, overwrite_a=overwrite_a, clean=True,
---> 81                             check_finite=check_finite)
     82     return c
     83 

/Users/davidjwu/anaconda/lib/python3.5/site-packages/scipy/linalg/decomp_cholesky.py in _cholesky(a, lower, overwrite_a, clean, check_finite)
     18 
     19     if check_finite:
---> 20         a1 = asarray_chkfinite(a)
     21     else:
     22         a1 = asarray(a)

/Users/davidjwu/anaconda/lib/python3.5/site-packages/numpy/lib/function_base.py in asarray_chkfinite(a, dtype, order)
    666     if a.dtype.char in typecodes['AllFloat'] and not np.isfinite(a).all():
    667         raise ValueError(
--> 668             "array must not contain infs or NaNs")
    669     return a
    670 

ValueError: array must not contain infs or NaNs

In [24]:
A = []
b = []
for i in range(X.shape[1]):
    a_upper = [0]*X.shape[1]
    a_lower = [0]*X.shape[1]
    a_upper[i] = 1
    a_lower[i] = -1
    A.append(a_upper)
    A.append(a_lower)
    b.append(20)
    b.append(20)

A = np.array(A, dtype = accpm.myfloat)
b = np.array(b, dtype = accpm.myfloat)

theta_best5 = accpm.accpm(A, b, cost, grad, args = (X, Y),
                          alpha=0.01, beta=0.7, start=1, maxiter = 300, 
                          summary=1, testing=1)[1]


-------- Starting ACCPM --------
Initially: b = [ 20.  20.  20.  20.  20.  20.  20.  20.  20.  20.  20.  20.  20.  20.  20.
  20.  20.  20.] and A =
 [[ 1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [-1.  0.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0. -1.  0.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0. -1.  0.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0. -1.  0.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0. -1.  0.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0. -1.  0.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0. -1.  0.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0. -1.  0.]
 [ 0.  0.  0.  0.  0.  0.  0.  0.  1.]
 [ 0.  0.  0.  0.  0.  0.  0.  0. -1.]]
--------------------------------
Entering iteration 0
At iteration 0 AC computation SUCCEEDED with AC [ 0.  0.  0.  0.  0.  0.  0.  0.  0.] where
        a_cp = [ 0.386   0.1206 -0.0317  0.3093  0.4321  0.1232  0.3831  0.4149 -0.4679] and b_cp = [ 0.]
--------------------------------
Entering iteration 1
At iteration 1 AC computation SUCCEEDED with AC [-5.2831 -1.7609  0.4662 -4.3368 -5.8189 -1.7979 -5.2474 -5.6189  6.2174] where
        a_cp = [-0.2534  0.2487  0.0955 -0.3274 -0.4524  0.0281 -0.3538 -0.2752  0.5927] and b_cp = [ 1.177]
--------------------------------
Entering iteration 2
At iteration 2 AC computation FAILED with AC [-8.2072 -2.3164  0.8671 -6.2524 -5.8867 -0.8785 -2.4554 -1.7587  1.7414] where
        a_cp = [-0.2562  0.2466  0.0949 -0.3279 -0.4535  0.0276 -0.3549 -0.2755  0.5906] and b_cp = [ 1.1743]
--------------------------------
Entering iteration 3
At iteration 3 AC computation FAILED with AC [-8.6429 -1.8383  0.8539 -5.7643 -4.915  -0.5681 -1.2863 -0.3311 -0.2965] where
        a_cp = [-0.2655  0.2442  0.0934 -0.3298 -0.4543  0.0266 -0.3535 -0.2774  0.5861] and b_cp = [ 1.17]
--------------------------------
Entering iteration 4
At iteration 4 AC computation FAILED with AC [-8.8986 -1.3943  0.8474 -5.3436 -4.0733 -0.3389 -0.3161  0.7944 -1.9312] where
        a_cp = [-0.2924  0.2409  0.0886 -0.3354 -0.4541  0.0261 -0.3454 -0.2837  0.574 ] and b_cp = [ 1.1845]
--------------------------------
Entering iteration 5
At iteration 5 AC computation FAILED with AC [-11.0884  -1.2674   1.1942  -6.5704  -3.9997   0.1726   1.3768   3.0999
  -4.6232] where
        a_cp = [-0.381   0.2463  0.0721 -0.3529 -0.448   0.0304 -0.3048 -0.2886  0.5354] and b_cp = [ 1.4255]
--------------------------------
Entering iteration 6
At iteration 6 AC computation FAILED with AC [-12.961   -1.4655   1.5426  -8.0269  -4.0236   0.5856   2.965    5.2546
  -7.031 ] where
        a_cp = [-0.5619  0.3458  0.0533 -0.4229 -0.4137  0.0833 -0.1171 -0.1767  0.4   ] and b_cp = [ 2.7732]
--------------------------------
Entering iteration 7
At iteration 7 AC computation FAILED with AC [-14.7114  -3.4899   2.2057  -9.655   -4.1182   0.5845   4.4878   7.6496
  -9.4799] where
        a_cp = [ 0.1419  0.0161 -0.0567  0.1402  0.3784  0.0714  0.5027  0.4802 -0.5703] and b_cp = [ 1.6587]
--------------------------------
Entering iteration 8
At iteration 8 AC computation FAILED with AC [-16.6944  -5.6868  -4.5446  -1.1894   4.2124   6.4182  10.0241   2.4289
   1.0953] where
        a_cp = [ 0.1187 -0.0228 -0.1059  0.3768  0.4974  0.1231  0.4811  0.2642 -0.518 ] and b_cp = [ 1.0701]
--------------------------------
Entering iteration 9
At iteration 9 AC computation SUCCEEDED with AC [  9.1791 -15.8864  -2.834    5.1353   0.3016 -12.668  -11.5936 -10.1397
  -7.1078] where
        a_cp = [ 0.3876 -0.1361 -0.117   0.3344  0.4325  0.0147  0.3365  0.315  -0.5532] and b_cp = [ 0.9145]
--------------------------------
Entering iteration 10
At iteration 10 AC computation FAILED with AC [  9.9638 -14.8622  -2.965    4.9086   0.0473 -10.8437 -10.6115  -9.7381
  -4.2264] where
        a_cp = [ 0.4221 -0.1567 -0.1319  0.3418  0.4186  0.0124  0.315   0.2973 -0.5478] and b_cp = [ 1.1614]
--------------------------------
Entering iteration 11
At iteration 11 AC computation FAILED with AC [  9.5297 -12.5105  -2.449    3.7828  -0.8135  -8.9016  -9.4555  -8.5097
  -2.6622] where
        a_cp = [ 0.494  -0.1866 -0.1514  0.3422  0.3876  0.0103  0.2735  0.2613 -0.5364] and b_cp = [ 1.6872]
--------------------------------
Entering iteration 12
At iteration 12 AC computation FAILED with AC [  9.3395 -10.857   -2.2155   3.0394  -1.258   -7.2048  -8.2791  -7.5878
  -0.9877] where
        a_cp = [ 0.6854 -0.2192 -0.1885  0.3093  0.2795  0.0205  0.1568  0.1778 -0.465 ] and b_cp = [ 3.0976]
--------------------------------
Entering iteration 13
At iteration 13 AC computation FAILED with AC [ 10.2447 -10.8095  -2.5109   3.4455  -0.6764  -5.2681  -6.6683  -7.5044
   2.943 ] where
        a_cp = [ 0.7992 -0.1163 -0.1795  0.027  -0.2707  0.0706 -0.3272 -0.2964  0.2041] and b_cp = [ 6.2497]
--------------------------------
Entering iteration 14
At iteration 14 AC computation FAILED with AC [  8.8206 -10.1181  -1.9082   3.7618  -0.0517  -3.3526  -4.3258  -6.6425
   6.0223] where
        a_cp = [ 0.0348  0.1058  0.0273 -0.2299 -0.4667  0.0534 -0.4122 -0.4391  0.5921] and b_cp = [ 2.8796]
--------------------------------
Entering iteration 15
At iteration 15 AC computation FAILED with AC [ 6.3483 -8.3751  4.3831 -5.3387 -8.4086 -3.7149 -9.0156  4.5041 -5.0312] where
        a_cp = [ 0.374   0.1889  0.1441 -0.4637 -0.5281 -0.0113 -0.3653  0.2614  0.3284] and b_cp = [ 3.011]
--------------------------------
Entering iteration 16
At iteration 16 AC computation FAILED with AC [ 3.957  -5.8428  4.7452 -4.6099 -9.2355 -2.2506 -7.3524  4.0724 -7.8687] where
        a_cp = [ 0.6131  0.1575  0.1624 -0.3509 -0.3596  0.0088 -0.1815  0.5355  0.0276] and b_cp = [ 3.1467]
--------------------------------
Entering iteration 17
At iteration 17 AC computation FAILED with AC [  0.9328  -2.4213   5.8423  -1.7383 -10.8227  -0.0428  -6.3207   2.6331
 -11.8149] where
        a_cp = [ 0.5942  0.0928  0.2188  0.0536  0.0676  0.1125  0.1335  0.6326 -0.3903] and b_cp = [ 2.0076]
--------------------------------
Entering iteration 18
At iteration 18 AC computation FAILED with AC [ 12.7483  -6.1538  17.6158  -5.5534  13.2824 -16.0719  13.3676 -10.2915
  15.1998] where
        a_cp = [ 0.4935  0.0665  0.0747  0.2477  0.4487  0.0388  0.4475  0.3398 -0.408 ] and b_cp = [ 1.3655]
--------------------------------
Entering iteration 19
At iteration 19 AC computation FAILED with AC [ -0.607  -15.1193   0.3355  -2.283   -8.3192   6.836   -8.3298  -2.9253
  -8.1136] where
        a_cp = [-0.1695  0.0031  0.0276 -0.3647 -0.583   0.1061 -0.4154 -0.2959  0.4755] and b_cp = [ 2.8886]
--------------------------------
Entering iteration 20
At iteration 20 AC computation FAILED with AC [ -1.9358 -11.0557   0.5823  -2.8216  -9.428    4.4975  -7.0564  -1.8122
 -11.2281] where
        a_cp = [-0.1208 -0.0584 -0.0168 -0.4313 -0.6542  0.1407 -0.4188 -0.2053  0.3611] and b_cp = [ 3.9766]
--------------------------------
Entering iteration 21
At iteration 21 AC computation FAILED with AC [ -2.7692  -7.6638   1.2032  -2.9805  -9.9292   2.2166  -5.6276  -1.2813
 -13.2271] where
        a_cp = [ 0.1306 -0.2518 -0.1622 -0.5136 -0.6568  0.2357 -0.2644  0.1676 -0.211 ] and b_cp = [ 7.4656]
--------------------------------
Entering iteration 22
At iteration 22 AC computation FAILED with AC [ -3.0618  -2.8487   2.2032  -1.677  -10.3837  -1.3147  -3.6797  -1.4771
 -14.4583] where
        a_cp = [ 0.3331 -0.1064 -0.0661  0.134   0.2578  0.0595  0.325   0.4331 -0.7015] and b_cp = [ 2.3095]
--------------------------------
Entering iteration 23
At iteration 23 AC computation FAILED with AC [ -0.2396  -2.9023   6.5529   5.0388 -17.1793   1.1752  12.784   -2.9535
  -4.9168] where
        a_cp = [ 0.334  -0.0156  0.0843  0.3923  0.3108  0.1588  0.5277  0.3268 -0.4692] and b_cp = [ 1.2606]
--------------------------------
Entering iteration 24
At iteration 24 AC computation SUCCEEDED with AC [-16.5558 -16.2673   7.2779   9.6753  14.5923 -16.1432  -9.0607 -12.7692
  -0.684 ] where
        a_cp = [-0.409   0.0323 -0.0268  0.5191  0.5153  0.1274  0.2315 -0.3946 -0.2652] and b_cp = [ 4.2603]
--------------------------------
Entering iteration 25
At iteration 25 AC computation FAILED with AC [-11.0017  -9.2579   2.7463  12.8579   1.8339  -8.2022 -13.7204  -1.9621
  -4.148 ] where
        a_cp = [-0.3444  0.0192  0.0206  0.7005  0.4759  0.1693  0.0539 -0.2195 -0.2893] and b_cp = [ 4.607]
--------------------------------
Entering iteration 26
At iteration 26 AC computation FAILED with AC [-10.383   -4.5959  -0.1335  14.3525  -6.2419  -7.5552 -15.4612   5.883
  -6.7316] where
        a_cp = [-0.2419  0.2032  0.0374  0.7684  0.2148  0.1937 -0.2242  0.3234 -0.2641] and b_cp = [ 6.1029]
--------------------------------
Entering iteration 27
At iteration 27 AC computation FAILED with AC [ -6.3566  -0.0239   6.9626   8.9602 -13.7784 -12.6058  -7.8405   1.0891
 -13.3821] where
        a_cp = [-0.2427  0.3734  0.4192  0.0346 -0.5778 -0.0193 -0.4529  0.0947  0.2765] and b_cp = [ 5.6147]
--------------------------------
Entering iteration 28
At iteration 28 AC computation FAILED with AC [ -5.785    0.9733   4.4613   6.9999 -13.0814 -10.6185  -3.574    1.067
 -12.1864] where
        a_cp = [ 0.1504  0.1468  0.1349  0.4542  0.185  -0.0315  0.3044  0.5099 -0.586 ] and b_cp = [ 3.5147]
--------------------------------
Entering iteration 29
At iteration 29 AC computation FAILED with AC [ -3.083  -10.8966  -5.2579   4.6637  -1.3113  -5.655    6.5283  14.5742
  14.7392] where
        a_cp = [ 0.3776 -0.0514 -0.0773  0.2927  0.3726  0.0437  0.3967  0.5073 -0.4558] and b_cp = [ 0.8428]
--------------------------------
Entering iteration 30
At iteration 30 AC computation FAILED with AC [ -0.9954 -11.1694  -1.8329   5.7226   1.05    -1.6036   3.3781  12.0093
  16.4136] where
        a_cp = [  4.4406e-01  -1.6838e-02  -1.3422e-04   3.2589e-01   3.1633e-01
   1.0101e-01   3.6014e-01   5.8318e-01  -3.4096e-01] and b_cp = [ 1.2603]
--------------------------------
Entering iteration 31
At iteration 31 AC computation FAILED with AC [  7.0918  18.0619  -1.9712  -3.4005  -8.5637 -18.3211   2.171  -16.2081
 -16.3355] where
        a_cp = [ 0.4734  0.556  -0.2041  0.0136  0.3037 -0.0566  0.3947  0.0973 -0.4052] and b_cp = [ 3.2352]
--------------------------------
Entering iteration 32
At iteration 32 AC computation FAILED with AC [  7.9239  -7.6251 -10.0613 -10.2648  13.7944 -19.548   16.5568 -18.0069
  13.0739] where
        a_cp = [ 0.2923  0.0415 -0.3065  0.1554  0.5122 -0.0506  0.5604  0.035  -0.4632] and b_cp = [ nan]
--------------------------------
Entering iteration 33
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-24-eb05156e0173> in <module>()
     16 theta_best5 = accpm.accpm(A, b, cost, grad, args = (X, Y),
     17                           alpha=0.01, beta=0.7, start=1, maxiter = 300,
---> 18                           summary=1, testing=1)[1]

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in accpm(A, b, func, grad_func, constr, grad_constr, args, alpha, beta, x0, y0, start, tol, maxiter, summary, testing)
    332         ac = analytic_center(A, b, x0=x0, y0=y0,
    333                              alpha=alpha, beta=beta, start=start,
--> 334                              testing=testing)
    335         queries.append(ac)
    336         (x0, y0) = (ac, None)

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in analytic_center(A, b, x0, y0, rtol, etol, start, alpha, beta, testing, maxiter)
    142     while i < maxiter:
    143         (delta_x, delta_y, delta_v) = newton_step(x, y, v, A, b,
--> 144                                                   testing=testing)
    145         # print('at iteration', i,'delta_x is\n', delta_x)
    146         # print('    delta_x=', delta_x)

/Users/davidjwu/Google Drive/classes/2016_sem2/ong_project/mclass-sky/projects/david/lab/accpm.py in newton_step(x, y, v, A, b, testing)
    108     b_chol = np.dot(np.transpose(A), g) - \
    109              np.dot(np.transpose(A), np.dot(H, r_p))
--> 110     L = splinalg.cholesky(A_chol, lower=True)
    111     if np.linalg.norm(A_chol - np.dot(L, np.transpose(L))) > 10e-6:
    112         print('**** Cholesky factorization FAILED or INACCURATE ****')

/Users/davidjwu/anaconda/lib/python3.5/site-packages/scipy/linalg/decomp_cholesky.py in cholesky(a, lower, overwrite_a, check_finite)
     79     """
     80     c, lower = _cholesky(a, lower=lower, overwrite_a=overwrite_a, clean=True,
---> 81                             check_finite=check_finite)
     82     return c
     83 

/Users/davidjwu/anaconda/lib/python3.5/site-packages/scipy/linalg/decomp_cholesky.py in _cholesky(a, lower, overwrite_a, clean, check_finite)
     18 
     19     if check_finite:
---> 20         a1 = asarray_chkfinite(a)
     21     else:
     22         a1 = asarray(a)

/Users/davidjwu/anaconda/lib/python3.5/site-packages/numpy/lib/function_base.py in asarray_chkfinite(a, dtype, order)
    666     if a.dtype.char in typecodes['AllFloat'] and not np.isfinite(a).all():
    667         raise ValueError(
--> 668             "array must not contain infs or NaNs")
    669     return a
    670 

ValueError: array must not contain infs or NaNs