License


Copyright (C) 2017 J. Patrick Hall, jphall@gwu.edu

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.


Decision Tree Ensemble Examples Kaggle House Prices

Imports and inits


In [182]:
import h2o
from h2o.estimators.gbm import H2OGradientBoostingEstimator 
from h2o.estimators.random_forest import H2ORandomForestEstimator
from h2o.grid.grid_search import H2OGridSearch 
from h2o.estimators.xgboost import H2OXGBoostEstimator
from h2o.estimators.stackedensemble import H2OStackedEnsembleEstimator
import xgboost as xgb
h2o.init() # give h2o as much memory as possible
h2o.no_progress() # turn off h2o progress bars

import numpy as np
import pandas as pd


Checking whether there is an H2O instance running at http://localhost:54321. connected.
H2O cluster uptime: 6 hours 32 mins
H2O cluster version: 3.12.0.1
H2O cluster version age: 8 days
H2O cluster name: H2O_from_python_phall_51a0jp
H2O cluster total nodes: 1
H2O cluster free memory: 3.032 Gb
H2O cluster total cores: 8
H2O cluster allowed cores: 8
H2O cluster status: locked, healthy
H2O connection url: http://localhost:54321
H2O connection proxy: None
H2O internal security: False
Python version: 3.5.2 final

Import data


In [124]:
train = h2o.import_file('../../03_regression/data/train.csv')
test = h2o.import_file('../../03_regression/data/test.csv')

# bug fix - from Keston
dummy_col = np.random.rand(test.shape[0])
test = test.cbind(h2o.H2OFrame(dummy_col))
cols = test.columns
cols[-1] = 'SalePrice'
test.columns = cols
print(train.shape)
print(test.shape)


(1460, 81)
(1459, 81)

Determine data types


In [125]:
def get_type_lists(frame=train, rejects=['Id', 'SalePrice']):

    """Creates lists of numeric and categorical variables.
    
    :param frame: The frame from which to determine types.
    :param rejects: Variable names not to be included in returned lists.
    :return: Tuple of lists for numeric and categorical variables in the frame.
    
    """
    
    nums, cats = [], []
    for key, val in frame.types.items():
        if key not in rejects:
            if val == 'enum':
                cats.append(key)
            else: 
                nums.append(key)
                
    print('Numeric =', nums)                
    print()
    print('Categorical =', cats)
    
    return nums, cats

In [126]:
original_nums, cats = get_type_lists()


Numeric = ['FullBath', 'TotalBsmtSF', 'KitchenAbvGr', 'BsmtFinSF2', 'TotRmsAbvGrd', 'MSSubClass', 'MasVnrArea', 'GrLivArea', 'BsmtFullBath', 'YearRemodAdd', 'BsmtFinSF1', 'Fireplaces', '2ndFlrSF', 'MoSold', 'ScreenPorch', 'PoolArea', 'OverallQual', '3SsnPorch', 'YrSold', 'LowQualFinSF', 'BsmtHalfBath', 'GarageYrBlt', 'EnclosedPorch', 'LotFrontage', 'WoodDeckSF', 'MiscVal', 'BsmtUnfSF', 'GarageArea', 'BedroomAbvGr', 'OpenPorchSF', 'LotArea', 'OverallCond', 'GarageCars', 'HalfBath', 'YearBuilt', '1stFlrSF']

Categorical = ['KitchenQual', 'Electrical', 'LotShape', 'SaleType', 'LandContour', 'LandSlope', 'GarageType', 'BsmtExposure', 'MasVnrType', 'GarageCond', 'ExterQual', 'Street', 'Functional', 'Alley', 'BsmtQual', 'HeatingQC', 'BsmtFinType2', 'RoofMatl', 'GarageQual', 'CentralAir', 'GarageFinish', 'HouseStyle', 'RoofStyle', 'Utilities', 'Neighborhood', 'Condition2', 'Exterior2nd', 'BldgType', 'SaleCondition', 'BsmtCond', 'LotConfig', 'Condition1', 'Fence', 'Foundation', 'PoolQC', 'PavedDrive', 'MiscFeature', 'Exterior1st', 'MSZoning', 'FireplaceQu', 'ExterCond', 'BsmtFinType1', 'Heating']

Split into to train and validation (before doing data prep!!!)


In [127]:
train, valid = train.split_frame([0.7], seed=12345)
print(train.shape)
print(valid.shape)


(1001, 81)
(459, 81)

Impute numeric missing


In [128]:
# median usually better than mean
# (_ signifies temporary throw-away variable, used to suppress output)
_ = train[['MasVnrArea', 'GarageYrBlt', 'LotFrontage']].impute(method='median')
_ = valid[['MasVnrArea', 'GarageYrBlt', 'LotFrontage']].impute(method='median')
_ = test[['BsmtHalfBath', 'BsmtFinSF1', 'BsmtFullBath', 'BsmtFinSF2', 'BsmtUnfSF', 'MasVnrArea', 
          'GarageYrBlt', 'LotFrontage', 'GarageCars', 'TotalBsmtSF', 'GarageArea']].impute(method='median')

Encode categorical vars using shrunken averages

http://helios.mm.di.uoa.gr/~rouvas/ssi/sigkdd/sigkdd.vol3.1/barreca.ps


In [129]:
def target_encoder(training_frame, test_frame, x, y, lambda_=0.15, threshold=150, test=False):

    """ Applies simple target encoding to categorical variables.

    :param training_frame: Training frame which to create target means and to be encoded.
    :param test_frame: Test frame to be encoded using information from training frame.
    :param x: Name of input variable to be encoded.
    :param y: Name of target variable to use for encoding.
    :param lambda_: Balance between level mean and overall mean for small groups.
    :param threshold: Number below which a level is considered small enough to be shrunken.
    :param test: Whether or not to print the row_val_dict for testing purposes.
    :return: Tuple of encoded variable from train and test set as H2OFrames.

    """

    # convert to pandas
    trdf = training_frame.as_data_frame().loc[:, [x,y]] # df
    tss = test_frame.as_data_frame().loc[:, x]          # series


    # create dictionary of level:encode val

    encode_name = x + '_Tencode'
    overall_mean = trdf[y].mean()
    row_val_dict = {}

    for level in trdf[x].unique():
        level_df = trdf[trdf[x] == level][y]
        level_n = level_df.shape[0]
        level_mean = level_df.mean()
        if level_n >= threshold:
            row_val_dict[level] = level_mean
        else:
            row_val_dict[level] = ((1 - lambda_) * level_mean) +\
                                  (lambda_ * overall_mean)

    row_val_dict[np.nan] = overall_mean # handle missing values

    if test:
        print(row_val_dict)

    # apply the transform to training data
    trdf[encode_name] = trdf[x].apply(lambda i: row_val_dict[i])

    # apply the transform to test data
    tsdf = pd.DataFrame(columns=[x, encode_name])
    tsdf[x] = tss
    tsdf.loc[:, encode_name] = overall_mean # handle previously unseen values
    # handle values that are seen in tsdf but not row_val_dict
    for i, col_i in enumerate(tsdf[x]):
        try:
            row_val_dict[col_i]
        except:
            # a value that appeared in tsdf isn't in the row_val_dict so just
            # make it the overall_mean
            row_val_dict[col_i] = overall_mean
    tsdf[encode_name] = tsdf[x].apply(lambda i: row_val_dict[i])


    # convert back to H2O

    trdf = h2o.H2OFrame(trdf[encode_name].as_matrix())
    trdf.columns = [encode_name]

    tsdf = h2o.H2OFrame(tsdf[encode_name].as_matrix())
    tsdf.columns = [encode_name]

    return (trdf, tsdf)

Execute encoding


In [130]:
total = len(cats)
for i, var in enumerate(cats):
    
    tr_enc, _ = target_encoder(train, test, var, 'SalePrice')
    v_enc, ts_enc = target_encoder(valid, test, var, 'SalePrice')
    
    print('Encoding: ' + var + ' (' + str(i+1) + '/' + str(total) + ') ...')

    train = train.cbind(tr_enc)
    valid = valid.cbind(v_enc)
    test = test.cbind(ts_enc)    
    
print('Done.')


Encoding: KitchenQual (1/43) ...
Encoding: Electrical (2/43) ...
Encoding: LotShape (3/43) ...
Encoding: SaleType (4/43) ...
Encoding: LandContour (5/43) ...
Encoding: LandSlope (6/43) ...
Encoding: GarageType (7/43) ...
Encoding: BsmtExposure (8/43) ...
Encoding: MasVnrType (9/43) ...
Encoding: GarageCond (10/43) ...
Encoding: ExterQual (11/43) ...
Encoding: Street (12/43) ...
Encoding: Functional (13/43) ...
Encoding: Alley (14/43) ...
Encoding: BsmtQual (15/43) ...
Encoding: HeatingQC (16/43) ...
Encoding: BsmtFinType2 (17/43) ...
Encoding: RoofMatl (18/43) ...
Encoding: GarageQual (19/43) ...
Encoding: CentralAir (20/43) ...
Encoding: GarageFinish (21/43) ...
Encoding: HouseStyle (22/43) ...
Encoding: RoofStyle (23/43) ...
Encoding: Utilities (24/43) ...
Encoding: Neighborhood (25/43) ...
Encoding: Condition2 (26/43) ...
Encoding: Exterior2nd (27/43) ...
Encoding: BldgType (28/43) ...
Encoding: SaleCondition (29/43) ...
Encoding: BsmtCond (30/43) ...
Encoding: LotConfig (31/43) ...
Encoding: Condition1 (32/43) ...
Encoding: Fence (33/43) ...
Encoding: Foundation (34/43) ...
Encoding: PoolQC (35/43) ...
Encoding: PavedDrive (36/43) ...
Encoding: MiscFeature (37/43) ...
Encoding: Exterior1st (38/43) ...
Encoding: MSZoning (39/43) ...
Encoding: FireplaceQu (40/43) ...
Encoding: ExterCond (41/43) ...
Encoding: BsmtFinType1 (42/43) ...
Encoding: Heating (43/43) ...
Done.

Redefine numerics and explore


In [131]:
encoded_nums, cats = get_type_lists(frame=train)


Numeric = ['ExterCond_Tencode', 'TotalBsmtSF', 'Electrical_Tencode', 'KitchenAbvGr', 'LandContour_Tencode', 'FireplaceQu_Tencode', 'Alley_Tencode', 'BsmtFinSF2', 'Foundation_Tencode', 'TotRmsAbvGrd', 'MSSubClass', 'MasVnrArea', 'Condition2_Tencode', 'GrLivArea', 'BsmtFullBath', 'YearRemodAdd', 'BsmtFinSF1', 'BsmtExposure_Tencode', 'Fireplaces', '2ndFlrSF', 'MSZoning_Tencode', 'RoofMatl_Tencode', 'MoSold', 'ScreenPorch', 'PoolArea', 'Exterior1st_Tencode', '3SsnPorch', '1stFlrSF', 'FullBath', 'YrSold', 'SaleCondition_Tencode', 'BsmtQual_Tencode', 'PavedDrive_Tencode', 'BsmtHalfBath', 'CentralAir_Tencode', 'GarageYrBlt', 'LandSlope_Tencode', 'RoofStyle_Tencode', 'EnclosedPorch', 'ExterQual_Tencode', 'LowQualFinSF', 'GarageCond_Tencode', 'LotFrontage', 'LotConfig_Tencode', 'WoodDeckSF', 'Exterior2nd_Tencode', 'BsmtCond_Tencode', 'Fence_Tencode', 'MiscVal', 'BsmtUnfSF', 'Street_Tencode', 'GarageFinish_Tencode', 'Condition1_Tencode', 'PoolQC_Tencode', 'KitchenQual_Tencode', 'GarageArea', 'Functional_Tencode', 'BedroomAbvGr', 'OpenPorchSF', 'HeatingQC_Tencode', 'LotShape_Tencode', 'LotArea', 'BsmtFinType1_Tencode', 'BldgType_Tencode', 'BsmtFinType2_Tencode', 'Heating_Tencode', 'YearBuilt', 'Neighborhood_Tencode', 'OverallCond', 'GarageQual_Tencode', 'MasVnrType_Tencode', 'GarageCars', 'GarageType_Tencode', 'Utilities_Tencode', 'HalfBath', 'SaleType_Tencode', 'HouseStyle_Tencode', 'MiscFeature_Tencode', 'OverallQual']

Categorical = ['KitchenQual', 'Electrical', 'LotShape', 'Condition1', 'SaleType', 'LandContour', 'LandSlope', 'GarageType', 'BsmtExposure', 'MasVnrType', 'MSZoning', 'GarageCond', 'ExterQual', 'Street', 'Functional', 'Alley', 'BsmtQual', 'HeatingQC', 'BsmtFinType2', 'RoofMatl', 'GarageQual', 'CentralAir', 'GarageFinish', 'HouseStyle', 'RoofStyle', 'Utilities', 'Neighborhood', 'Condition2', 'Exterior2nd', 'BldgType', 'SaleCondition', 'BsmtCond', 'LotConfig', 'Fence', 'Foundation', 'PoolQC', 'Exterior1st', 'PavedDrive', 'MiscFeature', 'Heating', 'FireplaceQu', 'ExterCond', 'BsmtFinType1']

In [132]:
print('Imputed and encoded numeric training data:')
train[encoded_nums].describe() #79 numeric columns w/ no missing
print('--------------------------------------------------------------------------------')
print('Imputed and encoded numeric validation data:')
valid[encoded_nums].describe() #79 numeric columns w/ no missing
print('--------------------------------------------------------------------------------')
print('Imputed and encoded numeric test data:')
test[encoded_nums].describe() #79 numeric columns w/ no missing


Imputed and encoded numeric training data:
Rows:1001
Cols:79


ExterCond_Tencode TotalBsmtSF Electrical_Tencode KitchenAbvGr LandContour_Tencode FireplaceQu_Tencode Alley_Tencode BsmtFinSF2 Foundation_Tencode TotRmsAbvGrd MSSubClass MasVnrArea Condition2_Tencode GrLivArea BsmtFullBath YearRemodAdd BsmtFinSF1 BsmtExposure_Tencode Fireplaces 2ndFlrSF MSZoning_Tencode RoofMatl_Tencode MoSold ScreenPorch PoolArea Exterior1st_Tencode 3SsnPorch 1stFlrSF FullBath YrSold SaleCondition_Tencode BsmtQual_Tencode PavedDrive_Tencode BsmtHalfBath CentralAir_Tencode GarageYrBlt LandSlope_Tencode RoofStyle_Tencode EnclosedPorch ExterQual_Tencode LowQualFinSF GarageCond_Tencode LotFrontage LotConfig_Tencode WoodDeckSF Exterior2nd_Tencode BsmtCond_Tencode Fence_Tencode MiscVal BsmtUnfSF Street_Tencode GarageFinish_Tencode Condition1_Tencode PoolQC_Tencode KitchenQual_Tencode GarageArea Functional_Tencode BedroomAbvGr OpenPorchSF HeatingQC_Tencode LotShape_Tencode LotArea BsmtFinType1_Tencode BldgType_Tencode BsmtFinType2_Tencode Heating_Tencode YearBuilt Neighborhood_Tencode OverallCond GarageQual_Tencode MasVnrType_Tencode GarageCars GarageType_Tencode Utilities_Tencode HalfBath SaleType_Tencode HouseStyle_Tencode MiscFeature_Tencode OverallQual
type real int real int real real real int real int int real real int int int int real int int real real int int int real int int int int real real real int real real real real int real int real real real int real real real int int real real real real real int real int int real real int real real real real int real int real real int real real int real real real int
mins 122047.14941169939 0.0 84275.79385614385 0.0 145140.16285614387 141462.34885614386 128075.200999001 0.0 121726.89385614387 3.0 20.0 0.0 108075.79385614385 480.0 0.0 1950.0 0.0 167645.4123076923 0.0 0.0 78614.79385614385 143775.793856143861.0 0.0 0.0 78325.79385614385 0.0 480.0 0.0 2006.0 115832.04385614385 121216.12093947716129253.89464979463 0.0 119608.23368665231 1908.0 181486.5182747485 161577.2224275724 0.0 116078.96885614384 0.0 112070.79385614385 21.0 176473.2899159664 0.0 129978.23968947721 84275.79385614385 141306.738141858140.0 0.0 146350.10385614386141354.57177033494 134468.29385614386 182171.95904095902124936.94820396995 0.0 110059.12718947718 0.0 0.0 135668.69902855766 163944.593856143821300.0 150410.4464877228 138273.46052281052154536.9355228105 93469.96052281052 1875.0 109690.79385614385 2.0 96813.29385614385 155578.6188811189 0.0 125174.9605228105 144200.79385614386 0.0 125968.29385614385118907.22242757239 140375.79385614386 2.0
mean 182637.23505924645 1063.2387612387613182952.64128239392 1.046953046953047 182186.73299732237 200266.80114860163 180171.3854686272741.64935064935065 183119.90242260235 6.512487512487512 57.08791208791209106.91146881287727182224.4420403772 1519.80119880119880.426573426573426561985.138861138861 445.5994005994006182844.62529074325 0.6203796203796204341.7872127872128183387.92640181992182033.940055498946.36263736263736214.7632367632367643.3766233766233764183565.71379414792 3.45654345654345671172.08891108891111.57442557442557442007.828171828172 181541.32494458588 182245.41278741238182908.18055950044 0.059940059940059943182822.70708043204 1978.734522560336 182145.0556687069 182159.0086938536 21.257742257742258181095.69602749898 5.9250749250749255186002.74671607107 70.59975669099758 181772.16118142597 91.07392607392607 183994.52609268852 184043.11900766566177450.8703097601539.684315684315685575.99000999001 182203.5349842964 185712.8721618042 182645.11776425372 182802.82568320786180810.97023994988 477.46853146853147182576.24533688094 2.871128871128871 44.92407592407592182409.7085632649 181993.9278632456310628.262737262738185645.79515235015 182849.79797600003184056.75787594018 182323.579859550981972.2987012987012182171.95904095905 5.583416583416583 186018.3297154893 180574.40004970055 1.7932067932067932185255.62265751234 182178.65314071544 0.38161838161838163181180.3311701286 183188.25635258848 181198.19224147475 6.1448551448551445
maxs 185708.33940774488 6110.0 187738.31270358307 3.0 215016.8662245649 306119.08332982805 182171.959040959021127.0 226465.8274336283 14.0 190.0 1378.0 269469.54385614384 5642.0 3.0 2010.0 5644.0 243510.2073978105 3.0 2065.0 204495.20385614387669075.7938561438 12.0 440.0 738.0 250025.79385614384 508.0 4692.0 3.0 2010.0 260380.61674771016 312352.66653056245187523.8671023965 2.0 186782.0 2010.0 200379.84385614382 248325.79385614384 552.0 348876.58744588745 528.0 188146.7502726281 313.0 215932.78135614385 736.0 298475.79385614384 212500.14385614384182171.9590409590215500.0 2153.0 182383.5220883534 243708.832 219155.3393106893 443825.79385614384305958.08769176033 1418.0 185063.63879957132 8.0 523.0 216426.0 220137.0973044197 164660.0 236446.98648648648 187595.7541966427 218122.46052281052 185483.958141858142010.0 329868.3581418581 9.0 222252.04385614384 256064.37787676242 4.0 243875.54558028182 182216.631 2.0 263880.6876061438 210965.119205298 239825.79385614384 10.0
sigma 9945.861000354022 450.4683539784608716469.485082849522 0.225373482897182911064.930655592714 24220.26519043972 9252.695490054044 148.9183867830897439735.240377141236 1.587480364002624742.22127738162672179.4411497100248 6389.719881512633 520.2774292995626 0.5204355357324736 20.606836203107406467.173265887122824443.64548833232 0.6416730131026672432.908595059423222616.41995033148515980.2063757640462.67681950033293 54.16981527671003 43.98791894358056 29589.150408848316 29.83605804459362 392.4739572085174 0.553809800116696 1.316983505760630324904.825355766643 49068.18360107548 15415.629575665145 0.24577143121932704 15828.294334486285 24.0757519967241041835.4154172265178 20695.377655471337 61.04442237008638 52277.89924581869 49.51948485817861 10671.429849329988 22.74966637011053210669.040225587902 120.0504416046460430224.673393447127 10415.5288163924 11076.460716121788516.2493547150991 444.457507417863162541.575966699049341548.00781303608 13080.759735205764 11861.80122991297749556.81599252628 209.922579201812549673.472750816674 0.805217749665035963.0187450666087935398.540443061385 21926.25817117466 9442.373107111374 33760.02487150487 13615.6841282550857125.75433938659 8588.039549532366 29.87302609900257651529.93244080358 1.088707819061071711950.130371967634 32873.17832435439 0.734978779417342234065.80911242865 1201.565692600516 0.500221729058003 25459.93047873387321247.33154021499 5900.1270688417535 1.3535124690951332
zeros 0 25 0 1 0 0 0 894 0 0 0 570 0 0 586 0 326 0 466 572 0 0 0 921 995 0 985 0 6 0 0 0 0 943 0 0 0 0 867 0 984 0 0 0 523 0 0 0 969 78 0 0 0 0 0 48 0 4 460 0 0 0 0 0 0 0 0 0 0 0 0 48 0 0 626 0 0 0 0
missing0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 185708.33940774488 856.0 187738.31270358307 1.0 182282.48766816143 182171.95904095902 182171.959040959020.0 226465.8274336283 8.0 60.0 196.0 182525.73333333334 1710.0 1.0 2003.0 706.0 167645.4123076923 0.0 854.0 192391.8022670025 181235.935975609752.0 0.0 0.0 216859.7290502793 0.0 856.0 2.0 2008.0 177020.8800489596 200924.0538641686 187523.8671023965 0.0 186782.0 2003.0 181982.57594936708 171522.79741935484 0.0 229333.4454277286 0.0 188146.7502726281 65.0 176473.2899159664 0.0 216626.9093484419 184737.95170142702182171.959040959020.0 150.0 182383.5220883534 200494.42807017543 185776.46347031964 182171.95904095902212221.98514851482 548.0 185063.63879957132 3.0 61.0 216426.0 165131.570739549828450.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085422003.0 197940.3021894772 5.0 188334.07174392935 203515.30891719743 2.0 203664.60358890702 182216.631 1.0 174574.41216991964210965.119205298 182171.95904095902 7.0
1 185708.33940774488 1262.0 187738.31270358307 1.0 182282.48766816143 204076.0357142857 182171.959040959020.0 150397.2807424594 6.0 20.0 0.0 182525.73333333334 1262.0 0.0 1976.0 978.0 243510.2073978105 1.0 0.0 192391.8022670025 181235.935975609755.0 0.0 0.0 155330.24861804862 0.0 1262.0 2.0 2007.0 177020.8800489596 200924.0538641686 187523.8671023965 1.0 186782.0 1976.0 181982.57594936708 171522.79741935484 0.0 144619.2755267423 0.0 188146.7502726281 80.0 178818.25814185815 298.0 155721.17213200592 184737.95170142702182171.959040959020.0 284.0 182383.5220883534 200494.42807017543 147024.1605228105 182171.95904095902139811.59481037923 460.0 185063.63879957132 3.0 0.0 216426.0 165131.570739549829600.0 161782.77448994666 187595.7541966427 185630.71806674334 183201.273652085421976.0 218575.79385614384 8.0 188334.07174392935 155578.6188811189 2.0 203664.60358890702 182216.631 0.0 174574.41216991964178321.97183098592 182171.95904095902 6.0
2 185708.33940774488 920.0 187738.31270358307 1.0 182282.48766816143 204076.0357142857 182171.959040959020.0 226465.8274336283 6.0 60.0 162.0 182525.73333333334 1786.0 1.0 2002.0 486.0 187129.2701381951 1.0 866.0 192391.8022670025 181235.935975609759.0 0.0 0.0 216859.7290502793 0.0 920.0 2.0 2008.0 177020.8800489596 200924.0538641686 187523.8671023965 0.0 186782.0 2001.0 181982.57594936708 171522.79741935484 0.0 229333.4454277286 0.0 188146.7502726281 68.0 176473.2899159664 0.0 216626.9093484419 184737.95170142702182171.959040959020.0 434.0 182383.5220883534 200494.42807017543 185776.46347031964 182171.95904095902212221.98514851482 608.0 185063.63879957132 3.0 42.0 216426.0 209450.3942028985511250.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085422001.0 197940.3021894772 5.0 188334.07174392935 203515.30891719743 2.0 203664.60358890702 182216.631 1.0 174574.41216991964210965.119205298 182171.95904095902 7.0
3 185708.33940774488 1145.0 187738.31270358307 1.0 182282.48766816143 204076.0357142857 182171.959040959020.0 226465.8274336283 9.0 60.0 350.0 182525.73333333334 2198.0 1.0 2000.0 655.0 207605.41721854304 1.0 1053.0 192391.8022670025 181235.9359756097512.0 0.0 0.0 216859.7290502793 0.0 1145.0 2.0 2008.0 177020.8800489596 200924.0538641686 187523.8671023965 0.0 186782.0 2000.0 181982.57594936708 171522.79741935484 0.0 229333.4454277286 0.0 188146.7502726281 84.0 178818.25814185815 192.0 216626.9093484419 184737.95170142702182171.959040959020.0 490.0 182383.5220883534 200494.42807017543 185776.46347031964 182171.95904095902212221.98514851482 836.0 185063.63879957132 4.0 84.0 216426.0 209450.3942028985514260.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085422000.0 329868.3581418581 5.0 188334.07174392935 203515.30891719743 3.0 203664.60358890702 182216.631 1.0 174574.41216991964210965.119205298 182171.95904095902 8.0
4 185708.33940774488 796.0 187738.31270358307 1.0 182282.48766816143 182171.95904095902 182171.959040959020.0 185142.46052281052 5.0 50.0 0.0 182525.73333333334 1362.0 1.0 1995.0 732.0 167645.4123076923 0.0 566.0 192391.8022670025 181235.9359756097510.0 0.0 0.0 216859.7290502793 320.0 796.0 1.0 2009.0 177020.8800489596 200924.0538641686 187523.8671023965 0.0 186782.0 1993.0 181982.57594936708 171522.79741935484 0.0 144619.2755267423 0.0 188146.7502726281 85.0 176473.2899159664 40.0 216626.9093484419 184737.95170142702154576.6979101979 700.0 64.0 182383.5220883534 141354.57177033494 185776.46347031964 182171.95904095902139811.59481037923 480.0 185063.63879957132 1.0 30.0 216426.0 209450.3942028985514115.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085421993.0 157653.3733433233 5.0 188334.07174392935 155578.6188811189 2.0 203664.60358890702 182216.631 1.0 174574.41216991964149995.43881027232 151058.18256582128 5.0
5 185708.33940774488 1686.0 187738.31270358307 1.0 182282.48766816143 225928.18076923073 182171.959040959020.0 226465.8274336283 7.0 20.0 186.0 182525.73333333334 1694.0 1.0 2005.0 1369.0 207605.41721854304 1.0 0.0 192391.8022670025 181235.935975609758.0 0.0 0.0 216859.7290502793 0.0 1694.0 2.0 2007.0 177020.8800489596 312352.66653056245187523.8671023965 0.0 186782.0 2004.0 181982.57594936708 171522.79741935484 0.0 229333.4454277286 0.0 188146.7502726281 75.0 176473.2899159664 255.0 216626.9093484419 184737.95170142702182171.959040959020.0 317.0 182383.5220883534 200494.42807017543 185776.46347031964 182171.95904095902212221.98514851482 636.0 185063.63879957132 3.0 57.0 216426.0 165131.5707395498210084.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085422004.0 214617.5167374998 5.0 188334.07174392935 256064.37787676242 2.0 203664.60358890702 182216.631 0.0 174574.41216991964178321.97183098592 182171.95904095902 8.0
6 185708.33940774488 952.0 129502.64385614383 2.0 182282.48766816143 204076.0357142857 182171.959040959020.0 136922.75385614386 8.0 50.0 0.0 182525.73333333334 1774.0 0.0 1950.0 0.0 167645.4123076923 2.0 752.0 135492.29843360864181235.935975609754.0 0.0 0.0 174764.54385614384 0.0 1022.0 2.0 2008.0 153108.76116383614 141930.00455580864187523.8671023965 0.0 186782.0 1931.0 181982.57594936708 171522.79741935484 205.0 144619.2755267423 0.0 188146.7502726281 51.0 176473.2899159664 90.0 153754.05472570908 184737.95170142702182171.959040959020.0 952.0 182383.5220883534 141354.57177033494 134468.29385614386 182171.95904095902139811.59481037923 468.0 153787.09385614382 2.0 0.0 157465.01829268291 165131.570739549826120.0 172096.88704318934 187595.7541966427 185630.71806674334 183201.273652085421931.0 133772.61742757243 5.0 131334.20218947722 155578.6188811189 2.0 133017.2480620155 182216.631 0.0 174574.41216991964149995.43881027232 182171.95904095902 7.0
7 185708.33940774488 1040.0 187738.31270358307 1.0 182282.48766816143 182171.95904095902 182171.959040959020.0 150397.2807424594 5.0 20.0 0.0 182525.73333333334 1040.0 1.0 1965.0 906.0 167645.4123076923 0.0 0.0 192391.8022670025 181235.935975609752.0 0.0 0.0 162189.7051282051 0.0 1040.0 1.0 2008.0 177020.8800489596 141930.00455580864187523.8671023965 0.0 186782.0 1965.0 181982.57594936708 222601.05940594056 0.0 144619.2755267423 0.0 188146.7502726281 70.0 176473.2899159664 0.0 169688.48681389034 184737.95170142702182171.959040959020.0 134.0 182383.5220883534 141354.57177033494 185776.46347031964 182171.95904095902139811.59481037923 384.0 185063.63879957132 3.0 0.0 216426.0 165131.5707395498211200.0 150410.4464877228 187595.7541966427 185630.71806674334 183201.273652085421965.0 143540.98922651424 5.0 188334.07174392935 155578.6188811189 1.0 133017.2480620155 182216.631 0.0 174574.41216991964178321.97183098592 182171.95904095902 5.0
8 185708.33940774488 1175.0 187738.31270358307 1.0 182282.48766816143 225928.18076923073 182171.959040959020.0 226465.8274336283 11.0 60.0 286.0 182525.73333333334 2324.0 1.0 2006.0 998.0 167645.4123076923 2.0 1142.0 192391.8022670025 181235.935975609757.0 0.0 0.0 155487.09385614382 0.0 1182.0 3.0 2006.0 260380.61674771016 312352.66653056245187523.8671023965 0.0 186782.0 2005.0 181982.57594936708 222601.05940594056 0.0 348876.58744588745 0.0 188146.7502726281 85.0 176473.2899159664 147.0 153754.05472570908 184737.95170142702182171.959040959020.0 177.0 182383.5220883534 243708.832 185776.46347031964 182171.95904095902305958.08769176033 736.0 185063.63879957132 4.0 21.0 216426.0 209450.3942028985511924.0 236446.98648648648 187595.7541966427 185630.71806674334 183201.273652085422005.0 301677.8909715284 5.0 188334.07174392935 256064.37787676242 3.0 243875.54558028182 182216.631 0.0 263880.6876061438 210965.119205298 182171.95904095902 9.0
9 185708.33940774488 912.0 187738.31270358307 1.0 182282.48766816143 182171.95904095902 182171.959040959020.0 150397.2807424594 4.0 20.0 0.0 182525.73333333334 912.0 1.0 1962.0 737.0 167645.4123076923 0.0 0.0 192391.8022670025 181235.935975609759.0 176.0 0.0 162189.7051282051 0.0 912.0 1.0 2008.0 177020.8800489596 141930.00455580864187523.8671023965 0.0 186782.0 1962.0 181982.57594936708 222601.05940594056 0.0 144619.2755267423 0.0 188146.7502726281 70.59975669099757 176473.2899159664 140.0 172512.37104060987 184737.95170142702182171.959040959020.0 175.0 182383.5220883534 141354.57177033494 185776.46347031964 182171.95904095902139811.59481037923 352.0 185063.63879957132 2.0 0.0 141464.28231292518 220137.0973044197 12968.0 161782.77448994666 187595.7541966427 185630.71806674334 183201.273652085421962.0 143540.98922651424 6.0 188334.07174392935 155578.6188811189 1.0 133017.2480620155 182216.631 0.0 174574.41216991964178321.97183098592 182171.95904095902 5.0
--------------------------------------------------------------------------------
Imputed and encoded numeric validation data:
Rows:459
Cols:79


ExterCond_Tencode TotalBsmtSF Electrical_Tencode KitchenAbvGr LandContour_Tencode FireplaceQu_Tencode Alley_Tencode BsmtFinSF2 Foundation_Tencode TotRmsAbvGrd MSSubClass MasVnrArea Condition2_Tencode GrLivArea BsmtFullBath YearRemodAdd BsmtFinSF1 BsmtExposure_Tencode Fireplaces 2ndFlrSF MSZoning_Tencode RoofMatl_Tencode MoSold ScreenPorch PoolArea Exterior1st_Tencode 3SsnPorch 1stFlrSF FullBath YrSold SaleCondition_Tencode BsmtQual_Tencode PavedDrive_Tencode BsmtHalfBath CentralAir_Tencode GarageYrBlt LandSlope_Tencode RoofStyle_Tencode EnclosedPorch ExterQual_Tencode LowQualFinSF GarageCond_Tencode LotFrontage LotConfig_Tencode WoodDeckSF Exterior2nd_Tencode BsmtCond_Tencode Fence_Tencode MiscVal BsmtUnfSF Street_Tencode GarageFinish_Tencode Condition1_Tencode PoolQC_Tencode KitchenQual_Tencode GarageArea Functional_Tencode BedroomAbvGr OpenPorchSF HeatingQC_Tencode LotShape_Tencode LotArea BsmtFinType1_Tencode BldgType_Tencode BsmtFinType2_Tencode Heating_Tencode YearBuilt Neighborhood_Tencode OverallCond GarageQual_Tencode MasVnrType_Tencode GarageCars GarageType_Tencode Utilities_Tencode HalfBath SaleType_Tencode HouseStyle_Tencode MiscFeature_Tencode OverallQual
type real int real int real real real int real int int real real int int int int real int int real real int int int real int int int int real real real int real real real real int real int real real real int real real real int int real real real real real int real int int real real int real real real real int real int real real int real real int real real real int
mins 91754.02450980392 0.0 100143.52450980392 1.0 163075.56297134238 133191.52450980392 134607.547237076620.0 110363.31736694675 2.0 20.0 0.0 84954.02450980392 334.0 0.0 1950.0 0.0 161376.63366336632 0.0 0.0 118217.35784313723175904.024509803921.0 0.0 0.0 96429.02450980392 0.0 334.0 0.0 2006.0 143816.52450980392 134771.7517825312 114840.96895424835 0.0 111601.52450980392 1900.0 175531.83179723503 139864.02450980392 0.0 91042.14950980392 0.0 118776.94117647059 21.0 165751.57330498463 0.0 106204.02450980392 78579.02450980392 133419.962009803920.0 0.0 95579.02450980392 143948.79679144386 150223.0311764706 178193.4967320261 105130.89950980392 0.0 84954.02450980392 0.0 0.0 100679.02450980392 163981.4191419142 1491.0 146338.19117647054 128987.56617647059145091.52450980392 77729.02450980392 1872.0 112866.7168174962 1.0 134853.20367647058 131576.52450980392 0.0 111434.07450980392 178193.4967320261 0.0 107734.02450980392122402.59593837534 73479.02450980392 1.0
mean 178484.55631381093 1044.7603485838779179083.62772865137 1.0457516339869282 177854.22806185653 194587.7731541999 176164.9969256838 57.23529411764706179041.90369302404 6.529411764705882 56.4814814814814896.68340611353712178197.18104147978 1506.0043572984750.42265795206971681984.2701525054467439.36601307189545178366.110436157 0.5969498910675382358.3442265795207179328.32668845312177969.719434832756.23311546840958615.7102396514161221.411764705882353 179651.10523303002 3.30718954248366 1141.99128540305011.54466230936819172007.7886710239652177335.48292323467 179069.59942970652179002.9605814003 0.05228758169934641179115.18492887347 1977.9953051643192177815.9926203597 177381.1458157119 23.47276688453159 174940.2994916485 5.668845315904139184432.0126553889 68.85751978891821 178163.26637404418 101.15904139433552179728.60882139349 180413.2355397497 173941.1787702735 51.78649237472767 548.1590413943355178225.25931265755181122.03431372548 178617.62590029472 178198.69396030012177298.2844312017 463.1917211328976 178425.73264556366 2.856209150326797550.446623093681914180663.6615169379 176786.2223824170410273.808278867102180031.30962236744 178649.14910504507180587.69974155238 178371.048677858951969.0196078431372178193.49673202613 5.557734204793029184195.2038275876 176108.20460862629 1.710239651416122 185134.53079371178 178193.49673202608 0.38562091503267976177239.63702422145177648.76674783204 177409.66351972884 6.0
maxs 197862.35784313726 3200.0 184788.65617433414 2.0 252389.9995098039 345181.5245098039 180974.4445098039 1474.0 222366.88205128204 12.0 190.0 1600.0 302979.0245098039 3608.0 2.0 2009.0 1880.0 252970.21398348815 3.0 1611.0 219311.6970098039 296434.0245098039 12.0 480.0 648.0 230256.21200980392 407.0 3228.0 3.0 2010.0 255001.6042717087 287410.74022408965184063.06872037915 1.0 184861.0283687943 2009.0 219485.84269162212 205162.1274859944 301.0 311103.9129713424 572.0 187300.52567237162 182.0 221371.6687405731 857.0 237481.8022875817 204324.73418722322181956.919246646 8300.0 2336.0 178405.7096069869 223156.8495098039 311479.0245098039 180579.02450980392307728.63562091504 1248.0 181312.14950980392 6.0 547.0 211491.75330396474 257372.27450980392215245.0 224699.7863950498 183943.1995098039 194068.52450980392 179414.415730337122009.0 288359.0245098039 9.0 282791.5245098039 243111.468058191 4.0 243247.17284313726 178193.4967320261 2.0 255001.6042717087 221634.02450980392 188229.02450980392 10.0
sigma 12461.390436783056 412.0811851328444417731.970597652486 0.2091739611899642612704.546441754977 26261.653007678007 9343.377742370945 185.240010652032937636.63649998418 1.706878545585754542.51618219006454183.006592418819 7675.71672468966 537.10494366091060.516125042604655220.739310451691143431.4241433973325 27626.16956481009 0.6515613257699316444.585699914114622954.50756787530212445.8724128997532.76205442369920859.12791370210353430.24604981500501227697.042657464834 28.18457901138756373.0166882400161 0.54459315902805591.353066297207534525636.556448480504 44973.30052212846 17370.731330504437 0.2228492452574714 19717.249202290554 23.8354067943704039612.485004032442 13516.296484902436 61.32101817353126446704.676972640176 46.6608516349771311807.813469454739 20.33369576727011811574.452561519602 136.0428056028112826639.054892573466 13346.55064027858310548.08650865389 449.54109321577573436.03582789669873866.018585588162332859.958768536344 12058.531723299979 111.3469012372631 48579.93227209306 221.954985446370368139.874204543359 0.839148304865123472.74780631554772 31183.876623648637 21170.42264902131511072.98878572322427951.821767244168 11313.6862910715546894.848900014342 7482.963820995204 30.82351593092024447446.35307377432 1.16463541118628610759.770112055132 27404.304553567163 0.771294315166226630435.66812388826 2.5135516264537697e-110.5091844194507408 25705.64861904969421371.858060255647 5663.060039991695 1.4417359744722111
zeros 0 12 0 0 0 0 0 399 0 0 0 291 0 0 270 0 141 0 224 257 0 0 0 423 458 0 451 0 3 0 0 0 0 435 0 0 0 0 385 0 450 0 0 0 238 0 0 0 439 40 0 0 0 0 0 33 0 2 196 0 0 0 0 0 0 0 0 0 0 0 0 33 0 0 287 0 0 0 0
missing0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 180398.05693069307 756.0 184788.65617433414 1.0 175715.7828162291 219907.18575980392 178193.4967320261 0.0 144486.10784313726 7.0 70.0 0.0 178218.27472527474 1717.0 1.0 1970.0 216.0 161376.63366336632 1.0 756.0 187920.61064425771176671.8111111111 2.0 0.0 0.0 154595.81798806478 0.0 961.0 1.0 2006.0 147087.25059676042 138313.57142857142184063.06872037915 0.0 184861.0283687943 1998.0 175531.83179723503 171401.71038251367 272.0 143747.87889273354 0.0 187300.52567237162 60.0 165751.57330498463 0.0 180267.35784313726 204324.73418722322178193.4967320261 0.0 540.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 211880.81318681315 642.0 179857.76346604215 3.0 35.0 158961.70308123247 194850.585660883029550.0 169309.44117647054 181805.66321243523182592.86046511628 179414.415730337121915.0 216008.84593837534 5.0 185601.24938271602 157482.0 3.0 142532.16792065662 178193.4967320261 0.0 170822.7626262626 203633.455628685 178193.4967320261 7.0
1 180398.05693069307 1107.0 184788.65617433414 1.0 175715.7828162291 205118.42900418595 178193.4967320261 32.0 148549.72906403942 7.0 60.0 240.0 178218.27472527474 2090.0 1.0 1973.0 859.0 199413.65506535943 2.0 983.0 187920.61064425771176671.8111111111 11.0 0.0 0.0 167128.41844919784 0.0 1107.0 2.0 2009.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1973.0 175531.83179723503 171401.71038251367 228.0 143747.87889273354 0.0 187300.52567237162 68.85751978891821 165751.57330498463 235.0 169568.25527903467 181115.23 178193.4967320261 350.0 216.0 178405.7096069869 201271.56721053383 197366.52450980392 178193.4967320261 140285.62820512822 484.0 179857.76346604215 3.0 204.0 211491.75330396474 194850.5856608830210382.0 169309.44117647054 181805.66321243523156634.52450980392 179414.415730337121973.0 184610.14950980392 6.0 185601.24938271602 243111.468058191 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 203633.455628685 163465.69117647054 7.0
2 180398.05693069307 991.0 184788.65617433414 2.0 175715.7828162291 205118.42900418595 178193.4967320261 0.0 144486.10784313726 5.0 190.0 0.0 127029.02450980392 1077.0 1.0 1950.0 851.0 161376.63366336632 2.0 0.0 187920.61064425771176671.8111111111 1.0 0.0 0.0 151733.02861939298 0.0 1077.0 1.0 2008.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1939.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 50.0 165751.57330498463 0.0 151828.55059676044 181115.23 178193.4967320261 0.0 140.0 178405.7096069869 201271.56721053383 152316.52450980392 178193.4967320261 140285.62820512822 205.0 179857.76346604215 2.0 4.0 211491.75330396474 163981.4191419142 7420.0 224699.7863950498 128987.56617647059182592.86046511628 179414.415730337121939.0 129965.77450980392 6.0 194951.10784313726 157482.0 1.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 122402.59593837534 178193.4967320261 5.0
3 180398.05693069307 832.0 135344.4530812325 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 144486.10784313726 5.0 45.0 0.0 178218.27472527474 854.0 0.0 2001.0 0.0 161376.63366336632 0.0 0.0 132608.82714138282176671.8111111111 7.0 0.0 0.0 154595.81798806478 0.0 854.0 1.0 2007.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1991.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 51.0 165751.57330498463 48.0 163767.73719637108 181115.23 181956.919246646 0.0 832.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 140285.62820512822 576.0 179857.76346604215 2.0 112.0 211491.75330396474 163981.4191419142 6120.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121929.0 129965.77450980392 8.0 185601.24938271602 157482.0 2.0 142532.16792065662 178193.4967320261 0.0 170822.7626262626 122402.59593837534 178193.4967320261 7.0
4 180398.05693069307 1004.0 184788.65617433414 1.0 175715.7828162291 205118.42900418595 178193.4967320261 0.0 148549.72906403942 5.0 20.0 180.0 178218.27472527474 1004.0 1.0 1970.0 578.0 161376.63366336632 1.0 0.0 187920.61064425771176671.8111111111 3.0 0.0 0.0 154595.81798806478 0.0 1004.0 1.0 2010.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1970.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 68.85751978891821 221371.6687405731 0.0 163767.73719637108 181115.23 178193.4967320261 700.0 426.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 480.0 179857.76346604215 2.0 0.0 211491.75330396474 194850.5856608830211241.0 169309.44117647054 181805.66321243523182592.86046511628 179414.415730337121970.0 152080.32258672698 7.0 185601.24938271602 203114.2504640024 2.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 170914.57205240175 163465.69117647054 6.0
5 180398.05693069307 1114.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 222366.88205128204 6.0 20.0 0.0 178218.27472527474 1114.0 1.0 2004.0 646.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 6.0 0.0 0.0 206602.9363057325 0.0 1114.0 1.0 2008.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 2004.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 66.0 177919.81360946747 0.0 209302.39072847684 181115.23 178193.4967320261 0.0 468.0 178405.7096069869 143948.79679144386 150829.02450980392 178193.4967320261 211880.81318681315 576.0 179857.76346604215 3.0 102.0 211491.75330396474 163981.4191419142 13695.0 224699.7863950498 181805.66321243523182592.86046511628 179414.415730337122004.0 189097.7776348039 5.0 185601.24938271602 157482.0 2.0 142532.16792065662 178193.4967320261 1.0 170822.7626262626 170914.57205240175 178193.4967320261 5.0
6 180398.05693069307 637.0 100143.52450980392 1.0 163075.56297134238 219907.18575980392 134607.547237076620.0 222366.88205128204 6.0 45.0 0.0 178218.27472527474 1108.0 0.0 1950.0 0.0 161376.63366336632 1.0 0.0 132608.82714138282176671.8111111111 6.0 0.0 0.0 154595.81798806478 0.0 1108.0 1.0 2007.0 171302.3622047244 138313.57142857142114840.96895424835 0.0 184861.0283687943 1930.0 175531.83179723503 171401.71038251367 205.0 143747.87889273354 0.0 187300.52567237162 57.0 177919.81360946747 0.0 163767.73719637108 181115.23 181956.919246646 0.0 637.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 211880.81318681315 280.0 179857.76346604215 3.0 0.0 211491.75330396474 163981.4191419142 7449.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121930.0 112866.7168174962 7.0 185601.24938271602 157482.0 1.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 122402.59593837534 178193.4967320261 7.0
7 180398.05693069307 520.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 144486.10784313726 4.0 30.0 0.0 84954.02450980392 520.0 0.0 1950.0 0.0 161376.63366336632 0.0 0.0 132608.82714138282176671.8111111111 5.0 0.0 0.0 151733.02861939298 0.0 520.0 1.0 2008.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 111601.52450980392 1920.0 175531.83179723503 171401.71038251367 87.0 143747.87889273354 0.0 187300.52567237162 60.0 177919.81360946747 49.0 151828.55059676044 181115.23 178193.4967320261 0.0 520.0 178405.7096069869 143948.79679144386 150223.0311764706 178193.4967320261 105130.89950980392 240.0 179857.76346604215 1.0 0.0 127694.14950980392 194850.585660883026324.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121927.0 129965.77450980392 6.0 134853.20367647058 157482.0 1.0 142532.16792065662 178193.4967320261 0.0 170822.7626262626 170914.57205240175 178193.4967320261 4.0
8 180398.05693069307 1228.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 148549.72906403942 6.0 20.0 0.0 178218.27472527474 1228.0 0.0 2006.0 0.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 6.0 0.0 0.0 167128.41844919784 0.0 1228.0 1.0 2008.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1966.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 68.85751978891821 221371.6687405731 0.0 169568.25527903467 181115.23 151206.9049445865 0.0 1228.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 211880.81318681315 271.0 179857.76346604215 3.0 65.0 158961.70308123247 194850.585660883028544.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121966.0 143162.40700980392 6.0 185601.24938271602 157482.0 1.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 170914.57205240175 178193.4967320261 5.0
9 180398.05693069307 1097.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 222366.88205128204 6.0 20.0 0.0 178218.27472527474 1097.0 0.0 1995.0 0.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 6.0 0.0 0.0 206602.9363057325 0.0 1097.0 1.0 2009.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1995.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 112.0 165751.57330498463 392.0 209302.39072847684 181115.23 178193.4967320261 0.0 1097.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 140285.62820512822 672.0 179857.76346604215 3.0 64.0 211491.75330396474 163981.4191419142 10859.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121994.0 190019.77971813726 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 170914.57205240175 178193.4967320261 5.0
--------------------------------------------------------------------------------
Imputed and encoded numeric test data:
Rows:1459
Cols:79


ExterCond_Tencode TotalBsmtSF Electrical_Tencode KitchenAbvGr LandContour_Tencode FireplaceQu_Tencode Alley_Tencode BsmtFinSF2 Foundation_Tencode TotRmsAbvGrd MSSubClass MasVnrArea Condition2_Tencode GrLivArea BsmtFullBath YearRemodAdd BsmtFinSF1 BsmtExposure_Tencode Fireplaces 2ndFlrSF MSZoning_Tencode RoofMatl_Tencode MoSold ScreenPorch PoolArea Exterior1st_Tencode 3SsnPorch 1stFlrSF FullBath YrSold SaleCondition_Tencode BsmtQual_Tencode PavedDrive_Tencode BsmtHalfBath CentralAir_Tencode GarageYrBlt LandSlope_Tencode RoofStyle_Tencode EnclosedPorch ExterQual_Tencode LowQualFinSF GarageCond_Tencode LotFrontage LotConfig_Tencode WoodDeckSF Exterior2nd_Tencode BsmtCond_Tencode Fence_Tencode MiscVal BsmtUnfSF Street_Tencode GarageFinish_Tencode Condition1_Tencode PoolQC_Tencode KitchenQual_Tencode GarageArea Functional_Tencode BedroomAbvGr OpenPorchSF HeatingQC_Tencode LotShape_Tencode LotArea BsmtFinType1_Tencode BldgType_Tencode BsmtFinType2_Tencode Heating_Tencode YearBuilt Neighborhood_Tencode OverallCond GarageQual_Tencode MasVnrType_Tencode GarageCars GarageType_Tencode Utilities_Tencode HalfBath SaleType_Tencode HouseStyle_Tencode MiscFeature_Tencode OverallQual
type real real real int real real real real real int int real real int real int real real int int real real int int int real int int int int real real real real real real real real int real int real real real int real real real int real real real real real real real real int int real real int real real real real int real int real real real real real int real real real int
mins 91754.02450980392 0.0 100143.52450980392 0.0 163075.56297134238 133191.52450980392 134607.547237076620.0 110363.31736694675 3.0 20.0 0.0 127029.02450980392 407.0 0.0 1950.0 0.0 161376.63366336632 0.0 0.0 118217.35784313723175904.024509803921.0 0.0 0.0 96429.02450980392 0.0 407.0 0.0 2006.0 143816.52450980392 134771.7517825312 114840.96895424835 0.0 111601.52450980392 1895.0 175531.83179723503 139864.02450980392 0.0 91042.14950980392 0.0 118776.94117647059 21.0 165751.57330498463 0.0 106204.02450980392 78579.02450980392 133419.962009803920.0 0.0 95579.02450980392 143948.79679144386 150223.0311764706 178193.4967320261 105130.89950980392 0.0 84954.02450980392 0.0 0.0 100679.02450980392 163981.4191419142 1470.0 146338.19117647054 128987.56617647059145091.52450980392 77729.02450980392 1879.0 112866.7168174962 1.0 134853.20367647058 131576.52450980392 0.0 111434.07450980392 178193.4967320261 0.0 107734.02450980392122402.59593837534 73479.02450980392 1.0
mean 178138.29247727426 1046.1179698216736180126.1193152811 1.0424948594928032 179174.226337526 194452.82035270397 176172.8514977089752.61934156378601 181006.2901857593 6.385195339273475 57.37834132967786100.70914127423823178369.39980873463 1486.04592186429070.43445435827041861983.6627827278958439.2037037037037 179354.8610184363 0.5812200137080192325.9677861549006179232.09043019178176751.753206153376.10418094585332417.0644276901987661.7443454420836186179810.686881209 1.7943797121315971156.5346127484581.570938999314599 2007.7697052775875176492.09637795313 181062.10689687656177090.15440559445 0.06520247083047358179789.60281035837 1977.7212165097756177395.21920765378 177370.7037166422 24.24331734064427177673.68837649448 3.5435229609321452184620.93755108098 68.58035714285714 178278.00897433652 93.17477724468814 180995.23531825157 179283.61725237884174246.9783571091 58.16792323509253554.2949245541838 178065.09267032953180987.1789957136 179939.77372747526 178193.4967320261 179340.3962464452 472.7688614540466 178383.03720943845 2.854009595613433748.3139136394791 182227.81273899964 176844.0836371834 9819.161069225496182091.99147253158 178370.36965515942180689.57815766838 179140.348339493621971.357779300891179660.9318538107 5.5538039753255655182567.66333366183 178207.07986924512 1.7661179698216736186339.7089378328 178193.4967320261 0.3776559287183002175933.10715345875176296.0327526845 177606.24421888925 6.078821110349555
maxs 197862.35784313726 5095.0 184788.65617433414 2.0 252389.9995098039 345181.5245098039 180974.4445098039 1526.0 222366.88205128204 15.0 190.0 1290.0 302979.0245098039 5095.0 3.0 2010.0 4010.0 252970.21398348815 4.0 1862.0 219311.6970098039 296434.0245098039 12.0 576.0 800.0 230256.21200980392 360.0 5095.0 4.0 2010.0 255001.6042717087 287410.74022408965184063.06872037915 2.0 184861.0283687943 2207.0 219485.84269162212 205162.1274859944 1012.0 311103.9129713424 1064.0 187300.52567237162 200.0 221371.6687405731 1424.0 237481.8022875817 204324.73418722322181956.919246646 17000.0 2140.0 178405.7096069869 223156.8495098039 311479.0245098039 178193.4967320261 307728.63562091504 1488.0 181312.14950980392 6.0 742.0 211491.75330396474 257372.2745098039256600.0 224699.7863950498 183943.1995098039 194068.52450980392 179414.415730337122010.0 288359.0245098039 9.0 194951.10784313726 243111.468058191 5.0 243247.17284313726 178193.4967320261 2.0 255001.6042717087 203633.455628685 188229.02450980392 10.0
sigma 13372.26174917729 442.7467124418268 15963.223969023631 0.2084716721132495716731.14952435502 26907.81955497986 9344.441064269215 176.6933005286070738032.67490944731 1.508894575192540942.74687961871821176.709824372394026115.23069917075 485.5660986532533 0.530283455023205221.130466908170447455.1118876132698628882.71553690542 0.6474204530720101420.610226469103423489.4065731974663137.23596097321572.72243190125080656.60976290691055430.49164630534206627215.585184717398 20.2078417514965 398.165819592379 0.55518988803566121.301740149380264324614.448808109904 46910.28684795173520263.256532577616 0.2522950420673912 18602.363953739645 25.7144505812253538806.028004426134 13409.559779876743 67.2277654195696948363.331700835224 44.04325086437556511764.269564905075 20.56122785671849211456.730191238737 127.7448815190760325951.286853243677 13660.62136447893 9594.992921526902 630.806977589708 437.110507934869255302.397777524548 33850.87496256971 15269.946772589561 5.126500680162683e-1250064.36965926004 216.974164680402857764.753398575106 0.829788362735451168.8833641131539730689.890057024284 19890.63718996989 4955.51732692645 28488.122976770395 11421.9222903730926944.959535831843 4120.712522628475 30.3900708372052948658.82908689111 1.113739603289208211447.223084004698 28422.54135345877 0.775678926349497830059.124281346794 5.126500680162683e-120.503016676941585824826.25863986618 20533.377591439952 4663.358457904923 1.4368116404730185
zeros 0 41 0 2 0 0 0 1278 0 0 0 877 0 0 849 0 462 0 730 839 0 0 0 1319 1453 0 1446 0 3 0 0 0 0 1364 0 0 0 0 1208 0 1445 0 0 0 762 0 0 0 1408 123 0 0 0 0 0 76 0 2 642 0 0 0 0 0 0 0 0 0 0 0 0 76 0 0 921 0 0 0 0
missing0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 180398.05693069307 882.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 144.0 148549.72906403942 5.0 20.0 0.0 178218.27472527474 896.0 0.0 1961.0 468.0 161376.63366336632 0.0 0.0 134962.35784313726176671.8111111111 6.0 120.0 0.0 206602.9363057325 0.0 896.0 1.0 2010.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1961.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 80.0 177919.81360946747 140.0 209302.39072847684 181115.23 151206.9049445865 0.0 270.0 178405.7096069869 143948.79679144386 150223.0311764706 178193.4967320261 140285.62820512822 730.0 179857.76346604215 2.0 0.0 149413.2797336845 163981.4191419142 11622.0 156012.9060887513 181805.66321243523168862.10143288082 179414.415730337121961.0 152080.32258672698 6.0 185601.24938271602 157482.0 1.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 170914.57205240175 178193.4967320261 5.0
1 180398.05693069307 1329.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 148549.72906403942 6.0 20.0 108.0 178218.27472527474 1329.0 0.0 1958.0 923.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 6.0 0.0 0.0 154595.81798806478 0.0 1329.0 1.0 2010.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1958.0 175531.83179723503 205162.1274859944 0.0 143747.87889273354 0.0 187300.52567237162 81.0 165751.57330498463 393.0 163767.73719637108 181115.23 178193.4967320261 12500.0 406.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 211880.81318681315 312.0 179857.76346604215 3.0 36.0 149413.2797336845 194850.5856608830214267.0 169309.44117647054 181805.66321243523182592.86046511628 179414.415730337121958.0 152080.32258672698 6.0 185601.24938271602 203114.2504640024 1.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 170914.57205240175 188229.02450980392 6.0
2 180398.05693069307 928.0 184788.65617433414 1.0 175715.7828162291 205118.42900418595 178193.4967320261 0.0 222366.88205128204 6.0 60.0 0.0 178218.27472527474 1629.0 0.0 1998.0 791.0 161376.63366336632 1.0 701.0 187920.61064425771176671.8111111111 3.0 0.0 0.0 206602.9363057325 0.0 928.0 2.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1997.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 74.0 177919.81360946747 212.0 209302.39072847684 181115.23 151206.9049445865 0.0 137.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 482.0 179857.76346604215 3.0 34.0 158961.70308123247 194850.5856608830213830.0 224699.7863950498 181805.66321243523182592.86046511628 179414.415730337121997.0 191808.05969498912 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 203633.455628685 178193.4967320261 5.0
3 180398.05693069307 926.0 184788.65617433414 1.0 175715.7828162291 219907.18575980392 178193.4967320261 0.0 222366.88205128204 7.0 60.0 20.0 178218.27472527474 1604.0 0.0 1998.0 602.0 161376.63366336632 1.0 678.0 187920.61064425771176671.8111111111 6.0 0.0 0.0 206602.9363057325 0.0 926.0 2.0 2010.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1998.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 78.0 177919.81360946747 360.0 209302.39072847684 181115.23 178193.4967320261 0.0 324.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 211880.81318681315 470.0 179857.76346604215 3.0 36.0 211491.75330396474 194850.585660883029978.0 224699.7863950498 181805.66321243523182592.86046511628 179414.415730337121998.0 191808.05969498912 6.0 185601.24938271602 203114.2504640024 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 203633.455628685 178193.4967320261 6.0
4 180398.05693069307 1280.0 184788.65617433414 1.0 252389.9995098039 178193.4967320261 178193.4967320261 0.0 222366.88205128204 5.0 120.0 0.0 178218.27472527474 1280.0 0.0 1992.0 263.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 1.0 144.0 0.0 167128.41844919784 0.0 1280.0 2.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1992.0 175531.83179723503 171401.71038251367 0.0 228065.58659034083 0.0 187300.52567237162 43.0 177919.81360946747 0.0 169568.25527903467 181115.23 178193.4967320261 0.0 1017.0 178405.7096069869 201271.56721053383 181573.27604166663 178193.4967320261 211880.81318681315 506.0 179857.76346604215 2.0 82.0 211491.75330396474 194850.585660883025005.0 169309.44117647054 183943.1995098039 182592.86046511628 179414.415730337121992.0 288359.0245098039 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 170914.57205240175 178193.4967320261 8.0
5 180398.05693069307 763.0 184788.65617433414 1.0 175715.7828162291 205118.42900418595 178193.4967320261 0.0 222366.88205128204 7.0 60.0 0.0 178218.27472527474 1655.0 0.0 1994.0 0.0 161376.63366336632 1.0 892.0 187920.61064425771176671.8111111111 4.0 0.0 0.0 167128.41844919784 0.0 763.0 2.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1993.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 75.0 165751.57330498463 157.0 169568.25527903467 181115.23 178193.4967320261 0.0 763.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 440.0 179857.76346604215 3.0 84.0 158961.70308123247 194850.5856608830210000.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121993.0 191808.05969498912 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 203633.455628685 178193.4967320261 6.0
6 179370.36597321855 1168.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 0.0 222366.88205128204 6.0 20.0 0.0 178218.27472527474 1187.0 1.0 2007.0 935.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 3.0 0.0 0.0 167128.41844919784 0.0 1187.0 2.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1992.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 68.58035714285714 177919.81360946747 483.0 169568.25527903467 181115.23 181956.919246646 500.0 233.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 420.0 179857.76346604215 3.0 21.0 211491.75330396474 194850.585660883027980.0 169309.44117647054 181805.66321243523182592.86046511628 179414.415730337121992.0 191808.05969498912 7.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 170914.57205240175 163465.69117647054 6.0
7 180398.05693069307 789.0 184788.65617433414 1.0 175715.7828162291 219907.18575980392 178193.4967320261 0.0 222366.88205128204 7.0 60.0 0.0 178218.27472527474 1465.0 0.0 1998.0 0.0 161376.63366336632 1.0 676.0 187920.61064425771176671.8111111111 5.0 0.0 0.0 206602.9363057325 0.0 789.0 2.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1998.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 63.0 177919.81360946747 0.0 209302.39072847684 181115.23 178193.4967320261 0.0 789.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 393.0 179857.76346604215 3.0 75.0 158961.70308123247 194850.585660883028402.0 168970.1659826721 181805.66321243523182592.86046511628 179414.415730337121998.0 191808.05969498912 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 203633.455628685 178193.4967320261 6.0
8 180398.05693069307 1300.0 184788.65617433414 1.0 175715.7828162291 133191.52450980392 178193.4967320261 0.0 222366.88205128204 5.0 20.0 0.0 178218.27472527474 1341.0 1.0 1990.0 637.0 252970.21398348815 1.0 0.0 187920.61064425771176671.8111111111 2.0 0.0 0.0 167128.41844919784 0.0 1341.0 1.0 2010.0 171302.3622047244 206633.03141361254184063.06872037915 0.0 184861.0283687943 1990.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 85.0 177919.81360946747 192.0 169568.25527903467 181115.23 178193.4967320261 0.0 663.0 178405.7096069869 143948.79679144386 181573.27604166663 178193.4967320261 211880.81318681315 506.0 179857.76346604215 2.0 0.0 158961.70308123247 163981.4191419142 10176.0 224699.7863950498 181805.66321243523182592.86046511628 179414.415730337121990.0 191808.05969498912 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 1.0 170822.7626262626 170914.57205240175 178193.4967320261 7.0
9 180398.05693069307 882.0 184788.65617433414 1.0 175715.7828162291 178193.4967320261 178193.4967320261 78.0 148549.72906403942 4.0 20.0 0.0 178218.27472527474 882.0 1.0 1970.0 804.0 161376.63366336632 0.0 0.0 187920.61064425771176671.8111111111 4.0 0.0 0.0 173812.54638480392 0.0 882.0 1.0 2010.0 171302.3622047244 138313.57142857142184063.06872037915 0.0 184861.0283687943 1970.0 175531.83179723503 171401.71038251367 0.0 143747.87889273354 0.0 187300.52567237162 70.0 165751.57330498463 240.0 163573.83733031675 181115.23 151206.9049445865 0.0 0.0 178405.7096069869 223156.8495098039 181573.27604166663 178193.4967320261 140285.62820512822 525.0 179857.76346604215 2.0 0.0 149413.2797336845 163981.4191419142 8400.0 169309.44117647054 181805.66321243523167901.0383986928 179414.415730337121970.0 152080.32258672698 5.0 185601.24938271602 157482.0 2.0 201051.3968871595 178193.4967320261 0.0 170822.7626262626 170914.57205240175 178193.4967320261 4.0

In [133]:
# Check Neighborhood_Tencode

print(test[0:5, ['Neighborhood', 'Neighborhood_Tencode']])
_, _ = target_encoder(valid, test, 'Neighborhood', 'SalePrice', test=True)
del _

# NAmes   152080
# NAmes   152080
# Gilbert 191808
# Gilbert 191808
# StoneBr 288359


Neighborhood Neighborhood_Tencode
NAmes 152080
NAmes 152080
Gilbert 191808
Gilbert 191808
StoneBr 288359
{'Crawfor': 216008.84593837534, 'NAmes': 152080.32258672698, 'BrkSide': 129965.77450980392, 'ClearCr': 207949.02450980392, nan: 178193.49673202613, 'NridgHt': 284073.1545098039, 'Veenker': 243734.02450980392, 'IDOTRR': 112866.71681749621, 'NWAmes': 184610.14950980392, 'Mitchel': 169316.52450980392, 'BrDale': 116064.02450980392, 'MeadowV': 113131.52450980392, 'Sawyer': 143162.40700980392, 'Blmngtn': 210845.6545098039, 'Edwards': 126241.13989441929, 'NPkVill': 147641.52450980392, 'CollgCr': 190019.77971813726, 'Timber': 260109.74673202613, 'Somerst': 227656.9671023965, 'SWISU': 156269.02450980392, 'SawyerW': 189097.7776348039, 'StoneBr': 288359.0245098039, 'OldTown': 139863.03613771088, 'Gilbert': 191808.0596949891, 'NoRidge': 273948.2552790347}

Create combination features


In [134]:
def feature_combiner(training_frame, test_frame, nums):
    
    """ Combines numeric features using simple arithmatic operations.
    
    :param training_frame: Training frame from which to generate features and onto which generated 
                           feeatures will be cbound.
    :param test_frame: Test frame from which to generate features and onto which generated 
                       feeatures will be cbound.
    :param nums: List of original numeric features from which to generate combined features.
    
    """

    total = len(nums)
    
    # convert to pandas
    train_df = training_frame.as_data_frame()
    test_df = test_frame.as_data_frame()
    
    for i, col_i in enumerate(nums):
        
        print('Combining: ' + col_i + ' (' + str(i+1) + '/' + str(total) + ') ...')        
        
        for j, col_j in enumerate(nums):
            
            # don't repeat (i*j = j*i)
            if i < j:
                
                # convert to pandas
                col_i_train_df = train_df[col_i]
                col_j_train_df = train_df[col_j]
                col_i_test_df = test_df[col_i]
                col_j_test_df = test_df[col_j] 

                # multiply, convert back to h2o
                train_df[str(col_i + '|' + col_j)] = col_i_train_df.values*col_j_train_df.values
                test_df[str(col_i + '|' + col_j)] = col_i_test_df.values*col_j_test_df.values
                
    print('Done.')
    
    # convert back to h2o
    
    print('Converting to H2OFrame ...')
    
    training_frame = h2o.H2OFrame(train_df)
    training_frame.columns = list(train_df)
    test_frame = h2o.H2OFrame(test_df)
    test_frame.columns = list(test_df)
    
    print('Done.')
    print()
    
    # conserve memory 
    del train_df
    del test_df 
    
    return training_frame, test_frame

In [135]:
train, _ = feature_combiner(train, test, encoded_nums)
valid, test = feature_combiner(valid, test, encoded_nums)


Combining: ExterCond_Tencode (1/79) ...
Combining: TotalBsmtSF (2/79) ...
Combining: Electrical_Tencode (3/79) ...
Combining: KitchenAbvGr (4/79) ...
Combining: LandContour_Tencode (5/79) ...
Combining: FireplaceQu_Tencode (6/79) ...
Combining: Alley_Tencode (7/79) ...
Combining: BsmtFinSF2 (8/79) ...
Combining: Foundation_Tencode (9/79) ...
Combining: TotRmsAbvGrd (10/79) ...
Combining: MSSubClass (11/79) ...
Combining: MasVnrArea (12/79) ...
Combining: Condition2_Tencode (13/79) ...
Combining: GrLivArea (14/79) ...
Combining: BsmtFullBath (15/79) ...
Combining: YearRemodAdd (16/79) ...
Combining: BsmtFinSF1 (17/79) ...
Combining: BsmtExposure_Tencode (18/79) ...
Combining: Fireplaces (19/79) ...
Combining: 2ndFlrSF (20/79) ...
Combining: MSZoning_Tencode (21/79) ...
Combining: RoofMatl_Tencode (22/79) ...
Combining: MoSold (23/79) ...
Combining: ScreenPorch (24/79) ...
Combining: PoolArea (25/79) ...
Combining: Exterior1st_Tencode (26/79) ...
Combining: 3SsnPorch (27/79) ...
Combining: 1stFlrSF (28/79) ...
Combining: FullBath (29/79) ...
Combining: YrSold (30/79) ...
Combining: SaleCondition_Tencode (31/79) ...
Combining: BsmtQual_Tencode (32/79) ...
Combining: PavedDrive_Tencode (33/79) ...
Combining: BsmtHalfBath (34/79) ...
Combining: CentralAir_Tencode (35/79) ...
Combining: GarageYrBlt (36/79) ...
Combining: LandSlope_Tencode (37/79) ...
Combining: RoofStyle_Tencode (38/79) ...
Combining: EnclosedPorch (39/79) ...
Combining: ExterQual_Tencode (40/79) ...
Combining: LowQualFinSF (41/79) ...
Combining: GarageCond_Tencode (42/79) ...
Combining: LotFrontage (43/79) ...
Combining: LotConfig_Tencode (44/79) ...
Combining: WoodDeckSF (45/79) ...
Combining: Exterior2nd_Tencode (46/79) ...
Combining: BsmtCond_Tencode (47/79) ...
Combining: Fence_Tencode (48/79) ...
Combining: MiscVal (49/79) ...
Combining: BsmtUnfSF (50/79) ...
Combining: Street_Tencode (51/79) ...
Combining: GarageFinish_Tencode (52/79) ...
Combining: Condition1_Tencode (53/79) ...
Combining: PoolQC_Tencode (54/79) ...
Combining: KitchenQual_Tencode (55/79) ...
Combining: GarageArea (56/79) ...
Combining: Functional_Tencode (57/79) ...
Combining: BedroomAbvGr (58/79) ...
Combining: OpenPorchSF (59/79) ...
Combining: HeatingQC_Tencode (60/79) ...
Combining: LotShape_Tencode (61/79) ...
Combining: LotArea (62/79) ...
Combining: BsmtFinType1_Tencode (63/79) ...
Combining: BldgType_Tencode (64/79) ...
Combining: BsmtFinType2_Tencode (65/79) ...
Combining: Heating_Tencode (66/79) ...
Combining: YearBuilt (67/79) ...
Combining: Neighborhood_Tencode (68/79) ...
Combining: OverallCond (69/79) ...
Combining: GarageQual_Tencode (70/79) ...
Combining: MasVnrType_Tencode (71/79) ...
Combining: GarageCars (72/79) ...
Combining: GarageType_Tencode (73/79) ...
Combining: Utilities_Tencode (74/79) ...
Combining: HalfBath (75/79) ...
Combining: SaleType_Tencode (76/79) ...
Combining: HouseStyle_Tencode (77/79) ...
Combining: MiscFeature_Tencode (78/79) ...
Combining: OverallQual (79/79) ...
Done.
Converting to H2OFrame ...
Done.

Combining: ExterCond_Tencode (1/79) ...
Combining: TotalBsmtSF (2/79) ...
Combining: Electrical_Tencode (3/79) ...
Combining: KitchenAbvGr (4/79) ...
Combining: LandContour_Tencode (5/79) ...
Combining: FireplaceQu_Tencode (6/79) ...
Combining: Alley_Tencode (7/79) ...
Combining: BsmtFinSF2 (8/79) ...
Combining: Foundation_Tencode (9/79) ...
Combining: TotRmsAbvGrd (10/79) ...
Combining: MSSubClass (11/79) ...
Combining: MasVnrArea (12/79) ...
Combining: Condition2_Tencode (13/79) ...
Combining: GrLivArea (14/79) ...
Combining: BsmtFullBath (15/79) ...
Combining: YearRemodAdd (16/79) ...
Combining: BsmtFinSF1 (17/79) ...
Combining: BsmtExposure_Tencode (18/79) ...
Combining: Fireplaces (19/79) ...
Combining: 2ndFlrSF (20/79) ...
Combining: MSZoning_Tencode (21/79) ...
Combining: RoofMatl_Tencode (22/79) ...
Combining: MoSold (23/79) ...
Combining: ScreenPorch (24/79) ...
Combining: PoolArea (25/79) ...
Combining: Exterior1st_Tencode (26/79) ...
Combining: 3SsnPorch (27/79) ...
Combining: 1stFlrSF (28/79) ...
Combining: FullBath (29/79) ...
Combining: YrSold (30/79) ...
Combining: SaleCondition_Tencode (31/79) ...
Combining: BsmtQual_Tencode (32/79) ...
Combining: PavedDrive_Tencode (33/79) ...
Combining: BsmtHalfBath (34/79) ...
Combining: CentralAir_Tencode (35/79) ...
Combining: GarageYrBlt (36/79) ...
Combining: LandSlope_Tencode (37/79) ...
Combining: RoofStyle_Tencode (38/79) ...
Combining: EnclosedPorch (39/79) ...
Combining: ExterQual_Tencode (40/79) ...
Combining: LowQualFinSF (41/79) ...
Combining: GarageCond_Tencode (42/79) ...
Combining: LotFrontage (43/79) ...
Combining: LotConfig_Tencode (44/79) ...
Combining: WoodDeckSF (45/79) ...
Combining: Exterior2nd_Tencode (46/79) ...
Combining: BsmtCond_Tencode (47/79) ...
Combining: Fence_Tencode (48/79) ...
Combining: MiscVal (49/79) ...
Combining: BsmtUnfSF (50/79) ...
Combining: Street_Tencode (51/79) ...
Combining: GarageFinish_Tencode (52/79) ...
Combining: Condition1_Tencode (53/79) ...
Combining: PoolQC_Tencode (54/79) ...
Combining: KitchenQual_Tencode (55/79) ...
Combining: GarageArea (56/79) ...
Combining: Functional_Tencode (57/79) ...
Combining: BedroomAbvGr (58/79) ...
Combining: OpenPorchSF (59/79) ...
Combining: HeatingQC_Tencode (60/79) ...
Combining: LotShape_Tencode (61/79) ...
Combining: LotArea (62/79) ...
Combining: BsmtFinType1_Tencode (63/79) ...
Combining: BldgType_Tencode (64/79) ...
Combining: BsmtFinType2_Tencode (65/79) ...
Combining: Heating_Tencode (66/79) ...
Combining: YearBuilt (67/79) ...
Combining: Neighborhood_Tencode (68/79) ...
Combining: OverallCond (69/79) ...
Combining: GarageQual_Tencode (70/79) ...
Combining: MasVnrType_Tencode (71/79) ...
Combining: GarageCars (72/79) ...
Combining: GarageType_Tencode (73/79) ...
Combining: Utilities_Tencode (74/79) ...
Combining: HalfBath (75/79) ...
Combining: SaleType_Tencode (76/79) ...
Combining: HouseStyle_Tencode (77/79) ...
Combining: MiscFeature_Tencode (78/79) ...
Combining: OverallQual (79/79) ...
Done.
Converting to H2OFrame ...
Done.

Redefine numerics and explore


In [136]:
encoded_combined_nums, cats = get_type_lists(frame=train)


Numeric = ['FullBath|OverallQual', 'Neighborhood_Tencode|HalfBath', 'MasVnrArea|GarageArea', 'TotRmsAbvGrd|ExterQual_Tencode', 'BsmtFullBath|Exterior1st_Tencode', 'PoolArea|HouseStyle_Tencode', 'MSSubClass|GarageArea', 'BsmtFullBath|Neighborhood_Tencode', 'ExterCond_Tencode|GarageCars', 'BsmtFinSF2|LandSlope_Tencode', 'TotalBsmtSF|GarageCars', 'BsmtFullBath|Fence_Tencode', 'TotalBsmtSF|YearBuilt', 'Condition2_Tencode|GarageQual_Tencode', 'ScreenPorch|BedroomAbvGr', 'ExterQual_Tencode|GarageType_Tencode', 'MasVnrArea|PoolArea', 'Fireplaces|BedroomAbvGr', 'Foundation_Tencode|GarageYrBlt', 'GarageFinish_Tencode|BedroomAbvGr', 'BsmtHalfBath|BsmtFinType1_Tencode', 'ExterCond_Tencode|BsmtFinSF2', 'ExterCond_Tencode|HouseStyle_Tencode', 'BsmtFullBath|RoofMatl_Tencode', 'MoSold|PoolArea', 'BsmtExposure_Tencode|RoofMatl_Tencode', 'MSSubClass|MasVnrType_Tencode', 'MSZoning_Tencode', 'Condition2_Tencode|SaleCondition_Tencode', 'Alley_Tencode|YearBuilt', 'PoolArea|Fence_Tencode', 'CentralAir_Tencode|OverallQual', 'YrSold|Utilities_Tencode', 'SaleCondition_Tencode|BedroomAbvGr', 'HeatingQC_Tencode|LotArea', 'KitchenQual_Tencode|GarageType_Tencode', 'MSSubClass|YearRemodAdd', 'FireplaceQu_Tencode|HeatingQC_Tencode', 'GarageCond_Tencode|LotFrontage', 'BsmtExposure_Tencode|CentralAir_Tencode', 'FullBath|OverallCond', 'RoofMatl_Tencode|MiscFeature_Tencode', 'Fireplaces|BsmtQual_Tencode', 'Functional_Tencode|BldgType_Tencode', 'FireplaceQu_Tencode|GarageType_Tencode', 'Exterior1st_Tencode|1stFlrSF', 'BsmtFinSF2|GarageYrBlt', 'MiscFeature_Tencode|OverallQual', 'YearRemodAdd|BsmtCond_Tencode', 'KitchenAbvGr|BsmtFullBath', 'Street_Tencode|HalfBath', 'BsmtUnfSF|Street_Tencode', 'Fireplaces|RoofMatl_Tencode', 'BsmtFinSF2|HalfBath', 'MasVnrArea|2ndFlrSF', 'KitchenQual_Tencode|Heating_Tencode', 'SaleCondition_Tencode|KitchenQual_Tencode', 'TotalBsmtSF|Condition2_Tencode', 'BsmtFinSF2|MSSubClass', 'BsmtQual_Tencode|GarageType_Tencode', 'FullBath|CentralAir_Tencode', 'GarageType_Tencode|OverallQual', 'MoSold|1stFlrSF', 'Alley_Tencode|3SsnPorch', 'Electrical_Tencode|Foundation_Tencode', 'KitchenAbvGr|KitchenQual_Tencode', 'BsmtFullBath|GarageQual_Tencode', 'MSSubClass|PoolArea', 'LandSlope_Tencode|Street_Tencode', 'BsmtFinSF1|Utilities_Tencode', 'BsmtFinSF1|LotShape_Tencode', 'BsmtFinSF2|LotArea', 'HeatingQC_Tencode', 'MSSubClass|ExterQual_Tencode', 'TotalBsmtSF|PavedDrive_Tencode', 'BldgType_Tencode|BsmtFinType2_Tencode', 'RoofMatl_Tencode|RoofStyle_Tencode', 'BsmtCond_Tencode|Fence_Tencode', 'MasVnrArea|YearBuilt', 'LotConfig_Tencode|YearBuilt', 'BsmtFullBath|GarageYrBlt', 'Exterior1st_Tencode|SaleCondition_Tencode', 'LandContour_Tencode|RoofMatl_Tencode', 'Electrical_Tencode|MSSubClass', 'BsmtFinSF2|2ndFlrSF', 'BsmtExposure_Tencode|Fence_Tencode', 'SaleCondition_Tencode|HalfBath', 'GarageArea|BsmtFinType1_Tencode', 'TotalBsmtSF|YearRemodAdd', 'MSZoning_Tencode|YearBuilt', 'BsmtFinSF1|GarageCond_Tencode', 'ExterCond_Tencode|OverallCond', 'YearRemodAdd|BsmtHalfBath', 'RoofStyle_Tencode|BsmtFinType1_Tencode', 'BsmtFinType1_Tencode|HalfBath', 'Condition2_Tencode|CentralAir_Tencode', 'YearRemodAdd|LotArea', 'TotRmsAbvGrd|LandSlope_Tencode', 'BsmtFinSF2', 'TotalBsmtSF|MasVnrArea', 'MoSold|LowQualFinSF', 'FireplaceQu_Tencode|MSSubClass', 'Exterior1st_Tencode|KitchenQual_Tencode', 'BsmtUnfSF|HeatingQC_Tencode', 'BsmtFinSF2|FullBath', 'BsmtFullBath|BsmtFinType1_Tencode', '1stFlrSF|GarageCond_Tencode', 'GarageYrBlt|BldgType_Tencode', 'Foundation_Tencode|Functional_Tencode', 'ScreenPorch|LotFrontage', 'LowQualFinSF|Heating_Tencode', 'ExterCond_Tencode|TotalBsmtSF', 'CentralAir_Tencode|LotShape_Tencode', 'ExterCond_Tencode|Condition1_Tencode', 'BedroomAbvGr|Neighborhood_Tencode', '2ndFlrSF|ExterQual_Tencode', 'GarageCars|Utilities_Tencode', 'Exterior2nd_Tencode|MasVnrType_Tencode', 'BsmtFinSF1|FullBath', 'Condition1_Tencode|GarageArea', 'KitchenQual_Tencode|YearBuilt', 'ScreenPorch|KitchenQual_Tencode', 'Electrical_Tencode|HalfBath', 'Foundation_Tencode|LowQualFinSF', 'YrSold|Street_Tencode', 'GarageYrBlt|GarageCars', 'TotRmsAbvGrd|GarageCond_Tencode', '1stFlrSF|Neighborhood_Tencode', 'FireplaceQu_Tencode|PoolQC_Tencode', '1stFlrSF|GarageArea', 'BsmtFinType2_Tencode|MasVnrType_Tencode', 'BsmtCond_Tencode|BsmtFinType1_Tencode', 'GarageFinish_Tencode|Functional_Tencode', 'BsmtFinType1_Tencode|OverallCond', 'Exterior2nd_Tencode|MiscVal', 'BsmtFullBath|Heating_Tencode', 'ExterQual_Tencode', 'Alley_Tencode|Foundation_Tencode', 'GrLivArea|FullBath', 'Alley_Tencode|LotShape_Tencode', 'GrLivArea|Exterior1st_Tencode', 'MiscVal|GarageQual_Tencode', 'LotConfig_Tencode|LotArea', 'Foundation_Tencode|MasVnrType_Tencode', 'GrLivArea|BsmtHalfBath', 'MoSold|Condition1_Tencode', 'MasVnrArea|BsmtHalfBath', 'BsmtUnfSF', 'Electrical_Tencode|LandContour_Tencode', 'MSZoning_Tencode|GarageType_Tencode', 'BsmtExposure_Tencode|LandSlope_Tencode', 'Alley_Tencode|YrSold', 'LotConfig_Tencode|MasVnrType_Tencode', 'GarageArea|OverallCond', 'BsmtCond_Tencode|HouseStyle_Tencode', 'BsmtExposure_Tencode|PavedDrive_Tencode', 'TotRmsAbvGrd|Heating_Tencode', '1stFlrSF|Condition1_Tencode', 'Neighborhood_Tencode|GarageCars', 'MSSubClass|3SsnPorch', 'SaleCondition_Tencode|MasVnrType_Tencode', 'SaleCondition_Tencode|BldgType_Tencode', 'RoofStyle_Tencode|GarageQual_Tencode', 'MSZoning_Tencode|OverallCond', 'ExterCond_Tencode|OverallQual', 'BsmtHalfBath|HalfBath', 'BsmtFinType1_Tencode', 'GrLivArea|LotFrontage', 'RoofStyle_Tencode|LotConfig_Tencode', 'CentralAir_Tencode|KitchenQual_Tencode', 'SaleType_Tencode|OverallQual', 'TotalBsmtSF|HalfBath', 'LotFrontage|GarageType_Tencode', 'FireplaceQu_Tencode|SaleCondition_Tencode', 'Alley_Tencode|LowQualFinSF', 'WoodDeckSF|Heating_Tencode', 'Exterior1st_Tencode|GarageArea', 'BsmtHalfBath|EnclosedPorch', 'ScreenPorch|HeatingQC_Tencode', 'Foundation_Tencode|TotRmsAbvGrd', 'FireplaceQu_Tencode|BedroomAbvGr', 'Fireplaces|PoolQC_Tencode', 'ScreenPorch|BsmtUnfSF', 'BsmtFinSF2|Condition1_Tencode', 'ExterCond_Tencode', 'ExterCond_Tencode|BsmtUnfSF', 'YearRemodAdd|MiscFeature_Tencode', '1stFlrSF|OverallCond', 'MoSold|BsmtUnfSF', 'GrLivArea|BedroomAbvGr', 'GrLivArea|HouseStyle_Tencode', 'TotRmsAbvGrd|BsmtFullBath', 'BsmtQual_Tencode|HeatingQC_Tencode', 'LowQualFinSF|LotShape_Tencode', 'Fireplaces|Exterior1st_Tencode', 'ExterQual_Tencode|SaleType_Tencode', 'KitchenAbvGr|Heating_Tencode', 'Alley_Tencode|LotFrontage', 'Fireplaces|LotConfig_Tencode', 'Condition1_Tencode|SaleType_Tencode', 'YrSold|OpenPorchSF', 'YearRemodAdd|1stFlrSF', 'Exterior2nd_Tencode|Condition1_Tencode', 'BsmtFinSF2|BldgType_Tencode', 'FireplaceQu_Tencode|RoofStyle_Tencode', 'Foundation_Tencode|GarageCond_Tencode', 'Alley_Tencode|HeatingQC_Tencode', 'FireplaceQu_Tencode|BsmtCond_Tencode', 'LandContour_Tencode|YearRemodAdd', 'Foundation_Tencode|Street_Tencode', 'LowQualFinSF|Fence_Tencode', 'ExterCond_Tencode|FullBath', 'ExterQual_Tencode|GarageCars', 'Alley_Tencode|SaleType_Tencode', '1stFlrSF|GarageType_Tencode', 'Exterior1st_Tencode|Condition1_Tencode', 'PoolArea', 'EnclosedPorch|Functional_Tencode', 'Fireplaces|SaleType_Tencode', 'ExterQual_Tencode|GarageCond_Tencode', 'ExterQual_Tencode|MiscFeature_Tencode', 'MSZoning_Tencode|PoolQC_Tencode', 'MasVnrArea|Fence_Tencode', 'Electrical_Tencode|LotFrontage', 'LandContour_Tencode|MSSubClass', 'TotalBsmtSF|LotArea', 'ExterCond_Tencode|LotArea', 'KitchenAbvGr|BsmtHalfBath', 'YearRemodAdd|BsmtExposure_Tencode', '2ndFlrSF|MiscVal', 'Electrical_Tencode|1stFlrSF', 'Exterior1st_Tencode|LotFrontage', 'GarageArea|HeatingQC_Tencode', 'Exterior2nd_Tencode|GarageQual_Tencode', 'LandContour_Tencode|ScreenPorch', 'PoolArea|OpenPorchSF', 'ScreenPorch|OverallQual', 'MSZoning_Tencode|BsmtFinType2_Tencode', 'BsmtUnfSF|GarageFinish_Tencode', 'Condition2_Tencode|WoodDeckSF', 'LotConfig_Tencode|Street_Tencode', 'GarageCond_Tencode|Exterior2nd_Tencode', 'BsmtFullBath|OverallCond', 'Fireplaces|YearBuilt', 'PavedDrive_Tencode|Heating_Tencode', '1stFlrSF|Utilities_Tencode', 'RoofMatl_Tencode|3SsnPorch', 'BsmtFinSF1|Condition1_Tencode', 'ExterCond_Tencode|BsmtCond_Tencode', 'ScreenPorch|SaleType_Tencode', 'YearRemodAdd|PavedDrive_Tencode', 'MasVnrArea|BsmtFullBath', 'Electrical_Tencode|BsmtFinSF1', 'YearRemodAdd|BsmtUnfSF', 'Functional_Tencode', 'TotRmsAbvGrd|MasVnrType_Tencode', 'LandSlope_Tencode|MiscFeature_Tencode', 'EnclosedPorch|MiscFeature_Tencode', 'MoSold|GarageArea', 'PavedDrive_Tencode|MasVnrType_Tencode', 'MiscVal|GarageFinish_Tencode', 'Electrical_Tencode|GarageArea', 'Condition1_Tencode|Heating_Tencode', 'BsmtFinSF2|BsmtFinType2_Tencode', 'TotRmsAbvGrd|LotArea', 'LowQualFinSF|BsmtFinType1_Tencode', 'Electrical_Tencode|LotArea', 'Exterior1st_Tencode|GarageCars', 'PavedDrive_Tencode|MiscVal', 'BsmtFinType1_Tencode|MasVnrType_Tencode', 'BsmtFinSF1|LotArea', 'SaleCondition_Tencode|LotArea', 'RoofStyle_Tencode|GarageFinish_Tencode', 'GarageFinish_Tencode|GarageCars', 'BsmtCond_Tencode|Utilities_Tencode', 'MSSubClass|MasVnrArea', 'ExterCond_Tencode|LandSlope_Tencode', 'BsmtExposure_Tencode|HalfBath', 'SaleCondition_Tencode|OverallCond', 'Foundation_Tencode|Fireplaces', 'GarageFinish_Tencode|OverallCond', 'TotalBsmtSF|MasVnrType_Tencode', 'LandContour_Tencode|MoSold', 'BsmtFinSF1|YrSold', 'GarageYrBlt|HalfBath', 'LotFrontage|BedroomAbvGr', 'MSSubClass|HouseStyle_Tencode', 'FireplaceQu_Tencode|PavedDrive_Tencode', 'MSSubClass|BldgType_Tencode', 'Electrical_Tencode|MasVnrArea', 'LandContour_Tencode|Neighborhood_Tencode', 'BsmtFullBath|CentralAir_Tencode', 'Electrical_Tencode', 'Alley_Tencode|Street_Tencode', 'Electrical_Tencode|KitchenQual_Tencode', 'Alley_Tencode|BsmtHalfBath', 'MSZoning_Tencode|MasVnrType_Tencode', 'MSSubClass|KitchenQual_Tencode', 'FireplaceQu_Tencode|HouseStyle_Tencode', 'MSSubClass|Heating_Tencode', '1stFlrSF|BsmtFinType2_Tencode', 'TotRmsAbvGrd|HeatingQC_Tencode', 'ExterCond_Tencode|MiscVal', 'MoSold|LotArea', 'PoolArea|SaleCondition_Tencode', 'PoolArea|BldgType_Tencode', 'RoofMatl_Tencode|MoSold', 'BsmtUnfSF|Utilities_Tencode', 'ExterQual_Tencode|GarageFinish_Tencode', 'PoolArea|GarageYrBlt', 'Condition2_Tencode|PavedDrive_Tencode', 'BsmtUnfSF|Functional_Tencode', 'ExterCond_Tencode|YearRemodAdd', 'LotShape_Tencode|GarageType_Tencode', 'MasVnrArea|OverallQual', 'TotalBsmtSF|GarageCond_Tencode', 'FireplaceQu_Tencode|3SsnPorch', 'Fireplaces|HouseStyle_Tencode', 'PoolArea|Exterior1st_Tencode', 'BsmtFullBath|OverallQual', 'Electrical_Tencode|EnclosedPorch', 'MSZoning_Tencode|LotArea', 'YearRemodAdd|RoofStyle_Tencode', 'Electrical_Tencode|GrLivArea', 'BsmtFinSF1|Functional_Tencode', 'BsmtFullBath|BedroomAbvGr', 'LotArea|Neighborhood_Tencode', 'EnclosedPorch|LotArea', 'MSZoning_Tencode|YrSold', 'LotFrontage|YearBuilt', 'BsmtFullBath|LotArea', 'LowQualFinSF|GarageCond_Tencode', '2ndFlrSF|SaleCondition_Tencode', 'KitchenQual_Tencode|BldgType_Tencode', 'Alley_Tencode|MasVnrArea', 'Foundation_Tencode|LotFrontage', 'GrLivArea|Condition1_Tencode', 'LandContour_Tencode|BedroomAbvGr', 'Heating_Tencode|HalfBath', 'GarageCond_Tencode|WoodDeckSF', 'Alley_Tencode|FullBath', 'CentralAir_Tencode|GarageYrBlt', '1stFlrSF|LandSlope_Tencode', 'BsmtExposure_Tencode|GarageFinish_Tencode', 'Heating_Tencode|Neighborhood_Tencode', 'Condition1_Tencode|KitchenQual_Tencode', 'MasVnrArea|YearRemodAdd', 'FullBath|Street_Tencode', 'RoofMatl_Tencode|GarageType_Tencode', 'LowQualFinSF|LotConfig_Tencode', 'LandContour_Tencode|HeatingQC_Tencode', 'YearRemodAdd|YrSold', 'FireplaceQu_Tencode|YearBuilt', 'BsmtFinSF2|GarageFinish_Tencode', 'PavedDrive_Tencode|Exterior2nd_Tencode', '3SsnPorch|GarageQual_Tencode', 'KitchenAbvGr|YearRemodAdd', 'PoolQC_Tencode|BedroomAbvGr', 'BsmtFinSF1|GarageFinish_Tencode', 'RoofStyle_Tencode|MiscFeature_Tencode', 'WoodDeckSF|LotArea', '3SsnPorch|LotArea', 'Functional_Tencode|BsmtFinType1_Tencode', 'PoolArea|LotShape_Tencode', 'Electrical_Tencode|SaleCondition_Tencode', 'PoolArea|GarageQual_Tencode', 'EnclosedPorch|PoolQC_Tencode', 'PoolArea|BsmtQual_Tencode', 'LotFrontage|BsmtCond_Tencode', '1stFlrSF|Functional_Tencode', 'BsmtFinSF1|MiscFeature_Tencode', 'MSSubClass|Neighborhood_Tencode', 'EnclosedPorch|Fence_Tencode', 'BsmtFinSF2|RoofStyle_Tencode', 'TotalBsmtSF|LotFrontage', 'LowQualFinSF|MiscFeature_Tencode', 'BsmtFinSF2|Exterior2nd_Tencode', 'EnclosedPorch|Exterior2nd_Tencode', 'YearRemodAdd|MasVnrType_Tencode', 'OpenPorchSF|GarageCars', 'Fence_Tencode|OpenPorchSF', 'LowQualFinSF|Exterior2nd_Tencode', 'ExterCond_Tencode|Condition2_Tencode', 'GarageFinish_Tencode', 'Exterior2nd_Tencode|MiscFeature_Tencode', 'BsmtQual_Tencode|LotShape_Tencode', '1stFlrSF|SaleCondition_Tencode', 'MSSubClass|RoofStyle_Tencode', 'Exterior2nd_Tencode|Neighborhood_Tencode', 'MSZoning_Tencode|Utilities_Tencode', 'TotalBsmtSF|OverallCond', 'LotFrontage|PoolQC_Tencode', 'LotConfig_Tencode|OverallQual', 'Heating_Tencode|SaleType_Tencode', 'TotalBsmtSF|2ndFlrSF', 'Condition2_Tencode|YearRemodAdd', 'Foundation_Tencode|RoofMatl_Tencode', 'ScreenPorch|ExterQual_Tencode', 'HeatingQC_Tencode|GarageCars', '2ndFlrSF|Neighborhood_Tencode', 'BsmtFinSF2|Neighborhood_Tencode', 'Exterior2nd_Tencode|YearBuilt', 'MSZoning_Tencode|Exterior2nd_Tencode', 'MoSold|OverallQual', 'Alley_Tencode|MoSold', 'BsmtFinSF1|BsmtExposure_Tencode', 'PoolArea|FullBath', '1stFlrSF|KitchenQual_Tencode', 'RoofMatl_Tencode|GarageYrBlt', 'BsmtFinType2_Tencode|GarageCars', 'Condition2_Tencode|LandSlope_Tencode', 'PavedDrive_Tencode|SaleType_Tencode', 'ExterQual_Tencode|LotArea', 'GrLivArea|2ndFlrSF', 'Foundation_Tencode|GrLivArea', 'GrLivArea|BsmtExposure_Tencode', 'KitchenAbvGr|BsmtUnfSF', 'KitchenAbvGr|GarageType_Tencode', 'LotConfig_Tencode|GarageArea', 'PavedDrive_Tencode|Fence_Tencode', 'Condition2_Tencode|Functional_Tencode', 'ExterCond_Tencode|LotFrontage', 'Electrical_Tencode|RoofStyle_Tencode', '1stFlrSF|OverallQual', 'SaleCondition_Tencode', 'BsmtHalfBath|BldgType_Tencode', 'MSSubClass|2ndFlrSF', 'BsmtFullBath|RoofStyle_Tencode', 'GarageCond_Tencode|GarageCars', 'MSZoning_Tencode|GarageCars', 'MoSold|HouseStyle_Tencode', 'RoofMatl_Tencode|OpenPorchSF', 'Electrical_Tencode|GarageCond_Tencode', 'WoodDeckSF|Utilities_Tencode', 'ExterCond_Tencode|ScreenPorch', 'KitchenQual_Tencode|Neighborhood_Tencode', 'BsmtExposure_Tencode|LowQualFinSF', 'FullBath|Neighborhood_Tencode', 'Foundation_Tencode|BsmtHalfBath', 'Exterior1st_Tencode|LotShape_Tencode', 'MSSubClass|HalfBath', 'BsmtFullBath|BsmtFinSF1', 'BsmtExposure_Tencode|YrSold', 'BsmtFinSF2|MSZoning_Tencode', 'GarageYrBlt|Exterior2nd_Tencode', 'GarageFinish_Tencode|SaleType_Tencode', 'Functional_Tencode|LotShape_Tencode', 'BsmtUnfSF|YearBuilt', 'Fireplaces|ExterQual_Tencode', 'Fence_Tencode|BsmtFinType2_Tencode', 'FireplaceQu_Tencode|Exterior1st_Tencode', 'GarageArea|BldgType_Tencode', 'LowQualFinSF|BldgType_Tencode', 'GarageCars|HouseStyle_Tencode', 'MSZoning_Tencode|LotFrontage', 'RoofStyle_Tencode|BldgType_Tencode', 'LotConfig_Tencode|GarageType_Tencode', 'YearRemodAdd|BsmtFinType1_Tencode', 'Condition2_Tencode|GarageCond_Tencode', 'GarageFinish_Tencode|Neighborhood_Tencode', 'MSSubClass|Functional_Tencode', 'FullBath|KitchenQual_Tencode', 'YearBuilt|MiscFeature_Tencode', 'YrSold|PoolQC_Tencode', 'BsmtExposure_Tencode|Utilities_Tencode', 'BedroomAbvGr|Utilities_Tencode', 'MasVnrType_Tencode', 'MSSubClass|GarageYrBlt', 'FullBath|LotConfig_Tencode', 'LotConfig_Tencode|Heating_Tencode', 'KitchenAbvGr|MiscFeature_Tencode', 'MiscVal|BsmtFinType2_Tencode', 'Electrical_Tencode|MiscVal', 'PavedDrive_Tencode|BsmtFinType1_Tencode', 'GrLivArea|SaleType_Tencode', 'TotalBsmtSF|BsmtCond_Tencode', 'SaleType_Tencode|MiscFeature_Tencode', '2ndFlrSF|YrSold', 'ScreenPorch|OpenPorchSF', 'GrLivArea|CentralAir_Tencode', 'MasVnrArea|CentralAir_Tencode', '2ndFlrSF|Condition1_Tencode', 'LandContour_Tencode|ExterQual_Tencode', '3SsnPorch|BsmtCond_Tencode', 'GrLivArea|BsmtFinType2_Tencode', 'TotalBsmtSF|FireplaceQu_Tencode', 'GrLivArea|Utilities_Tencode', 'MSZoning_Tencode|MiscFeature_Tencode', 'SaleCondition_Tencode|YearBuilt', 'BsmtFullBath|LowQualFinSF', 'EnclosedPorch|BedroomAbvGr', 'ScreenPorch|Functional_Tencode', 'FireplaceQu_Tencode|HalfBath', 'Exterior1st_Tencode|BsmtFinType1_Tencode', 'YearRemodAdd|BldgType_Tencode', 'ExterCond_Tencode|BsmtHalfBath', 'ExterCond_Tencode|CentralAir_Tencode', 'FireplaceQu_Tencode|BsmtFinSF2', 'YrSold|LotFrontage', 'MoSold', 'PoolArea|LotArea', 'Condition2_Tencode|BsmtUnfSF', 'TotalBsmtSF|Electrical_Tencode', 'GarageType_Tencode|HalfBath', 'TotRmsAbvGrd|BsmtUnfSF', 'LandContour_Tencode|MasVnrArea', 'TotRmsAbvGrd|Street_Tencode', 'ExterCond_Tencode|1stFlrSF', 'GrLivArea|YrSold', 'Alley_Tencode|LotArea', 'LandSlope_Tencode|GarageArea', 'BsmtExposure_Tencode|1stFlrSF', 'RoofStyle_Tencode|WoodDeckSF', 'OpenPorchSF|OverallCond', 'MSSubClass|CentralAir_Tencode', 'Electrical_Tencode|BsmtCond_Tencode', 'BsmtQual_Tencode|GarageQual_Tencode', 'BsmtHalfBath|GarageCars', 'PoolArea|Exterior2nd_Tencode', 'Alley_Tencode|Fireplaces', 'LotFrontage|SaleType_Tencode', 'YearBuilt|MasVnrType_Tencode', 'PavedDrive_Tencode|BsmtFinType2_Tencode', 'MasVnrType_Tencode|GarageCars', 'MoSold|Fence_Tencode', 'RoofStyle_Tencode|OverallQual', 'ExterQual_Tencode|Fence_Tencode', 'BsmtHalfBath|GarageFinish_Tencode', 'KitchenAbvGr|BsmtFinSF2', 'TotRmsAbvGrd|GarageFinish_Tencode', 'TotalBsmtSF|PoolArea', 'TotalBsmtSF|LandContour_Tencode', 'ScreenPorch|Neighborhood_Tencode', 'KitchenAbvGr|1stFlrSF', 'BsmtFinType1_Tencode|Utilities_Tencode', 'RoofStyle_Tencode|GarageType_Tencode', 'TotRmsAbvGrd|BsmtFinType2_Tencode', 'Condition2_Tencode|3SsnPorch', 'BsmtHalfBath|HeatingQC_Tencode', 'Alley_Tencode|BsmtUnfSF', 'HeatingQC_Tencode|OverallQual', 'KitchenAbvGr|GrLivArea', 'YearRemodAdd|Exterior1st_Tencode', 'TotalBsmtSF|GarageArea', 'MoSold|HeatingQC_Tencode', 'SaleCondition_Tencode|EnclosedPorch', 'WoodDeckSF|GarageQual_Tencode', '2ndFlrSF|BsmtCond_Tencode', 'EnclosedPorch|HalfBath', 'Condition2_Tencode|Fence_Tencode', 'FireplaceQu_Tencode|BsmtUnfSF', 'WoodDeckSF|GarageType_Tencode', 'MasVnrArea|3SsnPorch', 'GarageArea|Functional_Tencode', 'BsmtQual_Tencode|Functional_Tencode', 'Fence_Tencode|MiscVal', 'BsmtFullBath|MSZoning_Tencode', 'Exterior1st_Tencode|BsmtFinType2_Tencode', 'SaleCondition_Tencode|PavedDrive_Tencode', 'FullBath|Fence_Tencode', 'BsmtHalfBath|GarageYrBlt', 'Electrical_Tencode|Exterior2nd_Tencode', 'KitchenAbvGr|RoofMatl_Tencode', 'CentralAir_Tencode|GarageCars', 'FireplaceQu_Tencode|OverallCond', 'MSZoning_Tencode|EnclosedPorch', 'MoSold|ScreenPorch', 'Exterior1st_Tencode|Utilities_Tencode', 'MSSubClass|SaleType_Tencode', 'BsmtFullBath|Condition1_Tencode', 'BsmtCond_Tencode|MiscVal', 'LotFrontage|Neighborhood_Tencode', 'Condition2_Tencode|Street_Tencode', '1stFlrSF|LotFrontage', 'BsmtFinSF1|BsmtQual_Tencode', 'MasVnrArea|BldgType_Tencode', 'FullBath|SaleCondition_Tencode', 'KitchenAbvGr|BsmtCond_Tencode', 'FireplaceQu_Tencode|GarageCond_Tencode', 'TotalBsmtSF|GarageFinish_Tencode', 'BsmtFinSF1|EnclosedPorch', 'Condition1_Tencode|Neighborhood_Tencode', 'BsmtFinSF1|PoolQC_Tencode', 'GarageYrBlt|Utilities_Tencode', 'ExterCond_Tencode|BsmtQual_Tencode', 'TotRmsAbvGrd', 'Foundation_Tencode|LotShape_Tencode', 'BsmtExposure_Tencode|GarageQual_Tencode', 'GrLivArea|BsmtCond_Tencode', 'MasVnrArea|MiscFeature_Tencode', 'Street_Tencode|MiscFeature_Tencode', 'TotalBsmtSF|MoSold', 'MoSold|BedroomAbvGr', 'GarageCond_Tencode|LotArea', 'TotRmsAbvGrd|YrSold', '3SsnPorch|LowQualFinSF', 'BsmtExposure_Tencode|Street_Tencode', 'ExterQual_Tencode|BsmtUnfSF', 'GrLivArea|GarageArea', 'BsmtUnfSF|SaleType_Tencode', 'Street_Tencode|HouseStyle_Tencode', 'Alley_Tencode|Neighborhood_Tencode', 'BsmtQual_Tencode|GarageYrBlt', 'BsmtFinSF2|LowQualFinSF', 'FireplaceQu_Tencode|LotShape_Tencode', 'GrLivArea|Fireplaces', 'LandContour_Tencode|EnclosedPorch', 'RoofMatl_Tencode', 'Alley_Tencode|RoofMatl_Tencode', 'GrLivArea|RoofStyle_Tencode', 'MSZoning_Tencode|BsmtHalfBath', '2ndFlrSF|RoofMatl_Tencode', 'Condition2_Tencode|LotArea', 'MasVnrArea|Street_Tencode', 'RoofMatl_Tencode|ScreenPorch', 'RoofStyle_Tencode|ExterQual_Tencode', 'BsmtFullBath|MoSold', 'LandContour_Tencode|BsmtHalfBath', '1stFlrSF|BsmtHalfBath', 'MoSold|EnclosedPorch', 'Fireplaces|2ndFlrSF', 'MasVnrArea|ScreenPorch', 'LandSlope_Tencode|LotArea', 'TotRmsAbvGrd|Utilities_Tencode', 'LandContour_Tencode|TotRmsAbvGrd', 'WoodDeckSF|OverallQual', 'MSSubClass|RoofMatl_Tencode', 'MiscVal|GarageArea', 'Alley_Tencode|Exterior2nd_Tencode', 'LandSlope_Tencode|HalfBath', 'BsmtFinSF2|Functional_Tencode', 'Alley_Tencode|GarageType_Tencode', 'OverallCond|OverallQual', 'LandSlope_Tencode|GarageType_Tencode', 'MoSold|RoofStyle_Tencode', 'FullBath|YearBuilt', 'MSSubClass|GarageCars', 'HeatingQC_Tencode|HouseStyle_Tencode', 'Electrical_Tencode|Exterior1st_Tencode', 'CentralAir_Tencode|BsmtCond_Tencode', 'TotalBsmtSF|BsmtHalfBath', 'FireplaceQu_Tencode|Functional_Tencode', 'LandContour_Tencode|LotShape_Tencode', 'CentralAir_Tencode|LotConfig_Tencode', 'KitchenAbvGr|LandContour_Tencode', 'ScreenPorch|RoofStyle_Tencode', '1stFlrSF|Street_Tencode', 'Foundation_Tencode', 'Exterior2nd_Tencode|BldgType_Tencode', 'LotConfig_Tencode|Neighborhood_Tencode', 'OpenPorchSF|GarageType_Tencode', 'Electrical_Tencode|MSZoning_Tencode', 'MasVnrArea|GrLivArea', '1stFlrSF|BsmtUnfSF', 'Condition1_Tencode|BsmtFinType1_Tencode', 'ExterCond_Tencode|BldgType_Tencode', 'SaleCondition_Tencode|Neighborhood_Tencode', 'FireplaceQu_Tencode|BldgType_Tencode', 'PoolArea|YrSold', 'GarageQual_Tencode|HalfBath', 'BsmtQual_Tencode|Exterior2nd_Tencode', 'Fence_Tencode|HouseStyle_Tencode', 'ScreenPorch|PavedDrive_Tencode', 'Fireplaces|BsmtCond_Tencode', 'Exterior2nd_Tencode|LotShape_Tencode', 'BedroomAbvGr|LotShape_Tencode', 'Alley_Tencode|BsmtFinSF2', 'Heating_Tencode', 'KitchenAbvGr|MoSold', 'Electrical_Tencode|Street_Tencode', 'Heating_Tencode|GarageQual_Tencode', 'Condition2_Tencode|ExterQual_Tencode', 'YrSold|LowQualFinSF', 'Condition2_Tencode|GrLivArea', 'GrLivArea|BldgType_Tencode', 'GarageCars', 'CentralAir_Tencode|MiscVal', 'BsmtExposure_Tencode|LotShape_Tencode', 'TotRmsAbvGrd|SaleType_Tencode', 'EnclosedPorch|BsmtFinType1_Tencode', 'BsmtQual_Tencode|MiscVal', 'PoolArea|Functional_Tencode', 'BsmtFinSF1|BsmtFinType2_Tencode', 'ExterCond_Tencode|MasVnrType_Tencode', 'LowQualFinSF|MasVnrType_Tencode', 'Exterior2nd_Tencode|Heating_Tencode', 'LandSlope_Tencode|Fence_Tencode', 'TotalBsmtSF|BsmtQual_Tencode', 'FullBath|LotShape_Tencode', 'LotFrontage|WoodDeckSF', 'GarageArea|LotArea', 'Foundation_Tencode|Condition2_Tencode', 'ExterQual_Tencode|LotShape_Tencode', 'FireplaceQu_Tencode|FullBath', 'LandSlope_Tencode|SaleType_Tencode', 'YearBuilt|Utilities_Tencode', 'ExterQual_Tencode|Utilities_Tencode', 'BldgType_Tencode|MiscFeature_Tencode', 'LotConfig_Tencode|OpenPorchSF', 'MoSold|SaleCondition_Tencode', 'LotFrontage|GarageCars', '2ndFlrSF|GarageCars', 'KitchenAbvGr|Alley_Tencode', 'GrLivArea|LotConfig_Tencode', 'RoofMatl_Tencode|GarageCond_Tencode', 'PoolArea|RoofStyle_Tencode', 'Foundation_Tencode|SaleCondition_Tencode', 'KitchenAbvGr|HalfBath', 'Foundation_Tencode|ExterQual_Tencode', 'Street_Tencode|OverallCond', 'Condition2_Tencode|Condition1_Tencode', 'BsmtFinSF1|LandSlope_Tencode', 'BsmtFinType1_Tencode|GarageQual_Tencode', 'TotalBsmtSF|LandSlope_Tencode', 'PoolArea|BsmtCond_Tencode', 'FireplaceQu_Tencode|Condition2_Tencode', 'EnclosedPorch|Street_Tencode', 'BsmtFinSF1|PoolArea', 'BsmtExposure_Tencode|Exterior1st_Tencode', 'BsmtHalfBath|OverallCond', 'GarageCond_Tencode|Heating_Tencode', 'BsmtQual_Tencode|Fence_Tencode', 'GarageCond_Tencode|GarageType_Tencode', 'TotalBsmtSF|SaleType_Tencode', 'CentralAir_Tencode', 'ExterQual_Tencode|BldgType_Tencode', 'RoofStyle_Tencode|OpenPorchSF', 'Street_Tencode|GarageFinish_Tencode', 'WoodDeckSF|BsmtFinType1_Tencode', 'SaleCondition_Tencode|Street_Tencode', 'EnclosedPorch|MasVnrType_Tencode', 'YearRemodAdd|MiscVal', 'MasVnrArea|HeatingQC_Tencode', 'YrSold|Exterior2nd_Tencode', 'KitchenAbvGr|LandSlope_Tencode', 'BldgType_Tencode|SaleType_Tencode', 'GarageYrBlt|GarageArea', 'OpenPorchSF|GarageQual_Tencode', '1stFlrSF|HalfBath', 'BsmtCond_Tencode|BsmtUnfSF', 'ExterCond_Tencode|PavedDrive_Tencode', 'BsmtQual_Tencode|LotConfig_Tencode', 'GarageFinish_Tencode|BldgType_Tencode', 'RoofStyle_Tencode|Street_Tencode', 'ExterCond_Tencode|KitchenQual_Tencode', 'BsmtQual_Tencode|MiscFeature_Tencode', 'MasVnrArea|YrSold', 'CentralAir_Tencode|YearBuilt', 'FireplaceQu_Tencode|BsmtFinSF1', 'Electrical_Tencode|OpenPorchSF', 'LotConfig_Tencode|BsmtFinType2_Tencode', 'Exterior1st_Tencode|OverallQual', 'KitchenAbvGr|MSZoning_Tencode', 'OpenPorchSF|MasVnrType_Tencode', 'MoSold|MiscFeature_Tencode', 'ExterQual_Tencode|YearBuilt', 'CentralAir_Tencode|EnclosedPorch', 'GarageYrBlt|EnclosedPorch', 'LandContour_Tencode|HalfBath', '2ndFlrSF|HouseStyle_Tencode', 'TotRmsAbvGrd|LotFrontage', 'Foundation_Tencode|MSSubClass', 'Electrical_Tencode|MasVnrType_Tencode', 'BsmtExposure_Tencode|GarageType_Tencode', 'GarageCond_Tencode|BedroomAbvGr', 'LandSlope_Tencode|LotFrontage', 'MoSold|CentralAir_Tencode', 'FireplaceQu_Tencode|LotConfig_Tencode', 'LowQualFinSF|Neighborhood_Tencode', 'TotRmsAbvGrd|OverallCond', 'MasVnrArea|MSZoning_Tencode', 'FullBath|ExterQual_Tencode', 'TotRmsAbvGrd|Fireplaces', 'SaleCondition_Tencode|LotFrontage', '3SsnPorch|MiscFeature_Tencode', 'MoSold|LotConfig_Tencode', 'PoolArea|GarageCars', 'MasVnrArea|PoolQC_Tencode', 'GrLivArea|GarageCond_Tencode', 'CentralAir_Tencode|RoofStyle_Tencode', 'Foundation_Tencode|OpenPorchSF', '2ndFlrSF|ScreenPorch', 'CentralAir_Tencode|BsmtFinType1_Tencode', 'BldgType_Tencode|Neighborhood_Tencode', 'LowQualFinSF|Functional_Tencode', 'Exterior1st_Tencode|BsmtHalfBath', 'Functional_Tencode|GarageType_Tencode', 'GarageFinish_Tencode|LotArea', 'Exterior2nd_Tencode|GarageCars', '2ndFlrSF|CentralAir_Tencode', 'KitchenAbvGr|BldgType_Tencode', 'Exterior1st_Tencode|HalfBath', 'GarageFinish_Tencode|OpenPorchSF', 'GarageFinish_Tencode|YearBuilt', 'LotArea|OverallCond', 'TotalBsmtSF|OverallQual', 'Alley_Tencode|Heating_Tencode', 'YearRemodAdd|OpenPorchSF', 'HeatingQC_Tencode|GarageQual_Tencode', 'BsmtExposure_Tencode|BsmtHalfBath', 'Condition2_Tencode|LotFrontage', 'BsmtFinSF2|CentralAir_Tencode', 'Foundation_Tencode|LotArea', 'TotalBsmtSF|CentralAir_Tencode', 'MasVnrArea|BsmtUnfSF', 'CentralAir_Tencode|LandSlope_Tencode', 'PoolQC_Tencode|GarageQual_Tencode', 'RoofMatl_Tencode|BsmtQual_Tencode', 'Electrical_Tencode|Heating_Tencode', 'BsmtQual_Tencode|RoofStyle_Tencode', 'YrSold|BsmtFinType2_Tencode', 'BsmtHalfBath|HouseStyle_Tencode', 'RoofStyle_Tencode|Exterior2nd_Tencode', 'Condition2_Tencode|PoolArea', 'GrLivArea|Heating_Tencode', 'Fence_Tencode|BldgType_Tencode', 'GrLivArea|GarageQual_Tencode', 'BedroomAbvGr|SaleType_Tencode', 'FireplaceQu_Tencode|BsmtFinType2_Tencode', 'KitchenAbvGr|PavedDrive_Tencode', 'ScreenPorch|GarageYrBlt', 'WoodDeckSF|Functional_Tencode', 'ExterCond_Tencode|GrLivArea', 'PoolArea|MasVnrType_Tencode', 'Foundation_Tencode|PoolQC_Tencode', 'BsmtCond_Tencode|OverallQual', 'BsmtFullBath|LotConfig_Tencode', 'Condition1_Tencode|OverallCond', 'GarageYrBlt|RoofStyle_Tencode', 'FireplaceQu_Tencode|Fence_Tencode', 'Fireplaces|LowQualFinSF', 'MoSold|BsmtQual_Tencode', 'Exterior2nd_Tencode', 'BsmtFullBath|BsmtQual_Tencode', 'Electrical_Tencode|YearBuilt', 'BsmtUnfSF|HalfBath', 'GrLivArea|WoodDeckSF', 'OverallCond|MasVnrType_Tencode', 'ExterCond_Tencode|TotRmsAbvGrd', 'GrLivArea|Neighborhood_Tencode', 'PoolQC_Tencode|Neighborhood_Tencode', 'PavedDrive_Tencode|HalfBath', 'BsmtFullBath|LandSlope_Tencode', 'BsmtExposure_Tencode|GarageArea', 'Functional_Tencode|OpenPorchSF', 'Heating_Tencode|GarageCars', 'Foundation_Tencode|YrSold', 'SaleCondition_Tencode|ExterQual_Tencode', 'BsmtExposure_Tencode|Heating_Tencode', 'YrSold|BsmtUnfSF', 'BsmtHalfBath|GarageQual_Tencode', 'TotalBsmtSF|HeatingQC_Tencode', 'LandContour_Tencode|LowQualFinSF', 'EnclosedPorch|GarageFinish_Tencode', 'Alley_Tencode|ScreenPorch', 'TotRmsAbvGrd|HouseStyle_Tencode', 'BsmtFinSF1|Fireplaces', '3SsnPorch|YrSold', 'OpenPorchSF|Utilities_Tencode', 'MSSubClass|GarageFinish_Tencode', 'BsmtExposure_Tencode|Exterior2nd_Tencode', 'OverallQual', 'LandContour_Tencode|MiscFeature_Tencode', 'Exterior1st_Tencode|MasVnrType_Tencode', 'YearRemodAdd|LandSlope_Tencode', 'FullBath|LowQualFinSF', 'MSZoning_Tencode|MiscVal', 'GarageQual_Tencode|GarageCars', 'TotRmsAbvGrd|RoofStyle_Tencode', 'LandContour_Tencode|MasVnrType_Tencode', 'ScreenPorch', 'KitchenAbvGr|BsmtExposure_Tencode', 'MasVnrType_Tencode|OverallQual', '3SsnPorch|Fence_Tencode', 'GrLivArea|3SsnPorch', 'LotShape_Tencode|LotArea', 'PoolArea|LandSlope_Tencode', 'GarageType_Tencode', 'YearRemodAdd|GarageFinish_Tencode', 'RoofMatl_Tencode|EnclosedPorch', '2ndFlrSF|3SsnPorch', 'RoofMatl_Tencode|LowQualFinSF', 'MiscFeature_Tencode', 'LotConfig_Tencode|HeatingQC_Tencode', 'YearRemodAdd|HeatingQC_Tencode', 'RoofMatl_Tencode|OverallQual', 'KitchenQual_Tencode|SaleType_Tencode', 'GarageYrBlt|MasVnrType_Tencode', 'Electrical_Tencode|HeatingQC_Tencode', 'YearRemodAdd|BedroomAbvGr', 'Fireplaces|GarageType_Tencode', 'GarageCond_Tencode|SaleType_Tencode', '1stFlrSF|BsmtFinType1_Tencode', 'SaleCondition_Tencode|Exterior2nd_Tencode', 'GrLivArea|LowQualFinSF', 'Foundation_Tencode|GarageArea', 'Condition1_Tencode|GarageType_Tencode', 'MasVnrArea|EnclosedPorch', 'Exterior1st_Tencode|PavedDrive_Tencode', 'Exterior1st_Tencode|SaleType_Tencode', 'BsmtUnfSF|MiscFeature_Tencode', 'YearRemodAdd|MoSold', 'LandSlope_Tencode|HeatingQC_Tencode', 'Exterior2nd_Tencode|BsmtFinType1_Tencode', 'Electrical_Tencode|Condition1_Tencode', 'Heating_Tencode|GarageType_Tencode', 'BsmtFinSF2|EnclosedPorch', 'Exterior1st_Tencode|OpenPorchSF', 'MSZoning_Tencode|BsmtFinType1_Tencode', 'TotRmsAbvGrd|MasVnrArea', 'BsmtQual_Tencode|GarageFinish_Tencode', 'GarageType_Tencode|SaleType_Tencode', 'Condition2_Tencode|BsmtCond_Tencode', '2ndFlrSF|MasVnrType_Tencode', 'MoSold|PavedDrive_Tencode', 'WoodDeckSF|Condition1_Tencode', 'Alley_Tencode|OverallQual', '3SsnPorch', 'CentralAir_Tencode|LotFrontage', 'FireplaceQu_Tencode|YearRemodAdd', 'Fireplaces|Fence_Tencode', 'BsmtFullBath|HeatingQC_Tencode', 'RoofStyle_Tencode|SaleType_Tencode', 'PavedDrive_Tencode|PoolQC_Tencode', 'GarageYrBlt|Neighborhood_Tencode', 'LotConfig_Tencode|GarageFinish_Tencode', 'MSSubClass|YearBuilt', 'ExterCond_Tencode|YrSold', 'PavedDrive_Tencode|BedroomAbvGr', 'BsmtFinSF2|Fireplaces', 'LowQualFinSF|OverallCond', 'BsmtFullBath|SaleCondition_Tencode', 'MoSold|GarageType_Tencode', 'YrSold|Fence_Tencode', 'YearRemodAdd|GarageQual_Tencode', '2ndFlrSF|PoolArea', 'ScreenPorch|3SsnPorch', 'LotConfig_Tencode|Condition1_Tencode', 'KitchenAbvGr|ScreenPorch', 'ExterQual_Tencode|HouseStyle_Tencode', '2ndFlrSF|Fence_Tencode', 'Foundation_Tencode|BsmtQual_Tencode', 'YrSold|GarageQual_Tencode', 'MSSubClass|SaleCondition_Tencode', 'PoolArea|CentralAir_Tencode', 'ScreenPorch|GarageCars', 'BsmtCond_Tencode|OpenPorchSF', 'FullBath|LotArea', 'LandSlope_Tencode|YearBuilt', 'Fireplaces|Neighborhood_Tencode', 'Functional_Tencode|BedroomAbvGr', 'Alley_Tencode|BsmtExposure_Tencode', 'FullBath|BldgType_Tencode', 'Street_Tencode|BedroomAbvGr', 'GarageQual_Tencode|GarageType_Tencode', 'Exterior2nd_Tencode|Fence_Tencode', 'Condition1_Tencode|GarageQual_Tencode', '2ndFlrSF|MSZoning_Tencode', 'ScreenPorch|GarageFinish_Tencode', 'BsmtQual_Tencode|OverallCond', 'Fireplaces|MSZoning_Tencode', 'TotRmsAbvGrd|2ndFlrSF', 'Street_Tencode|PoolQC_Tencode', 'Fireplaces|Condition1_Tencode', 'Condition2_Tencode|Neighborhood_Tencode', 'PavedDrive_Tencode|OverallQual', 'Utilities_Tencode', 'TotalBsmtSF|SaleCondition_Tencode', 'BsmtFinSF1|BldgType_Tencode', 'BsmtHalfBath|Condition1_Tencode', 'YrSold|LotArea', 'BsmtFinType1_Tencode|BsmtFinType2_Tencode', 'ExterCond_Tencode|MiscFeature_Tencode', '3SsnPorch|FullBath', 'Functional_Tencode|MasVnrType_Tencode', 'BsmtFinSF1|GarageArea', 'LotFrontage|HouseStyle_Tencode', 'ExterQual_Tencode|BsmtFinType1_Tencode', 'BsmtCond_Tencode|PoolQC_Tencode', 'Foundation_Tencode|GarageQual_Tencode', 'LandContour_Tencode|LotFrontage', 'LowQualFinSF|LotFrontage', 'YearRemodAdd|HouseStyle_Tencode', 'BsmtFullBath|GarageFinish_Tencode', 'LandSlope_Tencode|Heating_Tencode', 'YrSold|MasVnrType_Tencode', 'PavedDrive_Tencode|LotArea', 'BsmtFinSF1|GarageYrBlt', 'ScreenPorch|GarageArea', 'ScreenPorch|Condition1_Tencode', 'Foundation_Tencode|Utilities_Tencode', 'GarageYrBlt|GarageFinish_Tencode', '1stFlrSF|BsmtCond_Tencode', 'Exterior2nd_Tencode|BsmtCond_Tencode', 'BsmtQual_Tencode|BsmtFinType1_Tencode', 'YearRemodAdd|ScreenPorch', 'BsmtExposure_Tencode|MasVnrType_Tencode', 'EnclosedPorch|MiscVal', 'PoolArea|1stFlrSF', 'Condition2_Tencode|OpenPorchSF', 'GarageYrBlt|LandSlope_Tencode', 'MSZoning_Tencode|OpenPorchSF', 'MiscVal|OpenPorchSF', 'HalfBath|MiscFeature_Tencode', 'WoodDeckSF|BedroomAbvGr', 'OverallCond|GarageCars', 'CentralAir_Tencode|ExterQual_Tencode', 'LotConfig_Tencode|BsmtFinType1_Tencode', '3SsnPorch|1stFlrSF', 'BsmtExposure_Tencode|MoSold', 'GrLivArea|RoofMatl_Tencode', 'Fireplaces|GarageYrBlt', 'Exterior2nd_Tencode|HeatingQC_Tencode', 'LowQualFinSF|WoodDeckSF', 'Fireplaces|BsmtFinType1_Tencode', 'Exterior1st_Tencode|BsmtCond_Tencode', 'BsmtFinSF2|Exterior1st_Tencode', 'Exterior1st_Tencode|GarageType_Tencode', 'BsmtFinSF1|GarageCars', 'RoofMatl_Tencode|Neighborhood_Tencode', 'PavedDrive_Tencode|MiscFeature_Tencode', '2ndFlrSF|BsmtFinType2_Tencode', 'BsmtFullBath|GarageCond_Tencode', 'MSSubClass', 'OpenPorchSF|HalfBath', 'BsmtUnfSF|OverallCond', 'FireplaceQu_Tencode|LotArea', 'MoSold|BsmtCond_Tencode', 'PoolQC_Tencode|LotShape_Tencode', 'TotalBsmtSF|GarageType_Tencode', '3SsnPorch|LotFrontage', 'LotConfig_Tencode|GarageQual_Tencode', 'MSSubClass|OverallCond', 'Neighborhood_Tencode|GarageQual_Tencode', 'BedroomAbvGr|Heating_Tencode', 'LotShape_Tencode|SaleType_Tencode', 'Exterior1st_Tencode|Street_Tencode', 'Condition2_Tencode|GarageFinish_Tencode', 'ScreenPorch|MiscFeature_Tencode', 'LotFrontage|HalfBath', 'YearRemodAdd|Exterior2nd_Tencode', 'Fireplaces|PavedDrive_Tencode', 'BsmtCond_Tencode|GarageFinish_Tencode', 'FireplaceQu_Tencode|2ndFlrSF', 'BsmtFullBath|BsmtExposure_Tencode', 'Condition2_Tencode|LotShape_Tencode', 'MoSold|LandSlope_Tencode', 'BsmtFullBath|HouseStyle_Tencode', 'YearRemodAdd|2ndFlrSF', 'BsmtCond_Tencode|Heating_Tencode', '3SsnPorch|Heating_Tencode', 'GrLivArea|OverallQual', 'FireplaceQu_Tencode|MoSold', 'Exterior1st_Tencode|LandSlope_Tencode', 'LotArea|GarageType_Tencode', 'MasVnrArea|Utilities_Tencode', 'BsmtCond_Tencode|GarageCars', 'BsmtHalfBath|BsmtUnfSF', 'EnclosedPorch|BsmtFinType2_Tencode', 'FullBath|Functional_Tencode', 'ExterCond_Tencode|RoofStyle_Tencode', 'PoolQC_Tencode|Heating_Tencode', 'YearBuilt|GarageType_Tencode', 'GarageArea', 'BsmtFullBath|Functional_Tencode', 'LandSlope_Tencode|Condition1_Tencode', 'Fireplaces|WoodDeckSF', 'FullBath|HeatingQC_Tencode', 'PoolQC_Tencode|GarageArea', 'Condition2_Tencode|MSZoning_Tencode', 'OpenPorchSF|OverallQual', 'FireplaceQu_Tencode|CentralAir_Tencode', 'MoSold|BsmtHalfBath', 'TotRmsAbvGrd|OverallQual', 'MasVnrType_Tencode|MiscFeature_Tencode', 'MasVnrArea|BsmtQual_Tencode', 'FireplaceQu_Tencode|MiscFeature_Tencode', 'KitchenAbvGr|EnclosedPorch', 'PoolQC_Tencode|OverallCond', 'ScreenPorch|Utilities_Tencode', 'KitchenQual_Tencode|Functional_Tencode', 'BsmtFinSF1|1stFlrSF', 'WoodDeckSF|KitchenQual_Tencode', 'CentralAir_Tencode|Street_Tencode', 'PoolQC_Tencode|LotArea', 'Condition2_Tencode|PoolQC_Tencode', 'BsmtFinSF1|KitchenQual_Tencode', 'YrSold|KitchenQual_Tencode', '2ndFlrSF|BsmtHalfBath', 'ScreenPorch|WoodDeckSF', 'RoofStyle_Tencode|OverallCond', 'EnclosedPorch|LotConfig_Tencode', 'LotShape_Tencode|YearBuilt', 'BsmtFinSF1|MoSold', 'LotArea|HalfBath', 'LowQualFinSF|HalfBath', 'TotalBsmtSF|BsmtExposure_Tencode', 'Alley_Tencode|SaleCondition_Tencode', 'MasVnrArea|BsmtFinType1_Tencode', 'RoofStyle_Tencode|BsmtUnfSF', 'EnclosedPorch|YearBuilt', 'SaleCondition_Tencode|GarageCond_Tencode', 'PoolQC_Tencode|OverallQual', 'LotFrontage|Condition1_Tencode', 'BsmtUnfSF|GarageQual_Tencode', 'FireplaceQu_Tencode|MiscVal', 'RoofStyle_Tencode|Utilities_Tencode', 'BsmtFinSF2|BsmtQual_Tencode', 'MSZoning_Tencode|HalfBath', 'SaleCondition_Tencode|GarageArea', 'GarageCars|GarageType_Tencode', 'ScreenPorch|LotShape_Tencode', 'YearRemodAdd|Street_Tencode', 'YearRemodAdd|Heating_Tencode', 'Exterior2nd_Tencode|OverallQual', 'LandContour_Tencode|BsmtFullBath', 'Electrical_Tencode|GarageQual_Tencode', 'TotalBsmtSF|Utilities_Tencode', 'Functional_Tencode|OverallCond', '2ndFlrSF|OverallQual', 'Fireplaces|FullBath', 'Electrical_Tencode|Neighborhood_Tencode', 'BsmtQual_Tencode|OverallQual', 'Foundation_Tencode|YearBuilt', 'BedroomAbvGr|GarageCars', '2ndFlrSF|HalfBath', 'RoofMatl_Tencode|BsmtUnfSF', 'BsmtHalfBath|WoodDeckSF', 'BsmtHalfBath|LowQualFinSF', '1stFlrSF|Fence_Tencode', 'GarageCond_Tencode|LotShape_Tencode', 'Alley_Tencode|HalfBath', 'BldgType_Tencode|MasVnrType_Tencode', 'YrSold|MiscFeature_Tencode', 'BsmtQual_Tencode|BsmtUnfSF', 'KitchenAbvGr|OpenPorchSF', 'Condition2_Tencode|HeatingQC_Tencode', 'Functional_Tencode|HeatingQC_Tencode', 'BsmtFinType2_Tencode', 'RoofMatl_Tencode|MiscVal', 'BsmtCond_Tencode|BsmtFinType2_Tencode', 'PoolArea|KitchenQual_Tencode', 'BsmtExposure_Tencode|Fireplaces', 'TotalBsmtSF|BsmtFinType2_Tencode', 'Foundation_Tencode|HouseStyle_Tencode', 'KitchenQual_Tencode|OverallQual', 'GarageFinish_Tencode|HalfBath', 'YearRemodAdd|Fence_Tencode', 'MasVnrType_Tencode|Utilities_Tencode', 'YearRemodAdd|LowQualFinSF', 'MSSubClass|ScreenPorch', 'TotRmsAbvGrd|BsmtFinSF1', 'GrLivArea|EnclosedPorch', '1stFlrSF|GarageQual_Tencode', 'SaleCondition_Tencode|BsmtCond_Tencode', 'BsmtExposure_Tencode|3SsnPorch', 'Alley_Tencode|1stFlrSF', 'MSSubClass|LotArea', 'Electrical_Tencode|BsmtUnfSF', 'Alley_Tencode|BedroomAbvGr', 'Street_Tencode|YearBuilt', 'MasVnrArea|BsmtFinType2_Tencode', 'Condition1_Tencode|Functional_Tencode', 'ExterCond_Tencode|GarageQual_Tencode', 'MoSold|Utilities_Tencode', 'LandContour_Tencode|Foundation_Tencode', 'Fence_Tencode|GarageArea', 'LandSlope_Tencode|ExterQual_Tencode', 'MSZoning_Tencode|Condition1_Tencode', 'Exterior1st_Tencode|GarageYrBlt', 'Alley_Tencode|GarageCond_Tencode', 'LandSlope_Tencode|BsmtUnfSF', 'MSZoning_Tencode|PavedDrive_Tencode', 'ExterCond_Tencode|BsmtFinType2_Tencode', 'RoofMatl_Tencode|GarageQual_Tencode', '2ndFlrSF|YearBuilt', 'Street_Tencode|MasVnrType_Tencode', 'TotRmsAbvGrd|MiscVal', 'GarageYrBlt|ExterQual_Tencode', 'SaleCondition_Tencode|OverallQual', 'KitchenAbvGr|LotShape_Tencode', 'RoofStyle_Tencode|Neighborhood_Tencode', 'RoofMatl_Tencode|BsmtFinType1_Tencode', 'PavedDrive_Tencode|HouseStyle_Tencode', 'TotalBsmtSF|FullBath', 'FireplaceQu_Tencode|SaleType_Tencode', '2ndFlrSF|Exterior1st_Tencode', 'BsmtFullBath|PoolQC_Tencode', 'KitchenQual_Tencode|OverallCond', 'ExterQual_Tencode|LotConfig_Tencode', 'LandContour_Tencode|GarageFinish_Tencode', 'MSSubClass|LotShape_Tencode', '2ndFlrSF|BldgType_Tencode', '3SsnPorch|PavedDrive_Tencode', 'TotRmsAbvGrd|1stFlrSF', 'BsmtFinSF1|HalfBath', 'Alley_Tencode|Condition2_Tencode', 'GarageFinish_Tencode|OverallQual', 'Street_Tencode|OverallQual', 'MiscVal|PoolQC_Tencode', 'LotConfig_Tencode|OverallCond', 'GarageCond_Tencode|LotConfig_Tencode', 'CentralAir_Tencode|BsmtFinType2_Tencode', 'BsmtCond_Tencode', 'Electrical_Tencode|ScreenPorch', 'ExterCond_Tencode|SaleType_Tencode', 'GrLivArea|MSZoning_Tencode', 'Condition2_Tencode|LotConfig_Tencode', 'EnclosedPorch|HeatingQC_Tencode', 'YearRemodAdd|FullBath', 'TotalBsmtSF|Neighborhood_Tencode', 'RoofMatl_Tencode|BsmtFinType2_Tencode', 'Fence_Tencode|YearBuilt', 'GarageCars|OverallQual', 'TotRmsAbvGrd|3SsnPorch', 'BldgType_Tencode|GarageCars', 'LandContour_Tencode|GrLivArea', 'LotFrontage|MiscFeature_Tencode', 'MSSubClass|BsmtCond_Tencode', '3SsnPorch|MasVnrType_Tencode', 'TotalBsmtSF|Exterior1st_Tencode', 'ExterCond_Tencode|Neighborhood_Tencode', '3SsnPorch|Functional_Tencode', 'BsmtFinSF1|OverallCond', 'Neighborhood_Tencode|Utilities_Tencode', 'BedroomAbvGr|OpenPorchSF', 'BsmtFinSF2|YearBuilt', '3SsnPorch|EnclosedPorch', 'Foundation_Tencode|Fence_Tencode', 'TotalBsmtSF|LotShape_Tencode', 'PoolArea|PavedDrive_Tencode', 'PavedDrive_Tencode|CentralAir_Tencode', 'Exterior1st_Tencode|HeatingQC_Tencode', 'BedroomAbvGr|BsmtFinType2_Tencode', 'MoSold|GarageCond_Tencode', 'TotRmsAbvGrd|EnclosedPorch', 'YearRemodAdd|HalfBath', 'Alley_Tencode|RoofStyle_Tencode', 'BsmtExposure_Tencode|PoolQC_Tencode', 'ScreenPorch|Heating_Tencode', 'WoodDeckSF|HeatingQC_Tencode', 'GrLivArea|Street_Tencode', 'BsmtCond_Tencode|BldgType_Tencode', 'LowQualFinSF|GarageQual_Tencode', 'TotRmsAbvGrd|KitchenQual_Tencode', 'MSSubClass|BsmtExposure_Tencode', 'GrLivArea|BsmtQual_Tencode', 'RoofMatl_Tencode|BldgType_Tencode', 'SaleCondition_Tencode|Functional_Tencode', 'LandSlope_Tencode|GarageQual_Tencode', 'MoSold|3SsnPorch', 'Exterior1st_Tencode|BldgType_Tencode', 'MSZoning_Tencode|KitchenQual_Tencode', 'GarageYrBlt|PoolQC_Tencode', 'LotFrontage|GarageQual_Tencode', 'BsmtFinSF2|Fence_Tencode', 'YrSold|BsmtFinType1_Tencode', 'Street_Tencode|Neighborhood_Tencode', 'BsmtExposure_Tencode|YearBuilt', '3SsnPorch|BldgType_Tencode', 'TotalBsmtSF|BsmtFinSF2', 'YrSold|GarageCars', 'Alley_Tencode|MasVnrType_Tencode', 'Fireplaces|HalfBath', 'WoodDeckSF|GarageCars', 'ScreenPorch|EnclosedPorch', '1stFlrSF|HeatingQC_Tencode', '2ndFlrSF|LotConfig_Tencode', 'BsmtUnfSF|OpenPorchSF', 'Exterior1st_Tencode|CentralAir_Tencode', 'MSSubClass|BsmtQual_Tencode', 'ExterCond_Tencode|FireplaceQu_Tencode', 'SaleCondition_Tencode|GarageType_Tencode', 'HeatingQC_Tencode|LotShape_Tencode', 'ExterQual_Tencode|Functional_Tencode', 'BsmtUnfSF|GarageCars', 'BsmtHalfBath|OverallQual', 'BedroomAbvGr|OverallQual', 'SaleCondition_Tencode|MiscVal', 'TotRmsAbvGrd|GarageArea', '2ndFlrSF|Street_Tencode', 'LotArea|BsmtFinType2_Tencode', 'RoofMatl_Tencode|LotConfig_Tencode', 'Exterior2nd_Tencode|HalfBath', 'Foundation_Tencode|Condition1_Tencode', 'KitchenAbvGr|BsmtFinType2_Tencode', 'Street_Tencode|LotArea', 'LowQualFinSF|Condition1_Tencode', 'BsmtFullBath|BldgType_Tencode', 'GrLivArea|MiscFeature_Tencode', 'RoofMatl_Tencode|SaleType_Tencode', 'ScreenPorch|HouseStyle_Tencode', 'WoodDeckSF|Fence_Tencode', 'Foundation_Tencode|PoolArea', 'Alley_Tencode|2ndFlrSF', 'MasVnrArea|ExterQual_Tencode', '2ndFlrSF|BsmtFinType1_Tencode', 'LotConfig_Tencode|BldgType_Tencode', 'LandSlope_Tencode|GarageFinish_Tencode', 'YearRemodAdd|MSZoning_Tencode', 'BsmtFinSF1|ExterQual_Tencode', 'FireplaceQu_Tencode|GarageYrBlt', 'MasVnrArea|LotArea', 'Exterior1st_Tencode|Fence_Tencode', '2ndFlrSF|GarageArea', 'BsmtCond_Tencode|YearBuilt', 'Exterior2nd_Tencode|OverallCond', 'Condition2_Tencode|Exterior2nd_Tencode', 'LandSlope_Tencode|BsmtCond_Tencode', 'MoSold|WoodDeckSF', 'ScreenPorch|GarageType_Tencode', 'Exterior1st_Tencode|MiscFeature_Tencode', 'ScreenPorch|Street_Tencode', 'YearRemodAdd|GarageCars', 'GarageCond_Tencode|PoolQC_Tencode', 'MSZoning_Tencode|Heating_Tencode', 'BsmtCond_Tencode|MasVnrType_Tencode', 'Heating_Tencode|YearBuilt', 'Alley_Tencode|LotConfig_Tencode', 'Exterior1st_Tencode|YearBuilt', 'BsmtFinSF2|MasVnrType_Tencode', 'PoolQC_Tencode|Utilities_Tencode', 'Condition2_Tencode|BsmtFinType1_Tencode', 'KitchenAbvGr|FireplaceQu_Tencode', 'Fence_Tencode|GarageType_Tencode', 'Exterior2nd_Tencode|BedroomAbvGr', 'Alley_Tencode|GarageQual_Tencode', 'LotShape_Tencode|GarageQual_Tencode', 'BsmtHalfBath|BedroomAbvGr', 'LowQualFinSF', 'BsmtFullBath|EnclosedPorch', 'PoolArea|BsmtHalfBath', 'BsmtUnfSF|BsmtFinType1_Tencode', 'BsmtExposure_Tencode|SaleType_Tencode', 'HalfBath', 'ExterCond_Tencode|EnclosedPorch', 'BsmtFullBath|GarageArea', 'YearRemodAdd|Functional_Tencode', 'FullBath', 'KitchenAbvGr|BsmtQual_Tencode', 'FireplaceQu_Tencode|ExterQual_Tencode', 'MasVnrArea|GarageFinish_Tencode', 'PoolQC_Tencode|BsmtFinType2_Tencode', 'BsmtFinSF1|MSZoning_Tencode', 'BsmtFullBath|YearBuilt', 'PoolArea|LowQualFinSF', 'MSZoning_Tencode|PoolArea', 'SaleCondition_Tencode|HouseStyle_Tencode', '2ndFlrSF|LotFrontage', 'Electrical_Tencode|GarageFinish_Tencode', 'FullBath|GarageArea', 'Condition1_Tencode|LotShape_Tencode', 'LandContour_Tencode|1stFlrSF', 'Functional_Tencode|BsmtFinType2_Tencode', 'PoolArea|BsmtUnfSF', 'PavedDrive_Tencode|Street_Tencode', 'BsmtFinSF2|MiscVal', '1stFlrSF|GarageYrBlt', 'MoSold|SaleType_Tencode', 'WoodDeckSF|LotShape_Tencode', 'MoSold|GarageFinish_Tencode', 'MoSold|BsmtFinType1_Tencode', 'Foundation_Tencode|Heating_Tencode', 'RoofStyle_Tencode|LotShape_Tencode', 'PoolQC_Tencode|BldgType_Tencode', 'ExterCond_Tencode|GarageType_Tencode', 'TotRmsAbvGrd|PavedDrive_Tencode', 'PoolQC_Tencode|GarageType_Tencode', 'ExterQual_Tencode|Exterior2nd_Tencode', 'LandContour_Tencode|WoodDeckSF', 'Fence_Tencode|BsmtFinType1_Tencode', 'Alley_Tencode|PoolQC_Tencode', 'LowQualFinSF|MiscVal', 'KitchenAbvGr|HeatingQC_Tencode', 'Utilities_Tencode|OverallQual', 'TotalBsmtSF|Foundation_Tencode', 'KitchenAbvGr|Functional_Tencode', 'GarageYrBlt|OverallQual', 'Exterior1st_Tencode|3SsnPorch', 'YrSold', 'BsmtFullBath|LotShape_Tencode', 'MiscVal|Functional_Tencode', 'GarageYrBlt|BsmtFinType2_Tencode', 'Fireplaces|MiscFeature_Tencode', '3SsnPorch|ExterQual_Tencode', 'WoodDeckSF|MiscFeature_Tencode', 'FullBath|BsmtQual_Tencode', 'MoSold|Functional_Tencode', 'GarageYrBlt|HouseStyle_Tencode', 'Condition2_Tencode|BldgType_Tencode', 'GrLivArea|MoSold', 'GarageCond_Tencode|Fence_Tencode', 'Alley_Tencode|GarageCars', 'GrLivArea|HalfBath', 'MiscVal|BedroomAbvGr', 'LandContour_Tencode|MSZoning_Tencode', 'TotalBsmtSF|MiscFeature_Tencode', 'FireplaceQu_Tencode|MasVnrArea', 'KitchenAbvGr|RoofStyle_Tencode', 'YrSold|Heating_Tencode', '3SsnPorch|GarageYrBlt', 'PavedDrive_Tencode|LandSlope_Tencode', 'LandSlope_Tencode|Functional_Tencode', 'ScreenPorch|LotConfig_Tencode', 'LandContour_Tencode|BsmtCond_Tencode', 'ExterCond_Tencode|Electrical_Tencode', 'MasVnrType_Tencode|HouseStyle_Tencode', 'Fireplaces|3SsnPorch', 'EnclosedPorch|OverallCond', 'FullBath|GarageFinish_Tencode', 'Fence_Tencode|HalfBath', 'Fence_Tencode|OverallCond', 'Street_Tencode|BldgType_Tencode', 'BsmtFullBath|FullBath', 'GarageFinish_Tencode|Heating_Tencode', 'CentralAir_Tencode|Utilities_Tencode', 'Alley_Tencode|PoolArea', 'Exterior1st_Tencode|FullBath', 'BldgType_Tencode', 'BsmtFinSF1|HouseStyle_Tencode', 'Exterior1st_Tencode|RoofStyle_Tencode', 'Condition1_Tencode|BsmtFinType2_Tencode', 'Utilities_Tencode|HalfBath', 'MSSubClass|1stFlrSF', 'Fence_Tencode|GarageQual_Tencode', 'LandContour_Tencode|GarageQual_Tencode', 'Heating_Tencode|OverallCond', 'RoofMatl_Tencode|LotArea', 'Street_Tencode|GarageArea', 'FullBath|GarageCars', 'BsmtHalfBath|Utilities_Tencode', 'MSZoning_Tencode|LowQualFinSF', 'BsmtCond_Tencode|LotShape_Tencode', 'MSSubClass|HeatingQC_Tencode', 'BsmtCond_Tencode|Neighborhood_Tencode', 'LotShape_Tencode|GarageCars', 'Fireplaces|BsmtHalfBath', 'PoolArea|PoolQC_Tencode', 'Fireplaces|KitchenQual_Tencode', 'MiscVal|YearBuilt', 'BsmtCond_Tencode|SaleType_Tencode', 'YearBuilt|SaleType_Tencode', 'BsmtFinType1_Tencode|SaleType_Tencode', 'FullBath|GarageQual_Tencode', 'ExterQual_Tencode|GarageQual_Tencode', 'BsmtQual_Tencode|Condition1_Tencode', '1stFlrSF|HouseStyle_Tencode', 'TotRmsAbvGrd|LowQualFinSF', 'TotRmsAbvGrd|Exterior1st_Tencode', 'Electrical_Tencode|3SsnPorch', 'TotalBsmtSF|LowQualFinSF', 'MSSubClass|BsmtHalfBath', 'BsmtQual_Tencode|GarageArea', 'WoodDeckSF|SaleType_Tencode', 'LotArea|GarageCars', 'GarageCars|HalfBath', 'MoSold|OpenPorchSF', 'GarageCond_Tencode|HeatingQC_Tencode', 'PavedDrive_Tencode|WoodDeckSF', 'KitchenAbvGr|PoolQC_Tencode', 'Exterior2nd_Tencode|GarageFinish_Tencode', '3SsnPorch|GarageFinish_Tencode', 'RoofMatl_Tencode|YrSold', 'BsmtFinSF2|BsmtHalfBath', 'MSZoning_Tencode|HouseStyle_Tencode', 'Foundation_Tencode|EnclosedPorch', 'Exterior1st_Tencode|PoolQC_Tencode', 'Fireplaces|OverallCond', 'BsmtQual_Tencode|LotArea', 'Electrical_Tencode|YrSold', 'FireplaceQu_Tencode|OpenPorchSF', 'Condition1_Tencode', 'GarageType_Tencode|MiscFeature_Tencode', 'LotFrontage|OverallCond', 'Foundation_Tencode|HalfBath', 'KitchenAbvGr|WoodDeckSF', 'BsmtExposure_Tencode|LotFrontage', 'CentralAir_Tencode|BedroomAbvGr', 'HeatingQC_Tencode|MiscFeature_Tencode', 'GarageYrBlt', 'PavedDrive_Tencode|YearBuilt', 'RoofStyle_Tencode|HeatingQC_Tencode', 'GarageQual_Tencode|OverallQual', 'ExterCond_Tencode|Functional_Tencode', 'Condition1_Tencode|OverallQual', 'LandContour_Tencode|Street_Tencode', 'MasVnrArea|MoSold', 'Condition2_Tencode|Heating_Tencode', 'Street_Tencode', 'YearBuilt|GarageQual_Tencode', 'Foundation_Tencode|BsmtFullBath', 'TotRmsAbvGrd|Functional_Tencode', 'LandContour_Tencode|GarageYrBlt', 'RoofStyle_Tencode|YearBuilt', 'TotalBsmtSF|GarageQual_Tencode', 'FullBath|HouseStyle_Tencode', '3SsnPorch|BsmtQual_Tencode', 'GarageYrBlt|GarageQual_Tencode', '1stFlrSF|ExterQual_Tencode', 'BsmtFinSF2|PavedDrive_Tencode', 'BsmtQual_Tencode|KitchenQual_Tencode', '3SsnPorch|LotShape_Tencode', 'BsmtFinType2_Tencode|OverallCond', 'MasVnrArea|LotConfig_Tencode', 'BsmtExposure_Tencode|LotConfig_Tencode', 'Fireplaces|Heating_Tencode', 'YrSold|OverallCond', 'BsmtExposure_Tencode|SaleCondition_Tencode', 'YrSold|GarageCond_Tencode', 'BsmtExposure_Tencode|ScreenPorch', '2ndFlrSF|OverallCond', 'BedroomAbvGr|HalfBath', 'FireplaceQu_Tencode|1stFlrSF', 'Fence_Tencode|LotShape_Tencode', '1stFlrSF|PoolQC_Tencode', 'LotFrontage|GarageFinish_Tencode', 'Exterior2nd_Tencode|BsmtFinType2_Tencode', 'YrSold|LotShape_Tencode', 'ExterQual_Tencode|LotFrontage', 'GrLivArea|PavedDrive_Tencode', 'PoolArea|LotFrontage', 'TotRmsAbvGrd|YearBuilt', 'Alley_Tencode|KitchenQual_Tencode', 'BsmtCond_Tencode|OverallCond', '2ndFlrSF|Exterior2nd_Tencode', 'Condition2_Tencode|YrSold', 'ScreenPorch|MasVnrType_Tencode', 'TotRmsAbvGrd|BsmtFinType1_Tencode', 'LotFrontage|Exterior2nd_Tencode', 'MSSubClass|LotFrontage', 'KitchenQual_Tencode|Utilities_Tencode', 'LandSlope_Tencode|RoofStyle_Tencode', '3SsnPorch|PoolQC_Tencode', 'Alley_Tencode|TotRmsAbvGrd', 'PoolArea|GarageCond_Tencode', 'Foundation_Tencode|GarageFinish_Tencode', 'WoodDeckSF|BsmtFinType2_Tencode', 'GarageCars|MiscFeature_Tencode', 'BsmtQual_Tencode|BsmtFinType2_Tencode', 'OpenPorchSF|LotArea', 'BsmtCond_Tencode|GarageQual_Tencode', 'OverallCond|SaleType_Tencode', 'Electrical_Tencode|LowQualFinSF', 'Electrical_Tencode|KitchenAbvGr', 'BsmtExposure_Tencode', 'Fence_Tencode|BsmtUnfSF', 'BsmtExposure_Tencode|KitchenQual_Tencode', 'TotalBsmtSF|Condition1_Tencode', 'Alley_Tencode|GarageFinish_Tencode', 'BsmtQual_Tencode|Street_Tencode', 'Electrical_Tencode|GarageType_Tencode', 'Foundation_Tencode|MiscVal', 'Electrical_Tencode|CentralAir_Tencode', 'GarageYrBlt|OverallCond', 'WoodDeckSF|BsmtCond_Tencode', 'BsmtHalfBath|GarageType_Tencode', 'BsmtQual_Tencode|HalfBath', 'PavedDrive_Tencode|GarageArea', 'PavedDrive_Tencode|BsmtHalfBath', 'Fireplaces|BsmtUnfSF', 'Alley_Tencode|BsmtCond_Tencode', 'PoolArea|EnclosedPorch', 'RoofStyle_Tencode|Functional_Tencode', 'GarageArea|SaleType_Tencode', 'LotArea|YearBuilt', 'EnclosedPorch|GarageArea', 'BsmtHalfBath|LotConfig_Tencode', 'Exterior1st_Tencode|WoodDeckSF', 'FullBath|GarageYrBlt', 'MoSold|ExterQual_Tencode', 'KitchenQual_Tencode|LotArea', '2ndFlrSF|LotShape_Tencode', 'BsmtFinSF2|RoofMatl_Tencode', 'BsmtHalfBath', 'Electrical_Tencode|WoodDeckSF', 'LotConfig_Tencode|MiscVal', 'ExterCond_Tencode|PoolArea', 'GarageYrBlt|BsmtUnfSF', 'BsmtFullBath|Exterior2nd_Tencode', 'GrLivArea|Functional_Tencode', 'LandContour_Tencode|BsmtQual_Tencode', 'BsmtHalfBath|CentralAir_Tencode', 'FullBath|BsmtHalfBath', 'BsmtQual_Tencode|WoodDeckSF', 'Functional_Tencode|Heating_Tencode', 'HeatingQC_Tencode|SaleType_Tencode', '1stFlrSF|MasVnrType_Tencode', 'PavedDrive_Tencode|OpenPorchSF', 'LotFrontage|Utilities_Tencode', 'MasVnrArea|KitchenQual_Tencode', 'MasVnrArea|WoodDeckSF', 'BsmtFullBath|HalfBath', 'TotalBsmtSF|EnclosedPorch', 'GarageArea|BsmtFinType2_Tencode', 'TotalBsmtSF|ScreenPorch', 'Fireplaces|LotFrontage', 'ExterQual_Tencode|MiscVal', 'TotalBsmtSF|BsmtFinType1_Tencode', '2ndFlrSF|MiscFeature_Tencode', 'PoolQC_Tencode', 'BsmtExposure_Tencode|BldgType_Tencode', 'BsmtFinSF1|Exterior1st_Tencode', 'MSSubClass|LandSlope_Tencode', 'Neighborhood_Tencode|OverallCond', 'YearBuilt|GarageCars', 'BsmtFullBath|2ndFlrSF', 'YearBuilt|Neighborhood_Tencode', 'YrSold|MiscVal', 'GarageCond_Tencode|BldgType_Tencode', 'Condition1_Tencode|MiscFeature_Tencode', 'ExterQual_Tencode|Street_Tencode', 'BsmtFinSF2|GarageCars', 'PavedDrive_Tencode|RoofStyle_Tencode', 'EnclosedPorch|GarageCond_Tencode', 'MasVnrArea|Condition1_Tencode', 'LotConfig_Tencode|Exterior2nd_Tencode', 'GarageQual_Tencode', 'LowQualFinSF|LotArea', 'WoodDeckSF|Exterior2nd_Tencode', 'LotFrontage|LotArea', '3SsnPorch|SaleCondition_Tencode', 'PoolQC_Tencode|YearBuilt', 'LowQualFinSF|HeatingQC_Tencode', 'GarageCond_Tencode|MiscVal', 'PoolArea|Street_Tencode', 'Fence_Tencode|KitchenQual_Tencode', '3SsnPorch|SaleType_Tencode', 'YrSold|PavedDrive_Tencode', 'YrSold|Condition1_Tencode', 'BsmtUnfSF|OverallQual', 'ExterCond_Tencode|LotShape_Tencode', 'ExterCond_Tencode|2ndFlrSF', 'FireplaceQu_Tencode', 'KitchenQual_Tencode|HalfBath', 'MSZoning_Tencode|Street_Tencode', 'RoofStyle_Tencode|LotFrontage', 'Fence_Tencode|MiscFeature_Tencode', 'BsmtFinSF1|3SsnPorch', 'MasVnrArea|LowQualFinSF', 'SaleCondition_Tencode|GarageFinish_Tencode', 'GrLivArea|BsmtFinType1_Tencode', 'Foundation_Tencode|GarageType_Tencode', 'Condition1_Tencode|PoolQC_Tencode', 'LandSlope_Tencode|Exterior2nd_Tencode', 'FullBath|MasVnrType_Tencode', 'PoolArea|MiscVal', 'GrLivArea', 'YearRemodAdd|EnclosedPorch', 'LowQualFinSF|YearBuilt', 'MSSubClass|MiscFeature_Tencode', 'GarageFinish_Tencode|BsmtFinType2_Tencode', 'Exterior2nd_Tencode|KitchenQual_Tencode', 'GarageYrBlt|BsmtFinType1_Tencode', 'BsmtFullBath|Street_Tencode', 'MSZoning_Tencode|ScreenPorch', 'YrSold|BedroomAbvGr', 'Exterior2nd_Tencode|PoolQC_Tencode', 'ExterCond_Tencode|KitchenAbvGr', 'RoofMatl_Tencode|ExterQual_Tencode', 'GrLivArea|Exterior2nd_Tencode', 'Street_Tencode|GarageType_Tencode', 'YrSold|YearBuilt', 'SaleCondition_Tencode|GarageYrBlt', 'TotRmsAbvGrd|BedroomAbvGr', 'BedroomAbvGr|GarageQual_Tencode', 'YearRemodAdd|WoodDeckSF', 'Neighborhood_Tencode|GarageType_Tencode', 'BsmtFinSF2|PoolArea', 'BsmtFinType1_Tencode|GarageType_Tencode', 'BsmtFinSF2|LotShape_Tencode', 'MSSubClass|MSZoning_Tencode', 'TotalBsmtSF|GrLivArea', 'BsmtFullBath|3SsnPorch', 'PavedDrive_Tencode|BsmtUnfSF', 'MasVnrArea|BedroomAbvGr', 'LandContour_Tencode|SaleType_Tencode', 'KitchenQual_Tencode|BedroomAbvGr', 'SaleType_Tencode|HouseStyle_Tencode', 'GrLivArea|GarageFinish_Tencode', 'GrLivArea|Fence_Tencode', 'BsmtQual_Tencode|Neighborhood_Tencode', 'FireplaceQu_Tencode|BsmtFullBath', 'SaleCondition_Tencode|Fence_Tencode', 'KitchenAbvGr|Fence_Tencode', 'KitchenAbvGr|Exterior1st_Tencode', 'MSSubClass|GrLivArea', 'BsmtUnfSF|MasVnrType_Tencode', 'BsmtUnfSF|BedroomAbvGr', '1stFlrSF|BldgType_Tencode', 'ExterCond_Tencode|BsmtExposure_Tencode', 'Exterior2nd_Tencode|HouseStyle_Tencode', 'RoofStyle_Tencode|BsmtFinType2_Tencode', 'LotShape_Tencode|HouseStyle_Tencode', 'BsmtExposure_Tencode|LotArea', 'YrSold|Neighborhood_Tencode', 'EnclosedPorch|BsmtUnfSF', 'RoofStyle_Tencode|GarageCars', 'Condition2_Tencode|ScreenPorch', 'LotConfig_Tencode|Functional_Tencode', 'ExterCond_Tencode|GarageArea', 'WoodDeckSF|OverallCond', 'BsmtExposure_Tencode|MSZoning_Tencode', '1stFlrSF|MiscVal', '1stFlrSF|WoodDeckSF', 'BsmtFullBath|SaleType_Tencode', 'MSZoning_Tencode|BsmtCond_Tencode', '1stFlrSF|MiscFeature_Tencode', 'FullBath|SaleType_Tencode', 'YearRemodAdd|OverallQual', 'CentralAir_Tencode|BsmtUnfSF', 'Exterior1st_Tencode|EnclosedPorch', 'TotalBsmtSF|Fireplaces', 'KitchenAbvGr|OverallCond', 'OpenPorchSF|HeatingQC_Tencode', 'FullBath|MiscVal', 'TotRmsAbvGrd|ScreenPorch', 'OpenPorchSF', 'BsmtQual_Tencode|Utilities_Tencode', 'BsmtFinSF1|GarageType_Tencode', 'BsmtFinSF1|SaleType_Tencode', 'OverallCond', 'FireplaceQu_Tencode|TotRmsAbvGrd', 'PoolArea|Heating_Tencode', 'BsmtQual_Tencode|MasVnrType_Tencode', 'TotRmsAbvGrd|LotShape_Tencode', 'OpenPorchSF|MiscFeature_Tencode', 'LotFrontage|LotConfig_Tencode', 'BsmtUnfSF|LotArea', 'ExterCond_Tencode|PoolQC_Tencode', 'PoolQC_Tencode|KitchenQual_Tencode', 'RoofStyle_Tencode|LotArea', 'BsmtQual_Tencode|LowQualFinSF', 'ExterCond_Tencode|GarageCond_Tencode', 'Foundation_Tencode|PavedDrive_Tencode', 'GarageCond_Tencode|GarageQual_Tencode', 'YearRemodAdd|GarageArea', 'KitchenAbvGr|GarageYrBlt', 'Fireplaces|1stFlrSF', 'WoodDeckSF|HalfBath', 'RoofMatl_Tencode|Street_Tencode', 'FullBath|BsmtFinType1_Tencode', 'TotRmsAbvGrd|Condition2_Tencode', 'LandContour_Tencode|Utilities_Tencode', 'MSZoning_Tencode|SaleCondition_Tencode', 'SaleCondition_Tencode|CentralAir_Tencode', 'WoodDeckSF|OpenPorchSF', 'Condition2_Tencode|BedroomAbvGr', 'Alley_Tencode|EnclosedPorch', 'BsmtFinSF1|Street_Tencode', 'CentralAir_Tencode|Heating_Tencode', 'MSSubClass|Condition1_Tencode', 'Street_Tencode|Utilities_Tencode', 'Exterior1st_Tencode|ExterQual_Tencode', 'EnclosedPorch|LowQualFinSF', 'BsmtQual_Tencode|OpenPorchSF', 'MSZoning_Tencode|OverallQual', 'Fireplaces|Utilities_Tencode', 'MoSold|GarageYrBlt', 'LotConfig_Tencode|HouseStyle_Tencode', 'LotFrontage|OverallQual', 'Foundation_Tencode|BedroomAbvGr', 'LandContour_Tencode|KitchenQual_Tencode', 'Fireplaces|MasVnrType_Tencode', 'CentralAir_Tencode|MasVnrType_Tencode', '2ndFlrSF|PoolQC_Tencode', 'YrSold|BsmtCond_Tencode', 'Foundation_Tencode|MiscFeature_Tencode', 'MoSold|GarageCars', '1stFlrSF|LotShape_Tencode', 'MasVnrArea|HouseStyle_Tencode', 'BsmtUnfSF|Condition1_Tencode', 'LandSlope_Tencode|GarageCars', 'Condition2_Tencode|Utilities_Tencode', 'Foundation_Tencode|BsmtFinSF1', 'BsmtFinSF2|OpenPorchSF', 'Condition2_Tencode|GarageType_Tencode', 'Foundation_Tencode|BsmtExposure_Tencode', 'KitchenQual_Tencode|GarageQual_Tencode', 'MasVnrArea|MasVnrType_Tencode', 'LotFrontage|MiscVal', 'GarageCond_Tencode|GarageArea', 'LowQualFinSF|BsmtCond_Tencode', 'MasVnrArea|GarageQual_Tencode', 'Functional_Tencode|YearBuilt', 'MasVnrArea|BsmtExposure_Tencode', 'BsmtUnfSF|GarageType_Tencode', '3SsnPorch|YearBuilt', 'ExterCond_Tencode|LandContour_Tencode', 'Electrical_Tencode|FireplaceQu_Tencode', 'MoSold|Neighborhood_Tencode', 'BsmtQual_Tencode|BedroomAbvGr', 'LandContour_Tencode|Fence_Tencode', 'RoofStyle_Tencode|BedroomAbvGr', 'LandSlope_Tencode|Neighborhood_Tencode', 'BsmtHalfBath|MasVnrType_Tencode', 'Alley_Tencode|BsmtFinType1_Tencode', 'BsmtFullBath|ScreenPorch', 'WoodDeckSF|Neighborhood_Tencode', 'LotShape_Tencode|OverallQual', 'YearRemodAdd|3SsnPorch', 'MSSubClass|GarageQual_Tencode', 'LandContour_Tencode|Condition2_Tencode', 'Foundation_Tencode|LotConfig_Tencode', 'ExterQual_Tencode|HalfBath', 'Alley_Tencode|ExterQual_Tencode', 'BsmtFinSF2|PoolQC_Tencode', 'YrSold|LotConfig_Tencode', 'Foundation_Tencode|ScreenPorch', 'TotRmsAbvGrd|BsmtCond_Tencode', 'GrLivArea|1stFlrSF', 'Condition2_Tencode|OverallCond', 'BsmtCond_Tencode|LotArea', 'Condition2_Tencode|RoofMatl_Tencode', 'CentralAir_Tencode|HouseStyle_Tencode', 'TotRmsAbvGrd|MSZoning_Tencode', 'MoSold|YrSold', 'RoofStyle_Tencode|KitchenQual_Tencode', 'KitchenAbvGr|Exterior2nd_Tencode', 'Exterior1st_Tencode|Neighborhood_Tencode', 'GrLivArea|GarageType_Tencode', 'KitchenAbvGr|GarageQual_Tencode', 'MiscVal|BldgType_Tencode', 'MasVnrArea|GarageType_Tencode', 'RoofMatl_Tencode|WoodDeckSF', 'MiscVal|HeatingQC_Tencode', 'MasVnrArea|1stFlrSF', 'Functional_Tencode|Neighborhood_Tencode', 'Condition2_Tencode|OverallQual', 'PoolQC_Tencode|HouseStyle_Tencode', 'LandSlope_Tencode|OpenPorchSF', 'PoolQC_Tencode|HeatingQC_Tencode', 'RoofStyle_Tencode|HouseStyle_Tencode', '3SsnPorch|GarageCond_Tencode', 'LotArea|BsmtFinType1_Tencode', '1stFlrSF', 'LandSlope_Tencode|OverallCond', '3SsnPorch|CentralAir_Tencode', 'Condition2_Tencode|YearBuilt', 'LandContour_Tencode|BsmtFinType2_Tencode', 'OverallCond|HouseStyle_Tencode', 'MSSubClass|BedroomAbvGr', 'Condition2_Tencode|GarageArea', 'Fireplaces|MiscVal', '2ndFlrSF|GarageFinish_Tencode', 'CentralAir_Tencode|HalfBath', 'PavedDrive_Tencode|GarageType_Tencode', 'GarageYrBlt|LotConfig_Tencode', 'BsmtFinType2_Tencode|Heating_Tencode', 'OpenPorchSF|BldgType_Tencode', 'LowQualFinSF|BedroomAbvGr', 'KitchenQual_Tencode|OpenPorchSF', 'SaleCondition_Tencode|SaleType_Tencode', 'BsmtUnfSF|KitchenQual_Tencode', 'BsmtExposure_Tencode|2ndFlrSF', 'Electrical_Tencode|MoSold', 'LandSlope_Tencode|BedroomAbvGr', 'BsmtFinSF2|OverallQual', 'Electrical_Tencode|BldgType_Tencode', 'LandContour_Tencode|PavedDrive_Tencode', 'LandContour_Tencode|RoofStyle_Tencode', 'Functional_Tencode|OverallQual', 'Fireplaces|LotArea', 'MasVnrArea|Exterior2nd_Tencode', 'TotalBsmtSF|3SsnPorch', '3SsnPorch|HouseStyle_Tencode', 'Functional_Tencode|MiscFeature_Tencode', '3SsnPorch|OverallQual', 'FireplaceQu_Tencode|Heating_Tencode', 'MiscVal|MasVnrType_Tencode', 'ExterCond_Tencode|HeatingQC_Tencode', 'TotRmsAbvGrd|RoofMatl_Tencode', 'EnclosedPorch|Utilities_Tencode', 'TotRmsAbvGrd|HalfBath', 'Condition1_Tencode|HalfBath', 'GrLivArea|MiscVal', '3SsnPorch|HeatingQC_Tencode', 'BsmtExposure_Tencode|WoodDeckSF', 'BsmtFinSF1|RoofStyle_Tencode', 'LotFrontage|BsmtUnfSF', 'OpenPorchSF|LotShape_Tencode', 'MSSubClass|PoolQC_Tencode', 'MasVnrType_Tencode|GarageType_Tencode', 'ExterCond_Tencode|Alley_Tencode', 'BsmtFinSF2|LotFrontage', 'BsmtQual_Tencode|PavedDrive_Tencode', 'BsmtFullBath|MasVnrType_Tencode', 'RoofStyle_Tencode|GarageCond_Tencode', 'CentralAir_Tencode|Functional_Tencode', 'ExterCond_Tencode|Heating_Tencode', 'GarageArea|HalfBath', 'CentralAir_Tencode|GarageCond_Tencode', 'BsmtFinSF1|2ndFlrSF', 'BsmtFinSF1|MasVnrType_Tencode', 'KitchenAbvGr|LotConfig_Tencode', 'BsmtFinSF2|BsmtUnfSF', 'LandSlope_Tencode|KitchenQual_Tencode', 'RoofMatl_Tencode|SaleCondition_Tencode', '3SsnPorch|GarageArea', 'GarageCars|SaleType_Tencode', 'ScreenPorch|Exterior1st_Tencode', 'LotFrontage|LotShape_Tencode', 'LowQualFinSF|BsmtUnfSF', 'Foundation_Tencode|MSZoning_Tencode', 'PoolArea|Condition1_Tencode', 'ExterQual_Tencode|OpenPorchSF', 'MasVnrType_Tencode|HalfBath', 'LowQualFinSF|Street_Tencode', 'SaleCondition_Tencode|LotShape_Tencode', 'RoofStyle_Tencode|EnclosedPorch', 'GrLivArea|BsmtUnfSF', 'GarageYrBlt|Condition1_Tencode', 'MiscVal|LotArea', 'ExterCond_Tencode|MSSubClass', 'BsmtHalfBath|ExterQual_Tencode', 'PavedDrive_Tencode|GarageFinish_Tencode', 'KitchenAbvGr|2ndFlrSF', 'Alley_Tencode|HouseStyle_Tencode', 'TotalBsmtSF|Fence_Tencode', 'MSZoning_Tencode|Fence_Tencode', 'Electrical_Tencode|OverallQual', 'RoofMatl_Tencode|Heating_Tencode', 'SaleCondition_Tencode|MiscFeature_Tencode', 'BsmtHalfBath|LotShape_Tencode', 'Electrical_Tencode|PoolQC_Tencode', 'TotRmsAbvGrd|FullBath', 'BsmtExposure_Tencode|GarageCars', 'CentralAir_Tencode|GarageQual_Tencode', 'MSZoning_Tencode|GarageCond_Tencode', '3SsnPorch|OverallCond', 'Foundation_Tencode|GarageCars', 'OpenPorchSF|SaleType_Tencode', 'Fence_Tencode|Street_Tencode', 'MSSubClass|MoSold', 'GrLivArea|PoolArea', 'BsmtHalfBath|LotArea', '2ndFlrSF|LandSlope_Tencode', 'PoolArea|GarageArea', 'KitchenAbvGr|YrSold', 'TotalBsmtSF|OpenPorchSF', 'BsmtExposure_Tencode|ExterQual_Tencode', 'BsmtFinSF2|GrLivArea', 'PavedDrive_Tencode|Utilities_Tencode', 'ScreenPorch|Exterior2nd_Tencode', 'TotalBsmtSF|HouseStyle_Tencode', 'LowQualFinSF|GarageArea', 'BsmtFinSF2|BsmtExposure_Tencode', 'TotalBsmtSF|RoofMatl_Tencode', 'KitchenAbvGr|Neighborhood_Tencode', 'YearRemodAdd', 'LandContour_Tencode|BldgType_Tencode', 'LotArea|MasVnrType_Tencode', 'LotShape_Tencode|BsmtFinType2_Tencode', 'RoofStyle_Tencode|GarageArea', 'LotFrontage|OpenPorchSF', 'Alley_Tencode|OverallCond', 'TotalBsmtSF|Heating_Tencode', 'LotShape_Tencode|HalfBath', 'GrLivArea|PoolQC_Tencode', 'BsmtCond_Tencode|HalfBath', 'ExterQual_Tencode|BedroomAbvGr', 'HouseStyle_Tencode|OverallQual', 'Condition2_Tencode|LowQualFinSF', 'FullBath|BsmtFinType2_Tencode', 'Exterior1st_Tencode|BsmtQual_Tencode', 'GarageCond_Tencode|Condition1_Tencode', 'MiscVal|GarageCars', 'BsmtQual_Tencode', 'GarageYrBlt|LotShape_Tencode', 'SaleCondition_Tencode|Utilities_Tencode', 'GrLivArea|ExterQual_Tencode', 'TotRmsAbvGrd|BsmtQual_Tencode', 'Alley_Tencode|WoodDeckSF', 'Exterior1st_Tencode|Exterior2nd_Tencode', 'ExterCond_Tencode|WoodDeckSF', 'Functional_Tencode|LotArea', 'GarageYrBlt|HeatingQC_Tencode', 'MSSubClass|Utilities_Tencode', 'Neighborhood_Tencode|OverallQual', 'BsmtFinSF1|WoodDeckSF', 'Condition2_Tencode|MiscVal', 'CentralAir_Tencode|Neighborhood_Tencode', 'HeatingQC_Tencode|BsmtFinType2_Tencode', 'FireplaceQu_Tencode|GarageFinish_Tencode', 'Foundation_Tencode|1stFlrSF', 'YearRemodAdd|BsmtFinSF1', 'GarageFinish_Tencode|GarageArea', '2ndFlrSF|PavedDrive_Tencode', 'MiscVal|BsmtUnfSF', 'FullBath|BsmtUnfSF', 'CentralAir_Tencode|SaleType_Tencode', 'BsmtFullBath|PavedDrive_Tencode', 'ExterCond_Tencode|YearBuilt', 'BsmtQual_Tencode|ExterQual_Tencode', 'Utilities_Tencode|SaleType_Tencode', 'KitchenAbvGr|SaleType_Tencode', 'Alley_Tencode|Exterior1st_Tencode', 'MSSubClass|BsmtFinType2_Tencode', 'MSZoning_Tencode|LotConfig_Tencode', 'LotShape_Tencode', 'OpenPorchSF|HouseStyle_Tencode', 'EnclosedPorch|BldgType_Tencode', 'GarageFinish_Tencode|Condition1_Tencode', 'FireplaceQu_Tencode|GarageQual_Tencode', 'MSSubClass|OverallQual', 'Fence_Tencode|SaleType_Tencode', 'GarageCond_Tencode|Utilities_Tencode', 'Alley_Tencode|BsmtFinType2_Tencode', 'BsmtExposure_Tencode|BsmtFinType1_Tencode', 'LandSlope_Tencode|BsmtFinType1_Tencode', 'FireplaceQu_Tencode|Alley_Tencode', 'TotRmsAbvGrd|MiscFeature_Tencode', 'BsmtExposure_Tencode|Functional_Tencode', 'KitchenAbvGr|MiscVal', 'BsmtFinSF1|BsmtCond_Tencode', 'TotRmsAbvGrd|PoolQC_Tencode', 'LandContour_Tencode|Fireplaces', 'MasVnrArea|RoofMatl_Tencode', 'EnclosedPorch|HouseStyle_Tencode', 'EnclosedPorch|Heating_Tencode', 'GarageYrBlt|MiscFeature_Tencode', 'RoofMatl_Tencode|PoolArea', 'TotalBsmtSF|BsmtFullBath', 'MSSubClass|OpenPorchSF', 'MSZoning_Tencode|Functional_Tencode', 'YearBuilt|HalfBath', 'GarageYrBlt|GarageCond_Tencode', 'BsmtCond_Tencode|GarageArea', 'Exterior2nd_Tencode|GarageType_Tencode', 'HouseStyle_Tencode', 'LowQualFinSF|OverallQual', 'LandContour_Tencode|2ndFlrSF', 'BsmtHalfBath|KitchenQual_Tencode', 'YrSold|SaleType_Tencode', 'Fireplaces|LandSlope_Tencode', 'Alley_Tencode|YearRemodAdd', 'GrLivArea|BsmtFullBath', 'FireplaceQu_Tencode|BsmtQual_Tencode', 'LowQualFinSF|KitchenQual_Tencode', 'MSSubClass|GarageType_Tencode', 'MiscVal', 'LandContour_Tencode|BsmtFinSF2', 'BsmtExposure_Tencode|MiscVal', 'MasVnrArea|Exterior1st_Tencode', '3SsnPorch|BsmtFinType2_Tencode', 'BsmtQual_Tencode|GarageCars', 'BsmtQual_Tencode|HouseStyle_Tencode', 'PoolArea|ExterQual_Tencode', 'LandContour_Tencode|CentralAir_Tencode', 'Fireplaces|YrSold', 'ScreenPorch|LowQualFinSF', '2ndFlrSF|1stFlrSF', 'BsmtFinSF1|MiscVal', 'LowQualFinSF|BsmtFinType2_Tencode', 'Condition2_Tencode|MasVnrType_Tencode', 'TotalBsmtSF|BsmtFinSF1', 'PoolArea|GarageFinish_Tencode', 'Fence_Tencode|Condition1_Tencode', '2ndFlrSF', 'BsmtUnfSF|PoolQC_Tencode', 'Alley_Tencode|MSSubClass', 'PoolQC_Tencode|BsmtFinType1_Tencode', 'MoSold|MasVnrType_Tencode', 'BsmtFinType1_Tencode|HouseStyle_Tencode', 'BsmtFinType2_Tencode|GarageType_Tencode', 'RoofMatl_Tencode|LandSlope_Tencode', 'CentralAir_Tencode|BldgType_Tencode', 'LandSlope_Tencode|OverallQual', 'RoofStyle_Tencode|BsmtCond_Tencode', 'GarageArea|HouseStyle_Tencode', 'Electrical_Tencode|BsmtFinType1_Tencode', 'OpenPorchSF|Heating_Tencode', 'Fence_Tencode|OverallQual', 'Fireplaces|MoSold', 'Foundation_Tencode|Exterior1st_Tencode', 'PavedDrive_Tencode|GarageQual_Tencode', 'MasVnrArea|Heating_Tencode', 'YrSold|HouseStyle_Tencode', 'LotConfig_Tencode|HalfBath', 'Exterior1st_Tencode|BsmtUnfSF', 'BsmtFinSF1|OpenPorchSF', 'Exterior1st_Tencode|YrSold', 'GarageYrBlt|MiscVal', '2ndFlrSF|FullBath', 'KitchenAbvGr|3SsnPorch', 'MSZoning_Tencode|GarageYrBlt', 'BldgType_Tencode|YearBuilt', 'PoolQC_Tencode|MiscFeature_Tencode', 'LandSlope_Tencode|LotConfig_Tencode', 'ScreenPorch|GarageCond_Tencode', 'ExterQual_Tencode|PoolQC_Tencode', 'BldgType_Tencode|Utilities_Tencode', 'BsmtFinSF2|GarageType_Tencode', 'Neighborhood_Tencode|SaleType_Tencode', '3SsnPorch|BsmtFinType1_Tencode', '2ndFlrSF|SaleType_Tencode', 'BsmtExposure_Tencode|BedroomAbvGr', 'Alley_Tencode|OpenPorchSF', '2ndFlrSF|Heating_Tencode', 'FireplaceQu_Tencode|BsmtExposure_Tencode', 'Condition2_Tencode|RoofStyle_Tencode', 'YearRemodAdd|CentralAir_Tencode', 'LotArea|OverallQual', 'Foundation_Tencode|BsmtUnfSF', 'EnclosedPorch|SaleType_Tencode', 'LandContour_Tencode|BsmtFinSF1', 'BsmtHalfBath|BsmtCond_Tencode', 'Electrical_Tencode|MiscFeature_Tencode', '3SsnPorch|WoodDeckSF', 'Fireplaces|GarageQual_Tencode', 'LandContour_Tencode|BsmtFinType1_Tencode', 'FireplaceQu_Tencode|RoofMatl_Tencode', 'MSSubClass|Exterior2nd_Tencode', 'ExterCond_Tencode|LowQualFinSF', 'Electrical_Tencode|Condition2_Tencode', 'RoofMatl_Tencode|PoolQC_Tencode', 'LandContour_Tencode|OverallCond', 'LowQualFinSF|Utilities_Tencode', 'BsmtQual_Tencode|PoolQC_Tencode', 'GrLivArea|OverallCond', 'HeatingQC_Tencode|Heating_Tencode', 'RoofMatl_Tencode|Functional_Tencode', 'ExterCond_Tencode|Fence_Tencode', 'Fireplaces|GarageCond_Tencode', 'YearBuilt', 'OpenPorchSF|BsmtFinType2_Tencode', 'Neighborhood_Tencode|HouseStyle_Tencode', 'Fireplaces|RoofStyle_Tencode', 'GarageCond_Tencode|BsmtFinType2_Tencode', 'MoSold|BldgType_Tencode', 'LandContour_Tencode|BsmtExposure_Tencode', 'BsmtHalfBath|PoolQC_Tencode', 'BsmtQual_Tencode|GarageCond_Tencode', 'Exterior1st_Tencode|Functional_Tencode', 'ScreenPorch|YearBuilt', 'MiscVal|GarageType_Tencode', 'BsmtExposure_Tencode|GarageCond_Tencode', 'GarageQual_Tencode|MasVnrType_Tencode', 'TotRmsAbvGrd|Exterior2nd_Tencode', 'LandContour_Tencode|LotConfig_Tencode', 'GarageArea|Utilities_Tencode', 'MSZoning_Tencode|LotShape_Tencode', 'LotShape_Tencode|OverallCond', 'LotConfig_Tencode|BsmtCond_Tencode', 'MasVnrArea', 'MSSubClass|BsmtFinSF1', 'GarageCond_Tencode|GarageFinish_Tencode', 'Alley_Tencode|CentralAir_Tencode', 'LandContour_Tencode|GarageType_Tencode', 'GarageArea|GarageType_Tencode', 'Foundation_Tencode|MoSold', 'BldgType_Tencode|GarageQual_Tencode', 'Alley_Tencode|Utilities_Tencode', 'BldgType_Tencode|Heating_Tencode', 'YearRemodAdd|LotConfig_Tencode', 'BsmtFinSF2|WoodDeckSF', 'KitchenAbvGr|TotRmsAbvGrd', 'BsmtExposure_Tencode|Condition1_Tencode', 'LotFrontage|KitchenQual_Tencode', 'Exterior1st_Tencode', 'BsmtExposure_Tencode|EnclosedPorch', 'BsmtCond_Tencode|Condition1_Tencode', 'BsmtFinSF2|MoSold', 'GrLivArea|GarageCars', '2ndFlrSF|EnclosedPorch', 'CentralAir_Tencode|Exterior2nd_Tencode', '1stFlrSF|GarageCars', 'MoSold|Exterior1st_Tencode', 'FullBath|WoodDeckSF', '2ndFlrSF|GarageType_Tencode', 'GrLivArea|OpenPorchSF', 'Electrical_Tencode|PoolArea', 'BsmtExposure_Tencode|OverallQual', 'MSZoning_Tencode|SaleType_Tencode', 'RoofMatl_Tencode|Exterior1st_Tencode', '2ndFlrSF|GarageCond_Tencode', 'Neighborhood_Tencode|MiscFeature_Tencode', 'RoofStyle_Tencode|MasVnrType_Tencode', 'GarageCond_Tencode|OverallCond', '3SsnPorch|Utilities_Tencode', 'GarageYrBlt|BsmtCond_Tencode', 'MSSubClass|Street_Tencode', 'MoSold|KitchenQual_Tencode', 'LotConfig_Tencode', 'EnclosedPorch|OpenPorchSF', 'Alley_Tencode|MiscFeature_Tencode', 'Street_Tencode|OpenPorchSF', '1stFlrSF|BedroomAbvGr', 'ExterCond_Tencode|Street_Tencode', 'FireplaceQu_Tencode|GrLivArea', 'BsmtQual_Tencode|LandSlope_Tencode', 'BsmtFinSF1|YearBuilt', 'BsmtCond_Tencode|MiscFeature_Tencode', 'LotConfig_Tencode|Utilities_Tencode', 'ExterCond_Tencode|SaleCondition_Tencode', 'EnclosedPorch|LotShape_Tencode', 'BsmtQual_Tencode|EnclosedPorch', 'RoofMatl_Tencode|CentralAir_Tencode', 'BsmtQual_Tencode|YearBuilt', 'FireplaceQu_Tencode|EnclosedPorch', 'Condition2_Tencode|SaleType_Tencode', 'GarageYrBlt|SaleType_Tencode', 'Condition2_Tencode|BsmtFinSF1', 'BsmtCond_Tencode|Functional_Tencode', 'Electrical_Tencode|Utilities_Tencode', 'Alley_Tencode|LandSlope_Tencode', 'CentralAir_Tencode|Fence_Tencode', 'BsmtFullBath|WoodDeckSF', 'TotalBsmtSF|PoolQC_Tencode', '1stFlrSF|YrSold', 'Exterior1st_Tencode|LowQualFinSF', 'EnclosedPorch|GarageType_Tencode', 'BldgType_Tencode|OverallQual', 'LotFrontage|BldgType_Tencode', 'LotFrontage|GarageArea', 'SaleCondition_Tencode|HeatingQC_Tencode', 'KitchenAbvGr|Utilities_Tencode', 'CentralAir_Tencode|MiscFeature_Tencode', '3SsnPorch|LotConfig_Tencode', 'BsmtFinSF1|SaleCondition_Tencode', 'YrSold|Functional_Tencode', 'Alley_Tencode|Functional_Tencode', 'LandSlope_Tencode|PoolQC_Tencode', 'MSZoning_Tencode|CentralAir_Tencode', 'GarageFinish_Tencode|PoolQC_Tencode', 'FireplaceQu_Tencode|LotFrontage', 'Electrical_Tencode|BsmtQual_Tencode', 'BldgType_Tencode|HouseStyle_Tencode', 'ExterCond_Tencode|Foundation_Tencode', '2ndFlrSF|RoofStyle_Tencode', 'KitchenQual_Tencode|HeatingQC_Tencode', 'Fireplaces|CentralAir_Tencode', 'LandContour_Tencode|OverallQual', 'RoofStyle_Tencode', 'MiscVal|Utilities_Tencode', 'BsmtFullBath|KitchenQual_Tencode', 'BsmtHalfBath|OpenPorchSF', 'BedroomAbvGr|BsmtFinType1_Tencode', 'FullBath|HalfBath', 'KitchenAbvGr|BsmtFinSF1', 'YearRemodAdd|BsmtQual_Tencode', 'RoofStyle_Tencode|Heating_Tencode', 'MoSold|FullBath', 'Fence_Tencode|Utilities_Tencode', 'LandContour_Tencode|BsmtUnfSF', 'BsmtExposure_Tencode|OverallCond', 'BsmtHalfBath|GarageArea', 'MSSubClass|YrSold', 'GrLivArea|YearRemodAdd', 'Fireplaces|GarageFinish_Tencode', 'BsmtQual_Tencode|CentralAir_Tencode', 'Street_Tencode|KitchenQual_Tencode', 'EnclosedPorch|GarageCars', 'ExterQual_Tencode|Neighborhood_Tencode', 'KitchenAbvGr|OverallQual', 'Exterior1st_Tencode|LotConfig_Tencode', 'Fence_Tencode|MasVnrType_Tencode', 'CentralAir_Tencode|PoolQC_Tencode', 'LotShape_Tencode|MasVnrType_Tencode', 'Exterior1st_Tencode|Heating_Tencode', 'Exterior2nd_Tencode|BsmtUnfSF', 'GarageYrBlt|Fence_Tencode', 'EnclosedPorch|OverallQual', 'YrSold|SaleCondition_Tencode', 'YearRemodAdd|PoolArea', 'GarageFinish_Tencode|HeatingQC_Tencode', '2ndFlrSF|MoSold', 'GarageCond_Tencode|BsmtFinType1_Tencode', 'SaleCondition_Tencode|BsmtUnfSF', 'Condition2_Tencode|BsmtFullBath', 'BsmtHalfBath|MiscFeature_Tencode', 'YearRemodAdd|GarageType_Tencode', 'BsmtFinSF1|RoofMatl_Tencode', 'PavedDrive_Tencode', 'KitchenQual_Tencode|GarageArea', 'BsmtFinType1_Tencode|GarageCars', 'YrSold|LandSlope_Tencode', 'MSZoning_Tencode|ExterQual_Tencode', 'TotRmsAbvGrd|PoolArea', 'PavedDrive_Tencode|BldgType_Tencode', 'BsmtFinSF2|Heating_Tencode', 'YearRemodAdd|Neighborhood_Tencode', 'BsmtFinType2_Tencode|OverallQual', 'YearBuilt|HouseStyle_Tencode', 'BsmtFinSF2|BsmtFinSF1', 'LandSlope_Tencode|LotShape_Tencode', 'GarageCond_Tencode|HalfBath', 'Street_Tencode|GarageQual_Tencode', 'FireplaceQu_Tencode|BsmtHalfBath', 'LotArea|BldgType_Tencode', 'GarageArea|Heating_Tencode', 'MSZoning_Tencode|GarageQual_Tencode', 'KitchenAbvGr|GarageFinish_Tencode', '2ndFlrSF|BedroomAbvGr', 'MasVnrArea|OpenPorchSF', 'MSZoning_Tencode|FullBath', 'LotShape_Tencode|BsmtFinType1_Tencode', 'BsmtHalfBath|MiscVal', 'TotRmsAbvGrd|BsmtExposure_Tencode', 'GarageYrBlt|WoodDeckSF', 'Street_Tencode|Condition1_Tencode', 'RoofMatl_Tencode|Condition1_Tencode', '3SsnPorch|LandSlope_Tencode', 'Exterior1st_Tencode|BedroomAbvGr', 'BsmtFinType2_Tencode|GarageQual_Tencode', 'BsmtHalfBath|Heating_Tencode', 'MasVnrArea|LandSlope_Tencode', 'GarageFinish_Tencode|MiscFeature_Tencode', 'KitchenQual_Tencode|BsmtFinType2_Tencode', 'MasVnrArea|RoofStyle_Tencode', 'TotalBsmtSF|KitchenAbvGr', 'LandSlope_Tencode|Utilities_Tencode', 'KitchenQual_Tencode|MiscFeature_Tencode', 'RoofMatl_Tencode|MasVnrType_Tencode', 'Condition1_Tencode|HouseStyle_Tencode', 'Electrical_Tencode|GarageCars', 'SaleCondition_Tencode|Heating_Tencode', 'BsmtFullBath|BsmtHalfBath', 'FullBath|Heating_Tencode', 'Fireplaces|Functional_Tencode', 'WoodDeckSF|BsmtUnfSF', 'RoofMatl_Tencode|Fence_Tencode', 'FireplaceQu_Tencode|Fireplaces', 'GarageYrBlt|KitchenQual_Tencode', 'LowQualFinSF|GarageType_Tencode', 'Foundation_Tencode|Exterior2nd_Tencode', 'ExterCond_Tencode|BsmtFullBath', 'PavedDrive_Tencode|LotFrontage', 'Electrical_Tencode|Fence_Tencode', 'BsmtFinSF2|ExterQual_Tencode', 'ExterQual_Tencode|MasVnrType_Tencode', 'LandContour_Tencode|FireplaceQu_Tencode', 'GrLivArea|GarageYrBlt', 'Condition1_Tencode|HeatingQC_Tencode', 'KitchenQual_Tencode|GarageCars', 'KitchenAbvGr', 'EnclosedPorch|ExterQual_Tencode', 'LandContour_Tencode', 'Electrical_Tencode|BsmtFullBath', 'Street_Tencode|GarageCars', 'GrLivArea|KitchenQual_Tencode', 'YearRemodAdd|GarageYrBlt', 'Exterior1st_Tencode|GarageFinish_Tencode', 'MSSubClass|BsmtFullBath', 'MSZoning_Tencode|LandSlope_Tencode', 'WoodDeckSF|YearBuilt', 'BsmtFinSF1|BsmtUnfSF', 'TotalBsmtSF|MiscVal', 'GarageArea|GarageQual_Tencode', 'RoofMatl_Tencode|HeatingQC_Tencode', 'GrLivArea|MasVnrType_Tencode', 'TotalBsmtSF|Alley_Tencode', '3SsnPorch|Street_Tencode', 'Foundation_Tencode|CentralAir_Tencode', 'Fence_Tencode|LotArea', 'GarageYrBlt|LowQualFinSF', 'KitchenAbvGr|SaleCondition_Tencode', 'BedroomAbvGr|LotArea', 'Utilities_Tencode|HouseStyle_Tencode', '1stFlrSF|LotConfig_Tencode', 'LandSlope_Tencode|MasVnrType_Tencode', 'BsmtFinSF2|1stFlrSF', 'SaleCondition_Tencode|RoofStyle_Tencode', 'YearBuilt|OverallCond', 'BedroomAbvGr|BldgType_Tencode', 'YrSold|GarageYrBlt', 'LandContour_Tencode|PoolQC_Tencode', 'Exterior2nd_Tencode|GarageArea', 'BedroomAbvGr|YearBuilt', 'Foundation_Tencode|WoodDeckSF', 'MasVnrArea|Condition2_Tencode', 'MasVnrArea|GarageYrBlt', 'SaleCondition_Tencode|WoodDeckSF', 'Condition1_Tencode|BldgType_Tencode', 'BsmtHalfBath|RoofStyle_Tencode', 'Condition1_Tencode|GarageCars', '3SsnPorch|KitchenQual_Tencode', 'FireplaceQu_Tencode|YrSold', 'Fence_Tencode|PoolQC_Tencode', 'ExterCond_Tencode|Exterior2nd_Tencode', 'LotFrontage|Fence_Tencode', 'BsmtFinSF2|BsmtCond_Tencode', 'YearRemodAdd|PoolQC_Tencode', 'Fence_Tencode|Functional_Tencode', 'Functional_Tencode|HalfBath', 'TotalBsmtSF|BedroomAbvGr', '2ndFlrSF|Functional_Tencode', 'MSZoning_Tencode|RoofMatl_Tencode', 'ScreenPorch|BsmtFinType1_Tencode', 'MiscVal|MiscFeature_Tencode', 'BsmtFullBath|BsmtFinType2_Tencode', 'Electrical_Tencode|BsmtFinType2_Tencode', 'LandContour_Tencode|MiscVal', 'Fireplaces|Street_Tencode', 'LotShape_Tencode|Neighborhood_Tencode', 'BldgType_Tencode|HalfBath', 'Fireplaces|LotShape_Tencode', 'YrSold|BsmtHalfBath', 'ScreenPorch|YrSold', 'Fence_Tencode|Neighborhood_Tencode', 'KitchenAbvGr|BedroomAbvGr', 'BsmtUnfSF|GarageArea', 'ExterCond_Tencode|RoofMatl_Tencode', 'FireplaceQu_Tencode|LowQualFinSF', 'HeatingQC_Tencode|MasVnrType_Tencode', 'TotalBsmtSF|YrSold', 'KitchenAbvGr|GarageArea', 'LotFrontage|BsmtFinType2_Tencode', 'Street_Tencode|Functional_Tencode', 'LotArea|GarageQual_Tencode', 'MiscVal|Neighborhood_Tencode', 'GarageFinish_Tencode|HouseStyle_Tencode', 'BsmtQual_Tencode|LotFrontage', 'BsmtExposure_Tencode|MiscFeature_Tencode', 'BsmtFinSF2|SaleType_Tencode', 'Fence_Tencode|GarageFinish_Tencode', 'Fireplaces|GarageArea', 'MoSold|Exterior2nd_Tencode', 'TotRmsAbvGrd|CentralAir_Tencode', 'BsmtHalfBath|LotFrontage', 'BsmtFinSF1|GarageQual_Tencode', 'ScreenPorch|PoolQC_Tencode', 'BedroomAbvGr|GarageType_Tencode', '2ndFlrSF|LowQualFinSF', 'Heating_Tencode|MasVnrType_Tencode', 'PoolArea|OverallQual', 'BsmtFinSF2|MiscFeature_Tencode', 'ExterQual_Tencode|BsmtCond_Tencode', 'BsmtHalfBath|SaleType_Tencode', 'Foundation_Tencode|KitchenQual_Tencode', 'RoofMatl_Tencode|HalfBath', 'PoolQC_Tencode|OpenPorchSF', 'Electrical_Tencode|RoofMatl_Tencode', 'GarageYrBlt|Street_Tencode', 'GarageQual_Tencode|HouseStyle_Tencode', 'BsmtHalfBath|BsmtFinType2_Tencode', 'MSZoning_Tencode|MoSold', 'MSSubClass|Fence_Tencode', 'Alley_Tencode', 'LotConfig_Tencode|BsmtUnfSF', 'FireplaceQu_Tencode|LandSlope_Tencode', 'LotArea|MiscFeature_Tencode', 'Electrical_Tencode|OverallCond', 'FireplaceQu_Tencode|GarageArea', 'ExterCond_Tencode|Fireplaces', 'TotalBsmtSF|KitchenQual_Tencode', 'RoofMatl_Tencode|YearBuilt', 'Functional_Tencode|HouseStyle_Tencode', 'BsmtFinSF1|LowQualFinSF', 'KitchenAbvGr|Condition1_Tencode', 'MasVnrArea|SaleType_Tencode', 'YearRemodAdd|Condition1_Tencode', 'PavedDrive_Tencode|LotConfig_Tencode', '2ndFlrSF|GarageQual_Tencode', 'CentralAir_Tencode|Condition1_Tencode', '2ndFlrSF|LotArea', 'Condition2_Tencode|BsmtHalfBath', 'WoodDeckSF|BldgType_Tencode', 'BsmtUnfSF|Heating_Tencode', 'Fireplaces', 'Neighborhood_Tencode|MasVnrType_Tencode', 'BedroomAbvGr|MasVnrType_Tencode', 'BsmtFinSF1|BsmtHalfBath', 'FullBath|Utilities_Tencode', 'RoofMatl_Tencode|GarageCars', '1stFlrSF|LowQualFinSF', 'HeatingQC_Tencode|YearBuilt', 'PavedDrive_Tencode|ExterQual_Tencode', 'BsmtFinSF2|GarageArea', 'GarageType_Tencode|Utilities_Tencode', 'FireplaceQu_Tencode|WoodDeckSF', '2ndFlrSF|WoodDeckSF', 'YrSold|EnclosedPorch', 'WoodDeckSF|Street_Tencode', 'LandContour_Tencode|3SsnPorch', 'BsmtFinType2_Tencode|YearBuilt', 'Alley_Tencode|GrLivArea', 'MoSold|LotFrontage', 'FullBath|Condition1_Tencode', 'Electrical_Tencode|LandSlope_Tencode', 'PavedDrive_Tencode|Functional_Tencode', 'GarageYrBlt|LotFrontage', 'PavedDrive_Tencode|KitchenQual_Tencode', 'TotRmsAbvGrd|OpenPorchSF', 'FullBath|YrSold', 'MasVnrArea|Fireplaces', 'EnclosedPorch|GarageQual_Tencode', 'BsmtHalfBath|YearBuilt', 'BsmtFinSF1|ScreenPorch', 'LotConfig_Tencode|GarageCars', 'MasVnrArea|Functional_Tencode', 'PoolArea|3SsnPorch', 'LotConfig_Tencode|Fence_Tencode', 'BedroomAbvGr', 'PoolArea|LotConfig_Tencode', 'BsmtQual_Tencode|Heating_Tencode', 'GarageQual_Tencode|MiscFeature_Tencode', 'GarageCond_Tencode|OverallQual', 'TotalBsmtSF|GarageYrBlt', 'Condition2_Tencode|BsmtFinType2_Tencode', 'LotArea|Utilities_Tencode', 'ExterCond_Tencode|LotConfig_Tencode', 'Functional_Tencode|GarageCars', 'KitchenQual_Tencode', 'TotalBsmtSF|BsmtUnfSF', 'RoofMatl_Tencode|HouseStyle_Tencode', 'MiscVal|HouseStyle_Tencode', 'MasVnrArea|SaleCondition_Tencode', '1stFlrSF|Heating_Tencode', 'BsmtHalfBath|Neighborhood_Tencode', 'YrSold|GarageArea', 'BsmtExposure_Tencode|PoolArea', 'OpenPorchSF|YearBuilt', 'FireplaceQu_Tencode|BsmtFinType1_Tencode', 'YrSold|HeatingQC_Tencode', 'BsmtFinSF2|BsmtFinType1_Tencode', 'MSSubClass|Exterior1st_Tencode', 'Street_Tencode|BsmtFinType2_Tencode', 'Exterior1st_Tencode|OverallCond', 'BsmtFinSF1|LotFrontage', 'HeatingQC_Tencode|OverallCond', 'ExterCond_Tencode|MoSold', 'Electrical_Tencode|Fireplaces', 'Condition2_Tencode|2ndFlrSF', 'ScreenPorch|LotArea', 'ExterCond_Tencode|MasVnrArea', 'HalfBath|SaleType_Tencode', 'KitchenAbvGr|HouseStyle_Tencode', 'MSZoning_Tencode|1stFlrSF', 'FullBath|LandSlope_Tencode', 'LandContour_Tencode|SaleCondition_Tencode', 'MSSubClass|BsmtUnfSF', 'ScreenPorch|Fence_Tencode', '3SsnPorch|Condition1_Tencode', 'BsmtHalfBath|GarageCond_Tencode', 'Alley_Tencode|MSZoning_Tencode', 'FullBath|OpenPorchSF', 'KitchenAbvGr|ExterQual_Tencode', 'MasVnrArea|MiscVal', 'Alley_Tencode|Condition1_Tencode', 'MSZoning_Tencode|Neighborhood_Tencode', 'MasVnrArea|LotFrontage', 'GarageYrBlt|BedroomAbvGr', 'LotFrontage|BsmtFinType1_Tencode', 'FullBath|LotFrontage', 'ScreenPorch|BsmtCond_Tencode', 'BsmtCond_Tencode|HeatingQC_Tencode', 'GarageCond_Tencode|YearBuilt', 'FireplaceQu_Tencode|KitchenQual_Tencode', 'Condition2_Tencode|FullBath', 'ExterCond_Tencode|BsmtFinSF1', '1stFlrSF|Exterior2nd_Tencode', 'BsmtFinSF2|SaleCondition_Tencode', '3SsnPorch|GarageType_Tencode', '2ndFlrSF|GarageYrBlt', 'LotConfig_Tencode|BedroomAbvGr', 'BsmtFinSF2|TotRmsAbvGrd', 'PoolArea|WoodDeckSF', 'Foundation_Tencode|RoofStyle_Tencode', 'LotFrontage|Street_Tencode', 'MoSold|BsmtFinType2_Tencode', 'LotShape_Tencode|Heating_Tencode', 'Street_Tencode|Heating_Tencode', 'ScreenPorch|SaleCondition_Tencode', 'Exterior2nd_Tencode|Street_Tencode', 'LowQualFinSF|OpenPorchSF', 'PoolQC_Tencode|GarageCars', 'PavedDrive_Tencode|EnclosedPorch', 'OpenPorchSF|BsmtFinType1_Tencode', '2ndFlrSF|Utilities_Tencode', 'FullBath|PavedDrive_Tencode', 'PoolQC_Tencode|MasVnrType_Tencode', 'BsmtFullBath|Fireplaces', 'GarageCond_Tencode|Functional_Tencode', 'BsmtUnfSF|BsmtFinType2_Tencode', 'MSSubClass|EnclosedPorch', 'BsmtFinSF2|Condition2_Tencode', 'LowQualFinSF|SaleType_Tencode', 'ScreenPorch|BsmtFinType2_Tencode', 'Condition2_Tencode|GarageYrBlt', 'Foundation_Tencode|OverallCond', 'RoofMatl_Tencode|GarageArea', 'GarageFinish_Tencode|BsmtFinType1_Tencode', 'GarageArea|GarageCars', 'GarageQual_Tencode|SaleType_Tencode', 'BedroomAbvGr|HeatingQC_Tencode', 'BsmtFinType1_Tencode|YearBuilt', 'MSZoning_Tencode|WoodDeckSF', 'Alley_Tencode|MiscVal', 'BsmtFullBath|BsmtCond_Tencode', '2ndFlrSF|HeatingQC_Tencode', 'BsmtCond_Tencode|BedroomAbvGr', 'YearRemodAdd|ExterQual_Tencode', 'YrSold|GarageFinish_Tencode', 'GarageYrBlt|Functional_Tencode', 'Condition1_Tencode|Utilities_Tencode', 'Foundation_Tencode|HeatingQC_Tencode', 'WoodDeckSF|GarageArea', 'LandContour_Tencode|Exterior2nd_Tencode', 'MiscVal|Condition1_Tencode', 'TotRmsAbvGrd|GarageCars', 'BsmtExposure_Tencode|BsmtQual_Tencode', 'Foundation_Tencode|BldgType_Tencode', 'GrLivArea|HeatingQC_Tencode', 'LandContour_Tencode|YrSold', 'KitchenAbvGr|FullBath', 'WoodDeckSF|MasVnrType_Tencode', 'Electrical_Tencode|TotRmsAbvGrd', 'BsmtFinType1_Tencode|Heating_Tencode', 'ExterCond_Tencode|Utilities_Tencode', 'MSZoning_Tencode|BsmtQual_Tencode', 'LandSlope_Tencode|LowQualFinSF', 'HeatingQC_Tencode|GarageType_Tencode', 'TotalBsmtSF|WoodDeckSF', 'Electrical_Tencode|FullBath', 'BsmtFinType2_Tencode|Neighborhood_Tencode', 'GarageArea|BedroomAbvGr', 'MoSold|PoolQC_Tencode', 'WoodDeckSF|PoolQC_Tencode', 'BsmtFinType2_Tencode|HalfBath', 'MoSold|MiscVal', 'YearRemodAdd|LotFrontage', '2ndFlrSF|BsmtQual_Tencode', 'MSSubClass|GarageCond_Tencode', 'TotalBsmtSF|TotRmsAbvGrd', 'ExterCond_Tencode|OpenPorchSF', 'PoolArea|SaleType_Tencode', 'Alley_Tencode|GarageArea', 'HeatingQC_Tencode|HalfBath', '3SsnPorch|GarageCars', 'TotRmsAbvGrd|GarageYrBlt', 'FireplaceQu_Tencode|Neighborhood_Tencode', 'PavedDrive_Tencode|GarageYrBlt', '3SsnPorch|BedroomAbvGr', 'Electrical_Tencode|BsmtHalfBath', 'GarageArea|LotShape_Tencode', 'LandContour_Tencode|Alley_Tencode', 'EnclosedPorch|Neighborhood_Tencode', 'GarageYrBlt|GarageType_Tencode', 'Exterior2nd_Tencode|LotArea', 'BsmtFullBath|1stFlrSF', 'LandContour_Tencode|PoolArea', 'TotRmsAbvGrd|YearRemodAdd', 'FullBath|EnclosedPorch', 'MSSubClass|WoodDeckSF', 'LotFrontage|Heating_Tencode', 'KitchenQual_Tencode|BsmtFinType1_Tencode', 'TotalBsmtSF|Functional_Tencode', 'MoSold|LotShape_Tencode', 'GarageYrBlt|Heating_Tencode', 'MasVnrType_Tencode|SaleType_Tencode', 'MSSubClass|Condition2_Tencode', 'OverallCond|MiscFeature_Tencode', 'Condition2_Tencode|BsmtQual_Tencode', 'PoolArea|OverallCond', 'Exterior1st_Tencode|GarageQual_Tencode', 'MSZoning_Tencode|GarageFinish_Tencode', 'HouseStyle_Tencode|MiscFeature_Tencode', 'Utilities_Tencode|MiscFeature_Tencode', 'Electrical_Tencode|BedroomAbvGr', 'CentralAir_Tencode|OpenPorchSF', 'RoofMatl_Tencode|LotShape_Tencode', 'BsmtFinSF1|CentralAir_Tencode', 'GarageCond_Tencode|MasVnrType_Tencode', 'Neighborhood_Tencode', 'FullBath|GarageCond_Tencode', 'TotRmsAbvGrd|BsmtHalfBath', 'TotRmsAbvGrd|SaleCondition_Tencode', 'PoolQC_Tencode|HalfBath', 'TotalBsmtSF|MSSubClass', 'FireplaceQu_Tencode|PoolArea', 'BsmtFullBath|BsmtUnfSF', 'TotRmsAbvGrd|GrLivArea', 'GarageCond_Tencode|HouseStyle_Tencode', 'MiscVal|HalfBath', 'LotFrontage|Functional_Tencode', 'ExterCond_Tencode|3SsnPorch', 'BsmtFullBath|ExterQual_Tencode', 'PavedDrive_Tencode|HeatingQC_Tencode', 'OverallCond|HalfBath', 'BsmtFinSF2|MasVnrArea', 'MSZoning_Tencode|3SsnPorch', 'YrSold|RoofStyle_Tencode', 'WoodDeckSF', 'MSZoning_Tencode|RoofStyle_Tencode', 'LandContour_Tencode|LotArea', 'Fence_Tencode', 'GrLivArea|LotShape_Tencode', 'FireplaceQu_Tencode|Utilities_Tencode', 'RoofMatl_Tencode|LotFrontage', 'HeatingQC_Tencode|BldgType_Tencode', 'HeatingQC_Tencode|Utilities_Tencode', '1stFlrSF|OpenPorchSF', 'RoofStyle_Tencode|MiscVal', 'BsmtCond_Tencode|GarageType_Tencode', 'Electrical_Tencode|PavedDrive_Tencode', 'MasVnrArea|HalfBath', 'Fireplaces|OpenPorchSF', 'KitchenAbvGr|Condition2_Tencode', 'OverallCond|Utilities_Tencode', 'FireplaceQu_Tencode|Exterior2nd_Tencode', 'Condition2_Tencode|Exterior1st_Tencode', 'GrLivArea|ScreenPorch', 'HeatingQC_Tencode|Neighborhood_Tencode', 'YearRemodAdd|SaleCondition_Tencode', 'RoofMatl_Tencode|BsmtHalfBath', 'FullBath|BedroomAbvGr', 'TotalBsmtSF|Street_Tencode', 'SaleCondition_Tencode|LowQualFinSF', 'PoolArea|BsmtFinType2_Tencode', 'PoolQC_Tencode|SaleType_Tencode', 'KitchenAbvGr|MSSubClass', 'BsmtFinSF1|LotConfig_Tencode', 'BsmtUnfSF|LotShape_Tencode', 'ExterQual_Tencode|HeatingQC_Tencode', 'BsmtFinType2_Tencode|HouseStyle_Tencode', 'PoolArea|YearBuilt', 'LandContour_Tencode|YearBuilt', 'BedroomAbvGr|MiscFeature_Tencode', 'YrSold|OverallQual', 'FullBath|Exterior2nd_Tencode', 'BsmtFinSF2|KitchenQual_Tencode', 'BsmtFinType2_Tencode|SaleType_Tencode', 'Fireplaces|ScreenPorch', 'LandContour_Tencode|GarageCond_Tencode', 'Foundation_Tencode|3SsnPorch', 'CentralAir_Tencode|LotArea', 'MoSold|Street_Tencode', 'BsmtExposure_Tencode|HeatingQC_Tencode', 'Heating_Tencode|HouseStyle_Tencode', 'Fence_Tencode|BedroomAbvGr', 'Exterior2nd_Tencode|OpenPorchSF', '1stFlrSF|SaleType_Tencode', 'Alley_Tencode|BsmtFullBath', 'BsmtFinSF1|BedroomAbvGr', 'ExterQual_Tencode|GarageArea', 'TotalBsmtSF', 'PavedDrive_Tencode|Condition1_Tencode', 'WoodDeckSF|GarageFinish_Tencode', 'KitchenAbvGr|BsmtFinType1_Tencode', 'RoofStyle_Tencode|LowQualFinSF', 'BsmtFinSF1|Fence_Tencode', 'BsmtFullBath|PoolArea', 'MSZoning_Tencode|GarageArea', 'LandContour_Tencode|Heating_Tencode', 'TotRmsAbvGrd|BldgType_Tencode', 'TotalBsmtSF|BldgType_Tencode', 'Alley_Tencode|GarageYrBlt', 'LandContour_Tencode|HouseStyle_Tencode', '3SsnPorch|OpenPorchSF', 'Electrical_Tencode|2ndFlrSF', 'ExterCond_Tencode|BsmtFinType1_Tencode', 'LowQualFinSF|PoolQC_Tencode', 'Foundation_Tencode|OverallQual', 'Fireplaces|SaleCondition_Tencode', 'LandContour_Tencode|Functional_Tencode', 'BsmtHalfBath|Street_Tencode', 'RoofStyle_Tencode|HalfBath', 'LotConfig_Tencode|LotShape_Tencode', 'TotalBsmtSF|ExterQual_Tencode', 'ScreenPorch|HalfBath', '1stFlrSF|FullBath', 'Condition1_Tencode|YearBuilt', 'LotConfig_Tencode|PoolQC_Tencode', 'LotShape_Tencode|Utilities_Tencode', 'GarageCond_Tencode|BsmtCond_Tencode', '3SsnPorch|RoofStyle_Tencode', 'TotRmsAbvGrd|Condition1_Tencode', 'PoolArea|HeatingQC_Tencode', 'LotConfig_Tencode|WoodDeckSF', 'GarageFinish_Tencode|MasVnrType_Tencode', 'BsmtExposure_Tencode|OpenPorchSF', 'BsmtFinType2_Tencode|MiscFeature_Tencode', 'MoSold|YearBuilt', 'SaleCondition_Tencode|Condition1_Tencode', 'GarageArea|OverallQual', 'FullBath|PoolQC_Tencode', 'FullBath|MiscFeature_Tencode', 'Foundation_Tencode|BsmtFinType2_Tencode', 'PoolArea|Neighborhood_Tencode', 'BsmtFinType1_Tencode|MiscFeature_Tencode', 'BldgType_Tencode|OverallCond', 'OverallCond|GarageQual_Tencode', 'KitchenAbvGr|CentralAir_Tencode', 'BsmtFinSF2|GarageQual_Tencode', 'LandSlope_Tencode', 'TotRmsAbvGrd|GarageType_Tencode', 'KitchenQual_Tencode|MasVnrType_Tencode', 'BsmtFinSF1|Neighborhood_Tencode', 'BsmtHalfBath|Exterior2nd_Tencode', 'TotRmsAbvGrd|MoSold', 'YrSold|HalfBath', 'MasVnrArea|BsmtCond_Tencode', 'ScreenPorch|LandSlope_Tencode', 'Fireplaces|GarageCars', 'SaleCondition_Tencode|BsmtFinType2_Tencode', 'MasVnrArea|LotShape_Tencode', 'MSSubClass|Fireplaces', 'BsmtExposure_Tencode|Neighborhood_Tencode', 'Exterior1st_Tencode|GarageCond_Tencode', 'Foundation_Tencode|BsmtCond_Tencode', 'FireplaceQu_Tencode|OverallQual', 'LotShape_Tencode|MiscFeature_Tencode', 'LandContour_Tencode|GarageCars', 'GarageArea|MiscFeature_Tencode', 'LotShape_Tencode|BldgType_Tencode', 'RoofMatl_Tencode|BsmtCond_Tencode', 'BsmtFinType1_Tencode|BldgType_Tencode', 'YrSold|GarageType_Tencode', 'GrLivArea|LotArea', 'ExterCond_Tencode|Exterior1st_Tencode', 'GrLivArea|SaleCondition_Tencode', 'BsmtFullBath|MiscFeature_Tencode', 'YrSold|BldgType_Tencode', 'BsmtExposure_Tencode|BsmtUnfSF', 'FullBath|GarageType_Tencode', 'BsmtHalfBath|Fence_Tencode', 'Electrical_Tencode|HouseStyle_Tencode', 'KitchenAbvGr|LotFrontage', 'YearRemodAdd|KitchenQual_Tencode', 'PoolQC_Tencode|Functional_Tencode', 'LowQualFinSF|GarageFinish_Tencode', 'GarageFinish_Tencode|LotShape_Tencode', 'ExterCond_Tencode|ExterQual_Tencode', 'LandContour_Tencode|Condition1_Tencode', 'OpenPorchSF|Neighborhood_Tencode', '1stFlrSF|CentralAir_Tencode', 'TotalBsmtSF|Exterior2nd_Tencode', 'MSSubClass|LowQualFinSF', 'Alley_Tencode|BsmtQual_Tencode', 'BsmtFinSF1|Exterior2nd_Tencode', 'ExterQual_Tencode|Condition1_Tencode', 'MSSubClass|BsmtFinType1_Tencode', 'FireplaceQu_Tencode|Condition1_Tencode', 'GarageQual_Tencode|Utilities_Tencode', 'MSZoning_Tencode|Exterior1st_Tencode', 'Fence_Tencode|HeatingQC_Tencode', 'Foundation_Tencode|Neighborhood_Tencode', 'LandSlope_Tencode|BsmtFinType2_Tencode', 'ScreenPorch|OverallCond', 'ScreenPorch|1stFlrSF', 'MiscVal|OverallCond', 'WoodDeckSF|MiscVal', 'LotArea|Heating_Tencode', 'LotConfig_Tencode|SaleType_Tencode', 'BsmtCond_Tencode|Street_Tencode', 'ScreenPorch|BsmtHalfBath', 'PoolArea|BsmtFinType1_Tencode', 'YrSold|CentralAir_Tencode', 'ScreenPorch|CentralAir_Tencode', '1stFlrSF|PavedDrive_Tencode', 'BsmtFullBath|MiscVal', 'YearRemodAdd|Fireplaces', 'TotRmsAbvGrd|Neighborhood_Tencode', 'BsmtFinSF2|LotConfig_Tencode', 'Condition1_Tencode|OpenPorchSF', 'SaleCondition_Tencode|LandSlope_Tencode', 'Electrical_Tencode|Functional_Tencode', 'CentralAir_Tencode|LowQualFinSF', 'BsmtFullBath|YrSold', 'SaleCondition_Tencode|PoolQC_Tencode', 'GarageYrBlt|LotArea', 'MSSubClass|LotConfig_Tencode', 'GarageCond_Tencode|BsmtUnfSF', 'YearBuilt|OverallQual', 'EnclosedPorch|Condition1_Tencode', 'Condition2_Tencode|KitchenQual_Tencode', 'RoofStyle_Tencode|Fence_Tencode', 'PoolArea|BedroomAbvGr', 'Fireplaces|BsmtFinType2_Tencode', 'RoofStyle_Tencode|PoolQC_Tencode', 'BsmtUnfSF|HouseStyle_Tencode', 'EnclosedPorch|LotFrontage', 'LotFrontage|HeatingQC_Tencode', 'ExterQual_Tencode|OverallCond', '3SsnPorch|HalfBath', 'HalfBath|HouseStyle_Tencode', 'GrLivArea|LandSlope_Tencode', 'Condition2_Tencode|Fireplaces', 'BsmtFinSF2|BsmtFullBath', 'MasVnrArea|Neighborhood_Tencode', 'Heating_Tencode|MiscFeature_Tencode', 'BsmtFinSF2|ScreenPorch', 'Electrical_Tencode|LotShape_Tencode', 'BedroomAbvGr|HouseStyle_Tencode', 'KitchenAbvGr|Fireplaces', 'FireplaceQu_Tencode|MasVnrType_Tencode', 'GarageFinish_Tencode|GarageQual_Tencode', 'Exterior1st_Tencode|LotArea', 'PoolArea|GarageType_Tencode', 'ScreenPorch|MiscVal', 'Foundation_Tencode|YearRemodAdd', 'SaleCondition_Tencode|LotConfig_Tencode', 'CentralAir_Tencode|WoodDeckSF', 'Fireplaces|HeatingQC_Tencode', 'ExterCond_Tencode|MSZoning_Tencode', 'ScreenPorch|FullBath', 'BsmtFinSF2|GarageCond_Tencode', 'RoofMatl_Tencode|BedroomAbvGr', 'CentralAir_Tencode|HeatingQC_Tencode', 'LandSlope_Tencode|EnclosedPorch', 'BsmtExposure_Tencode|HouseStyle_Tencode', 'BsmtFinSF2|YrSold', 'Fireplaces|EnclosedPorch', 'RoofMatl_Tencode|1stFlrSF', 'ExterCond_Tencode|GarageFinish_Tencode', 'EnclosedPorch|WoodDeckSF', 'Fireplaces|BldgType_Tencode', 'GarageYrBlt|OpenPorchSF', '3SsnPorch|MiscVal', 'GarageArea|MasVnrType_Tencode', 'MoSold|HalfBath', 'BsmtFullBath|YearRemodAdd', 'Electrical_Tencode|YearRemodAdd', 'YearRemodAdd|YearBuilt', 'BsmtFinSF2|HouseStyle_Tencode', 'Fence_Tencode|Heating_Tencode', 'Fireplaces|Exterior2nd_Tencode', 'MoSold|Heating_Tencode', 'BsmtFullBath|GarageType_Tencode', 'YrSold|BsmtQual_Tencode', 'TotalBsmtSF|LotConfig_Tencode', 'KitchenAbvGr|LotArea', 'Exterior2nd_Tencode|SaleType_Tencode', 'BsmtExposure_Tencode|BsmtFinType2_Tencode', 'Exterior1st_Tencode|MiscVal', 'GarageArea|Neighborhood_Tencode', 'RoofMatl_Tencode|FullBath', 'LandSlope_Tencode|GarageCond_Tencode', '2ndFlrSF|KitchenQual_Tencode', '1stFlrSF|YearBuilt', 'Fireplaces|PoolArea', 'MoSold|GarageQual_Tencode', '1stFlrSF|GarageFinish_Tencode', 'BsmtFinType1_Tencode|OverallQual', 'YrSold|WoodDeckSF', 'Condition2_Tencode|EnclosedPorch', 'KitchenAbvGr|LowQualFinSF', 'LotConfig_Tencode|MiscFeature_Tencode', 'LotArea|HouseStyle_Tencode', 'TotRmsAbvGrd|LotConfig_Tencode', 'BsmtFinSF2|Street_Tencode', 'ExterCond_Tencode|BedroomAbvGr', 'OverallCond|GarageType_Tencode', 'PavedDrive_Tencode|Neighborhood_Tencode', 'Foundation_Tencode|SaleType_Tencode', 'PoolArea|MiscFeature_Tencode', 'BsmtExposure_Tencode|FullBath', 'FullBath|RoofStyle_Tencode', 'PavedDrive_Tencode|BsmtCond_Tencode', 'ScreenPorch|BldgType_Tencode', 'LowQualFinSF|HouseStyle_Tencode', 'PavedDrive_Tencode|LotShape_Tencode', 'KitchenAbvGr|YearBuilt', 'SaleCondition_Tencode|BsmtQual_Tencode', 'YearRemodAdd|RoofMatl_Tencode', 'RoofStyle_Tencode|Condition1_Tencode', 'Exterior1st_Tencode|HouseStyle_Tencode', 'MiscVal|OverallQual', 'LandContour_Tencode|OpenPorchSF', 'YearRemodAdd|Utilities_Tencode', 'BsmtFinSF2|Utilities_Tencode', 'Condition2_Tencode', 'BsmtQual_Tencode|SaleType_Tencode', 'KitchenAbvGr|Street_Tencode', 'Condition2_Tencode|GarageCars', 'LandSlope_Tencode|HouseStyle_Tencode', 'Electrical_Tencode|BsmtFinSF2', 'YrSold|ExterQual_Tencode', 'BsmtHalfBath|Functional_Tencode', 'BsmtFinSF1', 'Electrical_Tencode|GarageYrBlt', 'ExterQual_Tencode|BsmtFinType2_Tencode', 'Electrical_Tencode|ExterQual_Tencode', 'CentralAir_Tencode|OverallCond', 'Heating_Tencode|OverallQual', '1stFlrSF|EnclosedPorch', 'YearRemodAdd|OverallCond', 'KitchenQual_Tencode|LotShape_Tencode', '3SsnPorch|BsmtHalfBath', 'CentralAir_Tencode|GarageArea', 'WoodDeckSF|HouseStyle_Tencode', 'Exterior2nd_Tencode|Utilities_Tencode', 'GarageYrBlt|YearBuilt', 'ExterCond_Tencode|HalfBath', 'MiscVal|Heating_Tencode', 'Street_Tencode|LotShape_Tencode', 'BsmtUnfSF|Neighborhood_Tencode', 'BsmtFinSF2|Foundation_Tencode', 'MiscVal|BsmtFinType1_Tencode', 'Condition2_Tencode|MiscFeature_Tencode', 'BsmtFinSF2|3SsnPorch', 'MSZoning_Tencode|BldgType_Tencode', '1stFlrSF|BsmtQual_Tencode', 'KitchenQual_Tencode|HouseStyle_Tencode', 'TotRmsAbvGrd|GarageQual_Tencode', 'SaleCondition_Tencode|BsmtFinType1_Tencode', 'LotArea|SaleType_Tencode', 'Condition1_Tencode|BedroomAbvGr', 'MoSold|OverallCond', 'LandContour_Tencode|Exterior1st_Tencode', 'MasVnrArea|FullBath', 'ExterCond_Tencode|GarageYrBlt', 'LowQualFinSF|GarageCars', 'YearRemodAdd|GarageCond_Tencode', 'FullBath|BsmtCond_Tencode', 'BldgType_Tencode|GarageType_Tencode', 'Street_Tencode|HeatingQC_Tencode', 'Alley_Tencode|BldgType_Tencode', 'GarageCond_Tencode|MiscFeature_Tencode', 'Condition2_Tencode|HalfBath', 'GarageCond_Tencode', 'LotConfig_Tencode|KitchenQual_Tencode', 'PavedDrive_Tencode|OverallCond', 'EnclosedPorch|BsmtCond_Tencode', 'LotFrontage', 'BsmtFinSF1|HeatingQC_Tencode', 'LandSlope_Tencode|WoodDeckSF', 'FireplaceQu_Tencode|Street_Tencode', 'ExterQual_Tencode|KitchenQual_Tencode', 'PavedDrive_Tencode|LowQualFinSF', 'BedroomAbvGr|OverallCond', 'LandSlope_Tencode|MiscVal', 'ScreenPorch|GarageQual_Tencode', 'BsmtHalfBath|LandSlope_Tencode', 'EnclosedPorch|KitchenQual_Tencode', 'BsmtFinSF2|HeatingQC_Tencode', 'MSSubClass|MiscVal', 'Street_Tencode|SaleType_Tencode', 'Fireplaces|OverallQual', '3SsnPorch|Neighborhood_Tencode', 'MSZoning_Tencode|BedroomAbvGr', 'BsmtFullBath|Utilities_Tencode', 'GarageArea|OpenPorchSF', 'Alley_Tencode|Fence_Tencode', 'LotArea', 'GarageFinish_Tencode|KitchenQual_Tencode', 'BsmtExposure_Tencode|RoofStyle_Tencode', 'Functional_Tencode|SaleType_Tencode', 'BsmtUnfSF|BldgType_Tencode', 'TotalBsmtSF|MSZoning_Tencode', '1stFlrSF|LotArea', 'LandContour_Tencode|GarageArea', 'Functional_Tencode|Utilities_Tencode', 'PavedDrive_Tencode|GarageCars', 'Electrical_Tencode|BsmtExposure_Tencode', 'GarageArea|YearBuilt', 'FireplaceQu_Tencode|MSZoning_Tencode', 'HeatingQC_Tencode|BsmtFinType1_Tencode', 'CentralAir_Tencode|GarageFinish_Tencode', 'MasVnrArea|GarageCars', 'ScreenPorch|PoolArea', 'RoofMatl_Tencode|KitchenQual_Tencode', 'SaleType_Tencode', 'ExterQual_Tencode|WoodDeckSF', 'GarageType_Tencode|HouseStyle_Tencode', 'FireplaceQu_Tencode|ScreenPorch', 'MiscVal|KitchenQual_Tencode', 'Foundation_Tencode|BsmtFinType1_Tencode', 'Foundation_Tencode|LandSlope_Tencode', 'EnclosedPorch', 'SaleCondition_Tencode|BsmtHalfBath', '3SsnPorch|Exterior2nd_Tencode', '2ndFlrSF|OpenPorchSF', 'KitchenAbvGr|GarageCars', 'MasVnrArea|BsmtFinSF1', 'Foundation_Tencode|MasVnrArea', 'Foundation_Tencode|2ndFlrSF', 'GarageFinish_Tencode|Utilities_Tencode', 'YearRemodAdd|LotShape_Tencode', 'BsmtQual_Tencode|BsmtCond_Tencode', 'Condition1_Tencode|LotArea', 'BsmtQual_Tencode|BsmtHalfBath', 'BsmtExposure_Tencode|GarageYrBlt', 'BsmtFinSF1|PavedDrive_Tencode', 'SaleCondition_Tencode|GarageCars', 'BsmtQual_Tencode|BldgType_Tencode', 'LotFrontage|MasVnrType_Tencode', 'Electrical_Tencode|Alley_Tencode', 'SaleCondition_Tencode|GarageQual_Tencode', 'MiscVal|Street_Tencode', 'BsmtFullBath|OpenPorchSF', 'GarageCond_Tencode|Street_Tencode', 'BsmtFullBath|LotFrontage', 'Alley_Tencode|BsmtFinSF1', '1stFlrSF|RoofStyle_Tencode', 'BsmtFullBath', 'KitchenAbvGr|MasVnrType_Tencode', 'PavedDrive_Tencode|GarageCond_Tencode', 'TotalBsmtSF|RoofStyle_Tencode', 'ExterQual_Tencode|Heating_Tencode', 'TotRmsAbvGrd|Fence_Tencode', 'Electrical_Tencode|LotConfig_Tencode', 'TotalBsmtSF|1stFlrSF', 'MSZoning_Tencode|HeatingQC_Tencode', 'TotRmsAbvGrd|MSSubClass', 'ExterQual_Tencode|OverallQual', 'RoofMatl_Tencode|OverallCond', 'MSSubClass|FullBath', 'MiscVal|SaleType_Tencode', 'CentralAir_Tencode|GarageType_Tencode', 'GarageCond_Tencode|OpenPorchSF', 'ScreenPorch|BsmtQual_Tencode', 'GarageCond_Tencode|KitchenQual_Tencode', 'PoolArea|HalfBath', 'BsmtFinSF2|OverallCond', 'BsmtCond_Tencode|KitchenQual_Tencode', 'BsmtFullBath|GarageCars', 'LandContour_Tencode|LandSlope_Tencode', 'YearRemodAdd|SaleType_Tencode', 'BsmtFinSF1|Heating_Tencode', 'Condition1_Tencode|MasVnrType_Tencode', 'Electrical_Tencode|SaleType_Tencode', 'Foundation_Tencode|FullBath', 'BsmtFinType2_Tencode|Utilities_Tencode', 'KitchenAbvGr|Foundation_Tencode', 'Exterior2nd_Tencode|Functional_Tencode', 'Condition2_Tencode|HouseStyle_Tencode', 'MasVnrArea|OverallCond', 'SaleCondition_Tencode|OpenPorchSF', 'TotRmsAbvGrd|WoodDeckSF', 'BsmtFinSF2|YearRemodAdd', 'Alley_Tencode|PavedDrive_Tencode', 'GarageFinish_Tencode|GarageType_Tencode', 'MasVnrArea|GarageCond_Tencode', 'Fence_Tencode|GarageCars', 'RoofMatl_Tencode|PavedDrive_Tencode', 'BsmtExposure_Tencode|BsmtCond_Tencode', 'BsmtFinType1_Tencode|Neighborhood_Tencode', 'BsmtFinSF1|OverallQual', 'RoofMatl_Tencode|GarageFinish_Tencode', 'RoofMatl_Tencode|Exterior2nd_Tencode', 'BsmtFinSF1|BsmtFinType1_Tencode', 'PoolArea|Utilities_Tencode', 'HalfBath|OverallQual', 'Functional_Tencode|GarageQual_Tencode', 'LandSlope_Tencode|BldgType_Tencode', 'LandContour_Tencode|FullBath', 'RoofMatl_Tencode|Utilities_Tencode', 'Condition2_Tencode|MoSold', 'MSSubClass|PavedDrive_Tencode', 'KitchenAbvGr|PoolArea', 'FireplaceQu_Tencode|Foundation_Tencode', 'GrLivArea|BsmtFinSF1', 'MasVnrArea|PavedDrive_Tencode', 'YearRemodAdd|BsmtFinType2_Tencode', 'MiscVal|LotShape_Tencode', '2ndFlrSF|BsmtUnfSF', 'KitchenAbvGr|GarageCond_Tencode', 'Condition2_Tencode|BsmtExposure_Tencode', 'FireplaceQu_Tencode|GarageCars', 'GrLivArea|YearBuilt', 'Condition2_Tencode|1stFlrSF', 'Heating_Tencode|Utilities_Tencode', 'MSZoning_Tencode|BsmtUnfSF', 'Street_Tencode|BsmtFinType1_Tencode', 'GarageCond_Tencode|Neighborhood_Tencode', 'BsmtFinSF2|BedroomAbvGr', 'ExterQual_Tencode|LowQualFinSF', '3SsnPorch|BsmtUnfSF', 'KitchenAbvGr|MasVnrArea']

Categorical = ['HeatingQC', 'BsmtFinType2', 'Foundation', 'HouseStyle', 'Functional', 'SaleCondition', 'Condition1', 'ExterCond', 'Alley', 'PavedDrive', 'Neighborhood', 'Exterior2nd', 'BsmtQual', 'LotConfig', 'KitchenQual', 'RoofStyle', 'PoolQC', 'BsmtCond', 'GarageCond', 'CentralAir', 'MSZoning', 'FireplaceQu', 'LotShape', 'MasVnrType', 'BldgType', 'SaleType', 'Exterior1st', 'ExterQual', 'Street', 'Condition2', 'RoofMatl', 'Utilities', 'LandContour', 'LandSlope', 'Electrical', 'BsmtExposure', 'Heating', 'GarageType', 'GarageFinish', 'MiscFeature', 'GarageQual', 'Fence', 'BsmtFinType1']

In [137]:
# check number of created variables is correct
# 1 id column, 1 target column, 79 original + encoded numeric columns, 43 original categorical variables
# sum(range(1, 79)) combined variables
print(train.shape == (1001, sum(range(1, 79), (79 + 43 + 1 + 1))))
print(test.shape == (1459, sum(range(1, 79), (79 + 43 + 1 + 1))))


True
True

In [138]:
# check multiplication for a random column
ridx = np.random.choice(sum(range(1, 79)))
combined_only = [name for name in encoded_combined_nums if name not in encoded_nums]
combined_check_vars = combined_only[ridx].split('|')
combined_check_vars.append(combined_only[ridx])

print(train[736, combined_check_vars])
print(test[637, combined_check_vars])

print(train[736, combined_check_vars[0]]*train[736, combined_check_vars[1]])
print(test[637, combined_check_vars[0]]*test[637, combined_check_vars[1]])


CentralAir_Tencode MasVnrType_Tencode CentralAir_Tencode|MasVnrType_Tencode
186782 203515 3.8013e+10

CentralAir_Tencode MasVnrType_Tencode CentralAir_Tencode|MasVnrType_Tencode
184861 157482 2.91123e+10
38012996430.17197
29112284469.574463

Train models


In [139]:
h2o.show_progress() # turn on progress bars

In [140]:
# Check log transform - looks good
%matplotlib inline
train['SalePrice'].log().as_data_frame().hist()

# Execute log transform
train['SalePrice'] = train['SalePrice'].log()
valid['SalePrice'] = valid['SalePrice'].log()
print(train[0:3, 'SalePrice'])


SalePrice
12.2477
12.109
12.3172

Define ranked predictions plot function


In [141]:
def ranked_preds_plot(y, valid, preds):
    
    """ Generates ranked prediction plot.
    
    :param y: Name of target variable.
    :param valid: Name of validation H2OFrame.
    :param preds: Column vector of predictions to plot.

    """
    
    # plot top frame values
    preds.columns = ['predict']
    yhat_frame = valid.cbind(preds)
    print(yhat_frame[0:10, [y, 'predict']])

    # plot sorted predictions
    yhat_frame_df = yhat_frame[[y, 'predict']].as_data_frame()
    yhat_frame_df.sort_values(by='predict', inplace=True)
    yhat_frame_df.reset_index(inplace=True, drop=True)
    _ = yhat_frame_df.plot(title='Ranked Predictions Plot')

Function to generate submission file


In [142]:
import re
import time

def gen_submission(preds, test=test):

    """ Generates submission file for Kaggle House Prices contest.
    
    :param preds: Column vector of predictions.
    :param test: Test data.
    
    """
    
    # create time stamp
    time_stamp = re.sub('[: ]', '_', time.asctime())

    # create predictions column
    sub = test['Id'].cbind(preds.exp())
    sub.columns = ['Id', 'SalePrice']
    
    # save file for submission
    sub_fname = '../data/submission_' + str(time_stamp) + '.csv'
    h2o.download_csv(sub, sub_fname)

Simple prediction blending function


In [143]:
import os

def pred_blender(dir_, files):
    
    """ Performs simple blending of prediction files. 
    
    :param dir_: Directory in which files to be read are stored.
    :param files: List of prediction files to be blended.
    
    """
    
    # read predictions in files list and cbind
    for i, file in enumerate(files):
        if i == 0:
            df = pd.read_csv(dir_ + os.sep + file).drop('SalePrice', axis=1)
        col = pd.read_csv(dir_ + os.sep + file).drop('Id', axis=1)
        col.columns = ['SalePrice' + str(i)]
        df = pd.concat([df, col], axis=1)
        
    # create mean prediction    
    df['mean'] = df.iloc[:, 1:].mean(axis=1)
    print(df.head())
        
    # create time stamp
    time_stamp = re.sub('[: ]', '_', time.asctime())        
        
    # write new submission file    
    df = df[['Id', 'mean']]
    df.columns = ['Id', 'SalePrice']
    
    # save file for submission
    sub_fname = '../data/submission_' + str(time_stamp) + '.csv'
    df.to_csv(sub_fname, index=False)

Random forest model - typically not tuned as much as GBM


In [191]:
# initialize rf model
rf_model1 = H2ORandomForestEstimator(
    ntrees=10000,                    
    max_depth=10, 
    col_sample_rate_per_tree=0.1,
    sample_rate=0.8,
    stopping_rounds=50,
    score_each_iteration=True,
    nfolds=3,
    keep_cross_validation_predictions=True,
    seed=12345)           

# train rf model
rf_model1.train(
    x=encoded_combined_nums,
    y='SalePrice',
    training_frame=train,
    validation_frame=valid)

# print model information
print(rf_model1)

rf_preds1_val = rf_model1.predict(valid)
ranked_preds_plot('SalePrice', valid, rf_preds1_val) # valid RMSE not so hot ...
rf_preds1_test = rf_model1.predict(test)
gen_submission(rf_preds1_test) # 0.14574 public leaderboard


drf Model Build progress: |███████████████████████████████████████████████| 100%
Model Details
=============
H2ORandomForestEstimator :  Distributed Random Forest
Model Key:  DRF_model_python_1497530715156_39


ModelMetricsRegression: drf
** Reported on train data. **

MSE: 0.017103284870273683
RMSE: 0.13077952771849913
MAE: 0.08983148719488154
RMSLE: 0.010147981199023763
Mean Residual Deviance: 0.017103284870273683

ModelMetricsRegression: drf
** Reported on validation data. **

MSE: 0.018264657787037664
RMSE: 0.13514680087607572
MAE: 0.09885812331003446
RMSLE: 0.010437127656733918
Mean Residual Deviance: 0.018264657787037664

ModelMetricsRegression: drf
** Reported on cross-validation data. **

MSE: 0.018240553858393096
RMSE: 0.13505759459724245
MAE: 0.08959435620967451
RMSLE: 0.010509925297604954
Mean Residual Deviance: 0.018240553858393096
Cross-Validation Metrics Summary: 
mean sd cv_1_valid cv_2_valid cv_3_valid
mae 0.0895260 0.0011247 0.0884336 0.0917750 0.0883693
mean_residual_deviance 0.0182064 0.0015892 0.0198677 0.0197224 0.0150292
mse 0.0182064 0.0015892 0.0198677 0.0197224 0.0150292
r2 0.8818927 0.0041669 0.8741716 0.8884693 0.8830372
residual_deviance 0.0182064 0.0015892 0.0198677 0.0197224 0.0150292
rmse 0.1346610 0.0060355 0.1409529 0.1404365 0.1225936
rmsle 0.0104696 0.0005393 0.0109937 0.0110241 0.0093911
Scoring History: 
timestamp duration number_of_trees training_rmse training_mae training_deviance validation_rmse validation_mae validation_deviance
2017-06-15 15:57:45 1 min 57.627 sec 0.0 nan nan nan nan nan nan
2017-06-15 15:57:45 1 min 57.913 sec 1.0 0.2238943 0.1450992 0.0501287 0.2240792 0.1536762 0.0502115
2017-06-15 15:57:46 1 min 58.201 sec 2.0 0.2128776 0.1448769 0.0453169 0.1786217 0.1306484 0.0319057
2017-06-15 15:57:46 1 min 58.471 sec 3.0 0.2079195 0.1440704 0.0432305 0.1662800 0.1209441 0.0276490
2017-06-15 15:57:46 1 min 58.784 sec 4.0 0.2063258 0.1396038 0.0425703 0.1603434 0.1209225 0.0257100
--- --- --- --- --- --- --- --- --- ---
2017-06-15 15:58:28 2 min 40.497 sec 147.0 0.1309164 0.0898152 0.0171391 0.1351602 0.0988925 0.0182683
2017-06-15 15:58:28 2 min 40.806 sec 148.0 0.1307827 0.0897553 0.0171041 0.1351861 0.0988916 0.0182753
2017-06-15 15:58:29 2 min 41.204 sec 149.0 0.1306617 0.0897194 0.0170725 0.1351723 0.0989532 0.0182715
2017-06-15 15:58:29 2 min 41.525 sec 150.0 0.1306832 0.0898671 0.0170781 0.1350215 0.0987829 0.0182308
2017-06-15 15:58:29 2 min 41.839 sec 151.0 0.1307795 0.0898315 0.0171033 0.1351468 0.0988581 0.0182647
See the whole table with table.as_data_frame()
Variable Importances: 
variable relative_importance scaled_importance percentage
GrLivArea|Neighborhood_Tencode 1603.1712646 1.0 0.0770906
Neighborhood_Tencode|OverallQual 1294.7052002 0.8075901 0.0622576
LotShape_Tencode|OverallQual 1124.1563721 0.7012079 0.0540566
GrLivArea|OverallQual 958.2045288 0.5976932 0.0460765
YearRemodAdd|OverallQual 816.1578369 0.5090896 0.0392460
--- --- --- ---
MiscVal|HouseStyle_Tencode 0.0 0.0 0.0
MiscVal|MiscFeature_Tencode 0.0 0.0 0.0
Street_Tencode|PoolQC_Tencode 0.0 0.0 0.0
Street_Tencode|GarageQual_Tencode 0.0 0.0 0.0
Street_Tencode|Utilities_Tencode 0.0 0.0 0.0
See the whole table with table.as_data_frame()

drf prediction progress: |████████████████████████████████████████████████| 100%
SalePrice predict
11.8494 12.1712
12.2061 12.3031
11.6784 11.71
11.7906 11.7274
11.9117 11.825
11.9767 11.8828
11.8451 11.7094
11.1346 11.1583
11.914 11.7471
11.8845 11.8584
drf prediction progress: |████████████████████████████████████████████████| 100%

Extremely random trees model - typically not tuned as much as GBM


In [192]:
# initialize extra trees model
ert_model1 = H2ORandomForestEstimator(
    ntrees=10000,                    
    max_depth=10, 
    col_sample_rate_per_tree=0.1,
    sample_rate=0.8,
    stopping_rounds=50,
    score_each_iteration=True,
    nfolds=3,
    keep_cross_validation_predictions=True,
    seed=12345,
    histogram_type='random') # <- this is what makes it ERT instead of RF

# train ert model
ert_model1.train(
    x=encoded_combined_nums,
    y='SalePrice',
    training_frame=train,
    validation_frame=valid)

# print model information/create submission
print(ert_model1)
ert_preds1_val = ert_model1.predict(valid)
ranked_preds_plot('SalePrice', valid, ert_preds1_val) # valid RMSE not so hot ...
ert_preds1_test = ert_model1.predict(test)
gen_submission(ert_preds1_test) # 0.14855 public leaderboard


drf Model Build progress: |███████████████████████████████████████████████| 100%
Model Details
=============
H2ORandomForestEstimator :  Distributed Random Forest
Model Key:  DRF_model_python_1497530715156_40


ModelMetricsRegression: drf
** Reported on train data. **

MSE: 0.017324102070941275
RMSE: 0.13162105481624614
MAE: 0.0892460685529443
RMSLE: 0.01021143122248222
Mean Residual Deviance: 0.017324102070941275

ModelMetricsRegression: drf
** Reported on validation data. **

MSE: 0.018656079782938404
RMSE: 0.1365872606905139
MAE: 0.10084357998026773
RMSLE: 0.010555786838637508
Mean Residual Deviance: 0.018656079782938404

ModelMetricsRegression: drf
** Reported on cross-validation data. **

MSE: 0.018342256462386228
RMSE: 0.13543358690659502
MAE: 0.08997786478212023
RMSLE: 0.010550036662112572
Mean Residual Deviance: 0.018342256462386228
Cross-Validation Metrics Summary: 
mean sd cv_1_valid cv_2_valid cv_3_valid
mae 0.0898772 0.0017086 0.0886332 0.0932554 0.0877428
mean_residual_deviance 0.0182870 0.0017292 0.0195059 0.0204803 0.0148747
mse 0.0182870 0.0017292 0.0195059 0.0204803 0.0148747
r2 0.8816286 0.0025828 0.8764631 0.8841832 0.8842394
residual_deviance 0.0182870 0.0017292 0.0195059 0.0204803 0.0148747
rmse 0.1349117 0.0065509 0.1396636 0.1431096 0.1219619
rmsle 0.0104987 0.0005839 0.0108981 0.0112494 0.0093487
Scoring History: 
timestamp duration number_of_trees training_rmse training_mae training_deviance validation_rmse validation_mae validation_deviance
2017-06-15 16:01:03 2 min 31.304 sec 0.0 nan nan nan nan nan nan
2017-06-15 16:01:03 2 min 31.617 sec 1.0 0.2284850 0.1509611 0.0522054 0.2306071 0.1621440 0.0531797
2017-06-15 16:01:03 2 min 31.930 sec 2.0 0.2095138 0.1431641 0.0438960 0.1743004 0.1268387 0.0303806
2017-06-15 16:01:04 2 min 32.227 sec 3.0 0.2178683 0.1450369 0.0474666 0.1619895 0.1186909 0.0262406
2017-06-15 16:01:04 2 min 32.541 sec 4.0 0.2080616 0.1395749 0.0432896 0.1589995 0.1206055 0.0252808
--- --- --- --- --- --- --- --- --- ---
2017-06-15 16:01:56 3 min 24.856 sec 166.0 0.1317246 0.0892813 0.0173514 0.1366875 0.1009726 0.0186835
2017-06-15 16:01:57 3 min 25.177 sec 167.0 0.1316493 0.0891682 0.0173315 0.1367468 0.1010049 0.0186997
2017-06-15 16:01:57 3 min 25.481 sec 168.0 0.1316442 0.0891711 0.0173302 0.1367110 0.1009699 0.0186899
2017-06-15 16:01:57 3 min 25.830 sec 169.0 0.1315860 0.0892515 0.0173149 0.1365025 0.1008243 0.0186329
2017-06-15 16:01:58 3 min 26.258 sec 170.0 0.1316211 0.0892461 0.0173241 0.1365873 0.1008436 0.0186561
See the whole table with table.as_data_frame()
Variable Importances: 
variable relative_importance scaled_importance percentage
GrLivArea|Neighborhood_Tencode 1777.0230713 1.0 0.0758818
Neighborhood_Tencode|OverallQual 1632.1829834 0.9184928 0.0696969
LotShape_Tencode|OverallQual 1124.0327148 0.6325369 0.0479981
GrLivArea|OverallQual 1066.8115234 0.6003363 0.0455546
BldgType_Tencode|OverallQual 883.5972290 0.4972345 0.0377311
--- --- --- ---
MiscVal|HouseStyle_Tencode 0.0 0.0 0.0
MiscVal|MiscFeature_Tencode 0.0 0.0 0.0
MiscVal|OverallQual 0.0 0.0 0.0
Street_Tencode|PoolQC_Tencode 0.0 0.0 0.0
Street_Tencode|Heating_Tencode 0.0 0.0 0.0
See the whole table with table.as_data_frame()

drf prediction progress: |████████████████████████████████████████████████| 100%
SalePrice predict
11.8494 12.158
12.2061 12.3103
11.6784 11.701
11.7906 11.716
11.9117 11.8218
11.9767 11.8833
11.8451 11.6965
11.1346 11.1619
11.914 11.7635
11.8845 11.8395
drf prediction progress: |████████████████████████████████████████████████| 100%

H2O GBM model


In [193]:
# initialize H2O GBM
h2o_gbm_model = H2OGradientBoostingEstimator(
    ntrees = 10000,
    learn_rate = 0.005,
    sample_rate = 0.1, 
    col_sample_rate = 0.8,
    max_depth = 5,
    nfolds = 3,
    keep_cross_validation_predictions=True,
    stopping_rounds = 10,
    seed = 12345)

# execute training
h2o_gbm_model.train(x=encoded_combined_nums,
                    y='SalePrice',
                    training_frame=train,
                    validation_frame=valid)

# print model information/create submission
print(h2o_gbm_model)
h2o_gbm_preds1_val = h2o_gbm_model.predict(valid)
ranked_preds_plot('SalePrice', valid, h2o_gbm_preds1_val) # better validation error
h2o_gbm_preds1_test = h2o_gbm_model.predict(test)
gen_submission(h2o_gbm_preds1_test) # 0.15062 public leaderboard


gbm Model Build progress: |███████████████████████████████████████████████| 100%
Model Details
=============
H2OGradientBoostingEstimator :  Gradient Boosting Machine
Model Key:  GBM_model_python_1497530715156_41


ModelMetricsRegression: gbm
** Reported on train data. **

MSE: 0.006176434976609031
RMSE: 0.07859029823463601
MAE: 0.05301111489980966
RMSLE: 0.006099179628794482
Mean Residual Deviance: 0.006176434976609031

ModelMetricsRegression: gbm
** Reported on validation data. **

MSE: 0.017546665790746808
RMSE: 0.13246382823528394
MAE: 0.10119308547315771
RMSLE: 0.010243903760409427
Mean Residual Deviance: 0.017546665790746808

ModelMetricsRegression: gbm
** Reported on cross-validation data. **

MSE: 0.01645365655874634
RMSE: 0.12827180734185648
MAE: 0.08578849396442542
RMSLE: 0.009938680530110027
Mean Residual Deviance: 0.01645365655874634
Cross-Validation Metrics Summary: 
mean sd cv_1_valid cv_2_valid cv_3_valid
mae 0.0857441 0.0011121 0.0861861 0.0874109 0.0836352
mean_residual_deviance 0.0164479 0.0018601 0.0192577 0.0171547 0.0129314
mse 0.0164479 0.0018601 0.0192577 0.0171547 0.0129314
r2 0.8934627 0.0077844 0.8780353 0.90299 0.8993628
residual_deviance 0.0164479 0.0018601 0.0192577 0.0171547 0.0129314
rmse 0.1278214 0.0074029 0.1387720 0.1309758 0.1137164
rmsle 0.0098986 0.0006068 0.0107699 0.0101946 0.0087312
Scoring History: 
timestamp duration number_of_trees training_rmse training_mae training_deviance validation_rmse validation_mae validation_deviance
2017-06-15 16:21:26 18 min 50.401 sec 0.0 0.3937891 0.3048737 0.1550698 0.4113848 0.3219006 0.1692374
2017-06-15 16:21:26 18 min 50.629 sec 1.0 0.3925006 0.3036122 0.1540567 0.4100106 0.3205841 0.1681087
2017-06-15 16:21:27 18 min 50.785 sec 2.0 0.3912234 0.3024207 0.1530558 0.4087253 0.3193950 0.1670564
2017-06-15 16:21:27 18 min 50.977 sec 3.0 0.3898574 0.3012256 0.1519888 0.4072898 0.3181570 0.1658849
2017-06-15 16:21:27 18 min 51.163 sec 4.0 0.3883409 0.2998284 0.1508087 0.4057679 0.3168080 0.1646476
--- --- --- --- --- --- --- --- --- ---
2017-06-15 16:27:24 24 min 48.471 sec 2423.0 0.0795575 0.0536925 0.0063294 0.1324477 0.1012448 0.0175424
2017-06-15 16:27:28 24 min 52.499 sec 2452.0 0.0792686 0.0534924 0.0062835 0.1328942 0.1016985 0.0176609
2017-06-15 16:27:32 24 min 56.543 sec 2480.0 0.0790669 0.0533530 0.0062516 0.1324744 0.1012399 0.0175495
2017-06-15 16:27:36 25 min 0.691 sec 2510.0 0.0787727 0.0531997 0.0062051 0.1325743 0.1013174 0.0175759
2017-06-15 16:27:40 25 min 4.621 sec 2537.0 0.0785903 0.0530111 0.0061764 0.1324638 0.1011931 0.0175467
See the whole table with table.as_data_frame()
Variable Importances: 
variable relative_importance scaled_importance percentage
Neighborhood_Tencode|OverallQual 3338.4831543 1.0 0.3173326
GrLivArea|Neighborhood_Tencode 1284.7108154 0.3848187 0.1221155
LotShape_Tencode|OverallQual 1223.4885254 0.3664804 0.1162962
GrLivArea|OverallQual 904.2254028 0.2708492 0.0859493
GrLivArea|KitchenQual_Tencode 526.5789185 0.1577300 0.0500529
--- --- --- ---
Utilities_Tencode|MiscFeature_Tencode 0.0 0.0 0.0
Utilities_Tencode|OverallQual 0.0 0.0 0.0
HalfBath|SaleType_Tencode 0.0 0.0 0.0
HalfBath|MiscFeature_Tencode 0.0 0.0 0.0
HalfBath|OverallQual 0.0 0.0 0.0
See the whole table with table.as_data_frame()

gbm prediction progress: |████████████████████████████████████████████████| 100%
SalePrice predict
11.8494 12.0243
12.2061 12.3046
11.6784 11.6736
11.7906 11.6473
11.9117 11.8533
11.9767 11.8995
11.8451 11.6644
11.1346 11.0265
11.914 11.7871
11.8845 11.8265
gbm prediction progress: |████████████████████████████████████████████████| 100%

Train H2O XGBoost - very new!!


In [194]:
# initialize XGB GBM
h2o_xgb_model = H2OXGBoostEstimator(
    ntrees = 10000,
    learn_rate = 0.005,
    sample_rate = 0.1, 
    col_sample_rate = 0.8,
    max_depth = 5,
    nfolds = 3,
    keep_cross_validation_predictions=True,
    stopping_rounds = 10,
    seed = 12345)

# execute training 
h2o_xgb_model.train(x=encoded_combined_nums,
                    y='SalePrice',
                    training_frame=train,
                    validation_frame=valid)

# print model information/create submission
print(h2o_xgb_model)
h2o_xgb_preds1_val = h2o_xgb_model.predict(valid)
ranked_preds_plot('SalePrice', valid, h2o_xgb_preds1_val) 
h2o_xgb_preds1_test = h2o_xgb_model.predict(test)
gen_submission(h2o_xgb_preds1_test) # 0.16494 on public leaderboard


xgboost Model Build progress: |███████████████████████████████████████████| 100%
Model Details
=============
H2OXGBoostEstimator :  XGBoost
Model Key:  XGBoost_model_python_1497530715156_42


ModelMetricsRegression: xgboost
** Reported on train data. **

MSE: 0.00840358868692754
RMSE: 0.09167108970077502
MAE: 0.05488036133788087
RMSLE: 0.007108057792476213
Mean Residual Deviance: 0.00840358868692754

ModelMetricsRegression: xgboost
** Reported on validation data. **

MSE: 0.020605834537669652
RMSE: 0.1435473250801618
MAE: 0.11459932348047726
RMSLE: 0.011121763109013057
Mean Residual Deviance: 0.020605834537669652

ModelMetricsRegression: xgboost
** Reported on cross-validation data. **

MSE: 0.017285036067784806
RMSE: 0.13147256773861538
MAE: 0.08792207052895834
RMSLE: 0.010168982730659084
Mean Residual Deviance: 0.017285036067784806
Cross-Validation Metrics Summary: 
mean sd cv_1_valid cv_2_valid cv_3_valid
mae 0.0878787 0.0007503 0.0866027 0.0892005 0.0878330
mean_residual_deviance 0.0172410 0.0015741 0.0185664 0.0190513 0.0141053
mse 0.0172410 0.0015741 0.0185664 0.0190513 0.0141053
r2 0.8883015 0.0030024 0.8824132 0.8922644 0.8902271
residual_deviance 0.0172410 0.0015741 0.0185664 0.0190513 0.0141053
rmse 0.131017 0.0061468 0.1362587 0.1380265 0.1187658
rmsle 0.0101289 0.0005164 0.0105763 0.0107113 0.0090990
Scoring History: 
timestamp duration number_of_trees training_rmse training_mae training_deviance validation_rmse validation_mae validation_deviance
2017-06-15 17:05:02 5 min 50.591 sec 0.0 11.5392208 11.5324996 133.1536163 11.5129466 11.5056257 132.5479390
2017-06-15 17:05:02 5 min 51.417 sec 1.0 11.4819725 11.4752177 131.8356917 11.4557013 11.4483439 131.2330931
2017-06-15 17:05:02 5 min 51.437 sec 2.0 11.4252150 11.4184267 130.5355385 11.3989470 11.3915529 129.9359924
2017-06-15 17:05:02 5 min 51.458 sec 3.0 11.3688895 11.3620675 129.2516474 11.3426245 11.3351937 128.6551304
2017-06-15 17:05:02 5 min 51.479 sec 4.0 11.3125084 11.3056524 127.9728461 11.2862466 11.2787786 127.3793613
--- --- --- --- --- --- --- --- --- ---
2017-06-15 17:07:07 7 min 56.013 sec 2934.0 0.0944030 0.0570718 0.0089119 0.1445220 0.1155929 0.0208866
2017-06-15 17:07:11 8 min 0.018 sec 3015.0 0.0937420 0.0564378 0.0087876 0.1443555 0.1155753 0.0208385
2017-06-15 17:07:15 8 min 4.046 sec 3096.0 0.0930069 0.0558811 0.0086503 0.1433480 0.1144898 0.0205486
2017-06-15 17:07:19 8 min 8.086 sec 3178.0 0.0923369 0.0553875 0.0085261 0.1432491 0.1143704 0.0205203
2017-06-15 17:07:23 8 min 12.098 sec 3260.0 0.0916711 0.0548804 0.0084036 0.1435473 0.1145993 0.0206058
See the whole table with table.as_data_frame()
Variable Importances: 
variable relative_importance scaled_importance percentage
Neighborhood_Tencode|OverallCond 87.0 1.0 0.0055042
MSSubClass|LotArea 64.0 0.7356322 0.0040491
GrLivArea|OverallCond 58.0 0.6666667 0.0036695
GrLivArea|MoSold 55.0 0.6321839 0.0034797
LotArea|OverallCond 55.0 0.6321839 0.0034797
--- --- --- ---
GarageArea|GarageCars 1.0 0.0114943 0.0000633
KitchenAbvGr|OpenPorchSF 1.0 0.0114943 0.0000633
BsmtFullBath|HalfBath 1.0 0.0114943 0.0000633
KitchenAbvGr|2ndFlrSF 1.0 0.0114943 0.0000633
FireplaceQu_Tencode|RoofMatl_Tencode 1.0 0.0114943 0.0000633
See the whole table with table.as_data_frame()

xgboost prediction progress: |████████████████████████████████████████████| 100%
SalePrice predict
11.8494 11.977
12.2061 12.2466
11.6784 11.6435
11.7906 11.5821
11.9117 11.8348
11.9767 11.8584
11.8451 11.6547
11.1346 11.1257
11.914 11.7848
11.8845 11.8398
xgboost prediction progress: |████████████████████████████████████████████| 100%

Create blend


In [196]:
# create XGBoost blend
pred_blender('../data',
            ['submission_Thu_Jun_15_15_58_31_2017.csv',
             'submission_Thu_Jun_15_16_01_59_2017.csv',
             'submission_Thu_Jun_15_16_27_42_2017.csv',
             'submission_Thu_Jun_15_17_07_26_2017.csv'])
# 0.14705 on public leaderboard


     Id     SalePrice0     SalePrice1     SalePrice2     SalePrice3  \
0  1461  119081.074863  118567.449551  111874.076414  108450.225192   
1  1462  150015.290818  144812.782606  152345.926941  147465.853860   
2  1463  176503.892538  176940.325397  168826.171846  168720.909452   
3  1464  185223.022830  185907.910302  185119.575064  177289.259208   
4  1465  192687.508653  189991.207625  179623.201624  173343.132782   

            mean  
0  114493.206505  
1  148659.963557  
2  172747.824808  
3  183384.941851  
4  183911.262671  

Train H2O stacked ensemble


In [195]:
stack = H2OStackedEnsembleEstimator(training_frame=train, 
                                    validation_frame=valid, 
                                    base_models=[rf_model1, ert_model1, 
                                                 h2o_gbm_model])

stack.train(x=encoded_combined_nums,
            y='SalePrice',
            training_frame=train,
            validation_frame=valid)

# print model information/create submission
print(stack)
stack_preds1_val = stack.predict(valid)
ranked_preds_plot('SalePrice', valid, stack_preds1_val) 
stack_preds1_test = stack.predict(test)
gen_submission(stack_preds1_test)
# 0.14630 on public leaderboard


stackedensemble Model Build progress: |███████████████████████████████████| 100%
Model Details
=============
H2OStackedEnsembleEstimator :  Stacked Ensemble
Model Key:  StackedEnsemble_model_python_1497530715156_43
No model summary for this model


ModelMetricsRegressionGLM: stackedensemble
** Reported on train data. **

MSE: 0.0037195951897363083
RMSE: 0.06098848407475225
MAE: 0.04305787492087697
RMSLE: 0.004733690637851762
R^2: 0.9760134192704554
Mean Residual Deviance: 0.0037195951897363083
Null degrees of freedom: 1000
Residual degrees of freedom: 997
Null deviance: 155.22490791465145
Residual deviance: 3.7233147849260444
AIC: -2749.019633542589

ModelMetricsRegressionGLM: stackedensemble
** Reported on validation data. **

MSE: 0.016980254787969905
RMSE: 0.13030830667294355
MAE: 0.09925529488015572
RMSLE: 0.01009315309820752
R^2: 0.8992360780098589
Mean Residual Deviance: 0.016980254787969905
Null degrees of freedom: 458
Residual degrees of freedom: 455
Null deviance: 77.67997881888834
Residual deviance: 7.793936947678187
AIC: -558.1626052192096

stackedensemble prediction progress: |████████████████████████████████████| 100%
SalePrice predict
11.8494 12.0728
12.2061 12.3159
11.6784 11.6697
11.7906 11.6571
11.9117 11.8351
11.9767 11.8878
11.8451 11.6624
11.1346 11.0312
11.914 11.7651
11.8845 11.8257
stackedensemble prediction progress: |████████████████████████████████████| 100%

Native XGBoost GBM model (for example)


In [107]:
"""

ave_y = half_train['SalePrice'].mean()[0]

# XGBoost uses SVMLight data structure, not Numpy arrays or Pandas data frames 
dtrain1 = xgb.DMatrix(train.as_data_frame()[encoded_combined_nums],
                      train.as_data_frame()['SalePrice'])
dvalid1 = xgb.DMatrix(valid.as_data_frame()[encoded_combined_nums],
                      valid.as_data_frame()['SalePrice'])
dtest = xgb.DMatrix(test.as_data_frame()[encoded_combined_nums])

# tuning parameters
params1 = {
    'objective': 'reg:linear',
    'booster': 'gbtree', 
    'eval_metric': 'rmse',
    'eta': 0.005,
    'subsample': 0.1, 
    'colsample_bytree': 0.8,
    'max_depth': 5,
    'reg_alpha' : 0.007,
    'reg_lambda' : 0.0,
    'base_score': ave_y,
    'silent': 0,
    'seed': 12345,
}

# watchlist is used for early stopping
watchlist = [(dtrain1, 'train'), (dvalid1, 'eval')]

# train model
xgb_model1 = xgb.train(params1, 
                       dtrain1, 
                       10000,
                       evals=watchlist, 
                       early_stopping_rounds=50, 
                       verbose_eval=True)

# create assessment stats and submission file
xgb_preds1_val = h2o.H2OFrame(xgb_model1.predict(dvalid1).tolist())
ranked_preds_plot('SalePrice', valid, xgb_preds1_val) 
xgb_preds1_test = h2o.H2OFrame(xgb_model1.predict(dtest).tolist())
gen_submission(xgb_preds1_test) 

"""


[0]	train-rmse:0.394481	eval-rmse:0.386675
Multiple eval metrics have been passed: 'eval-rmse' will be used for early stopping.

Will train until eval-rmse hasn't improved in 50 rounds.
[1]	train-rmse:0.392907	eval-rmse:0.385508
[2]	train-rmse:0.391742	eval-rmse:0.384175
[3]	train-rmse:0.390294	eval-rmse:0.382704
[4]	train-rmse:0.388924	eval-rmse:0.381541
[5]	train-rmse:0.387633	eval-rmse:0.380214
[6]	train-rmse:0.386467	eval-rmse:0.379089
[7]	train-rmse:0.385057	eval-rmse:0.377412
[8]	train-rmse:0.383782	eval-rmse:0.376077
[9]	train-rmse:0.382354	eval-rmse:0.374844
[10]	train-rmse:0.381072	eval-rmse:0.373659
[11]	train-rmse:0.379447	eval-rmse:0.372006
[12]	train-rmse:0.377973	eval-rmse:0.370835
[13]	train-rmse:0.376468	eval-rmse:0.369565
[14]	train-rmse:0.374766	eval-rmse:0.368023
[15]	train-rmse:0.373482	eval-rmse:0.366748
[16]	train-rmse:0.372088	eval-rmse:0.365415
[17]	train-rmse:0.370921	eval-rmse:0.364812
[18]	train-rmse:0.369993	eval-rmse:0.364129
[19]	train-rmse:0.36835	eval-rmse:0.362271
[20]	train-rmse:0.367002	eval-rmse:0.361146
[21]	train-rmse:0.365714	eval-rmse:0.359928
[22]	train-rmse:0.364386	eval-rmse:0.358834
[23]	train-rmse:0.363024	eval-rmse:0.357736
[24]	train-rmse:0.361641	eval-rmse:0.356375
[25]	train-rmse:0.360185	eval-rmse:0.354883
[26]	train-rmse:0.358758	eval-rmse:0.353424
[27]	train-rmse:0.357644	eval-rmse:0.35236
[28]	train-rmse:0.3561	eval-rmse:0.350898
[29]	train-rmse:0.354605	eval-rmse:0.349334
[30]	train-rmse:0.353355	eval-rmse:0.348222
[31]	train-rmse:0.351953	eval-rmse:0.347099
[32]	train-rmse:0.350821	eval-rmse:0.34617
[33]	train-rmse:0.349655	eval-rmse:0.345241
[34]	train-rmse:0.34841	eval-rmse:0.34378
[35]	train-rmse:0.347057	eval-rmse:0.3424
[36]	train-rmse:0.345954	eval-rmse:0.341186
[37]	train-rmse:0.344484	eval-rmse:0.339761
[38]	train-rmse:0.343191	eval-rmse:0.338621
[39]	train-rmse:0.341834	eval-rmse:0.337323
[40]	train-rmse:0.340514	eval-rmse:0.336344
[41]	train-rmse:0.339287	eval-rmse:0.335169
[42]	train-rmse:0.338146	eval-rmse:0.334124
[43]	train-rmse:0.337179	eval-rmse:0.332952
[44]	train-rmse:0.335928	eval-rmse:0.331562
[45]	train-rmse:0.334645	eval-rmse:0.330224
[46]	train-rmse:0.333581	eval-rmse:0.329291
[47]	train-rmse:0.332334	eval-rmse:0.328114
[48]	train-rmse:0.3313	eval-rmse:0.327098
[49]	train-rmse:0.330103	eval-rmse:0.325924
[50]	train-rmse:0.329169	eval-rmse:0.324967
[51]	train-rmse:0.327828	eval-rmse:0.323649
[52]	train-rmse:0.326729	eval-rmse:0.322657
[53]	train-rmse:0.325602	eval-rmse:0.321635
[54]	train-rmse:0.324531	eval-rmse:0.320718
[55]	train-rmse:0.323367	eval-rmse:0.319721
[56]	train-rmse:0.32213	eval-rmse:0.318554
[57]	train-rmse:0.321197	eval-rmse:0.317656
[58]	train-rmse:0.320148	eval-rmse:0.316663
[59]	train-rmse:0.318972	eval-rmse:0.315537
[60]	train-rmse:0.317966	eval-rmse:0.314584
[61]	train-rmse:0.317116	eval-rmse:0.313679
[62]	train-rmse:0.316027	eval-rmse:0.312611
[63]	train-rmse:0.315021	eval-rmse:0.31169
[64]	train-rmse:0.314082	eval-rmse:0.310879
[65]	train-rmse:0.312947	eval-rmse:0.309758
[66]	train-rmse:0.312146	eval-rmse:0.309094
[67]	train-rmse:0.310966	eval-rmse:0.308016
[68]	train-rmse:0.309951	eval-rmse:0.307145
[69]	train-rmse:0.308693	eval-rmse:0.306213
[70]	train-rmse:0.307669	eval-rmse:0.304855
[71]	train-rmse:0.306661	eval-rmse:0.303947
[72]	train-rmse:0.305579	eval-rmse:0.302887
[73]	train-rmse:0.30454	eval-rmse:0.302028
[74]	train-rmse:0.303384	eval-rmse:0.300886
[75]	train-rmse:0.302557	eval-rmse:0.300095
[76]	train-rmse:0.301678	eval-rmse:0.299309
[77]	train-rmse:0.300654	eval-rmse:0.298313
[78]	train-rmse:0.29969	eval-rmse:0.297333
[79]	train-rmse:0.298653	eval-rmse:0.296232
[80]	train-rmse:0.29771	eval-rmse:0.295339
[81]	train-rmse:0.29677	eval-rmse:0.294592
[82]	train-rmse:0.295788	eval-rmse:0.293556
[83]	train-rmse:0.294856	eval-rmse:0.292755
[84]	train-rmse:0.293827	eval-rmse:0.291844
[85]	train-rmse:0.292828	eval-rmse:0.290974
[86]	train-rmse:0.291856	eval-rmse:0.290023
[87]	train-rmse:0.290942	eval-rmse:0.289289
[88]	train-rmse:0.289931	eval-rmse:0.288403
[89]	train-rmse:0.288876	eval-rmse:0.287558
[90]	train-rmse:0.288038	eval-rmse:0.286839
[91]	train-rmse:0.287023	eval-rmse:0.285803
[92]	train-rmse:0.286174	eval-rmse:0.285082
[93]	train-rmse:0.28521	eval-rmse:0.284306
[94]	train-rmse:0.284174	eval-rmse:0.283435
[95]	train-rmse:0.283309	eval-rmse:0.282843
[96]	train-rmse:0.282311	eval-rmse:0.281995
[97]	train-rmse:0.28136	eval-rmse:0.281121
[98]	train-rmse:0.280641	eval-rmse:0.279872
[99]	train-rmse:0.279617	eval-rmse:0.27891
[100]	train-rmse:0.278514	eval-rmse:0.277978
[101]	train-rmse:0.277729	eval-rmse:0.277252
[102]	train-rmse:0.277085	eval-rmse:0.276726
[103]	train-rmse:0.276109	eval-rmse:0.275851
[104]	train-rmse:0.275228	eval-rmse:0.275101
[105]	train-rmse:0.274252	eval-rmse:0.274194
[106]	train-rmse:0.273419	eval-rmse:0.273546
[107]	train-rmse:0.27278	eval-rmse:0.272938
[108]	train-rmse:0.271689	eval-rmse:0.271799
[109]	train-rmse:0.270753	eval-rmse:0.270933
[110]	train-rmse:0.269808	eval-rmse:0.270018
[111]	train-rmse:0.268751	eval-rmse:0.268814
[112]	train-rmse:0.2679	eval-rmse:0.268106
[113]	train-rmse:0.267224	eval-rmse:0.267608
[114]	train-rmse:0.266638	eval-rmse:0.267288
[115]	train-rmse:0.265662	eval-rmse:0.266006
[116]	train-rmse:0.264807	eval-rmse:0.265085
[117]	train-rmse:0.263956	eval-rmse:0.264114
[118]	train-rmse:0.263285	eval-rmse:0.263777
[119]	train-rmse:0.262444	eval-rmse:0.263158
[120]	train-rmse:0.261842	eval-rmse:0.262426
[121]	train-rmse:0.261068	eval-rmse:0.261821
[122]	train-rmse:0.260404	eval-rmse:0.261211
[123]	train-rmse:0.259732	eval-rmse:0.260533
[124]	train-rmse:0.258933	eval-rmse:0.259943
[125]	train-rmse:0.257944	eval-rmse:0.258987
[126]	train-rmse:0.257288	eval-rmse:0.258446
[127]	train-rmse:0.256666	eval-rmse:0.257901
[128]	train-rmse:0.255969	eval-rmse:0.257132
[129]	train-rmse:0.255062	eval-rmse:0.256245
[130]	train-rmse:0.254296	eval-rmse:0.255642
[131]	train-rmse:0.253697	eval-rmse:0.255297
[132]	train-rmse:0.252992	eval-rmse:0.254598
[133]	train-rmse:0.252244	eval-rmse:0.25383
[134]	train-rmse:0.251445	eval-rmse:0.253113
[135]	train-rmse:0.250598	eval-rmse:0.252351
[136]	train-rmse:0.249889	eval-rmse:0.251718
[137]	train-rmse:0.249237	eval-rmse:0.251024
[138]	train-rmse:0.248384	eval-rmse:0.2502
[139]	train-rmse:0.247657	eval-rmse:0.249506
[140]	train-rmse:0.246924	eval-rmse:0.248873
[141]	train-rmse:0.24613	eval-rmse:0.24819
[142]	train-rmse:0.24543	eval-rmse:0.24754
[143]	train-rmse:0.244576	eval-rmse:0.246903
[144]	train-rmse:0.243904	eval-rmse:0.246201
[145]	train-rmse:0.243302	eval-rmse:0.245704
[146]	train-rmse:0.242711	eval-rmse:0.245259
[147]	train-rmse:0.241985	eval-rmse:0.244758
[148]	train-rmse:0.241176	eval-rmse:0.243974
[149]	train-rmse:0.240489	eval-rmse:0.243233
[150]	train-rmse:0.239991	eval-rmse:0.242703
[151]	train-rmse:0.239281	eval-rmse:0.241943
[152]	train-rmse:0.238588	eval-rmse:0.241358
[153]	train-rmse:0.237822	eval-rmse:0.240559
[154]	train-rmse:0.236981	eval-rmse:0.239921
[155]	train-rmse:0.236364	eval-rmse:0.239298
[156]	train-rmse:0.235579	eval-rmse:0.238473
[157]	train-rmse:0.234594	eval-rmse:0.23756
[158]	train-rmse:0.233983	eval-rmse:0.237068
[159]	train-rmse:0.233418	eval-rmse:0.236585
[160]	train-rmse:0.232673	eval-rmse:0.235971
[161]	train-rmse:0.23201	eval-rmse:0.235364
[162]	train-rmse:0.231192	eval-rmse:0.234618
[163]	train-rmse:0.230762	eval-rmse:0.234389
[164]	train-rmse:0.230095	eval-rmse:0.233727
[165]	train-rmse:0.229522	eval-rmse:0.233286
[166]	train-rmse:0.228767	eval-rmse:0.232476
[167]	train-rmse:0.228206	eval-rmse:0.231826
[168]	train-rmse:0.227761	eval-rmse:0.231384
[169]	train-rmse:0.227161	eval-rmse:0.230829
[170]	train-rmse:0.226492	eval-rmse:0.230101
[171]	train-rmse:0.225764	eval-rmse:0.229369
[172]	train-rmse:0.225242	eval-rmse:0.229163
[173]	train-rmse:0.224389	eval-rmse:0.228337
[174]	train-rmse:0.223694	eval-rmse:0.227707
[175]	train-rmse:0.223284	eval-rmse:0.227453
[176]	train-rmse:0.222745	eval-rmse:0.22701
[177]	train-rmse:0.222067	eval-rmse:0.226363
[178]	train-rmse:0.221403	eval-rmse:0.22577
[179]	train-rmse:0.22079	eval-rmse:0.22522
[180]	train-rmse:0.220261	eval-rmse:0.224891
[181]	train-rmse:0.219611	eval-rmse:0.224217
[182]	train-rmse:0.218869	eval-rmse:0.223282
[183]	train-rmse:0.218293	eval-rmse:0.222731
[184]	train-rmse:0.217692	eval-rmse:0.222241
[185]	train-rmse:0.217051	eval-rmse:0.221572
[186]	train-rmse:0.216656	eval-rmse:0.221219
[187]	train-rmse:0.215919	eval-rmse:0.22053
[188]	train-rmse:0.215219	eval-rmse:0.219859
[189]	train-rmse:0.2146	eval-rmse:0.21931
[190]	train-rmse:0.214007	eval-rmse:0.218876
[191]	train-rmse:0.2135	eval-rmse:0.218387
[192]	train-rmse:0.212812	eval-rmse:0.217761
[193]	train-rmse:0.212145	eval-rmse:0.217161
[194]	train-rmse:0.211639	eval-rmse:0.216655
[195]	train-rmse:0.21104	eval-rmse:0.216083
[196]	train-rmse:0.210304	eval-rmse:0.215584
[197]	train-rmse:0.2095	eval-rmse:0.214969
[198]	train-rmse:0.208902	eval-rmse:0.214352
[199]	train-rmse:0.208245	eval-rmse:0.213788
[200]	train-rmse:0.207601	eval-rmse:0.213234
[201]	train-rmse:0.207219	eval-rmse:0.212918
[202]	train-rmse:0.206697	eval-rmse:0.213126
[203]	train-rmse:0.205964	eval-rmse:0.212401
[204]	train-rmse:0.205391	eval-rmse:0.211967
[205]	train-rmse:0.204886	eval-rmse:0.211686
[206]	train-rmse:0.204225	eval-rmse:0.211103
[207]	train-rmse:0.20364	eval-rmse:0.21063
[208]	train-rmse:0.202969	eval-rmse:0.21002
[209]	train-rmse:0.202294	eval-rmse:0.209401
[210]	train-rmse:0.201831	eval-rmse:0.209045
[211]	train-rmse:0.201443	eval-rmse:0.208717
[212]	train-rmse:0.200972	eval-rmse:0.208218
[213]	train-rmse:0.200571	eval-rmse:0.207886
[214]	train-rmse:0.199984	eval-rmse:0.207263
[215]	train-rmse:0.199415	eval-rmse:0.206828
[216]	train-rmse:0.198832	eval-rmse:0.206183
[217]	train-rmse:0.198166	eval-rmse:0.205559
[218]	train-rmse:0.197734	eval-rmse:0.205127
[219]	train-rmse:0.197314	eval-rmse:0.204675
[220]	train-rmse:0.196808	eval-rmse:0.204207
[221]	train-rmse:0.196255	eval-rmse:0.203911
[222]	train-rmse:0.19563	eval-rmse:0.204065
[223]	train-rmse:0.195141	eval-rmse:0.203558
[224]	train-rmse:0.194392	eval-rmse:0.202828
[225]	train-rmse:0.194008	eval-rmse:0.202405
[226]	train-rmse:0.193534	eval-rmse:0.201922
[227]	train-rmse:0.193002	eval-rmse:0.201499
[228]	train-rmse:0.192568	eval-rmse:0.201082
[229]	train-rmse:0.192141	eval-rmse:0.200722
[230]	train-rmse:0.191581	eval-rmse:0.200278
[231]	train-rmse:0.191023	eval-rmse:0.199795
[232]	train-rmse:0.190541	eval-rmse:0.199274
[233]	train-rmse:0.190036	eval-rmse:0.198812
[234]	train-rmse:0.189626	eval-rmse:0.19849
[235]	train-rmse:0.189134	eval-rmse:0.197919
[236]	train-rmse:0.188646	eval-rmse:0.197486
[237]	train-rmse:0.188232	eval-rmse:0.197153
[238]	train-rmse:0.18769	eval-rmse:0.196935
[239]	train-rmse:0.187098	eval-rmse:0.196511
[240]	train-rmse:0.186806	eval-rmse:0.196237
[241]	train-rmse:0.186088	eval-rmse:0.195657
[242]	train-rmse:0.185737	eval-rmse:0.19532
[243]	train-rmse:0.185319	eval-rmse:0.195058
[244]	train-rmse:0.184983	eval-rmse:0.194682
[245]	train-rmse:0.184452	eval-rmse:0.19422
[246]	train-rmse:0.184093	eval-rmse:0.194016
[247]	train-rmse:0.183593	eval-rmse:0.193575
[248]	train-rmse:0.183066	eval-rmse:0.19319
[249]	train-rmse:0.182633	eval-rmse:0.192895
[250]	train-rmse:0.182111	eval-rmse:0.192507
[251]	train-rmse:0.181815	eval-rmse:0.192424
[252]	train-rmse:0.181383	eval-rmse:0.192064
[253]	train-rmse:0.18083	eval-rmse:0.191663
[254]	train-rmse:0.180286	eval-rmse:0.1912
[255]	train-rmse:0.179843	eval-rmse:0.190705
[256]	train-rmse:0.179379	eval-rmse:0.190336
[257]	train-rmse:0.179051	eval-rmse:0.190123
[258]	train-rmse:0.178549	eval-rmse:0.189605
[259]	train-rmse:0.178155	eval-rmse:0.18931
[260]	train-rmse:0.177854	eval-rmse:0.189048
[261]	train-rmse:0.177506	eval-rmse:0.188698
[262]	train-rmse:0.176938	eval-rmse:0.18831
[263]	train-rmse:0.176564	eval-rmse:0.18797
[264]	train-rmse:0.176136	eval-rmse:0.187684
[265]	train-rmse:0.175722	eval-rmse:0.187304
[266]	train-rmse:0.175334	eval-rmse:0.18697
[267]	train-rmse:0.174871	eval-rmse:0.186276
[268]	train-rmse:0.174558	eval-rmse:0.186019
[269]	train-rmse:0.174056	eval-rmse:0.185649
[270]	train-rmse:0.173557	eval-rmse:0.185127
[271]	train-rmse:0.173123	eval-rmse:0.18479
[272]	train-rmse:0.172673	eval-rmse:0.184421
[273]	train-rmse:0.172224	eval-rmse:0.184008
[274]	train-rmse:0.171723	eval-rmse:0.183665
[275]	train-rmse:0.171374	eval-rmse:0.18331
[276]	train-rmse:0.170814	eval-rmse:0.182781
[277]	train-rmse:0.170279	eval-rmse:0.182293
[278]	train-rmse:0.169984	eval-rmse:0.182029
[279]	train-rmse:0.169582	eval-rmse:0.181702
[280]	train-rmse:0.169159	eval-rmse:0.181291
[281]	train-rmse:0.168798	eval-rmse:0.181035
[282]	train-rmse:0.168416	eval-rmse:0.180674
[283]	train-rmse:0.168125	eval-rmse:0.180558
[284]	train-rmse:0.167756	eval-rmse:0.180339
[285]	train-rmse:0.167336	eval-rmse:0.180048
[286]	train-rmse:0.167083	eval-rmse:0.179816
[287]	train-rmse:0.166665	eval-rmse:0.179532
[288]	train-rmse:0.166338	eval-rmse:0.179327
[289]	train-rmse:0.165875	eval-rmse:0.179011
[290]	train-rmse:0.165549	eval-rmse:0.178669
[291]	train-rmse:0.165018	eval-rmse:0.178122
[292]	train-rmse:0.16458	eval-rmse:0.177798
[293]	train-rmse:0.164186	eval-rmse:0.177518
[294]	train-rmse:0.163807	eval-rmse:0.1772
[295]	train-rmse:0.163491	eval-rmse:0.177112
[296]	train-rmse:0.163171	eval-rmse:0.176818
[297]	train-rmse:0.162773	eval-rmse:0.176513
[298]	train-rmse:0.1623	eval-rmse:0.176132
[299]	train-rmse:0.16188	eval-rmse:0.175785
[300]	train-rmse:0.16144	eval-rmse:0.175553
[301]	train-rmse:0.160995	eval-rmse:0.175275
[302]	train-rmse:0.160583	eval-rmse:0.175019
[303]	train-rmse:0.160237	eval-rmse:0.174684
[304]	train-rmse:0.159896	eval-rmse:0.174392
[305]	train-rmse:0.159489	eval-rmse:0.174033
[306]	train-rmse:0.159195	eval-rmse:0.173848
[307]	train-rmse:0.158922	eval-rmse:0.173677
[308]	train-rmse:0.158683	eval-rmse:0.173541
[309]	train-rmse:0.158494	eval-rmse:0.173395
[310]	train-rmse:0.158231	eval-rmse:0.17306
[311]	train-rmse:0.157852	eval-rmse:0.172753
[312]	train-rmse:0.157518	eval-rmse:0.172628
[313]	train-rmse:0.157185	eval-rmse:0.17243
[314]	train-rmse:0.156943	eval-rmse:0.172291
[315]	train-rmse:0.156535	eval-rmse:0.172582
[316]	train-rmse:0.156	eval-rmse:0.172263
[317]	train-rmse:0.155802	eval-rmse:0.172136
[318]	train-rmse:0.155433	eval-rmse:0.171909
[319]	train-rmse:0.155167	eval-rmse:0.171661
[320]	train-rmse:0.154667	eval-rmse:0.171265
[321]	train-rmse:0.154277	eval-rmse:0.171043
[322]	train-rmse:0.153912	eval-rmse:0.170828
[323]	train-rmse:0.153595	eval-rmse:0.170529
[324]	train-rmse:0.153324	eval-rmse:0.170327
[325]	train-rmse:0.152869	eval-rmse:0.170015
[326]	train-rmse:0.152562	eval-rmse:0.169781
[327]	train-rmse:0.15231	eval-rmse:0.169533
[328]	train-rmse:0.152029	eval-rmse:0.169213
[329]	train-rmse:0.151521	eval-rmse:0.169013
[330]	train-rmse:0.151228	eval-rmse:0.168837
[331]	train-rmse:0.151056	eval-rmse:0.168656
[332]	train-rmse:0.15059	eval-rmse:0.168267
[333]	train-rmse:0.150314	eval-rmse:0.168191
[334]	train-rmse:0.150043	eval-rmse:0.168014
[335]	train-rmse:0.149844	eval-rmse:0.167889
[336]	train-rmse:0.149452	eval-rmse:0.1676
[337]	train-rmse:0.149204	eval-rmse:0.167412
[338]	train-rmse:0.148955	eval-rmse:0.167212
[339]	train-rmse:0.148778	eval-rmse:0.167153
[340]	train-rmse:0.14853	eval-rmse:0.166938
[341]	train-rmse:0.148137	eval-rmse:0.166613
[342]	train-rmse:0.147883	eval-rmse:0.16638
[343]	train-rmse:0.147647	eval-rmse:0.16633
[344]	train-rmse:0.147371	eval-rmse:0.166127
[345]	train-rmse:0.146946	eval-rmse:0.165776
[346]	train-rmse:0.146615	eval-rmse:0.16565
[347]	train-rmse:0.146241	eval-rmse:0.165504
[348]	train-rmse:0.14598	eval-rmse:0.165506
[349]	train-rmse:0.14554	eval-rmse:0.165107
[350]	train-rmse:0.14536	eval-rmse:0.165028
[351]	train-rmse:0.145093	eval-rmse:0.164845
[352]	train-rmse:0.144754	eval-rmse:0.1646
[353]	train-rmse:0.1445	eval-rmse:0.164496
[354]	train-rmse:0.144246	eval-rmse:0.164325
[355]	train-rmse:0.144018	eval-rmse:0.164068
[356]	train-rmse:0.143749	eval-rmse:0.163849
[357]	train-rmse:0.143409	eval-rmse:0.163556
[358]	train-rmse:0.143103	eval-rmse:0.163381
[359]	train-rmse:0.14306	eval-rmse:0.16332
[360]	train-rmse:0.142791	eval-rmse:0.16303
[361]	train-rmse:0.142506	eval-rmse:0.162953
[362]	train-rmse:0.142228	eval-rmse:0.162734
[363]	train-rmse:0.142042	eval-rmse:0.162535
[364]	train-rmse:0.141633	eval-rmse:0.162326
[365]	train-rmse:0.14146	eval-rmse:0.162281
[366]	train-rmse:0.141299	eval-rmse:0.162184
[367]	train-rmse:0.141089	eval-rmse:0.162097
[368]	train-rmse:0.140731	eval-rmse:0.161788
[369]	train-rmse:0.140605	eval-rmse:0.161698
[370]	train-rmse:0.140563	eval-rmse:0.161675
[371]	train-rmse:0.140315	eval-rmse:0.161509
[372]	train-rmse:0.140061	eval-rmse:0.161334
[373]	train-rmse:0.139837	eval-rmse:0.161167
[374]	train-rmse:0.139704	eval-rmse:0.16111
[375]	train-rmse:0.139529	eval-rmse:0.161023
[376]	train-rmse:0.139278	eval-rmse:0.160643
[377]	train-rmse:0.139158	eval-rmse:0.160901
[378]	train-rmse:0.138959	eval-rmse:0.160707
[379]	train-rmse:0.138735	eval-rmse:0.160791
[380]	train-rmse:0.138516	eval-rmse:0.160677
[381]	train-rmse:0.138364	eval-rmse:0.160594
[382]	train-rmse:0.138088	eval-rmse:0.160389
[383]	train-rmse:0.137753	eval-rmse:0.160159
[384]	train-rmse:0.137465	eval-rmse:0.160024
[385]	train-rmse:0.13723	eval-rmse:0.159941
[386]	train-rmse:0.136904	eval-rmse:0.159606
[387]	train-rmse:0.136745	eval-rmse:0.159475
[388]	train-rmse:0.136484	eval-rmse:0.159277
[389]	train-rmse:0.136277	eval-rmse:0.159096
[390]	train-rmse:0.135982	eval-rmse:0.158869
[391]	train-rmse:0.135789	eval-rmse:0.158631
[392]	train-rmse:0.135594	eval-rmse:0.15849
[393]	train-rmse:0.135333	eval-rmse:0.158381
[394]	train-rmse:0.135089	eval-rmse:0.158392
[395]	train-rmse:0.13494	eval-rmse:0.158262
[396]	train-rmse:0.134744	eval-rmse:0.158041
[397]	train-rmse:0.134584	eval-rmse:0.158028
[398]	train-rmse:0.134423	eval-rmse:0.158167
[399]	train-rmse:0.134139	eval-rmse:0.157943
[400]	train-rmse:0.133877	eval-rmse:0.157822
[401]	train-rmse:0.133678	eval-rmse:0.157755
[402]	train-rmse:0.133478	eval-rmse:0.157586
[403]	train-rmse:0.133268	eval-rmse:0.15736
[404]	train-rmse:0.133069	eval-rmse:0.157199
[405]	train-rmse:0.132771	eval-rmse:0.157159
[406]	train-rmse:0.132469	eval-rmse:0.156936
[407]	train-rmse:0.132315	eval-rmse:0.156781
[408]	train-rmse:0.132094	eval-rmse:0.156556
[409]	train-rmse:0.132016	eval-rmse:0.156513
[410]	train-rmse:0.131691	eval-rmse:0.156306
[411]	train-rmse:0.131499	eval-rmse:0.156183
[412]	train-rmse:0.131374	eval-rmse:0.156187
[413]	train-rmse:0.131085	eval-rmse:0.15601
[414]	train-rmse:0.130915	eval-rmse:0.155848
[415]	train-rmse:0.130704	eval-rmse:0.155646
[416]	train-rmse:0.130662	eval-rmse:0.155593
[417]	train-rmse:0.130444	eval-rmse:0.155481
[418]	train-rmse:0.130333	eval-rmse:0.15536
[419]	train-rmse:0.130169	eval-rmse:0.155195
[420]	train-rmse:0.13004	eval-rmse:0.155122
[421]	train-rmse:0.129892	eval-rmse:0.155023
[422]	train-rmse:0.129731	eval-rmse:0.154872
[423]	train-rmse:0.129607	eval-rmse:0.154748
[424]	train-rmse:0.129414	eval-rmse:0.154543
[425]	train-rmse:0.129257	eval-rmse:0.154369
[426]	train-rmse:0.129131	eval-rmse:0.154272
[427]	train-rmse:0.128965	eval-rmse:0.154133
[428]	train-rmse:0.128865	eval-rmse:0.154043
[429]	train-rmse:0.128711	eval-rmse:0.153937
[430]	train-rmse:0.128574	eval-rmse:0.153877
[431]	train-rmse:0.128424	eval-rmse:0.153756
[432]	train-rmse:0.128118	eval-rmse:0.153566
[433]	train-rmse:0.127965	eval-rmse:0.153421
[434]	train-rmse:0.127893	eval-rmse:0.153453
[435]	train-rmse:0.127761	eval-rmse:0.153385
[436]	train-rmse:0.127633	eval-rmse:0.153391
[437]	train-rmse:0.127315	eval-rmse:0.153171
[438]	train-rmse:0.127177	eval-rmse:0.153046
[439]	train-rmse:0.126931	eval-rmse:0.153031
[440]	train-rmse:0.126691	eval-rmse:0.152968
[441]	train-rmse:0.12634	eval-rmse:0.152688
[442]	train-rmse:0.12625	eval-rmse:0.152596
[443]	train-rmse:0.126122	eval-rmse:0.152505
[444]	train-rmse:0.125816	eval-rmse:0.152187
[445]	train-rmse:0.125774	eval-rmse:0.152276
[446]	train-rmse:0.125564	eval-rmse:0.152024
[447]	train-rmse:0.125243	eval-rmse:0.151735
[448]	train-rmse:0.125057	eval-rmse:0.151566
[449]	train-rmse:0.124992	eval-rmse:0.151462
[450]	train-rmse:0.124733	eval-rmse:0.151442
[451]	train-rmse:0.124602	eval-rmse:0.151362
[452]	train-rmse:0.12447	eval-rmse:0.151229
[453]	train-rmse:0.124246	eval-rmse:0.1511
[454]	train-rmse:0.124123	eval-rmse:0.150938
[455]	train-rmse:0.124022	eval-rmse:0.150817
[456]	train-rmse:0.123892	eval-rmse:0.150699
[457]	train-rmse:0.123705	eval-rmse:0.150455
[458]	train-rmse:0.123578	eval-rmse:0.150334
[459]	train-rmse:0.123398	eval-rmse:0.150242
[460]	train-rmse:0.12324	eval-rmse:0.150169
[461]	train-rmse:0.122954	eval-rmse:0.149939
[462]	train-rmse:0.122851	eval-rmse:0.149865
[463]	train-rmse:0.122645	eval-rmse:0.149748
[464]	train-rmse:0.122589	eval-rmse:0.149675
[465]	train-rmse:0.122474	eval-rmse:0.149602
[466]	train-rmse:0.122319	eval-rmse:0.149373
[467]	train-rmse:0.122154	eval-rmse:0.149204
[468]	train-rmse:0.12195	eval-rmse:0.149024
[469]	train-rmse:0.121752	eval-rmse:0.148861
[470]	train-rmse:0.121626	eval-rmse:0.148889
[471]	train-rmse:0.121489	eval-rmse:0.148792
[472]	train-rmse:0.121255	eval-rmse:0.148589
[473]	train-rmse:0.121121	eval-rmse:0.148444
[474]	train-rmse:0.120946	eval-rmse:0.148394
[475]	train-rmse:0.120697	eval-rmse:0.148288
[476]	train-rmse:0.12049	eval-rmse:0.148033
[477]	train-rmse:0.120329	eval-rmse:0.14796
[478]	train-rmse:0.120295	eval-rmse:0.147929
[479]	train-rmse:0.120184	eval-rmse:0.147767
[480]	train-rmse:0.120032	eval-rmse:0.147619
[481]	train-rmse:0.11984	eval-rmse:0.147502
[482]	train-rmse:0.119673	eval-rmse:0.147376
[483]	train-rmse:0.119579	eval-rmse:0.147348
[484]	train-rmse:0.119478	eval-rmse:0.147249
[485]	train-rmse:0.119414	eval-rmse:0.147149
[486]	train-rmse:0.119218	eval-rmse:0.147043
[487]	train-rmse:0.11912	eval-rmse:0.146987
[488]	train-rmse:0.119034	eval-rmse:0.146885
[489]	train-rmse:0.118873	eval-rmse:0.146844
[490]	train-rmse:0.118794	eval-rmse:0.146816
[491]	train-rmse:0.118743	eval-rmse:0.146762
[492]	train-rmse:0.118562	eval-rmse:0.146661
[493]	train-rmse:0.118451	eval-rmse:0.1467
[494]	train-rmse:0.118341	eval-rmse:0.146641
[495]	train-rmse:0.118206	eval-rmse:0.146555
[496]	train-rmse:0.117945	eval-rmse:0.146471
[497]	train-rmse:0.117758	eval-rmse:0.146342
[498]	train-rmse:0.117566	eval-rmse:0.146357
[499]	train-rmse:0.117368	eval-rmse:0.146228
[500]	train-rmse:0.11728	eval-rmse:0.146136
[501]	train-rmse:0.117073	eval-rmse:0.146065
[502]	train-rmse:0.116956	eval-rmse:0.146011
[503]	train-rmse:0.116815	eval-rmse:0.146464
[504]	train-rmse:0.116575	eval-rmse:0.146433
[505]	train-rmse:0.116472	eval-rmse:0.146343
[506]	train-rmse:0.116388	eval-rmse:0.146276
[507]	train-rmse:0.116378	eval-rmse:0.146238
[508]	train-rmse:0.116252	eval-rmse:0.14617
[509]	train-rmse:0.116142	eval-rmse:0.146131
[510]	train-rmse:0.116041	eval-rmse:0.146065
[511]	train-rmse:0.115969	eval-rmse:0.145975
[512]	train-rmse:0.115936	eval-rmse:0.145975
[513]	train-rmse:0.11573	eval-rmse:0.14586
[514]	train-rmse:0.115568	eval-rmse:0.145789
[515]	train-rmse:0.115476	eval-rmse:0.145689
[516]	train-rmse:0.115368	eval-rmse:0.145562
[517]	train-rmse:0.115295	eval-rmse:0.145648
[518]	train-rmse:0.115257	eval-rmse:0.145591
[519]	train-rmse:0.115182	eval-rmse:0.14555
[520]	train-rmse:0.115126	eval-rmse:0.145519
[521]	train-rmse:0.115056	eval-rmse:0.145621
[522]	train-rmse:0.114988	eval-rmse:0.145566
[523]	train-rmse:0.114891	eval-rmse:0.145856
[524]	train-rmse:0.114771	eval-rmse:0.14573
[525]	train-rmse:0.114747	eval-rmse:0.145673
[526]	train-rmse:0.114637	eval-rmse:0.145607
[527]	train-rmse:0.114588	eval-rmse:0.145545
[528]	train-rmse:0.114558	eval-rmse:0.145445
[529]	train-rmse:0.114427	eval-rmse:0.145382
[530]	train-rmse:0.114339	eval-rmse:0.145249
[531]	train-rmse:0.114175	eval-rmse:0.145292
[532]	train-rmse:0.114021	eval-rmse:0.145265
[533]	train-rmse:0.113901	eval-rmse:0.145122
[534]	train-rmse:0.113783	eval-rmse:0.145031
[535]	train-rmse:0.113633	eval-rmse:0.145001
[536]	train-rmse:0.113533	eval-rmse:0.144934
[537]	train-rmse:0.113343	eval-rmse:0.144816
[538]	train-rmse:0.113327	eval-rmse:0.144808
[539]	train-rmse:0.113217	eval-rmse:0.144654
[540]	train-rmse:0.113099	eval-rmse:0.144636
[541]	train-rmse:0.113048	eval-rmse:0.144828
[542]	train-rmse:0.112952	eval-rmse:0.144827
[543]	train-rmse:0.112878	eval-rmse:0.144805
[544]	train-rmse:0.112809	eval-rmse:0.144779
[545]	train-rmse:0.112673	eval-rmse:0.144648
[546]	train-rmse:0.112586	eval-rmse:0.144766
[547]	train-rmse:0.112439	eval-rmse:0.144733
[548]	train-rmse:0.112347	eval-rmse:0.144637
[549]	train-rmse:0.112195	eval-rmse:0.144598
[550]	train-rmse:0.112144	eval-rmse:0.144626
[551]	train-rmse:0.112114	eval-rmse:0.14463
[552]	train-rmse:0.112016	eval-rmse:0.144566
[553]	train-rmse:0.111966	eval-rmse:0.144499
[554]	train-rmse:0.111843	eval-rmse:0.144386
[555]	train-rmse:0.111739	eval-rmse:0.144338
[556]	train-rmse:0.111649	eval-rmse:0.144307
[557]	train-rmse:0.111562	eval-rmse:0.144261
[558]	train-rmse:0.111407	eval-rmse:0.144164
[559]	train-rmse:0.111236	eval-rmse:0.144079
[560]	train-rmse:0.111126	eval-rmse:0.144041
[561]	train-rmse:0.111034	eval-rmse:0.143921
[562]	train-rmse:0.110926	eval-rmse:0.143885
[563]	train-rmse:0.110829	eval-rmse:0.143875
[564]	train-rmse:0.110734	eval-rmse:0.14381
[565]	train-rmse:0.110676	eval-rmse:0.143759
[566]	train-rmse:0.110535	eval-rmse:0.143624
[567]	train-rmse:0.110482	eval-rmse:0.143682
[568]	train-rmse:0.110409	eval-rmse:0.143583
[569]	train-rmse:0.110237	eval-rmse:0.143482
[570]	train-rmse:0.110103	eval-rmse:0.143321
[571]	train-rmse:0.110034	eval-rmse:0.143294
[572]	train-rmse:0.10991	eval-rmse:0.143211
[573]	train-rmse:0.109771	eval-rmse:0.143052
[574]	train-rmse:0.109669	eval-rmse:0.14306
[575]	train-rmse:0.109596	eval-rmse:0.142977
[576]	train-rmse:0.109569	eval-rmse:0.142938
[577]	train-rmse:0.109533	eval-rmse:0.142894
[578]	train-rmse:0.109463	eval-rmse:0.142906
[579]	train-rmse:0.109248	eval-rmse:0.142885
[580]	train-rmse:0.109176	eval-rmse:0.142963
[581]	train-rmse:0.109082	eval-rmse:0.142891
[582]	train-rmse:0.108984	eval-rmse:0.142851
[583]	train-rmse:0.108891	eval-rmse:0.14286
[584]	train-rmse:0.108859	eval-rmse:0.142708
[585]	train-rmse:0.108789	eval-rmse:0.142678
[586]	train-rmse:0.108692	eval-rmse:0.142658
[587]	train-rmse:0.108568	eval-rmse:0.142618
[588]	train-rmse:0.108482	eval-rmse:0.142567
[589]	train-rmse:0.108449	eval-rmse:0.14246
[590]	train-rmse:0.108344	eval-rmse:0.142397
[591]	train-rmse:0.108251	eval-rmse:0.142355
[592]	train-rmse:0.108193	eval-rmse:0.142306
[593]	train-rmse:0.108109	eval-rmse:0.142399
[594]	train-rmse:0.107955	eval-rmse:0.142319
[595]	train-rmse:0.107865	eval-rmse:0.14229
[596]	train-rmse:0.107835	eval-rmse:0.142314
[597]	train-rmse:0.107782	eval-rmse:0.14222
[598]	train-rmse:0.10768	eval-rmse:0.142201
[599]	train-rmse:0.107564	eval-rmse:0.142174
[600]	train-rmse:0.107516	eval-rmse:0.141989
[601]	train-rmse:0.107391	eval-rmse:0.141991
[602]	train-rmse:0.107289	eval-rmse:0.142024
[603]	train-rmse:0.1072	eval-rmse:0.142113
[604]	train-rmse:0.107088	eval-rmse:0.141963
[605]	train-rmse:0.106992	eval-rmse:0.141821
[606]	train-rmse:0.106925	eval-rmse:0.141791
[607]	train-rmse:0.106764	eval-rmse:0.141796
[608]	train-rmse:0.106651	eval-rmse:0.141696
[609]	train-rmse:0.10651	eval-rmse:0.141679
[610]	train-rmse:0.106401	eval-rmse:0.141745
[611]	train-rmse:0.106305	eval-rmse:0.141658
[612]	train-rmse:0.106288	eval-rmse:0.141636
[613]	train-rmse:0.106187	eval-rmse:0.14194
[614]	train-rmse:0.106097	eval-rmse:0.141845
[615]	train-rmse:0.106084	eval-rmse:0.14188
[616]	train-rmse:0.106031	eval-rmse:0.141804
[617]	train-rmse:0.10596	eval-rmse:0.141718
[618]	train-rmse:0.105883	eval-rmse:0.141726
[619]	train-rmse:0.105853	eval-rmse:0.141776
[620]	train-rmse:0.105803	eval-rmse:0.141633
[621]	train-rmse:0.105669	eval-rmse:0.141557
[622]	train-rmse:0.105629	eval-rmse:0.141493
[623]	train-rmse:0.105601	eval-rmse:0.141506
[624]	train-rmse:0.105571	eval-rmse:0.141459
[625]	train-rmse:0.105474	eval-rmse:0.141404
[626]	train-rmse:0.105382	eval-rmse:0.141386
[627]	train-rmse:0.105306	eval-rmse:0.141382
[628]	train-rmse:0.105209	eval-rmse:0.141274
[629]	train-rmse:0.105219	eval-rmse:0.141172
[630]	train-rmse:0.105172	eval-rmse:0.141226
[631]	train-rmse:0.105031	eval-rmse:0.141163
[632]	train-rmse:0.104908	eval-rmse:0.141172
[633]	train-rmse:0.104834	eval-rmse:0.141126
[634]	train-rmse:0.104872	eval-rmse:0.141139
[635]	train-rmse:0.104806	eval-rmse:0.141144
[636]	train-rmse:0.10475	eval-rmse:0.141107
[637]	train-rmse:0.104636	eval-rmse:0.141012
[638]	train-rmse:0.104567	eval-rmse:0.141082
[639]	train-rmse:0.10446	eval-rmse:0.141039
[640]	train-rmse:0.104388	eval-rmse:0.141024
[641]	train-rmse:0.104277	eval-rmse:0.141048
[642]	train-rmse:0.104261	eval-rmse:0.140937
[643]	train-rmse:0.104144	eval-rmse:0.140909
[644]	train-rmse:0.104094	eval-rmse:0.140992
[645]	train-rmse:0.104149	eval-rmse:0.141214
[646]	train-rmse:0.104089	eval-rmse:0.141283
[647]	train-rmse:0.104003	eval-rmse:0.141447
[648]	train-rmse:0.103862	eval-rmse:0.141344
[649]	train-rmse:0.103816	eval-rmse:0.141324
[650]	train-rmse:0.103834	eval-rmse:0.141365
[651]	train-rmse:0.103766	eval-rmse:0.141213
[652]	train-rmse:0.103679	eval-rmse:0.141129
[653]	train-rmse:0.103565	eval-rmse:0.140977
[654]	train-rmse:0.103459	eval-rmse:0.14097
[655]	train-rmse:0.103446	eval-rmse:0.140966
[656]	train-rmse:0.103404	eval-rmse:0.141164
[657]	train-rmse:0.103367	eval-rmse:0.141134
[658]	train-rmse:0.103298	eval-rmse:0.141071
[659]	train-rmse:0.103226	eval-rmse:0.141008
[660]	train-rmse:0.10319	eval-rmse:0.140994
[661]	train-rmse:0.103127	eval-rmse:0.140801
[662]	train-rmse:0.103033	eval-rmse:0.140784
[663]	train-rmse:0.102972	eval-rmse:0.140863
[664]	train-rmse:0.102954	eval-rmse:0.140875
[665]	train-rmse:0.102889	eval-rmse:0.140851
[666]	train-rmse:0.102771	eval-rmse:0.140823
[667]	train-rmse:0.102686	eval-rmse:0.140786
[668]	train-rmse:0.10271	eval-rmse:0.140723
[669]	train-rmse:0.102705	eval-rmse:0.140671
[670]	train-rmse:0.102602	eval-rmse:0.140618
[671]	train-rmse:0.102572	eval-rmse:0.140549
[672]	train-rmse:0.102523	eval-rmse:0.140514
[673]	train-rmse:0.102513	eval-rmse:0.140485
[674]	train-rmse:0.102448	eval-rmse:0.140066
[675]	train-rmse:0.102386	eval-rmse:0.140018
[676]	train-rmse:0.102267	eval-rmse:0.139987
[677]	train-rmse:0.102212	eval-rmse:0.139844
[678]	train-rmse:0.102188	eval-rmse:0.139848
[679]	train-rmse:0.102122	eval-rmse:0.139963
[680]	train-rmse:0.102039	eval-rmse:0.139897
[681]	train-rmse:0.102003	eval-rmse:0.139927
[682]	train-rmse:0.101956	eval-rmse:0.139922
[683]	train-rmse:0.101832	eval-rmse:0.139971
[684]	train-rmse:0.101829	eval-rmse:0.140033
[685]	train-rmse:0.101707	eval-rmse:0.139854
[686]	train-rmse:0.101643	eval-rmse:0.139878
[687]	train-rmse:0.101646	eval-rmse:0.139875
[688]	train-rmse:0.101565	eval-rmse:0.139861
[689]	train-rmse:0.101487	eval-rmse:0.139748
[690]	train-rmse:0.101446	eval-rmse:0.139892
[691]	train-rmse:0.101339	eval-rmse:0.139854
[692]	train-rmse:0.101299	eval-rmse:0.139921
[693]	train-rmse:0.101191	eval-rmse:0.139828
[694]	train-rmse:0.101062	eval-rmse:0.139671
[695]	train-rmse:0.100984	eval-rmse:0.139572
[696]	train-rmse:0.100951	eval-rmse:0.139536
[697]	train-rmse:0.100905	eval-rmse:0.139507
[698]	train-rmse:0.100824	eval-rmse:0.139564
[699]	train-rmse:0.100778	eval-rmse:0.13953
[700]	train-rmse:0.100752	eval-rmse:0.139526
[701]	train-rmse:0.100742	eval-rmse:0.139509
[702]	train-rmse:0.100693	eval-rmse:0.139404
[703]	train-rmse:0.100656	eval-rmse:0.139316
[704]	train-rmse:0.100596	eval-rmse:0.13932
[705]	train-rmse:0.100602	eval-rmse:0.139268
[706]	train-rmse:0.100577	eval-rmse:0.139252
[707]	train-rmse:0.100563	eval-rmse:0.139249
[708]	train-rmse:0.100533	eval-rmse:0.139185
[709]	train-rmse:0.100427	eval-rmse:0.139193
[710]	train-rmse:0.10038	eval-rmse:0.139038
[711]	train-rmse:0.100361	eval-rmse:0.139027
[712]	train-rmse:0.100265	eval-rmse:0.13895
[713]	train-rmse:0.10025	eval-rmse:0.138695
[714]	train-rmse:0.100193	eval-rmse:0.138618
[715]	train-rmse:0.100158	eval-rmse:0.138583
[716]	train-rmse:0.100103	eval-rmse:0.138526
[717]	train-rmse:0.100106	eval-rmse:0.13856
[718]	train-rmse:0.100082	eval-rmse:0.138557
[719]	train-rmse:0.10001	eval-rmse:0.138514
[720]	train-rmse:0.099988	eval-rmse:0.138486
[721]	train-rmse:0.099898	eval-rmse:0.138389
[722]	train-rmse:0.099897	eval-rmse:0.138372
[723]	train-rmse:0.09981	eval-rmse:0.138272
[724]	train-rmse:0.099725	eval-rmse:0.138318
[725]	train-rmse:0.099683	eval-rmse:0.138271
[726]	train-rmse:0.099661	eval-rmse:0.138455
[727]	train-rmse:0.099617	eval-rmse:0.138368
[728]	train-rmse:0.099583	eval-rmse:0.138338
[729]	train-rmse:0.099538	eval-rmse:0.138253
[730]	train-rmse:0.099502	eval-rmse:0.138011
[731]	train-rmse:0.099447	eval-rmse:0.138
[732]	train-rmse:0.099417	eval-rmse:0.138014
[733]	train-rmse:0.099371	eval-rmse:0.138029
[734]	train-rmse:0.099318	eval-rmse:0.138031
[735]	train-rmse:0.09928	eval-rmse:0.137982
[736]	train-rmse:0.099263	eval-rmse:0.137896
[737]	train-rmse:0.099229	eval-rmse:0.137907
[738]	train-rmse:0.099246	eval-rmse:0.137822
[739]	train-rmse:0.099155	eval-rmse:0.137662
[740]	train-rmse:0.099133	eval-rmse:0.137682
[741]	train-rmse:0.099071	eval-rmse:0.137679
[742]	train-rmse:0.099029	eval-rmse:0.137663
[743]	train-rmse:0.098997	eval-rmse:0.137691
[744]	train-rmse:0.098939	eval-rmse:0.137753
[745]	train-rmse:0.098931	eval-rmse:0.137666
[746]	train-rmse:0.098834	eval-rmse:0.137589
[747]	train-rmse:0.098781	eval-rmse:0.137541
[748]	train-rmse:0.098723	eval-rmse:0.137477
[749]	train-rmse:0.09868	eval-rmse:0.137563
[750]	train-rmse:0.098636	eval-rmse:0.137487
[751]	train-rmse:0.098518	eval-rmse:0.137452
[752]	train-rmse:0.098484	eval-rmse:0.137082
[753]	train-rmse:0.098446	eval-rmse:0.137135
[754]	train-rmse:0.098416	eval-rmse:0.13714
[755]	train-rmse:0.098411	eval-rmse:0.137089
[756]	train-rmse:0.098362	eval-rmse:0.137055
[757]	train-rmse:0.098316	eval-rmse:0.136908
[758]	train-rmse:0.098298	eval-rmse:0.136902
[759]	train-rmse:0.098273	eval-rmse:0.136971
[760]	train-rmse:0.09826	eval-rmse:0.136946
[761]	train-rmse:0.098256	eval-rmse:0.13691
[762]	train-rmse:0.098165	eval-rmse:0.136918
[763]	train-rmse:0.09815	eval-rmse:0.136852
[764]	train-rmse:0.098099	eval-rmse:0.136885
[765]	train-rmse:0.098057	eval-rmse:0.136791
[766]	train-rmse:0.098022	eval-rmse:0.136764
[767]	train-rmse:0.097925	eval-rmse:0.136697
[768]	train-rmse:0.097852	eval-rmse:0.136651
[769]	train-rmse:0.097788	eval-rmse:0.13664
[770]	train-rmse:0.097767	eval-rmse:0.136559
[771]	train-rmse:0.097726	eval-rmse:0.136597
[772]	train-rmse:0.097701	eval-rmse:0.136564
[773]	train-rmse:0.097602	eval-rmse:0.136545
[774]	train-rmse:0.097549	eval-rmse:0.136535
[775]	train-rmse:0.097517	eval-rmse:0.136598
[776]	train-rmse:0.0975	eval-rmse:0.136529
[777]	train-rmse:0.097417	eval-rmse:0.136595
[778]	train-rmse:0.097383	eval-rmse:0.136561
[779]	train-rmse:0.097337	eval-rmse:0.136595
[780]	train-rmse:0.097328	eval-rmse:0.136553
[781]	train-rmse:0.097241	eval-rmse:0.136579
[782]	train-rmse:0.097215	eval-rmse:0.136606
[783]	train-rmse:0.097175	eval-rmse:0.136595
[784]	train-rmse:0.097151	eval-rmse:0.136576
[785]	train-rmse:0.097105	eval-rmse:0.136492
[786]	train-rmse:0.096997	eval-rmse:0.136474
[787]	train-rmse:0.096983	eval-rmse:0.136364
[788]	train-rmse:0.096969	eval-rmse:0.136343
[789]	train-rmse:0.096907	eval-rmse:0.13636
[790]	train-rmse:0.096817	eval-rmse:0.136332
[791]	train-rmse:0.096742	eval-rmse:0.136275
[792]	train-rmse:0.096725	eval-rmse:0.136376
[793]	train-rmse:0.096636	eval-rmse:0.136403
[794]	train-rmse:0.096567	eval-rmse:0.136338
[795]	train-rmse:0.096524	eval-rmse:0.136387
[796]	train-rmse:0.096518	eval-rmse:0.1363
[797]	train-rmse:0.096451	eval-rmse:0.1363
[798]	train-rmse:0.096432	eval-rmse:0.136268
[799]	train-rmse:0.096403	eval-rmse:0.136258
[800]	train-rmse:0.096364	eval-rmse:0.136208
[801]	train-rmse:0.096314	eval-rmse:0.136191
[802]	train-rmse:0.096269	eval-rmse:0.1361
[803]	train-rmse:0.0962	eval-rmse:0.136212
[804]	train-rmse:0.096155	eval-rmse:0.136119
[805]	train-rmse:0.096105	eval-rmse:0.136056
[806]	train-rmse:0.096087	eval-rmse:0.136089
[807]	train-rmse:0.096082	eval-rmse:0.136039
[808]	train-rmse:0.09604	eval-rmse:0.136002
[809]	train-rmse:0.095965	eval-rmse:0.135967
[810]	train-rmse:0.095928	eval-rmse:0.136025
[811]	train-rmse:0.095915	eval-rmse:0.135979
[812]	train-rmse:0.095846	eval-rmse:0.135921
[813]	train-rmse:0.095811	eval-rmse:0.136085
[814]	train-rmse:0.095767	eval-rmse:0.135974
[815]	train-rmse:0.095766	eval-rmse:0.136042
[816]	train-rmse:0.09574	eval-rmse:0.136094
[817]	train-rmse:0.095701	eval-rmse:0.136054
[818]	train-rmse:0.095656	eval-rmse:0.135958
[819]	train-rmse:0.095617	eval-rmse:0.136001
[820]	train-rmse:0.095589	eval-rmse:0.135965
[821]	train-rmse:0.095576	eval-rmse:0.135976
[822]	train-rmse:0.09554	eval-rmse:0.13598
[823]	train-rmse:0.095509	eval-rmse:0.135917
[824]	train-rmse:0.095486	eval-rmse:0.135792
[825]	train-rmse:0.095483	eval-rmse:0.13597
[826]	train-rmse:0.095418	eval-rmse:0.135861
[827]	train-rmse:0.095395	eval-rmse:0.135832
[828]	train-rmse:0.095323	eval-rmse:0.135713
[829]	train-rmse:0.0953	eval-rmse:0.13557
[830]	train-rmse:0.095259	eval-rmse:0.135697
[831]	train-rmse:0.09527	eval-rmse:0.135825
[832]	train-rmse:0.095251	eval-rmse:0.135776
[833]	train-rmse:0.095254	eval-rmse:0.135761
[834]	train-rmse:0.095233	eval-rmse:0.135711
[835]	train-rmse:0.095201	eval-rmse:0.135648
[836]	train-rmse:0.095172	eval-rmse:0.135652
[837]	train-rmse:0.095131	eval-rmse:0.13564
[838]	train-rmse:0.095094	eval-rmse:0.135574
[839]	train-rmse:0.095048	eval-rmse:0.135535
[840]	train-rmse:0.09506	eval-rmse:0.135509
[841]	train-rmse:0.095007	eval-rmse:0.13542
[842]	train-rmse:0.094936	eval-rmse:0.135439
[843]	train-rmse:0.09487	eval-rmse:0.135374
[844]	train-rmse:0.094847	eval-rmse:0.13539
[845]	train-rmse:0.094822	eval-rmse:0.135353
[846]	train-rmse:0.094788	eval-rmse:0.135354
[847]	train-rmse:0.094777	eval-rmse:0.135289
[848]	train-rmse:0.094724	eval-rmse:0.135287
[849]	train-rmse:0.094632	eval-rmse:0.135185
[850]	train-rmse:0.094581	eval-rmse:0.135103
[851]	train-rmse:0.094537	eval-rmse:0.135069
[852]	train-rmse:0.094506	eval-rmse:0.135109
[853]	train-rmse:0.094487	eval-rmse:0.135107
[854]	train-rmse:0.094436	eval-rmse:0.1351
[855]	train-rmse:0.094372	eval-rmse:0.135061
[856]	train-rmse:0.094345	eval-rmse:0.135149
[857]	train-rmse:0.094266	eval-rmse:0.135183
[858]	train-rmse:0.094234	eval-rmse:0.135009
[859]	train-rmse:0.094224	eval-rmse:0.135063
[860]	train-rmse:0.09417	eval-rmse:0.135074
[861]	train-rmse:0.094161	eval-rmse:0.1351
[862]	train-rmse:0.094127	eval-rmse:0.135076
[863]	train-rmse:0.094104	eval-rmse:0.134969
[864]	train-rmse:0.094076	eval-rmse:0.134936
[865]	train-rmse:0.094058	eval-rmse:0.134769
[866]	train-rmse:0.094032	eval-rmse:0.13483
[867]	train-rmse:0.094019	eval-rmse:0.134902
[868]	train-rmse:0.09399	eval-rmse:0.134871
[869]	train-rmse:0.093917	eval-rmse:0.134836
[870]	train-rmse:0.093841	eval-rmse:0.13479
[871]	train-rmse:0.09377	eval-rmse:0.134734
[872]	train-rmse:0.093719	eval-rmse:0.134712
[873]	train-rmse:0.093654	eval-rmse:0.134749
[874]	train-rmse:0.093615	eval-rmse:0.134711
[875]	train-rmse:0.093557	eval-rmse:0.134718
[876]	train-rmse:0.093513	eval-rmse:0.134696
[877]	train-rmse:0.093517	eval-rmse:0.134644
[878]	train-rmse:0.093463	eval-rmse:0.134619
[879]	train-rmse:0.093398	eval-rmse:0.134533
[880]	train-rmse:0.093345	eval-rmse:0.134621
[881]	train-rmse:0.093338	eval-rmse:0.134648
[882]	train-rmse:0.093349	eval-rmse:0.134602
[883]	train-rmse:0.093311	eval-rmse:0.134533
[884]	train-rmse:0.093236	eval-rmse:0.134513
[885]	train-rmse:0.093183	eval-rmse:0.134473
[886]	train-rmse:0.09318	eval-rmse:0.134479
[887]	train-rmse:0.093146	eval-rmse:0.134403
[888]	train-rmse:0.09313	eval-rmse:0.134353
[889]	train-rmse:0.093107	eval-rmse:0.134326
[890]	train-rmse:0.093041	eval-rmse:0.13432
[891]	train-rmse:0.093025	eval-rmse:0.134346
[892]	train-rmse:0.092915	eval-rmse:0.134361
[893]	train-rmse:0.09291	eval-rmse:0.134306
[894]	train-rmse:0.092906	eval-rmse:0.134307
[895]	train-rmse:0.092912	eval-rmse:0.134255
[896]	train-rmse:0.092848	eval-rmse:0.134215
[897]	train-rmse:0.092786	eval-rmse:0.134159
[898]	train-rmse:0.092732	eval-rmse:0.134203
[899]	train-rmse:0.092715	eval-rmse:0.133997
[900]	train-rmse:0.092673	eval-rmse:0.133979
[901]	train-rmse:0.092648	eval-rmse:0.134025
[902]	train-rmse:0.092597	eval-rmse:0.134026
[903]	train-rmse:0.092604	eval-rmse:0.134019
[904]	train-rmse:0.09256	eval-rmse:0.133985
[905]	train-rmse:0.092502	eval-rmse:0.133957
[906]	train-rmse:0.092496	eval-rmse:0.133982
[907]	train-rmse:0.092447	eval-rmse:0.133938
[908]	train-rmse:0.092397	eval-rmse:0.133837
[909]	train-rmse:0.092393	eval-rmse:0.134019
[910]	train-rmse:0.092362	eval-rmse:0.134083
[911]	train-rmse:0.092316	eval-rmse:0.134073
[912]	train-rmse:0.092304	eval-rmse:0.134022
[913]	train-rmse:0.09231	eval-rmse:0.133987
[914]	train-rmse:0.092296	eval-rmse:0.133995
[915]	train-rmse:0.092285	eval-rmse:0.133948
[916]	train-rmse:0.092293	eval-rmse:0.133954
[917]	train-rmse:0.092266	eval-rmse:0.13393
[918]	train-rmse:0.092266	eval-rmse:0.133793
[919]	train-rmse:0.09223	eval-rmse:0.13378
[920]	train-rmse:0.092158	eval-rmse:0.133724
[921]	train-rmse:0.092126	eval-rmse:0.133692
[922]	train-rmse:0.092091	eval-rmse:0.133731
[923]	train-rmse:0.092062	eval-rmse:0.133759
[924]	train-rmse:0.09205	eval-rmse:0.133729
[925]	train-rmse:0.09201	eval-rmse:0.133655
[926]	train-rmse:0.091933	eval-rmse:0.134092
[927]	train-rmse:0.091916	eval-rmse:0.134102
[928]	train-rmse:0.091855	eval-rmse:0.134116
[929]	train-rmse:0.091841	eval-rmse:0.134129
[930]	train-rmse:0.091864	eval-rmse:0.134121
[931]	train-rmse:0.091828	eval-rmse:0.134086
[932]	train-rmse:0.09182	eval-rmse:0.134023
[933]	train-rmse:0.091761	eval-rmse:0.134145
[934]	train-rmse:0.091675	eval-rmse:0.134195
[935]	train-rmse:0.091597	eval-rmse:0.134165
[936]	train-rmse:0.091546	eval-rmse:0.134134
[937]	train-rmse:0.09152	eval-rmse:0.134083
[938]	train-rmse:0.091472	eval-rmse:0.134054
[939]	train-rmse:0.091415	eval-rmse:0.134067
[940]	train-rmse:0.091421	eval-rmse:0.133911
[941]	train-rmse:0.091361	eval-rmse:0.133942
[942]	train-rmse:0.091337	eval-rmse:0.133884
[943]	train-rmse:0.0913	eval-rmse:0.133951
[944]	train-rmse:0.091273	eval-rmse:0.133934
[945]	train-rmse:0.091265	eval-rmse:0.133824
[946]	train-rmse:0.091236	eval-rmse:0.133816
[947]	train-rmse:0.091171	eval-rmse:0.133836
[948]	train-rmse:0.091144	eval-rmse:0.134054
[949]	train-rmse:0.091082	eval-rmse:0.13401
[950]	train-rmse:0.091027	eval-rmse:0.133977
[951]	train-rmse:0.090986	eval-rmse:0.134029
[952]	train-rmse:0.090951	eval-rmse:0.13402
[953]	train-rmse:0.090914	eval-rmse:0.134031
[954]	train-rmse:0.090879	eval-rmse:0.134017
[955]	train-rmse:0.090839	eval-rmse:0.133978
[956]	train-rmse:0.090821	eval-rmse:0.133976
[957]	train-rmse:0.090779	eval-rmse:0.134107
[958]	train-rmse:0.090777	eval-rmse:0.134045
[959]	train-rmse:0.090765	eval-rmse:0.134028
[960]	train-rmse:0.090713	eval-rmse:0.134063
[961]	train-rmse:0.090692	eval-rmse:0.134127
[962]	train-rmse:0.090589	eval-rmse:0.134433
[963]	train-rmse:0.090581	eval-rmse:0.134354
[964]	train-rmse:0.090567	eval-rmse:0.134256
[965]	train-rmse:0.090565	eval-rmse:0.134323
[966]	train-rmse:0.090565	eval-rmse:0.134318
[967]	train-rmse:0.090536	eval-rmse:0.134438
[968]	train-rmse:0.090517	eval-rmse:0.134314
[969]	train-rmse:0.090491	eval-rmse:0.134259
[970]	train-rmse:0.090439	eval-rmse:0.134407
[971]	train-rmse:0.09042	eval-rmse:0.134423
[972]	train-rmse:0.090343	eval-rmse:0.13462
[973]	train-rmse:0.090285	eval-rmse:0.134816
[974]	train-rmse:0.090246	eval-rmse:0.134892
[975]	train-rmse:0.090211	eval-rmse:0.134909
Stopping. Best iteration:
[925]	train-rmse:0.09201	eval-rmse:0.133655

Parse progress: |█████████████████████████████████████████████████████████| 100%
SalePrice predict
11.8494 12.062
12.2061 12.306
11.6784 11.6806
11.914 11.7686
12.6758 12.487
12.861 12.5802
12.1035 11.9194
11.2898 11.4222
11.7714 11.6392
11.5843 11.6461
Parse progress: |█████████████████████████████████████████████████████████| 100%

Shutdown H2O


In [122]:
# Shutdown H2O - this will erase all your unsaved frames and models in H2O
h2o.cluster().shutdown(prompt=True)


Are you sure you want to shutdown the H2O instance running at http://localhost:54321 (Y/N)? y
H2O session _sid_942e closed.