In [3]:

    

import pandas as pd
import numpy as np
import matplotlib.pylab as plt
%matplotlib inline
DataFolder = "/media/yisi/Data/Challenge/yelp_dataset_challenge_round9/"


    

In [41]:

    

with open(DataFolder+"yelp_academic_dataset_review.json", 'rb') as f:
    data = f.readlines()
data = map(lambda x: x.rstrip(), data)
data_json_str = "[" + ','.join(data) + "]"
# now, load it into pandas
data_df = pd.read_json(data_json_str)


    

In [42]:

    

data_df.head(6)


    

    
Out[42]:






  

    

      

      
business_id
      
cool
      
date
      
funny
      
review_id
      
stars
      
text
      
type
      
useful
      
user_id
    
  
  

    

      
0
      
2aFiy99vNLklCx3T_tGS9A
      
0
      
2011-10-10
      
0
      
NxL8SIC5yqOdnlXCg18IBg
      
5
      
If you enjoy service by someone who is as comp...
      
review
      
0
      
KpkOkG6RIf4Ra25Lhhxf1A
    
    

      
1
      
2aFiy99vNLklCx3T_tGS9A
      
0
      
2010-12-29
      
0
      
pXbbIgOXvLuTi_SPs1hQEQ
      
5
      
After being on the phone with Verizon Wireless...
      
review
      
1
      
bQ7fQq1otn9hKX-gXRsrgA
    
    

      
2
      
2aFiy99vNLklCx3T_tGS9A
      
0
      
2011-04-29
      
0
      
wslW2Lu4NYylb1jEapAGsw
      
5
      
Great service! Corey is very service oriented....
      
review
      
0
      
r1NUhdNmL6yU9Bn-Yx6FTw
    
    

      
3
      
2LfIuF3_sX6uwe-IR-P0jQ
      
1
      
2014-07-14
      
0
      
GP6YEearUWrzPtQYSF1vVg
      
5
      
Highly recommended. Went in yesterday looking ...
      
review
      
0
      
aW3ix1KNZAvoM8q-WghA3Q
    
    

      
4
      
2LfIuF3_sX6uwe-IR-P0jQ
      
0
      
2014-01-15
      
0
      
25RlYGq2s5qShi-pn3ufVA
      
4
      
I walked in here looking for a specific piece ...
      
review
      
0
      
YOo-Cip8HqvKp_p9nEGphw
    
    

      
5
      
2LfIuF3_sX6uwe-IR-P0jQ
      
1
      
2013-04-28
      
0
      
Uf1Ki1yyH_JDKhLvn2e4FQ
      
5
      
What a great place! Modern on Melrose has amaz...
      
review
      
2
      
bgl3j8yJcRO-00NkUYsXGQ
    
  

In [43]:

    

data_df.dtypes


    

    
Out[43]:





business_id            object
cool                    int64
date           datetime64[ns]
funny                   int64
review_id              object
stars                   int64
text                   object
type                   object
useful                  int64
user_id                object
dtype: object

In [44]:

    

data_df.loc[0,'text']


    

    
Out[44]:





u"If you enjoy service by someone who is as competent as he is personable, I would recommend Corey Kaplan highly. The time he has spent here has been very productive and working with him educational and enjoyable. I hope not to need him again (though this is highly unlikely) but knowing he is there if I do is very nice. By the way, I'm not from El Centro, CA. but Scottsdale, AZ."

In [23]:

    




    

    
Out[23]:





1

In [ ]: