In [1]:
library(dplyr)


Attaching package: ‘dplyr’

The following objects are masked from ‘package:stats’:

    filter, lag

The following objects are masked from ‘package:base’:

    intersect, setdiff, setequal, union


In [2]:
quality_prediction_and_page_views <- read.table("../results/sql_queries/entity_views_and_aggregated_revisions/entity_views_and_aggregated_revisions_and_quality_scoring_prediction_converted_20150701.tsv", header=FALSE, sep="\t")

In [3]:
colnames(quality_prediction_and_page_views) <- c('entity_id','number_of_revisions', 'page_views', 'prediction', 'ordinal_score')

In [4]:
head(quality_prediction_and_page_views)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q1000999 33 736 D 2
Q1001536411 1 E 1
Q10018576 9 21 E 1
Q1002034824 11 E 1
Q1002083211 12 E 1
Q1002822013 6 E 1

In [5]:
cor(quality_prediction_and_page_views$page_views,quality_prediction_and_page_views$ordinal_score, method="spearman")


0.125866968879605

In [6]:
quality_prediction_and_page_views_model <- lm(quality_prediction_and_page_views$page_views ~ quality_prediction_and_page_views$ordinal_score)

In [7]:
summary(quality_prediction_and_page_views_model)


Call:
lm(formula = quality_prediction_and_page_views$page_views ~ quality_prediction_and_page_views$ordinal_score)

Residuals:
       Min         1Q     Median         3Q        Max 
-2.346e+05 -6.026e+04 -9.840e+02 -5.440e+02  1.253e+10 

Coefficients:
                                                Estimate Std. Error t value
(Intercept)                                       -58602       3429  -17.09
quality_prediction_and_page_views$ordinal_score    59621       2061   28.93
                                                Pr(>|t|)    
(Intercept)                                       <2e-16 ***
quality_prediction_and_page_views$ordinal_score   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 6279000 on 17178162 degrees of freedom
Multiple R-squared:  4.873e-05,	Adjusted R-squared:  4.867e-05 
F-statistic: 837.1 on 1 and 17178162 DF,  p-value: < 2.2e-16

Class A Items with Least Pages Views


In [8]:
class_a_quality_prediction_and_page_views <- filter(quality_prediction_and_page_views, prediction=="A")

In [9]:
sorted_ascend_class_a_quality_prediction_and_page_views <- dplyr::arrange(class_a_quality_prediction_and_page_views, page_views)

In [10]:
head(sorted_ascend_class_a_quality_prediction_and_page_views, n=10)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q50039 324 4934 A 5
Q3577919 265 6444 A 5
Q3152321 687 77136 A 5
Q51861 163 113735 A 5
Q104192 490 141510 A 5
Q273461 1176 241736 A 5
Q4605 347 683931 A 5
Q156907 250 699568 A 5
Q45909 727 796460 A 5
Q434 381 888587 A 5

Class E Items with Most Pages Views


In [ ]:


In [11]:
class_e_quality_prediction_and_page_views <- filter(quality_prediction_and_page_views, prediction=="E")

In [12]:
sorted_desc_class_e_quality_prediction_and_page_views <- dplyr::arrange(class_e_quality_prediction_and_page_views, desc(page_views))

In [13]:
head(sorted_desc_class_e_quality_prediction_and_page_views, n=10)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q1868372 45 2056080224E 1
Q1002972 30 2045659200E 1
Q372827 36 2045652543E 1
Q4299858 22 2045645431E 1
Q6883832 25 2045602031E 1
Q4043051 32 2045595548E 1
Q4442644 9 2045584646E 1
Q4101720 22 2045577388E 1
Q4299813 13 2045575479E 1
Q4380129 15 2045574094E 1

In [14]:
nrow(class_e_quality_prediction_and_page_views)


11140301

In [15]:
nrow(filter(quality_prediction_and_page_views, prediction=="D"))


3677094

In [16]:
nrow(filter(quality_prediction_and_page_views, prediction=="C"))


2293871

In [17]:
nrow(filter(quality_prediction_and_page_views, prediction=="B"))


66715

In [18]:
nrow(filter(quality_prediction_and_page_views, prediction=="A"))


183

In [ ]: