In [1]:
library(dplyr)


Attaching package: ‘dplyr’

The following objects are masked from ‘package:stats’:

    filter, lag

The following objects are masked from ‘package:base’:

    intersect, setdiff, setequal, union


In [2]:
quality_prediction_and_page_views <- read.table("../results/sql_queries/entity_views_and_aggregated_revisions/entity_views_and_aggregated_revisions_and_quality_scoring_prediction_converted_20160701.tsv", header=FALSE, sep="\t")

In [3]:
colnames(quality_prediction_and_page_views) <- c('entity_id','number_of_revisions', 'page_views', 'prediction', 'ordinal_score')

In [4]:
head(quality_prediction_and_page_views)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q1000999 33 736 C 3
Q1001536411 1 E 1
Q10018576 9 21 E 1
Q1002034824 11 E 1
Q1002083211 12 E 1
Q1002822013 6 E 1

In [5]:
cor(quality_prediction_and_page_views$page_views,quality_prediction_and_page_views$ordinal_score, method="spearman")


0.119037594571619

In [6]:
quality_prediction_and_page_views_model <- lm(quality_prediction_and_page_views$page_views ~ quality_prediction_and_page_views$ordinal_score)

In [7]:
summary(quality_prediction_and_page_views_model)


Call:
lm(formula = quality_prediction_and_page_views$page_views ~ quality_prediction_and_page_views$ordinal_score)

Residuals:
       Min         1Q     Median         3Q        Max 
-1.379e+05 -3.778e+04 -2.773e+03 -2.523e+03  1.253e+10 

Coefficients:
                                                Estimate Std. Error t value
(Intercept)                                       -32224       2824  -11.41
quality_prediction_and_page_views$ordinal_score    35003       1475   23.73
                                                Pr(>|t|)    
(Intercept)                                       <2e-16 ***
quality_prediction_and_page_views$ordinal_score   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 5879000 on 19974309 degrees of freedom
Multiple R-squared:  2.819e-05,	Adjusted R-squared:  2.814e-05 
F-statistic: 563.1 on 1 and 19974309 DF,  p-value: < 2.2e-16

Class A Items with Least Pages Views


In [8]:
class_a_quality_prediction_and_page_views <- filter(quality_prediction_and_page_views, prediction=="A")

In [9]:
sorted_ascend_class_a_quality_prediction_and_page_views <- dplyr::arrange(class_a_quality_prediction_and_page_views, page_views)

In [10]:
head(sorted_ascend_class_a_quality_prediction_and_page_views, n=10)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q50039 324 4934 A 5
Q3577919265 6444 A 5
Q103572 152 10742 A 5
Q442048 393 22306 A 5
Q365982 136 34456 A 5
Q60954 183 42687 A 5
Q61761 185 54542 A 5
Q1868 159 55127 A 5
Q3152321687 77136 A 5
Q512062 194 85526 A 5

Class E Items with Most Pages Views


In [ ]:


In [11]:
class_e_quality_prediction_and_page_views <- filter(quality_prediction_and_page_views, prediction=="E")

In [12]:
sorted_desc_class_e_quality_prediction_and_page_views <- dplyr::arrange(class_e_quality_prediction_and_page_views, desc(page_views))

In [13]:
head(sorted_desc_class_e_quality_prediction_and_page_views, n=10)


entity_idnumber_of_revisionspage_viewspredictionordinal_score
Q6883832 25 2045602031E 1
Q4043051 32 2045595548E 1
Q4442644 9 2045584646E 1
Q4101720 22 2045577388E 1
Q4299813 13 2045575479E 1
Q4380129 15 2045574094E 1
Q18241050 6 2045553487E 1
Q19902884 32 1141733962E 1
Q22302160 16 1139176637E 1
Q21281405 35 1137553627E 1

In [14]:
nrow(class_e_quality_prediction_and_page_views)


11594372

In [15]:
nrow(filter(quality_prediction_and_page_views, prediction=="D"))


3233999

In [16]:
nrow(filter(quality_prediction_and_page_views, prediction=="C"))


4809677

In [17]:
nrow(filter(quality_prediction_and_page_views, prediction=="B"))


335630

In [18]:
nrow(filter(quality_prediction_and_page_views, prediction=="A"))


633

In [ ]: