Stats Quality for 2016 D-I College Nationals

As one of the biggest tournaments hosted by USAU, the D-I College Nationals is one of the few tournaments where player statistics are relatively reliably tracked. For each tournament game, each player's aggregate scores, assists, Ds, and turns are counted, although its quite possible the definition of a "D" or a "Turn" could differ across stat-keepers.

Data below was scraped from the USAU website. First we'll set up some imports to be able to load this data.


In [1]:
import usau.reports
import usau.fantasy

In [2]:
from IPython.display import display, HTML
import pandas as pd
pd.options.display.width = 200
pd.options.display.max_colwidth = 200
pd.options.display.max_columns = 200

In [3]:
def display_url_column(df):
  """Helper for formatting url links"""
  df.url = df.url.apply(lambda url: "<a href='{base}{url}'>Match Report Link</a>"
                        .format(base=usau.reports.USAUResults.BASE_URL, url=url))
  display(HTML(df.to_html(escape=False)))

Since we should already have the data downloaded as csv files in this repository, we will not need to re-scrape the data. Omit this cell to directly download from the USAU website (may be slow).


In [4]:
# Read data from csv files
usau.reports.d1_college_nats_men_2016.load_from_csvs()
usau.reports.d1_college_nats_women_2016.load_from_csvs()


Out[4]:
<usau.reports.USAUResults at 0x3ddfb10>

Let's take a look at the games for which the sum of the player goals/assists is less than the final score of the game:


In [5]:
display_url_column(pd.concat([usau.reports.d1_college_nats_men_2016.missing_tallies,
                              usau.reports.d1_college_nats_women_2016.missing_tallies])
                   [["Score", "Gs", "As", "Ds", "Ts", "Team", "Opponent", "url"]])


Score Gs As Ds Ts Team Opponent url
0 11 9 10 5 13 Massachusetts Georgia Match Report Link
14 14 14 12 6 8 Massachusetts Washington Match Report Link
17 15 15 14 11 10 Texas A&M Georgia Match Report Link
18 15 14 13 5 2 Washington Cal Poly-SLO Match Report Link
22 16 15 15 9 10 North Carolina Florida State Match Report Link
23 14 13 14 5 12 Florida State North Carolina Match Report Link
33 15 14 15 8 5 Case Western Reserve North Carolina Match Report Link
34 15 14 15 2 5 Florida State Case Western Reserve Match Report Link
37 15 14 15 6 11 Colorado North Carolina Match Report Link
38 15 14 15 4 6 Oregon Florida State Match Report Link
40 15 14 15 6 12 Wisconsin Michigan Match Report Link
53 15 14 14 7 4 Harvard North Carolina-Wilmington Match Report Link
56 14 14 13 12 23 North Carolina-Wilmington Michigan Match Report Link
62 15 12 15 8 12 Carleton College Utah Match Report Link
66 16 15 15 10 12 Carleton College Auburn Match Report Link
78 15 14 15 4 8 Pittsburgh Carleton College Match Report Link
84 13 12 13 8 14 Pittsburgh Minnesota Match Report Link
106 15 12 15 2 6 Carleton College Cal Poly-SLO Match Report Link
108 13 10 11 17 19 North Carolina-Wilmington Florida State Match Report Link
109 6 4 3 11 27 Florida State North Carolina-Wilmington Match Report Link
21 14 12 12 10 27 Dartmouth British Columbia Match Report Link
23 15 15 14 11 27 Chaos (Independent) UCLA Match Report Link
26 15 15 13 5 10 Pittsburgh Chaos (Independent) Match Report Link
31 9 9 8 5 20 Pittsburgh British Columbia Match Report Link
38 15 15 14 8 12 British Columbia Chaos (Independent) Match Report Link
41 7 7 6 7 18 Ohio State Washington Match Report Link
44 14 14 13 9 19 Stanford Washington Match Report Link
59 15 14 14 8 12 Michigan Washington Match Report Link
76 11 10 10 7 15 Central Florida Wisconsin Match Report Link
77 12 12 11 9 11 Wisconsin Central Florida Match Report Link
95 11 11 10 4 9 Washington Dartmouth Match Report Link
99 15 15 14 6 17 Colorado Texas Match Report Link
102 15 0 0 0 0 California Ottawa Match Report Link
103 8 0 0 0 0 Ottawa California Match Report Link
105 10 0 0 0 0 Ohio State Chaos (Independent) Match Report Link
107 13 13 12 11 19 Colorado College Central Florida Match Report Link
108 13 0 0 0 0 Southern California Pittsburgh Match Report Link
109 14 0 0 0 0 Pittsburgh Southern California Match Report Link

All in all, not too bad! A few of the women's consolation games are missing player statistics, and there are several other games for which a couple of goals or assists were missed. For missing assists, it is technically possible that there were one or more callahans scored in those game, but obviously that's not the case with all ~14 missing assists. Surprisingly, there were 10 more assists recorded by the statkeepers than goals; I would have guessed that assists would be harder to keep track.

Turns and Ds are the other stats available. In past tournaments these haven't been tracked very well, but actually there was only one game where no Turns or Ds were recorded:


In [6]:
men_matches = usau.reports.d1_college_nats_men_2016.match_results
women_matches = usau.reports.d1_college_nats_women_2016.match_results
display_url_column(pd.concat([men_matches[(men_matches.Ts == 0) & (men_matches.Gs > 0)],
                              women_matches[(women_matches.Ts == 0) & (women_matches.Gs > 0)]])
                   [["Score", "Gs", "As", "Ds", "Ts", "Team", "Opponent", "url"]])


Score Gs As Ds Ts Team Opponent url
48 15 15 15 9 0 Stanford Southern California Match Report Link
49 4 4 4 4 0 Southern California Stanford Match Report Link

This implies that there was a pretty good effort made to keep up with counting turns and Ds. By contrast, see how many teams did not keep track of Ds and turns last year (2015)!


In [7]:
# Read last year's data from csv files
usau.reports.d1_college_nats_men_2015.load_from_csvs()
usau.reports.d1_college_nats_women_2015.load_from_csvs()
display_url_column(pd.concat([usau.reports.d1_college_nats_men_2015.missing_tallies,
                              usau.reports.d1_college_nats_women_2015.missing_tallies])
                   [["Score", "Gs", "As", "Ds", "Ts", "Team", "Opponent", "url"]])


Score Gs As Ds Ts Team Opponent url
4 10 9 9 0 0 Georgia Texas Match Report Link
7 9 5 9 0 0 Auburn Wisconsin Match Report Link
8 15 14 13 0 0 Pittsburgh Auburn Match Report Link
9 4 3 2 0 0 Auburn Pittsburgh Match Report Link
13 12 10 12 0 0 Auburn Georgia Match Report Link
20 14 13 13 0 0 Texas A&M Cincinnati Match Report Link
22 15 14 14 0 0 Central Florida Western Washington Match Report Link
23 11 8 10 0 0 Western Washington Central Florida Match Report Link
27 11 11 8 0 0 Western Washington Minnesota Match Report Link
29 12 10 11 0 0 Cincinnati Minnesota Match Report Link
31 15 14 14 0 0 Minnesota Texas A&M Match Report Link
33 11 11 10 0 0 Cincinnati Central Florida Match Report Link
34 14 13 10 0 0 Western Washington Cincinnati Match Report Link
38 15 14 15 0 0 Texas A&M Western Washington Match Report Link
40 15 13 15 0 0 Florida State Oregon Match Report Link
43 15 15 14 0 0 Illinois Maryland Match Report Link
45 10 10 9 0 0 Florida State North Carolina Match Report Link
50 15 14 14 0 0 Oregon Illinois Match Report Link
51 7 7 6 0 0 Illinois Oregon Match Report Link
59 11 11 10 0 0 Maryland Florida State Match Report Link
60 14 14 13 0 0 Colorado California-Santa Barbara Match Report Link
72 15 14 12 0 0 California-Santa Barbara Cornell Match Report Link
87 9 7 7 0 10 Texas Oregon Match Report Link
94 11 11 10 0 0 Minnesota Oregon Match Report Link
95 14 13 14 0 0 Oregon Minnesota Match Report Link
1 10 9 10 0 0 Notre Dame Oregon Match Report Link
4 11 9 11 0 0 Notre Dame Central Florida Match Report Link
10 15 14 14 0 0 Oregon Florida State Match Report Link
15 3 1 3 0 0 Central Florida Oregon Match Report Link
23 8 6 7 0 0 Ohio State Dartmouth Match Report Link
27 12 11 12 0 0 Ohio State Washington Match Report Link
34 15 15 14 0 0 Ohio State Middlebury Match Report Link
37 13 13 12 0 0 Washington Dartmouth Match Report Link
42 15 14 15 0 0 British Columbia Texas Match Report Link
46 15 15 14 0 0 British Columbia Pittsburgh Match Report Link
47 7 6 7 0 0 Pittsburgh British Columbia Match Report Link
58 11 10 11 0 0 Carleton College British Columbia Match Report Link
59 9 8 9 0 0 British Columbia Carleton College Match Report Link
66 12 11 12 0 0 Whitman Kansas Match Report Link
67 14 13 14 0 0 Kansas Whitman Match Report Link
104 8 8 7 0 0 Middlebury UCLA Match Report Link

In [ ]: