This notebook contains the extended results on word embeddings evaluation.
In [1]:
from __future__ import print_function
import pandas as pd
pd.options.display.max_rows = 999
pd.set_option('display.width', 1000)
import glob
header = ["evaluation_type", "dataset", "kwargs", "evaluation", "value", "num_skipped"]
similarity_dfs = []
similarity_names = []
similarity_glob = './results/similarity*'
for similarity_file in glob.glob(similarity_glob):
df = pd.read_table(similarity_file, header=None, names=header).set_index(["dataset", "kwargs"]).drop(["evaluation_type"], axis=1)
similarity_dfs.append(df)
similarity_names.append(similarity_file[len(similarity_glob):])
analogy_dfs = []
analogy_names = []
analogy_glob = './results/analogy*'
for analogy_file in glob.glob(analogy_glob):
df = pd.read_table(analogy_file, header=None, names=header).set_index(["dataset", "kwargs", "evaluation"]).drop(["evaluation_type"], axis=1)
analogy_dfs.append(df)
analogy_names.append(analogy_file[len(analogy_glob):])
similarity_df = pd.concat(similarity_dfs, keys=similarity_names, names=['embedding']).reorder_levels(["dataset", "kwargs", "embedding"]).sort_index()
analogy_df = pd.concat(analogy_dfs, keys=analogy_names, names=['embedding']).reorder_levels(["dataset", "evaluation", "kwargs", "embedding"]).sort_index()
We can see that the performance varies between the different embeddings on the different datasests.
Please see the API page for more information about the respective datasets.
In [2]:
for (dataset, kwargs), df in similarity_df.groupby(level=[0,1]):
print('Performance on', dataset, kwargs)
print(df.loc[dataset, kwargs].sort_values(by='value', ascending=False))
print()
print()
Performance on BakerVerb143 {}
evaluation value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.462748 0
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.447303 0
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.424932 0
fasttext-wiki.en.tsv cosinesimilarity 0.397307 0
fasttext-wiki.simple.tsv cosinesimilarity 0.343885 0
glove-glove.840B.300d.tsv cosinesimilarity 0.341463 0
glove-glove.42B.300d.tsv cosinesimilarity 0.327522 0
glove-glove.6B.300d.tsv cosinesimilarity 0.305143 0
glove-glove.6B.100d.tsv cosinesimilarity 0.302301 0
glove-glove.6B.200d.tsv cosinesimilarity 0.284473 0
glove-glove.6B.50d.tsv cosinesimilarity 0.250317 0
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.199709 0
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.184107 0
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.162098 0
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.155813 0
Performance on MEN {"segment": "dev"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.835428 0
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.807324 0
glove-glove.840B.300d.tsv cosinesimilarity 0.803037 0
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.791102 0
fasttext-wiki.en.tsv cosinesimilarity 0.761820 0
glove-glove.6B.300d.tsv cosinesimilarity 0.735006 0
glove-glove.42B.300d.tsv cosinesimilarity 0.733718 0
fasttext-wiki.simple.tsv cosinesimilarity 0.732653 4
glove-glove.6B.200d.tsv cosinesimilarity 0.706532 0
glove-glove.6B.100d.tsv cosinesimilarity 0.675664 0
glove-glove.6B.50d.tsv cosinesimilarity 0.643978 0
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.592014 13
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.573983 13
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.526833 13
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.440814 13
Performance on MEN {"segment": "full"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.836545 0
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.807004 0
glove-glove.840B.300d.tsv cosinesimilarity 0.801746 1
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.790632 0
fasttext-wiki.en.tsv cosinesimilarity 0.763676 0
glove-glove.6B.300d.tsv cosinesimilarity 0.737465 0
glove-glove.42B.300d.tsv cosinesimilarity 0.736211 0
fasttext-wiki.simple.tsv cosinesimilarity 0.731434 11
glove-glove.6B.200d.tsv cosinesimilarity 0.710064 0
glove-glove.6B.100d.tsv cosinesimilarity 0.680915 0
glove-glove.6B.50d.tsv cosinesimilarity 0.652263 0
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.595824 26
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.578204 26
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.531366 26
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.444020 26
Performance on MEN {"segment": "test"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.838559 0
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.805961 0
glove-glove.840B.300d.tsv cosinesimilarity 0.798470 1
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.789258 0
fasttext-wiki.en.tsv cosinesimilarity 0.766665 0
glove-glove.6B.300d.tsv cosinesimilarity 0.741998 0
glove-glove.42B.300d.tsv cosinesimilarity 0.740192 0
fasttext-wiki.simple.tsv cosinesimilarity 0.728636 7
glove-glove.6B.200d.tsv cosinesimilarity 0.717116 0
glove-glove.6B.100d.tsv cosinesimilarity 0.689322 0
glove-glove.6B.50d.tsv cosinesimilarity 0.669201 0
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.604638 13
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.587478 13
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.541197 13
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.449700 13
Performance on RadinskyMTurk {}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.727407 8
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.727033 18
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.707876 18
glove-glove.840B.300d.tsv cosinesimilarity 0.698341 6
fasttext-wiki.en.tsv cosinesimilarity 0.677348 1
glove-glove.42B.300d.tsv cosinesimilarity 0.647509 1
fasttext-wiki.simple.tsv cosinesimilarity 0.635360 2
glove-glove.6B.300d.tsv cosinesimilarity 0.633182 0
glove-glove.6B.200d.tsv cosinesimilarity 0.619915 0
glove-glove.6B.100d.tsv cosinesimilarity 0.619340 0
glove-glove.6B.50d.tsv cosinesimilarity 0.618783 0
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.585536 7
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.585303 7
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.536788 7
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.503456 7
Performance on RareWords {}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.621473 384
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.566278 352
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.547121 352
glove-glove.840B.300d.tsv cosinesimilarity 0.529419 583
fasttext-wiki.en.tsv cosinesimilarity 0.505934 494
fasttext-wiki.simple.tsv cosinesimilarity 0.495712 1209
glove-glove.42B.300d.tsv cosinesimilarity 0.429075 414
glove-glove.6B.300d.tsv cosinesimilarity 0.427523 381
glove-glove.6B.200d.tsv cosinesimilarity 0.406371 381
glove-glove.6B.100d.tsv cosinesimilarity 0.383019 381
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.367653 1524
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.357478 1524
glove-glove.6B.50d.tsv cosinesimilarity 0.352907 381
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.318538 1524
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.287581 1524
Performance on SemEval17Task2 {"segment": "test"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.677169 8
fasttext-wiki.en.tsv cosinesimilarity 0.662066 106
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.661624 5
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.656399 5
glove-glove.840B.300d.tsv cosinesimilarity 0.641472 15
glove-glove.6B.300d.tsv cosinesimilarity 0.610428 104
fasttext-wiki.simple.tsv cosinesimilarity 0.604131 115
glove-glove.6B.200d.tsv cosinesimilarity 0.594250 104
glove-glove.42B.300d.tsv cosinesimilarity 0.589606 105
glove-glove.6B.100d.tsv cosinesimilarity 0.555057 104
glove-glove.6B.50d.tsv cosinesimilarity 0.541821 104
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.481156 146
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.458263 146
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.387955 146
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.296084 146
Performance on SemEval17Task2 {"segment": "trial"}
evaluation value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.911765 1
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.906863 1
fasttext-wiki.en.tsv cosinesimilarity 0.897059 2
glove-glove.6B.200d.tsv cosinesimilarity 0.882353 2
glove-glove.6B.300d.tsv cosinesimilarity 0.879412 2
glove-glove.840B.300d.tsv cosinesimilarity 0.862745 1
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.855392 1
glove-glove.42B.300d.tsv cosinesimilarity 0.800000 2
glove-glove.6B.100d.tsv cosinesimilarity 0.788235 2
fasttext-wiki.simple.tsv cosinesimilarity 0.785294 2
glove-glove.6B.50d.tsv cosinesimilarity 0.705882 2
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.570588 2
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.523529 2
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.500000 2
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.276471 2
Performance on SimLex999 {}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.504760 1
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.450096 1
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.442968 1
glove-glove.840B.300d.tsv cosinesimilarity 0.407029 1
fasttext-wiki.en.tsv cosinesimilarity 0.382289 1
glove-glove.42B.300d.tsv cosinesimilarity 0.372519 1
glove-glove.6B.300d.tsv cosinesimilarity 0.369212 1
glove-glove.6B.200d.tsv cosinesimilarity 0.338891 1
fasttext-wiki.simple.tsv cosinesimilarity 0.300906 5
glove-glove.6B.100d.tsv cosinesimilarity 0.296110 1
glove-glove.6B.50d.tsv cosinesimilarity 0.263060 1
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.129890 2
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.121513 2
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.097458 2
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.071693 2
Performance on SimVerb3500 {}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.425496 2
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.356136 2
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.355532 2
glove-glove.840B.300d.tsv cosinesimilarity 0.282507 2
fasttext-wiki.en.tsv cosinesimilarity 0.256091 8
glove-glove.6B.300d.tsv cosinesimilarity 0.226666 2
glove-glove.42B.300d.tsv cosinesimilarity 0.225578 2
glove-glove.6B.200d.tsv cosinesimilarity 0.197008 2
fasttext-wiki.simple.tsv cosinesimilarity 0.186790 140
glove-glove.6B.100d.tsv cosinesimilarity 0.178847 2
glove-glove.6B.50d.tsv cosinesimilarity 0.152639 2
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.057446 141
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.044443 141
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.022461 141
glove-glove.twitter.27B.25d.tsv cosinesimilarity -0.002406 141
Performance on WordSim353 {"segment": "all"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.791886 0
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.749441 0
glove-glove.840B.300d.tsv cosinesimilarity 0.747714 0
fasttext-wiki.en.tsv cosinesimilarity 0.734721 21
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.723995 0
fasttext-wiki.simple.tsv cosinesimilarity 0.709322 21
glove-glove.42B.300d.tsv cosinesimilarity 0.652168 21
glove-glove.6B.300d.tsv cosinesimilarity 0.622426 21
glove-glove.6B.200d.tsv cosinesimilarity 0.590728 21
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.564405 30
glove-glove.6B.100d.tsv cosinesimilarity 0.554089 21
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.553063 30
glove-glove.6B.50d.tsv cosinesimilarity 0.520615 21
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.503697 30
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.412785 30
Performance on WordSim353 {"segment": "relatedness"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.737069 0
glove-glove.840B.300d.tsv cosinesimilarity 0.687613 0
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.681861 0
fasttext-wiki.simple.tsv cosinesimilarity 0.674015 14
fasttext-wiki.en.tsv cosinesimilarity 0.667808 14
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.620604 0
glove-glove.42B.300d.tsv cosinesimilarity 0.599902 14
glove-glove.6B.300d.tsv cosinesimilarity 0.560717 14
glove-glove.6B.200d.tsv cosinesimilarity 0.533303 14
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.496844 19
glove-glove.6B.100d.tsv cosinesimilarity 0.490777 14
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.484258 19
glove-glove.6B.50d.tsv cosinesimilarity 0.456771 14
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.439044 19
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.342601 19
Performance on WordSim353 {"segment": "similarity"}
evaluation value num_skipped
embedding
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.839528 0
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.823462 0
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.811771 0
glove-glove.840B.300d.tsv cosinesimilarity 0.803128 0
fasttext-wiki.en.tsv cosinesimilarity 0.782224 7
fasttext-wiki.simple.tsv cosinesimilarity 0.734799 7
glove-glove.42B.300d.tsv cosinesimilarity 0.695385 7
glove-glove.6B.300d.tsv cosinesimilarity 0.665383 7
glove-glove.6B.200d.tsv cosinesimilarity 0.630922 7
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.624367 11
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.617411 11
glove-glove.6B.100d.tsv cosinesimilarity 0.601925 7
glove-glove.6B.50d.tsv cosinesimilarity 0.570844 7
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.563415 11
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.479441 11
Performance on YangPowersVerb130 {}
evaluation value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv cosinesimilarity 0.630509 0
fasttext-crawl-300d-2M.tsv cosinesimilarity 0.610361 0
glove-glove.840B.300d.tsv cosinesimilarity 0.570936 0
glove-glove.6B.300d.tsv cosinesimilarity 0.548035 0
glove-glove.42B.300d.tsv cosinesimilarity 0.529482 0
fasttext-wiki.en.tsv cosinesimilarity 0.518032 0
glove-glove.6B.200d.tsv cosinesimilarity 0.515423 0
fasttext-wiki-news-300d-1M.tsv cosinesimilarity 0.507016 0
glove-glove.6B.100d.tsv cosinesimilarity 0.452952 0
fasttext-wiki.simple.tsv cosinesimilarity 0.429286 13
glove-glove.6B.50d.tsv cosinesimilarity 0.385552 0
glove-glove.twitter.27B.200d.tsv cosinesimilarity 0.317680 15
glove-glove.twitter.27B.100d.tsv cosinesimilarity 0.240560 15
glove-glove.twitter.27B.50d.tsv cosinesimilarity 0.193840 15
glove-glove.twitter.27B.25d.tsv cosinesimilarity 0.096403 15
For the analogy task, we report the results per category in the dataset. Note that the analogy task is a open vocabulary task: Given a query of 3 words, we ask the model to select a 4th word from the whole vocabulary. Different pre-trained embeddings have vocabularies of different size. In general the vocabulary of embeddings pretrained on more tokens (indicated by a bigger number before the B in the embedding source name) include more tokens in their vocabulary. While training embeddings on more tokens improves their quality, the larger vocabulary also makes the analogy task harder.
In this experiment all results are reported with reducing the vocabulary to the 300k most frequent tokens. Questions containing Out Of Vocabulary words are ignored.
We first display the results on the Google Analogy Test Set.
The Google Analogy Test Set contains the following categories. All analogy questions per category follow the pattern specified by the category name.
We first present the results using the threecosmul analogy function.
In [3]:
for kwargs, df in analogy_df.loc['GoogleAnalogyTestSet', 'threecosmul'].groupby(level=0):
print(kwargs)
print(df.loc[kwargs].sort_values(by='value', ascending=False))
print()
print()
{"category": "capital-common-countries"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.954545 0
fasttext-wiki.en.tsv 0.950593 0
glove-glove.6B.200d.tsv 0.944664 0
glove-glove.42B.300d.tsv 0.942688 0
glove-glove.6B.100d.tsv 0.922925 0
fasttext-crawl-300d-2M.tsv 0.821429 86
glove-glove.840B.300d.tsv 0.820158 0
fasttext-wiki-news-300d-1M.tsv 0.747619 296
glove-glove.6B.50d.tsv 0.707510 0
glove-glove.twitter.27B.200d.tsv 0.695652 0
fasttext-wiki-news-300d-1M-subword.tsv 0.685714 296
fasttext-wiki.simple.tsv 0.527668 0
glove-glove.twitter.27B.100d.tsv 0.474308 0
glove-glove.twitter.27B.50d.tsv 0.223320 0
glove-glove.twitter.27B.25d.tsv 0.098814 0
{"category": "capital-world"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.957118 0
glove-glove.42B.300d.tsv 0.935223 78
glove-glove.6B.200d.tsv 0.934571 0
fasttext-wiki.en.tsv 0.919761 0
glove-glove.6B.100d.tsv 0.838859 0
glove-glove.840B.300d.tsv 0.734714 3510
fasttext-crawl-300d-2M.tsv 0.730205 3842
glove-glove.twitter.27B.200d.tsv 0.728844 2326
glove-glove.6B.50d.tsv 0.537356 0
fasttext-wiki-news-300d-1M.tsv 0.532819 4265
glove-glove.twitter.27B.100d.tsv 0.504550 2326
fasttext-wiki-news-300d-1M-subword.tsv 0.463320 4265
glove-glove.twitter.27B.50d.tsv 0.221565 2326
fasttext-wiki.simple.tsv 0.215700 78
glove-glove.twitter.27B.25d.tsv 0.078253 2326
{"category": "city-in-state"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.775436 0
fasttext-crawl-300d-2M.tsv 0.724812 472
fasttext-wiki.en.tsv 0.720713 0
glove-glove.840B.300d.tsv 0.653425 0
glove-glove.6B.300d.tsv 0.576003 0
glove-glove.6B.200d.tsv 0.467369 0
fasttext-wiki-news-300d-1M.tsv 0.362768 2048
glove-glove.twitter.27B.200d.tsv 0.341305 0
fasttext-wiki-news-300d-1M-subword.tsv 0.291169 2048
glove-glove.6B.100d.tsv 0.263883 0
fasttext-wiki.simple.tsv 0.201459 0
glove-glove.twitter.27B.100d.tsv 0.153223 0
glove-glove.6B.50d.tsv 0.090799 0
glove-glove.twitter.27B.50d.tsv 0.046615 0
glove-glove.twitter.27B.25d.tsv 0.016214 0
{"category": "currency"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.469799 270
fasttext-wiki-news-300d-1M-subword.tsv 0.456376 270
fasttext-crawl-300d-2M.tsv 0.416107 270
glove-glove.840B.300d.tsv 0.297445 318
glove-glove.42B.300d.tsv 0.217822 58
glove-glove.6B.300d.tsv 0.215347 58
glove-glove.6B.200d.tsv 0.196782 58
glove-glove.6B.100d.tsv 0.150990 58
fasttext-wiki.en.tsv 0.142032 0
glove-glove.twitter.27B.200d.tsv 0.041485 408
glove-glove.6B.50d.tsv 0.033416 58
glove-glove.twitter.27B.100d.tsv 0.021834 408
glove-glove.twitter.27B.50d.tsv 0.006550 408
fasttext-wiki.simple.tsv 0.006192 220
glove-glove.twitter.27B.25d.tsv 0.000000 408
{"category": "family"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.946640 0
glove-glove.840B.300d.tsv 0.946640 0
fasttext-wiki-news-300d-1M.tsv 0.918972 0
glove-glove.42B.300d.tsv 0.909091 0
glove-glove.6B.300d.tsv 0.873518 0
fasttext-wiki-news-300d-1M-subword.tsv 0.859684 0
glove-glove.6B.200d.tsv 0.851779 0
fasttext-wiki.en.tsv 0.824111 0
glove-glove.twitter.27B.200d.tsv 0.797368 126
glove-glove.6B.100d.tsv 0.778656 0
glove-glove.twitter.27B.100d.tsv 0.700000 126
glove-glove.6B.50d.tsv 0.632411 0
glove-glove.twitter.27B.50d.tsv 0.502632 126
fasttext-wiki.simple.tsv 0.391775 44
glove-glove.twitter.27B.25d.tsv 0.323684 126
{"category": "gram1-adjective-to-adverb"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.762097 0
fasttext-wiki.simple.tsv 0.593750 0
fasttext-wiki.en.tsv 0.494960 0
fasttext-wiki-news-300d-1M.tsv 0.465726 0
glove-glove.840B.300d.tsv 0.431452 0
fasttext-crawl-300d-2M.tsv 0.381048 0
glove-glove.42B.300d.tsv 0.323589 0
glove-glove.6B.200d.tsv 0.257056 0
glove-glove.6B.300d.tsv 0.256048 0
glove-glove.6B.100d.tsv 0.228831 0
glove-glove.twitter.27B.200d.tsv 0.113978 62
glove-glove.6B.50d.tsv 0.100806 0
glove-glove.twitter.27B.100d.tsv 0.059140 62
glove-glove.twitter.27B.50d.tsv 0.020430 62
glove-glove.twitter.27B.25d.tsv 0.004301 62
{"category": "gram2-opposite"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.644089 0
fasttext-wiki-news-300d-1M.tsv 0.578818 0
fasttext-crawl-300d-2M.tsv 0.573892 0
fasttext-wiki.simple.tsv 0.569231 162
fasttext-wiki.en.tsv 0.496305 0
glove-glove.42B.300d.tsv 0.365764 0
glove-glove.840B.300d.tsv 0.359606 0
glove-glove.twitter.27B.200d.tsv 0.286667 212
glove-glove.6B.300d.tsv 0.247537 0
glove-glove.6B.200d.tsv 0.197044 0
glove-glove.twitter.27B.100d.tsv 0.191667 212
glove-glove.6B.100d.tsv 0.157635 0
glove-glove.twitter.27B.50d.tsv 0.090000 212
glove-glove.6B.50d.tsv 0.050493 0
glove-glove.twitter.27B.25d.tsv 0.045000 212
{"category": "gram3-comparative"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.969219 0
fasttext-crawl-300d-2M.tsv 0.948198 0
fasttext-wiki-news-300d-1M.tsv 0.934685 0
glove-glove.6B.300d.tsv 0.875375 0
glove-glove.840B.300d.tsv 0.873123 0
fasttext-wiki.en.tsv 0.867117 0
glove-glove.42B.300d.tsv 0.863363 0
glove-glove.6B.200d.tsv 0.843093 0
glove-glove.twitter.27B.200d.tsv 0.756006 0
glove-glove.6B.100d.tsv 0.750751 0
fasttext-wiki.simple.tsv 0.617868 0
glove-glove.twitter.27B.100d.tsv 0.599850 0
glove-glove.6B.50d.tsv 0.413664 0
glove-glove.twitter.27B.50d.tsv 0.387387 0
glove-glove.twitter.27B.25d.tsv 0.129880 0
{"category": "gram4-superlative"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.994652 0
fasttext-wiki-news-300d-1M-subword.tsv 0.990196 0
fasttext-wiki-news-300d-1M.tsv 0.973262 0
glove-glove.840B.300d.tsv 0.945633 0
glove-glove.42B.300d.tsv 0.877005 0
fasttext-wiki.en.tsv 0.775568 66
glove-glove.6B.300d.tsv 0.770945 0
glove-glove.6B.200d.tsv 0.700535 0
glove-glove.twitter.27B.200d.tsv 0.675579 0
fasttext-wiki.simple.tsv 0.638105 130
glove-glove.twitter.27B.100d.tsv 0.557932 0
glove-glove.6B.100d.tsv 0.506239 0
glove-glove.twitter.27B.50d.tsv 0.304813 0
glove-glove.6B.50d.tsv 0.174688 0
glove-glove.twitter.27B.25d.tsv 0.090909 0
{"category": "gram5-present-participle"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.982008 0
fasttext-crawl-300d-2M.tsv 0.905303 0
fasttext-wiki-news-300d-1M.tsv 0.900568 0
glove-glove.840B.300d.tsv 0.843750 0
glove-glove.42B.300d.tsv 0.830492 0
glove-glove.6B.300d.tsv 0.704545 0
fasttext-wiki.en.tsv 0.702652 0
glove-glove.6B.200d.tsv 0.671402 0
glove-glove.twitter.27B.200d.tsv 0.653409 0
glove-glove.6B.100d.tsv 0.651515 0
glove-glove.twitter.27B.100d.tsv 0.561553 0
fasttext-wiki.simple.tsv 0.528409 0
glove-glove.twitter.27B.50d.tsv 0.383523 0
glove-glove.6B.50d.tsv 0.296402 0
glove-glove.twitter.27B.25d.tsv 0.158144 0
{"category": "gram6-nationality-adjective"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.917448 0
fasttext-wiki.en.tsv 0.915572 0
glove-glove.6B.200d.tsv 0.907442 0
fasttext-wiki-news-300d-1M-subword.tsv 0.903173 370
glove-glove.42B.300d.tsv 0.883677 0
glove-glove.6B.100d.tsv 0.843027 0
fasttext-wiki.simple.tsv 0.829894 0
glove-glove.6B.50d.tsv 0.826767 0
fasttext-wiki-news-300d-1M.tsv 0.826688 370
glove-glove.840B.300d.tsv 0.791378 300
fasttext-crawl-300d-2M.tsv 0.776055 438
glove-glove.twitter.27B.200d.tsv 0.735557 370
glove-glove.twitter.27B.100d.tsv 0.567941 370
glove-glove.twitter.27B.50d.tsv 0.298617 370
glove-glove.twitter.27B.25d.tsv 0.106591 370
{"category": "gram7-past-tense"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.892949 0
fasttext-wiki-news-300d-1M-subword.tsv 0.862179 0
fasttext-crawl-300d-2M.tsv 0.845513 0
glove-glove.840B.300d.tsv 0.718590 0
fasttext-wiki.en.tsv 0.671154 0
glove-glove.6B.300d.tsv 0.624359 0
glove-glove.6B.200d.tsv 0.603205 0
glove-glove.42B.300d.tsv 0.555128 0
glove-glove.twitter.27B.200d.tsv 0.534413 78
glove-glove.6B.100d.tsv 0.528205 0
glove-glove.twitter.27B.100d.tsv 0.456815 78
glove-glove.6B.50d.tsv 0.311538 0
fasttext-wiki.simple.tsv 0.300000 0
glove-glove.twitter.27B.50d.tsv 0.296896 78
glove-glove.twitter.27B.25d.tsv 0.133603 78
{"category": "gram8-plural"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.971471 0
glove-glove.840B.300d.tsv 0.960210 0
fasttext-wiki-news-300d-1M-subword.tsv 0.954955 0
fasttext-crawl-300d-2M.tsv 0.942192 0
glove-glove.42B.300d.tsv 0.882132 0
fasttext-wiki.en.tsv 0.852102 0
glove-glove.6B.300d.tsv 0.793544 0
glove-glove.6B.200d.tsv 0.764264 0
glove-glove.twitter.27B.200d.tsv 0.732733 0
fasttext-wiki.simple.tsv 0.724474 0
glove-glove.6B.100d.tsv 0.666667 0
glove-glove.twitter.27B.100d.tsv 0.571321 0
glove-glove.6B.50d.tsv 0.462462 0
glove-glove.twitter.27B.50d.tsv 0.404655 0
glove-glove.twitter.27B.25d.tsv 0.152402 0
{"category": "gram9-plural-verbs"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.962069 0
fasttext-crawl-300d-2M.tsv 0.918391 0
fasttext-wiki-news-300d-1M.tsv 0.912644 0
fasttext-wiki.en.tsv 0.782759 0
glove-glove.840B.300d.tsv 0.775862 0
glove-glove.42B.300d.tsv 0.740230 0
fasttext-wiki.simple.tsv 0.714943 0
glove-glove.6B.300d.tsv 0.696552 0
glove-glove.6B.200d.tsv 0.651724 0
glove-glove.twitter.27B.200d.tsv 0.610345 0
glove-glove.6B.100d.tsv 0.574713 0
glove-glove.twitter.27B.100d.tsv 0.565517 0
glove-glove.twitter.27B.50d.tsv 0.357471 0
glove-glove.6B.50d.tsv 0.259770 0
glove-glove.twitter.27B.25d.tsv 0.136782 0
We then present the results using the threecosadd analogy function.
In [4]:
for kwargs, df in analogy_df.loc['GoogleAnalogyTestSet', 'threecosadd'].groupby(level=0):
print(kwargs)
print(df.loc[kwargs].sort_values(by='value', ascending=False))
print()
print()
{"category": "capital-common-countries"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.950593 0
glove-glove.6B.300d.tsv 0.948617 0
glove-glove.6B.200d.tsv 0.946640 0
fasttext-wiki.en.tsv 0.944664 0
glove-glove.6B.100d.tsv 0.938735 0
fasttext-crawl-300d-2M.tsv 0.804762 86
glove-glove.840B.300d.tsv 0.800395 0
glove-glove.6B.50d.tsv 0.792490 0
fasttext-wiki-news-300d-1M.tsv 0.761905 296
glove-glove.twitter.27B.200d.tsv 0.705534 0
fasttext-wiki-news-300d-1M-subword.tsv 0.704762 296
glove-glove.twitter.27B.100d.tsv 0.533597 0
fasttext-wiki.simple.tsv 0.397233 0
glove-glove.twitter.27B.50d.tsv 0.270751 0
glove-glove.twitter.27B.25d.tsv 0.150198 0
{"category": "capital-world"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.959770 0
glove-glove.6B.200d.tsv 0.946286 0
glove-glove.42B.300d.tsv 0.939721 78
fasttext-wiki.en.tsv 0.915340 0
glove-glove.6B.100d.tsv 0.889478 0
glove-glove.twitter.27B.200d.tsv 0.745678 2326
glove-glove.840B.300d.tsv 0.738659 3510
fasttext-crawl-300d-2M.tsv 0.731672 3842
glove-glove.6B.50d.tsv 0.685013 0
glove-glove.twitter.27B.100d.tsv 0.570064 2326
fasttext-wiki-news-300d-1M.tsv 0.548263 4265
fasttext-wiki-news-300d-1M-subword.tsv 0.486486 4265
glove-glove.twitter.27B.50d.tsv 0.292084 2326
fasttext-wiki.simple.tsv 0.157895 78
glove-glove.twitter.27B.25d.tsv 0.132848 2326
{"category": "city-in-state"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.780705 0
fasttext-crawl-300d-2M.tsv 0.730827 472
fasttext-wiki.en.tsv 0.710985 0
glove-glove.840B.300d.tsv 0.653425 0
glove-glove.6B.300d.tsv 0.593028 0
glove-glove.6B.200d.tsv 0.499797 0
fasttext-wiki-news-300d-1M.tsv 0.386635 2048
glove-glove.twitter.27B.200d.tsv 0.356303 0
glove-glove.6B.100d.tsv 0.308066 0
fasttext-wiki-news-300d-1M-subword.tsv 0.291169 2048
glove-glove.twitter.27B.100d.tsv 0.179165 0
glove-glove.6B.50d.tsv 0.153223 0
fasttext-wiki.simple.tsv 0.141467 0
glove-glove.twitter.27B.50d.tsv 0.061208 0
glove-glove.twitter.27B.25d.tsv 0.021078 0
{"category": "currency"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.483221 270
fasttext-wiki-news-300d-1M-subword.tsv 0.451342 270
fasttext-crawl-300d-2M.tsv 0.404362 270
glove-glove.840B.300d.tsv 0.262774 318
glove-glove.6B.200d.tsv 0.184406 58
glove-glove.42B.300d.tsv 0.175743 58
glove-glove.6B.300d.tsv 0.170792 58
glove-glove.6B.100d.tsv 0.152228 58
fasttext-wiki.en.tsv 0.123557 0
glove-glove.6B.50d.tsv 0.090347 58
glove-glove.twitter.27B.200d.tsv 0.032751 408
glove-glove.twitter.27B.100d.tsv 0.019651 408
glove-glove.twitter.27B.50d.tsv 0.010917 408
fasttext-wiki.simple.tsv 0.004644 220
glove-glove.twitter.27B.25d.tsv 0.000000 408
{"category": "family"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.958498 0
fasttext-crawl-300d-2M.tsv 0.928854 0
glove-glove.42B.300d.tsv 0.909091 0
fasttext-wiki-news-300d-1M.tsv 0.905138 0
glove-glove.6B.300d.tsv 0.881423 0
glove-glove.6B.200d.tsv 0.855731 0
fasttext-wiki-news-300d-1M-subword.tsv 0.853755 0
fasttext-wiki.en.tsv 0.822134 0
glove-glove.6B.100d.tsv 0.816206 0
glove-glove.twitter.27B.200d.tsv 0.794737 126
glove-glove.twitter.27B.100d.tsv 0.715789 126
glove-glove.6B.50d.tsv 0.689723 0
glove-glove.twitter.27B.50d.tsv 0.589474 126
glove-glove.twitter.27B.25d.tsv 0.397368 126
fasttext-wiki.simple.tsv 0.354978 44
{"category": "gram1-adjective-to-adverb"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.726815 0
fasttext-wiki.simple.tsv 0.577621 0
fasttext-wiki.en.tsv 0.484879 0
glove-glove.840B.300d.tsv 0.428427 0
fasttext-wiki-news-300d-1M.tsv 0.397177 0
fasttext-crawl-300d-2M.tsv 0.326613 0
glove-glove.42B.300d.tsv 0.302419 0
glove-glove.6B.200d.tsv 0.254032 0
glove-glove.6B.100d.tsv 0.243952 0
glove-glove.6B.300d.tsv 0.225806 0
glove-glove.6B.50d.tsv 0.152218 0
glove-glove.twitter.27B.200d.tsv 0.126882 62
glove-glove.twitter.27B.100d.tsv 0.081720 62
glove-glove.twitter.27B.50d.tsv 0.036559 62
glove-glove.twitter.27B.25d.tsv 0.009677 62
{"category": "gram2-opposite"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.633005 0
fasttext-wiki-news-300d-1M.tsv 0.578818 0
fasttext-wiki.simple.tsv 0.563077 162
fasttext-crawl-300d-2M.tsv 0.528325 0
fasttext-wiki.en.tsv 0.503695 0
glove-glove.42B.300d.tsv 0.355911 0
glove-glove.840B.300d.tsv 0.342365 0
glove-glove.twitter.27B.200d.tsv 0.308333 212
glove-glove.6B.300d.tsv 0.273399 0
glove-glove.twitter.27B.100d.tsv 0.231667 212
glove-glove.6B.200d.tsv 0.226601 0
glove-glove.6B.100d.tsv 0.200739 0
glove-glove.twitter.27B.50d.tsv 0.123333 212
glove-glove.6B.50d.tsv 0.094828 0
glove-glove.twitter.27B.25d.tsv 0.076667 212
{"category": "gram3-comparative"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.969970 0
fasttext-crawl-300d-2M.tsv 0.945195 0
fasttext-wiki-news-300d-1M.tsv 0.923423 0
glove-glove.6B.300d.tsv 0.881381 0
glove-glove.840B.300d.tsv 0.876877 0
glove-glove.6B.200d.tsv 0.864865 0
fasttext-wiki.en.tsv 0.861862 0
glove-glove.42B.300d.tsv 0.855856 0
glove-glove.6B.100d.tsv 0.791291 0
glove-glove.twitter.27B.200d.tsv 0.742492 0
glove-glove.twitter.27B.100d.tsv 0.626877 0
fasttext-wiki.simple.tsv 0.567568 0
glove-glove.6B.50d.tsv 0.518018 0
glove-glove.twitter.27B.50d.tsv 0.426426 0
glove-glove.twitter.27B.25d.tsv 0.160661 0
{"category": "gram4-superlative"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.993761 0
fasttext-wiki-news-300d-1M-subword.tsv 0.991979 0
fasttext-wiki-news-300d-1M.tsv 0.965241 0
glove-glove.840B.300d.tsv 0.919786 0
glove-glove.42B.300d.tsv 0.839572 0
glove-glove.6B.300d.tsv 0.721925 0
fasttext-wiki.en.tsv 0.710227 66
glove-glove.6B.200d.tsv 0.697861 0
glove-glove.twitter.27B.200d.tsv 0.639929 0
glove-glove.twitter.27B.100d.tsv 0.584670 0
fasttext-wiki.simple.tsv 0.553427 130
glove-glove.6B.100d.tsv 0.542781 0
glove-glove.twitter.27B.50d.tsv 0.363636 0
glove-glove.6B.50d.tsv 0.286096 0
glove-glove.twitter.27B.25d.tsv 0.138146 0
{"category": "gram5-present-participle"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.977273 0
fasttext-crawl-300d-2M.tsv 0.887311 0
fasttext-wiki-news-300d-1M.tsv 0.884470 0
glove-glove.840B.300d.tsv 0.827652 0
glove-glove.42B.300d.tsv 0.808712 0
glove-glove.6B.300d.tsv 0.699811 0
glove-glove.6B.100d.tsv 0.695076 0
glove-glove.6B.200d.tsv 0.682765 0
glove-glove.twitter.27B.200d.tsv 0.663826 0
fasttext-wiki.en.tsv 0.659091 0
glove-glove.twitter.27B.100d.tsv 0.621212 0
fasttext-wiki.simple.tsv 0.452652 0
glove-glove.twitter.27B.50d.tsv 0.451705 0
glove-glove.6B.50d.tsv 0.415720 0
glove-glove.twitter.27B.25d.tsv 0.196970 0
{"category": "gram6-nationality-adjective"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.925578 0
glove-glove.6B.200d.tsv 0.924953 0
fasttext-wiki.en.tsv 0.910569 0
fasttext-wiki-news-300d-1M-subword.tsv 0.904801 370
glove-glove.42B.300d.tsv 0.883052 0
glove-glove.6B.100d.tsv 0.878674 0
glove-glove.6B.50d.tsv 0.860538 0
fasttext-wiki-news-300d-1M.tsv 0.834825 370
fasttext-crawl-300d-2M.tsv 0.801895 438
glove-glove.840B.300d.tsv 0.778291 300
fasttext-wiki.simple.tsv 0.732333 0
glove-glove.twitter.27B.200d.tsv 0.727421 370
glove-glove.twitter.27B.100d.tsv 0.575264 370
glove-glove.twitter.27B.50d.tsv 0.349878 370
glove-glove.twitter.27B.25d.tsv 0.174939 370
{"category": "gram7-past-tense"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.875000 0
fasttext-wiki-news-300d-1M-subword.tsv 0.846154 0
fasttext-crawl-300d-2M.tsv 0.801282 0
glove-glove.840B.300d.tsv 0.640385 0
fasttext-wiki.en.tsv 0.625641 0
glove-glove.6B.300d.tsv 0.611538 0
glove-glove.6B.200d.tsv 0.601923 0
glove-glove.6B.100d.tsv 0.554487 0
glove-glove.twitter.27B.200d.tsv 0.531039 78
glove-glove.twitter.27B.100d.tsv 0.496626 78
glove-glove.42B.300d.tsv 0.492949 0
glove-glove.6B.50d.tsv 0.375000 0
glove-glove.twitter.27B.50d.tsv 0.360324 78
fasttext-wiki.simple.tsv 0.217308 0
glove-glove.twitter.27B.25d.tsv 0.165992 78
{"category": "gram8-plural"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.968468 0
glove-glove.840B.300d.tsv 0.957207 0
fasttext-wiki-news-300d-1M-subword.tsv 0.945946 0
fasttext-crawl-300d-2M.tsv 0.918168 0
fasttext-wiki.en.tsv 0.853604 0
glove-glove.42B.300d.tsv 0.849099 0
glove-glove.6B.300d.tsv 0.780781 0
glove-glove.6B.200d.tsv 0.774024 0
glove-glove.twitter.27B.200d.tsv 0.759760 0
glove-glove.6B.100d.tsv 0.719970 0
fasttext-wiki.simple.tsv 0.711712 0
glove-glove.twitter.27B.100d.tsv 0.653904 0
glove-glove.6B.50d.tsv 0.599099 0
glove-glove.twitter.27B.50d.tsv 0.482733 0
glove-glove.twitter.27B.25d.tsv 0.183183 0
{"category": "gram9-plural-verbs"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.952874 0
fasttext-wiki-news-300d-1M.tsv 0.897701 0
fasttext-crawl-300d-2M.tsv 0.879310 0
fasttext-wiki.en.tsv 0.740230 0
fasttext-wiki.simple.tsv 0.722989 0
glove-glove.840B.300d.tsv 0.668966 0
glove-glove.42B.300d.tsv 0.641379 0
glove-glove.6B.200d.tsv 0.597701 0
glove-glove.6B.300d.tsv 0.585057 0
glove-glove.6B.100d.tsv 0.583908 0
glove-glove.twitter.27B.100d.tsv 0.545977 0
glove-glove.twitter.27B.200d.tsv 0.519540 0
glove-glove.twitter.27B.50d.tsv 0.406897 0
glove-glove.6B.50d.tsv 0.343678 0
glove-glove.twitter.27B.25d.tsv 0.178161 0
We then display the results on the Bigger Analogy Test Set (BATS).
Unlike the Google Analogy Test Set, BATS is balanced across 4 types of relations (inflectional morphology, derivational morphology, lexicographic semantics, encyclopedic semantics).
We first present the results for the threecosadd analogy function.
In [5]:
for kwargs, df in analogy_df.loc['BiggerAnalogyTestSet', 'threecosadd'].groupby(level=0):
print(kwargs)
print(df.loc[kwargs].sort_values(by='value', ascending=False))
print()
print()
{"category": "D01"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.452569 1944
fasttext-wiki-news-300d-1M-subword.tsv 0.121212 470
fasttext-wiki.en.tsv 0.055497 558
fasttext-crawl-300d-2M.tsv 0.030127 558
glove-glove.twitter.27B.200d.tsv 0.021739 1944
fasttext-wiki-news-300d-1M.tsv 0.019697 470
glove-glove.840B.300d.tsv 0.018272 644
glove-glove.twitter.27B.100d.tsv 0.013834 1944
glove-glove.twitter.27B.50d.tsv 0.013834 1944
glove-glove.42B.300d.tsv 0.013527 380
glove-glove.6B.200d.tsv 0.004831 380
glove-glove.6B.300d.tsv 0.004831 380
glove-glove.6B.100d.tsv 0.002415 380
glove-glove.twitter.27B.25d.tsv 0.001976 1944
glove-glove.6B.50d.tsv 0.000966 380
{"category": "D02"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.627660 194
fasttext-wiki-news-300d-1M-subword.tsv 0.509796 0
fasttext-wiki-news-300d-1M.tsv 0.406122 0
fasttext-wiki.en.tsv 0.311020 0
fasttext-crawl-300d-2M.tsv 0.276327 0
glove-glove.6B.300d.tsv 0.230612 0
glove-glove.840B.300d.tsv 0.219592 0
glove-glove.42B.300d.tsv 0.206939 0
glove-glove.6B.200d.tsv 0.202857 0
glove-glove.twitter.27B.200d.tsv 0.173232 470
glove-glove.6B.100d.tsv 0.164490 0
glove-glove.twitter.27B.100d.tsv 0.102020 470
glove-glove.6B.50d.tsv 0.088980 0
glove-glove.twitter.27B.50d.tsv 0.047475 470
glove-glove.twitter.27B.25d.tsv 0.016162 470
{"category": "D03"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.683673 0
fasttext-wiki.simple.tsv 0.652245 0
fasttext-crawl-300d-2M.tsv 0.422041 0
fasttext-wiki-news-300d-1M.tsv 0.415510 0
glove-glove.840B.300d.tsv 0.404082 0
fasttext-wiki.en.tsv 0.373061 0
glove-glove.42B.300d.tsv 0.258367 0
glove-glove.6B.200d.tsv 0.168571 0
glove-glove.6B.300d.tsv 0.166939 0
glove-glove.6B.100d.tsv 0.146122 0
glove-glove.6B.50d.tsv 0.100816 0
glove-glove.twitter.27B.200d.tsv 0.065217 380
glove-glove.twitter.27B.100d.tsv 0.045894 380
glove-glove.twitter.27B.50d.tsv 0.035749 380
glove-glove.twitter.27B.25d.tsv 0.014976 380
{"category": "D04"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.361905 2030
fasttext-wiki-news-300d-1M-subword.tsv 0.207447 194
fasttext-crawl-300d-2M.tsv 0.147343 380
fasttext-wiki-news-300d-1M.tsv 0.144504 194
glove-glove.840B.300d.tsv 0.140089 644
fasttext-wiki.en.tsv 0.130904 968
glove-glove.42B.300d.tsv 0.094080 558
glove-glove.twitter.27B.200d.tsv 0.065359 2144
glove-glove.6B.300d.tsv 0.041667 194
glove-glove.6B.100d.tsv 0.035461 194
glove-glove.6B.200d.tsv 0.030585 194
glove-glove.twitter.27B.100d.tsv 0.029412 2144
glove-glove.6B.50d.tsv 0.013298 194
glove-glove.twitter.27B.50d.tsv 0.006536 2144
glove-glove.twitter.27B.25d.tsv 0.003268 2144
{"category": "D05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.746088 1044
fasttext-wiki.simple.tsv 0.675439 2108
fasttext-wiki.en.tsv 0.531707 810
fasttext-wiki-news-300d-1M.tsv 0.475107 1044
fasttext-crawl-300d-2M.tsv 0.378738 644
glove-glove.840B.300d.tsv 0.298048 1118
glove-glove.42B.300d.tsv 0.195703 728
glove-glove.6B.300d.tsv 0.109312 968
glove-glove.6B.200d.tsv 0.086370 968
glove-glove.6B.100d.tsv 0.077598 968
glove-glove.twitter.27B.200d.tsv 0.067251 2108
glove-glove.twitter.27B.100d.tsv 0.052632 2108
glove-glove.6B.50d.tsv 0.039136 968
glove-glove.twitter.27B.50d.tsv 0.032164 2108
glove-glove.twitter.27B.25d.tsv 0.002924 2108
{"category": "D06"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.396277 194
fasttext-wiki-news-300d-1M-subword.tsv 0.353723 194
fasttext-wiki.simple.tsv 0.298913 1898
fasttext-crawl-300d-2M.tsv 0.273384 98
glove-glove.840B.300d.tsv 0.251010 470
glove-glove.42B.300d.tsv 0.224915 98
fasttext-wiki.en.tsv 0.223404 288
glove-glove.6B.200d.tsv 0.140957 194
glove-glove.6B.100d.tsv 0.137855 194
glove-glove.6B.300d.tsv 0.113475 194
glove-glove.6B.50d.tsv 0.061613 194
glove-glove.twitter.27B.200d.tsv 0.049784 1988
glove-glove.twitter.27B.100d.tsv 0.041126 1988
glove-glove.twitter.27B.50d.tsv 0.021645 1988
glove-glove.twitter.27B.25d.tsv 0.019481 1988
{"category": "D07"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.263105 1458
fasttext-wiki-news-300d-1M-subword.tsv 0.227394 194
fasttext-wiki.en.tsv 0.094949 470
fasttext-wiki-news-300d-1M.tsv 0.091312 194
fasttext-crawl-300d-2M.tsv 0.083092 380
glove-glove.840B.300d.tsv 0.052020 470
glove-glove.42B.300d.tsv 0.044949 470
glove-glove.6B.300d.tsv 0.021212 470
glove-glove.6B.100d.tsv 0.020202 470
glove-glove.twitter.27B.200d.tsv 0.016667 1850
glove-glove.6B.200d.tsv 0.016162 470
glove-glove.6B.50d.tsv 0.013636 470
glove-glove.twitter.27B.100d.tsv 0.013333 1850
glove-glove.twitter.27B.25d.tsv 0.006667 1850
glove-glove.twitter.27B.50d.tsv 0.005000 1850
{"category": "D08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.316327 0
fasttext-wiki.simple.tsv 0.282317 810
fasttext-wiki-news-300d-1M.tsv 0.140816 0
fasttext-crawl-300d-2M.tsv 0.093469 0
fasttext-wiki.en.tsv 0.073878 0
glove-glove.840B.300d.tsv 0.053061 0
glove-glove.twitter.27B.200d.tsv 0.045983 558
glove-glove.6B.100d.tsv 0.037959 0
glove-glove.42B.300d.tsv 0.035918 0
glove-glove.twitter.27B.100d.tsv 0.034884 558
glove-glove.6B.200d.tsv 0.034286 0
glove-glove.6B.300d.tsv 0.028163 0
glove-glove.6B.50d.tsv 0.026531 0
glove-glove.twitter.27B.50d.tsv 0.023784 558
glove-glove.twitter.27B.25d.tsv 0.007928 558
{"category": "D09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.440603 194
fasttext-wiki-news-300d-1M.tsv 0.326684 194
fasttext-crawl-300d-2M.tsv 0.230496 194
fasttext-wiki.en.tsv 0.180676 380
fasttext-wiki.simple.tsv 0.162805 810
glove-glove.840B.300d.tsv 0.156888 98
glove-glove.42B.300d.tsv 0.114796 98
glove-glove.6B.100d.tsv 0.103608 288
glove-glove.twitter.27B.200d.tsv 0.081609 1580
glove-glove.6B.300d.tsv 0.077243 288
glove-glove.6B.200d.tsv 0.075856 288
glove-glove.6B.50d.tsv 0.074931 288
glove-glove.twitter.27B.100d.tsv 0.071264 1580
glove-glove.twitter.27B.50d.tsv 0.057471 1580
glove-glove.twitter.27B.25d.tsv 0.025287 1580
{"category": "D10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.373469 0
fasttext-wiki-news-300d-1M.tsv 0.337959 0
fasttext-wiki.simple.tsv 0.206633 98
fasttext-crawl-300d-2M.tsv 0.159592 0
glove-glove.840B.300d.tsv 0.117959 0
fasttext-wiki.en.tsv 0.114286 0
glove-glove.6B.100d.tsv 0.103265 0
glove-glove.42B.300d.tsv 0.092245 0
glove-glove.6B.200d.tsv 0.077959 0
glove-glove.6B.50d.tsv 0.077551 0
glove-glove.twitter.27B.200d.tsv 0.068182 558
glove-glove.twitter.27B.100d.tsv 0.067125 558
glove-glove.6B.300d.tsv 0.059184 0
glove-glove.twitter.27B.50d.tsv 0.043340 558
glove-glove.twitter.27B.25d.tsv 0.009514 558
{"category": "E01"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.950612 0
glove-glove.6B.200d.tsv 0.938776 0
glove-glove.42B.300d.tsv 0.902041 0
fasttext-wiki.en.tsv 0.892653 0
glove-glove.6B.100d.tsv 0.879592 0
fasttext-crawl-300d-2M.tsv 0.741463 810
glove-glove.840B.300d.tsv 0.737198 380
glove-glove.6B.50d.tsv 0.713469 0
glove-glove.twitter.27B.200d.tsv 0.685727 194
fasttext-wiki-news-300d-1M.tsv 0.626154 1800
fasttext-wiki-news-300d-1M-subword.tsv 0.532308 1800
glove-glove.twitter.27B.100d.tsv 0.518617 194
fasttext-wiki.simple.tsv 0.347755 0
glove-glove.twitter.27B.50d.tsv 0.268174 194
glove-glove.twitter.27B.25d.tsv 0.140514 194
{"category": "E02"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.291429 0
glove-glove.840B.300d.tsv 0.290821 380
fasttext-crawl-300d-2M.tsv 0.264228 728
glove-glove.6B.300d.tsv 0.195102 0
fasttext-wiki-news-300d-1M.tsv 0.193405 1328
glove-glove.6B.200d.tsv 0.188163 0
glove-glove.twitter.27B.200d.tsv 0.172429 194
fasttext-wiki.en.tsv 0.169388 0
glove-glove.6B.100d.tsv 0.151020 0
fasttext-wiki-news-300d-1M-subword.tsv 0.138146 1328
glove-glove.twitter.27B.100d.tsv 0.109486 194
glove-glove.6B.50d.tsv 0.106122 0
glove-glove.twitter.27B.50d.tsv 0.074468 194
fasttext-wiki.simple.tsv 0.042092 98
glove-glove.twitter.27B.25d.tsv 0.025709 194
{"category": "E03"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.327347 0
fasttext-wiki.en.tsv 0.256735 0
glove-glove.6B.300d.tsv 0.227755 0
glove-glove.6B.200d.tsv 0.170204 0
fasttext-wiki.simple.tsv 0.143673 0
glove-glove.840B.300d.tsv 0.134756 810
fasttext-wiki-news-300d-1M-subword.tsv 0.104575 2144
glove-glove.twitter.27B.200d.tsv 0.095666 558
fasttext-wiki-news-300d-1M.tsv 0.094771 2144
glove-glove.6B.100d.tsv 0.086531 0
fasttext-crawl-300d-2M.tsv 0.064103 1748
glove-glove.twitter.27B.100d.tsv 0.040169 558
glove-glove.twitter.27B.50d.tsv 0.027484 558
glove-glove.6B.50d.tsv 0.024082 0
glove-glove.twitter.27B.25d.tsv 0.005814 558
{"category": "E04"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.301871 98
fasttext-wiki.en.tsv 0.242857 0
glove-glove.6B.200d.tsv 0.200816 0
glove-glove.6B.300d.tsv 0.195102 0
glove-glove.6B.100d.tsv 0.194286 0
glove-glove.840B.300d.tsv 0.174194 1520
fasttext-crawl-300d-2M.tsv 0.133598 1694
fasttext-wiki-news-300d-1M.tsv 0.111111 2108
fasttext-wiki-news-300d-1M-subword.tsv 0.099415 2108
glove-glove.twitter.27B.200d.tsv 0.081924 558
glove-glove.6B.50d.tsv 0.079184 0
glove-glove.twitter.27B.100d.tsv 0.062368 558
glove-glove.twitter.27B.50d.tsv 0.031184 558
glove-glove.twitter.27B.25d.tsv 0.014271 558
fasttext-wiki.simple.tsv 0.012330 98
{"category": "E05"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.311650 98
glove-glove.6B.300d.tsv 0.302449 0
glove-glove.6B.200d.tsv 0.287755 0
glove-glove.6B.100d.tsv 0.228571 0
fasttext-wiki.en.tsv 0.209796 0
fasttext-wiki-news-300d-1M.tsv 0.181287 2108
glove-glove.6B.50d.tsv 0.142449 0
fasttext-wiki-news-300d-1M-subword.tsv 0.096491 2108
glove-glove.840B.300d.tsv 0.091270 1190
fasttext-wiki.simple.tsv 0.046344 98
fasttext-crawl-300d-2M.tsv 0.042529 1580
glove-glove.twitter.27B.200d.tsv 0.027536 380
glove-glove.twitter.27B.100d.tsv 0.026087 380
glove-glove.twitter.27B.50d.tsv 0.007246 380
glove-glove.twitter.27B.25d.tsv 0.004348 380
{"category": "E06"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.046122 0
fasttext-wiki-news-300d-1M-subword.tsv 0.038367 0
glove-glove.840B.300d.tsv 0.036565 98
glove-glove.42B.300d.tsv 0.031429 0
fasttext-wiki-news-300d-1M.tsv 0.024082 0
glove-glove.twitter.27B.200d.tsv 0.020487 644
glove-glove.twitter.27B.100d.tsv 0.016058 644
glove-glove.6B.100d.tsv 0.013469 0
glove-glove.6B.200d.tsv 0.012245 0
glove-glove.6B.300d.tsv 0.010612 0
fasttext-wiki.simple.tsv 0.009596 470
fasttext-wiki.en.tsv 0.009388 0
glove-glove.6B.50d.tsv 0.006531 0
glove-glove.twitter.27B.50d.tsv 0.005537 644
glove-glove.twitter.27B.25d.tsv 0.003876 644
{"category": "E07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.051208 380
glove-glove.840B.300d.tsv 0.046860 380
fasttext-crawl-300d-2M.tsv 0.044643 98
fasttext-wiki-news-300d-1M-subword.tsv 0.030435 380
glove-glove.42B.300d.tsv 0.022959 98
glove-glove.twitter.27B.200d.tsv 0.016401 194
glove-glove.twitter.27B.100d.tsv 0.014184 194
glove-glove.6B.200d.tsv 0.005762 194
glove-glove.6B.300d.tsv 0.005762 194
fasttext-wiki.en.tsv 0.004677 98
glove-glove.twitter.27B.50d.tsv 0.003989 194
glove-glove.6B.100d.tsv 0.002660 194
glove-glove.twitter.27B.25d.tsv 0.002216 194
glove-glove.6B.50d.tsv 0.001773 194
fasttext-wiki.simple.tsv 0.000000 728
{"category": "E08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.007755 0
fasttext-wiki-news-300d-1M.tsv 0.006939 0
glove-glove.42B.300d.tsv 0.004082 0
glove-glove.6B.100d.tsv 0.003265 0
glove-glove.840B.300d.tsv 0.003265 0
glove-glove.6B.200d.tsv 0.002857 0
fasttext-crawl-300d-2M.tsv 0.002449 0
glove-glove.6B.300d.tsv 0.002449 0
glove-glove.twitter.27B.200d.tsv 0.001276 98
glove-glove.twitter.27B.100d.tsv 0.000850 98
fasttext-wiki.en.tsv 0.000816 0
glove-glove.6B.50d.tsv 0.000816 0
glove-glove.twitter.27B.25d.tsv 0.000425 98
fasttext-wiki.simple.tsv 0.000000 98
glove-glove.twitter.27B.50d.tsv 0.000000 98
{"category": "E09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.171837 0
glove-glove.42B.300d.tsv 0.155918 0
glove-glove.twitter.27B.200d.tsv 0.155510 0
fasttext-crawl-300d-2M.tsv 0.147755 0
fasttext-wiki-news-300d-1M-subword.tsv 0.144490 0
glove-glove.6B.200d.tsv 0.133061 0
glove-glove.840B.300d.tsv 0.130612 0
glove-glove.6B.300d.tsv 0.130204 0
glove-glove.6B.100d.tsv 0.106939 0
glove-glove.twitter.27B.100d.tsv 0.100000 0
fasttext-wiki.en.tsv 0.082041 0
glove-glove.6B.50d.tsv 0.046939 0
glove-glove.twitter.27B.50d.tsv 0.041633 0
glove-glove.twitter.27B.25d.tsv 0.017551 0
fasttext-wiki.simple.tsv 0.010204 0
{"category": "E10"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.624638 380
fasttext-wiki-news-300d-1M.tsv 0.575856 288
fasttext-wiki-news-300d-1M-subword.tsv 0.573543 288
fasttext-wiki.en.tsv 0.533688 194
glove-glove.840B.300d.tsv 0.524747 470
glove-glove.42B.300d.tsv 0.465561 98
glove-glove.6B.300d.tsv 0.428191 194
glove-glove.6B.200d.tsv 0.383422 194
glove-glove.twitter.27B.200d.tsv 0.374625 1118
glove-glove.6B.100d.tsv 0.336879 194
glove-glove.twitter.27B.100d.tsv 0.288288 1118
glove-glove.6B.50d.tsv 0.245124 194
fasttext-wiki.simple.tsv 0.201374 558
glove-glove.twitter.27B.50d.tsv 0.198198 1118
glove-glove.twitter.27B.25d.tsv 0.141892 1118
{"category": "I01"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.988980 0
glove-glove.840B.300d.tsv 0.858776 0
fasttext-wiki-news-300d-1M.tsv 0.829796 0
glove-glove.42B.300d.tsv 0.818367 0
fasttext-crawl-300d-2M.tsv 0.779592 0
glove-glove.6B.300d.tsv 0.773469 0
fasttext-wiki.en.tsv 0.753061 0
glove-glove.6B.200d.tsv 0.746531 0
glove-glove.twitter.27B.200d.tsv 0.711837 0
glove-glove.6B.100d.tsv 0.707755 0
glove-glove.twitter.27B.100d.tsv 0.630612 0
fasttext-wiki.simple.tsv 0.614286 0
glove-glove.6B.50d.tsv 0.570612 0
glove-glove.twitter.27B.50d.tsv 0.416327 0
glove-glove.twitter.27B.25d.tsv 0.179184 0
{"category": "I02"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.803265 0
fasttext-wiki-news-300d-1M.tsv 0.733878 0
fasttext-wiki.en.tsv 0.660408 0
glove-glove.840B.300d.tsv 0.640816 0
glove-glove.42B.300d.tsv 0.609388 0
fasttext-crawl-300d-2M.tsv 0.596735 0
glove-glove.6B.300d.tsv 0.564490 0
glove-glove.6B.200d.tsv 0.529388 0
glove-glove.6B.100d.tsv 0.458367 0
fasttext-wiki.simple.tsv 0.420816 0
glove-glove.twitter.27B.200d.tsv 0.333333 194
glove-glove.6B.50d.tsv 0.320408 0
glove-glove.twitter.27B.100d.tsv 0.269060 194
glove-glove.twitter.27B.50d.tsv 0.164894 194
glove-glove.twitter.27B.25d.tsv 0.073582 194
{"category": "I03"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.976616 98
fasttext-wiki-news-300d-1M.tsv 0.954932 98
fasttext-crawl-300d-2M.tsv 0.942041 0
glove-glove.840B.300d.tsv 0.845301 194
glove-glove.42B.300d.tsv 0.770408 98
fasttext-wiki.en.tsv 0.631401 380
glove-glove.6B.200d.tsv 0.614694 0
glove-glove.6B.300d.tsv 0.611429 0
glove-glove.twitter.27B.200d.tsv 0.601667 1850
glove-glove.twitter.27B.100d.tsv 0.536667 1850
glove-glove.6B.100d.tsv 0.536327 0
fasttext-wiki.simple.tsv 0.438735 1944
glove-glove.6B.50d.tsv 0.316735 0
glove-glove.twitter.27B.50d.tsv 0.260000 1850
glove-glove.twitter.27B.25d.tsv 0.108333 1850
{"category": "I04"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.962585 98
fasttext-wiki-news-300d-1M-subword.tsv 0.956566 470
fasttext-wiki-news-300d-1M.tsv 0.920707 470
glove-glove.840B.300d.tsv 0.872803 288
glove-glove.42B.300d.tsv 0.743351 194
fasttext-wiki.simple.tsv 0.729249 1944
fasttext-wiki.en.tsv 0.705980 644
glove-glove.twitter.27B.200d.tsv 0.610837 1638
glove-glove.twitter.27B.100d.tsv 0.560345 1638
glove-glove.6B.200d.tsv 0.533302 288
glove-glove.6B.100d.tsv 0.481499 288
glove-glove.6B.300d.tsv 0.478261 288
glove-glove.twitter.27B.50d.tsv 0.408867 1638
glove-glove.6B.50d.tsv 0.260870 288
glove-glove.twitter.27B.25d.tsv 0.173645 1638
{"category": "I05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.994286 0
fasttext-wiki-news-300d-1M.tsv 0.990612 0
fasttext-crawl-300d-2M.tsv 0.963265 0
fasttext-wiki.en.tsv 0.840408 0
fasttext-wiki.simple.tsv 0.828571 0
glove-glove.6B.100d.tsv 0.796327 0
glove-glove.840B.300d.tsv 0.791429 0
glove-glove.42B.300d.tsv 0.786122 0
glove-glove.6B.300d.tsv 0.764490 0
glove-glove.6B.200d.tsv 0.749388 0
glove-glove.twitter.27B.200d.tsv 0.573061 0
glove-glove.twitter.27B.100d.tsv 0.567347 0
glove-glove.6B.50d.tsv 0.493061 0
glove-glove.twitter.27B.50d.tsv 0.406939 0
glove-glove.twitter.27B.25d.tsv 0.207347 0
{"category": "I06"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.910204 0
fasttext-wiki-news-300d-1M.tsv 0.855102 0
fasttext-crawl-300d-2M.tsv 0.848980 0
glove-glove.840B.300d.tsv 0.804082 0
glove-glove.42B.300d.tsv 0.742857 0
fasttext-wiki.en.tsv 0.724490 0
glove-glove.twitter.27B.200d.tsv 0.676735 0
glove-glove.6B.300d.tsv 0.635510 0
glove-glove.6B.100d.tsv 0.630204 0
glove-glove.6B.200d.tsv 0.628163 0
glove-glove.twitter.27B.100d.tsv 0.601224 0
fasttext-wiki.simple.tsv 0.513878 0
glove-glove.6B.50d.tsv 0.488980 0
glove-glove.twitter.27B.50d.tsv 0.477143 0
glove-glove.twitter.27B.25d.tsv 0.298367 0
{"category": "I07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.973469 0
fasttext-wiki-news-300d-1M.tsv 0.855102 0
fasttext-crawl-300d-2M.tsv 0.759592 0
glove-glove.6B.100d.tsv 0.660000 0
glove-glove.6B.200d.tsv 0.642857 0
glove-glove.6B.300d.tsv 0.642041 0
glove-glove.42B.300d.tsv 0.542041 0
glove-glove.twitter.27B.200d.tsv 0.539592 0
glove-glove.twitter.27B.100d.tsv 0.526939 0
fasttext-wiki.simple.tsv 0.507755 0
glove-glove.840B.300d.tsv 0.469388 0
glove-glove.6B.50d.tsv 0.439592 0
fasttext-wiki.en.tsv 0.408163 0
glove-glove.twitter.27B.50d.tsv 0.395918 0
glove-glove.twitter.27B.25d.tsv 0.191837 0
{"category": "I08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.879184 0
fasttext-wiki-news-300d-1M.tsv 0.829388 0
fasttext-crawl-300d-2M.tsv 0.748980 0
fasttext-wiki.en.tsv 0.612653 0
glove-glove.840B.300d.tsv 0.536327 0
glove-glove.42B.300d.tsv 0.522449 0
glove-glove.6B.100d.tsv 0.490612 0
glove-glove.6B.200d.tsv 0.463673 0
glove-glove.6B.300d.tsv 0.458367 0
fasttext-wiki.simple.tsv 0.368980 0
glove-glove.twitter.27B.200d.tsv 0.366071 98
glove-glove.twitter.27B.100d.tsv 0.327381 98
glove-glove.6B.50d.tsv 0.270204 0
glove-glove.twitter.27B.50d.tsv 0.255952 98
glove-glove.twitter.27B.25d.tsv 0.094813 98
{"category": "I09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.944490 0
fasttext-wiki-news-300d-1M.tsv 0.829388 0
fasttext-crawl-300d-2M.tsv 0.630612 0
glove-glove.6B.200d.tsv 0.542449 0
glove-glove.6B.300d.tsv 0.529796 0
glove-glove.6B.100d.tsv 0.515918 0
fasttext-wiki.en.tsv 0.502449 0
glove-glove.6B.50d.tsv 0.426122 0
glove-glove.840B.300d.tsv 0.390612 0
glove-glove.twitter.27B.100d.tsv 0.369796 0
glove-glove.twitter.27B.200d.tsv 0.365306 0
glove-glove.42B.300d.tsv 0.359592 0
fasttext-wiki.simple.tsv 0.312245 0
glove-glove.twitter.27B.50d.tsv 0.266122 0
glove-glove.twitter.27B.25d.tsv 0.112653 0
{"category": "I10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.944490 0
fasttext-wiki-news-300d-1M.tsv 0.878367 0
fasttext-crawl-300d-2M.tsv 0.794694 0
glove-glove.6B.300d.tsv 0.523265 0
glove-glove.6B.200d.tsv 0.517959 0
glove-glove.6B.100d.tsv 0.515102 0
glove-glove.42B.300d.tsv 0.491020 0
glove-glove.840B.300d.tsv 0.480408 0
fasttext-wiki.en.tsv 0.428163 0
fasttext-wiki.simple.tsv 0.424490 0
glove-glove.twitter.27B.200d.tsv 0.368622 98
glove-glove.twitter.27B.100d.tsv 0.366071 98
glove-glove.6B.50d.tsv 0.349796 0
glove-glove.twitter.27B.50d.tsv 0.264456 98
glove-glove.twitter.27B.25d.tsv 0.119048 98
{"category": "L01"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.070267 728
glove-glove.42B.300d.tsv 0.064646 470
fasttext-crawl-300d-2M.tsv 0.041528 644
fasttext-wiki-news-300d-1M-subword.tsv 0.038055 558
fasttext-wiki-news-300d-1M.tsv 0.037526 558
glove-glove.twitter.27B.200d.tsv 0.034262 728
glove-glove.6B.300d.tsv 0.029293 470
glove-glove.twitter.27B.100d.tsv 0.027294 728
glove-glove.6B.200d.tsv 0.021212 470
glove-glove.6B.100d.tsv 0.019192 470
fasttext-wiki.en.tsv 0.013878 0
glove-glove.twitter.27B.50d.tsv 0.012195 728
glove-glove.6B.50d.tsv 0.010606 470
glove-glove.twitter.27B.25d.tsv 0.005807 728
fasttext-wiki.simple.tsv 0.000000 470
{"category": "L02"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.060816 0
glove-glove.840B.300d.tsv 0.053571 98
glove-glove.twitter.27B.200d.tsv 0.040169 558
glove-glove.6B.200d.tsv 0.035102 0
glove-glove.twitter.27B.100d.tsv 0.034355 558
glove-glove.6B.100d.tsv 0.029796 0
glove-glove.6B.300d.tsv 0.028980 0
glove-glove.twitter.27B.50d.tsv 0.022727 558
fasttext-wiki-news-300d-1M.tsv 0.022109 98
glove-glove.6B.50d.tsv 0.019184 0
fasttext-crawl-300d-2M.tsv 0.012653 0
fasttext-wiki.simple.tsv 0.010606 470
glove-glove.twitter.27B.25d.tsv 0.007928 558
fasttext-wiki.en.tsv 0.005527 98
fasttext-wiki-news-300d-1M-subword.tsv 0.005102 98
{"category": "L03"}
value num_skipped
embedding
glove-glove.twitter.27B.200d.tsv 0.037681 380
fasttext-wiki-news-300d-1M-subword.tsv 0.035904 194
glove-glove.840B.300d.tsv 0.034864 98
glove-glove.twitter.27B.100d.tsv 0.034783 380
glove-glove.6B.100d.tsv 0.030612 98
fasttext-wiki-news-300d-1M.tsv 0.028812 194
glove-glove.42B.300d.tsv 0.028163 0
glove-glove.6B.300d.tsv 0.026361 98
glove-glove.twitter.27B.50d.tsv 0.022222 380
glove-glove.6B.50d.tsv 0.022109 98
glove-glove.6B.200d.tsv 0.021259 98
fasttext-crawl-300d-2M.tsv 0.020408 0
fasttext-wiki.simple.tsv 0.012121 470
fasttext-wiki.en.tsv 0.011054 98
glove-glove.twitter.27B.25d.tsv 0.010628 380
{"category": "L04"}
value num_skipped
embedding
glove-glove.6B.100d.tsv 0.032653 0
glove-glove.6B.200d.tsv 0.028571 0
glove-glove.42B.300d.tsv 0.027755 0
glove-glove.6B.300d.tsv 0.027347 0
glove-glove.6B.50d.tsv 0.020816 0
glove-glove.840B.300d.tsv 0.020816 0
fasttext-wiki-news-300d-1M.tsv 0.015918 0
glove-glove.twitter.27B.100d.tsv 0.015510 0
glove-glove.twitter.27B.200d.tsv 0.015102 0
fasttext-wiki.en.tsv 0.011020 0
fasttext-wiki-news-300d-1M-subword.tsv 0.009388 0
glove-glove.twitter.27B.50d.tsv 0.004490 0
fasttext-crawl-300d-2M.tsv 0.003265 0
glove-glove.twitter.27B.25d.tsv 0.003265 0
fasttext-wiki.simple.tsv 0.000850 98
{"category": "L05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.043793 98
fasttext-wiki-news-300d-1M.tsv 0.019983 98
glove-glove.6B.100d.tsv 0.018282 98
glove-glove.6B.50d.tsv 0.018282 98
fasttext-wiki.en.tsv 0.016582 98
glove-glove.twitter.27B.100d.tsv 0.014141 470
glove-glove.42B.300d.tsv 0.013180 98
glove-glove.840B.300d.tsv 0.012755 98
fasttext-crawl-300d-2M.tsv 0.012330 98
glove-glove.twitter.27B.200d.tsv 0.012121 470
glove-glove.6B.200d.tsv 0.011905 98
glove-glove.6B.300d.tsv 0.009779 98
glove-glove.twitter.27B.50d.tsv 0.004545 470
fasttext-wiki.simple.tsv 0.004040 470
glove-glove.twitter.27B.25d.tsv 0.003535 470
{"category": "L06"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.018282 98
glove-glove.twitter.27B.200d.tsv 0.016869 968
glove-glove.6B.200d.tsv 0.015510 0
glove-glove.twitter.27B.100d.tsv 0.012821 968
glove-glove.42B.300d.tsv 0.012755 98
glove-glove.6B.100d.tsv 0.012653 0
glove-glove.840B.300d.tsv 0.012488 288
fasttext-wiki.simple.tsv 0.012330 98
glove-glove.6B.300d.tsv 0.010612 0
fasttext-wiki.en.tsv 0.007755 0
glove-glove.6B.50d.tsv 0.007755 0
fasttext-wiki-news-300d-1M.tsv 0.005952 98
glove-glove.twitter.27B.50d.tsv 0.004049 968
fasttext-crawl-300d-2M.tsv 0.003103 194
glove-glove.twitter.27B.25d.tsv 0.001350 968
{"category": "L07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.099490 98
glove-glove.42B.300d.tsv 0.096939 98
glove-glove.twitter.27B.200d.tsv 0.090821 380
fasttext-wiki-news-300d-1M-subword.tsv 0.083759 98
fasttext-crawl-300d-2M.tsv 0.073554 98
glove-glove.840B.300d.tsv 0.073129 98
glove-glove.6B.300d.tsv 0.070153 98
glove-glove.twitter.27B.100d.tsv 0.068599 380
glove-glove.6B.200d.tsv 0.061224 98
glove-glove.6B.100d.tsv 0.054847 98
glove-glove.twitter.27B.50d.tsv 0.041063 380
glove-glove.6B.50d.tsv 0.029762 98
fasttext-wiki.en.tsv 0.014881 98
glove-glove.twitter.27B.25d.tsv 0.012077 380
fasttext-wiki.simple.tsv 0.000581 728
{"category": "L08"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.136735 0
fasttext-wiki-news-300d-1M-subword.tsv 0.132245 0
fasttext-wiki-news-300d-1M.tsv 0.123673 0
glove-glove.840B.300d.tsv 0.109796 0
glove-glove.6B.300d.tsv 0.105306 0
glove-glove.6B.200d.tsv 0.096327 0
glove-glove.6B.100d.tsv 0.093469 0
fasttext-crawl-300d-2M.tsv 0.089388 0
glove-glove.twitter.27B.200d.tsv 0.086869 470
glove-glove.twitter.27B.100d.tsv 0.050000 470
glove-glove.6B.50d.tsv 0.045714 0
fasttext-wiki.en.tsv 0.037143 0
glove-glove.twitter.27B.50d.tsv 0.028283 470
glove-glove.twitter.27B.25d.tsv 0.011616 470
fasttext-wiki.simple.tsv 0.007653 98
{"category": "L09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.207483 98
fasttext-wiki-news-300d-1M-subword.tsv 0.198554 98
fasttext-wiki.en.tsv 0.181548 98
fasttext-wiki.simple.tsv 0.154106 380
fasttext-crawl-300d-2M.tsv 0.139031 98
glove-glove.6B.300d.tsv 0.123724 98
glove-glove.840B.300d.tsv 0.111820 98
glove-glove.6B.200d.tsv 0.110544 98
glove-glove.42B.300d.tsv 0.106122 0
glove-glove.6B.100d.tsv 0.102041 98
glove-glove.twitter.27B.200d.tsv 0.070048 380
glove-glove.6B.50d.tsv 0.052296 98
glove-glove.twitter.27B.100d.tsv 0.047826 380
glove-glove.twitter.27B.50d.tsv 0.018357 380
glove-glove.twitter.27B.25d.tsv 0.007729 380
{"category": "L10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.334694 0
fasttext-wiki-news-300d-1M-subword.tsv 0.326122 0
glove-glove.42B.300d.tsv 0.306939 0
glove-glove.840B.300d.tsv 0.287347 0
fasttext-crawl-300d-2M.tsv 0.236327 0
glove-glove.twitter.27B.200d.tsv 0.226179 288
fasttext-wiki.en.tsv 0.219592 0
glove-glove.6B.200d.tsv 0.217959 0
glove-glove.6B.300d.tsv 0.210204 0
glove-glove.6B.100d.tsv 0.203673 0
glove-glove.twitter.27B.100d.tsv 0.160500 288
glove-glove.6B.50d.tsv 0.115918 0
glove-glove.twitter.27B.50d.tsv 0.101758 288
fasttext-wiki.simple.tsv 0.054117 288
glove-glove.twitter.27B.25d.tsv 0.035153 288
We then present the results for the threecosmul analogy function.
In [6]:
for kwargs, df in analogy_df.loc['BiggerAnalogyTestSet', 'threecosmul'].groupby(level=0):
print(kwargs)
print(df.loc[kwargs].sort_values(by='value', ascending=False))
print()
print()
{"category": "D01"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.501976 1944
fasttext-wiki-news-300d-1M-subword.tsv 0.161111 470
fasttext-wiki.en.tsv 0.085624 558
fasttext-crawl-300d-2M.tsv 0.072410 558
fasttext-wiki-news-300d-1M.tsv 0.035859 470
glove-glove.840B.300d.tsv 0.032669 644
glove-glove.42B.300d.tsv 0.020773 380
glove-glove.twitter.27B.200d.tsv 0.019763 1944
glove-glove.twitter.27B.100d.tsv 0.009881 1944
glove-glove.6B.200d.tsv 0.002899 380
glove-glove.6B.300d.tsv 0.002899 380
glove-glove.6B.100d.tsv 0.000966 380
glove-glove.6B.50d.tsv 0.000000 380
glove-glove.twitter.27B.25d.tsv 0.000000 1944
glove-glove.twitter.27B.50d.tsv 0.000000 1944
{"category": "D02"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.644947 194
fasttext-wiki-news-300d-1M-subword.tsv 0.524490 0
fasttext-wiki-news-300d-1M.tsv 0.424082 0
fasttext-crawl-300d-2M.tsv 0.347347 0
fasttext-wiki.en.tsv 0.318776 0
glove-glove.42B.300d.tsv 0.240816 0
glove-glove.840B.300d.tsv 0.237143 0
glove-glove.6B.300d.tsv 0.206531 0
glove-glove.6B.200d.tsv 0.164082 0
glove-glove.twitter.27B.200d.tsv 0.139394 470
glove-glove.6B.100d.tsv 0.112653 0
glove-glove.twitter.27B.100d.tsv 0.061616 470
glove-glove.6B.50d.tsv 0.043265 0
glove-glove.twitter.27B.50d.tsv 0.019697 470
glove-glove.twitter.27B.25d.tsv 0.005556 470
{"category": "D03"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.728163 0
fasttext-wiki.simple.tsv 0.719184 0
fasttext-crawl-300d-2M.tsv 0.533061 0
fasttext-wiki-news-300d-1M.tsv 0.488571 0
glove-glove.840B.300d.tsv 0.415102 0
fasttext-wiki.en.tsv 0.388980 0
glove-glove.42B.300d.tsv 0.283265 0
glove-glove.6B.300d.tsv 0.179592 0
glove-glove.6B.200d.tsv 0.168980 0
glove-glove.6B.100d.tsv 0.126939 0
glove-glove.twitter.27B.200d.tsv 0.067633 380
glove-glove.6B.50d.tsv 0.057551 0
glove-glove.twitter.27B.100d.tsv 0.040580 380
glove-glove.twitter.27B.50d.tsv 0.019807 380
glove-glove.twitter.27B.25d.tsv 0.005314 380
{"category": "D04"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.402381 2030
fasttext-wiki-news-300d-1M-subword.tsv 0.226950 194
fasttext-crawl-300d-2M.tsv 0.188406 380
fasttext-wiki-news-300d-1M.tsv 0.164007 194
glove-glove.840B.300d.tsv 0.161130 644
fasttext-wiki.en.tsv 0.153171 968
glove-glove.42B.300d.tsv 0.115222 558
glove-glove.twitter.27B.200d.tsv 0.049020 2144
glove-glove.6B.300d.tsv 0.031028 194
glove-glove.6B.200d.tsv 0.019504 194
glove-glove.6B.100d.tsv 0.011082 194
glove-glove.twitter.27B.100d.tsv 0.003268 2144
glove-glove.6B.50d.tsv 0.000887 194
glove-glove.twitter.27B.25d.tsv 0.000000 2144
glove-glove.twitter.27B.50d.tsv 0.000000 2144
{"category": "D05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.778805 1044
fasttext-wiki.simple.tsv 0.754386 2108
fasttext-wiki.en.tsv 0.568902 810
fasttext-wiki-news-300d-1M.tsv 0.548364 1044
fasttext-crawl-300d-2M.tsv 0.508306 644
glove-glove.840B.300d.tsv 0.307808 1118
glove-glove.42B.300d.tsv 0.192799 728
glove-glove.6B.300d.tsv 0.099865 968
glove-glove.twitter.27B.200d.tsv 0.070175 2108
glove-glove.6B.200d.tsv 0.064103 968
glove-glove.6B.100d.tsv 0.047233 968
glove-glove.twitter.27B.100d.tsv 0.043860 2108
glove-glove.twitter.27B.50d.tsv 0.017544 2108
glove-glove.6B.50d.tsv 0.010796 968
glove-glove.twitter.27B.25d.tsv 0.002924 2108
{"category": "D06"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.429078 194
fasttext-wiki-news-300d-1M-subword.tsv 0.369238 194
fasttext-wiki.simple.tsv 0.318841 1898
fasttext-crawl-300d-2M.tsv 0.311650 98
glove-glove.42B.300d.tsv 0.267432 98
fasttext-wiki.en.tsv 0.256707 288
glove-glove.840B.300d.tsv 0.255556 470
glove-glove.6B.300d.tsv 0.145833 194
glove-glove.6B.200d.tsv 0.130319 194
glove-glove.6B.100d.tsv 0.094415 194
glove-glove.twitter.27B.200d.tsv 0.060606 1988
glove-glove.twitter.27B.100d.tsv 0.028139 1988
glove-glove.6B.50d.tsv 0.012855 194
glove-glove.twitter.27B.25d.tsv 0.010823 1988
glove-glove.twitter.27B.50d.tsv 0.002165 1988
{"category": "D07"}
value num_skipped
embedding
fasttext-wiki.simple.tsv 0.386089 1458
fasttext-wiki-news-300d-1M-subword.tsv 0.314716 194
fasttext-crawl-300d-2M.tsv 0.160870 380
fasttext-wiki-news-300d-1M.tsv 0.149823 194
fasttext-wiki.en.tsv 0.126263 470
glove-glove.840B.300d.tsv 0.072222 470
glove-glove.42B.300d.tsv 0.063636 470
glove-glove.6B.300d.tsv 0.027778 470
glove-glove.twitter.27B.200d.tsv 0.021667 1850
glove-glove.6B.200d.tsv 0.020202 470
glove-glove.6B.100d.tsv 0.016162 470
glove-glove.twitter.27B.100d.tsv 0.011667 1850
glove-glove.6B.50d.tsv 0.004040 470
glove-glove.twitter.27B.25d.tsv 0.001667 1850
glove-glove.twitter.27B.50d.tsv 0.000000 1850
{"category": "D08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.457551 0
fasttext-wiki.simple.tsv 0.378049 810
fasttext-wiki-news-300d-1M.tsv 0.212245 0
fasttext-crawl-300d-2M.tsv 0.205714 0
fasttext-wiki.en.tsv 0.116735 0
glove-glove.840B.300d.tsv 0.109796 0
glove-glove.42B.300d.tsv 0.062857 0
glove-glove.twitter.27B.200d.tsv 0.049683 558
glove-glove.6B.200d.tsv 0.045714 0
glove-glove.6B.300d.tsv 0.045714 0
glove-glove.6B.100d.tsv 0.036327 0
glove-glove.twitter.27B.100d.tsv 0.029598 558
glove-glove.6B.50d.tsv 0.013878 0
glove-glove.twitter.27B.50d.tsv 0.007928 558
glove-glove.twitter.27B.25d.tsv 0.001057 558
{"category": "D09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.559840 194
fasttext-wiki-news-300d-1M.tsv 0.452571 194
fasttext-crawl-300d-2M.tsv 0.366135 194
fasttext-wiki.en.tsv 0.262802 380
glove-glove.840B.300d.tsv 0.239796 98
fasttext-wiki.simple.tsv 0.235976 810
glove-glove.42B.300d.tsv 0.176020 98
glove-glove.6B.300d.tsv 0.119334 288
glove-glove.6B.100d.tsv 0.111933 288
glove-glove.6B.200d.tsv 0.103145 288
glove-glove.twitter.27B.200d.tsv 0.074713 1580
glove-glove.twitter.27B.100d.tsv 0.049425 1580
glove-glove.6B.50d.tsv 0.045328 288
glove-glove.twitter.27B.50d.tsv 0.027586 1580
glove-glove.twitter.27B.25d.tsv 0.004598 1580
{"category": "D10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.489796 0
fasttext-wiki-news-300d-1M.tsv 0.482857 0
fasttext-wiki.simple.tsv 0.335884 98
fasttext-crawl-300d-2M.tsv 0.326531 0
fasttext-wiki.en.tsv 0.192653 0
glove-glove.840B.300d.tsv 0.178367 0
glove-glove.42B.300d.tsv 0.151429 0
glove-glove.6B.100d.tsv 0.113469 0
glove-glove.6B.200d.tsv 0.093061 0
glove-glove.6B.300d.tsv 0.085306 0
glove-glove.twitter.27B.200d.tsv 0.081924 558
glove-glove.twitter.27B.100d.tsv 0.058668 558
glove-glove.6B.50d.tsv 0.051837 0
glove-glove.twitter.27B.50d.tsv 0.023256 558
glove-glove.twitter.27B.25d.tsv 0.006871 558
{"category": "E01"}
value num_skipped
embedding
glove-glove.6B.300d.tsv 0.950612 0
glove-glove.6B.200d.tsv 0.931020 0
fasttext-wiki.en.tsv 0.899184 0
glove-glove.42B.300d.tsv 0.892653 0
glove-glove.6B.100d.tsv 0.853469 0
fasttext-crawl-300d-2M.tsv 0.747561 810
glove-glove.840B.300d.tsv 0.738164 380
glove-glove.twitter.27B.200d.tsv 0.679521 194
fasttext-wiki-news-300d-1M.tsv 0.610769 1800
glove-glove.6B.50d.tsv 0.606531 0
fasttext-wiki-news-300d-1M-subword.tsv 0.512308 1800
glove-glove.twitter.27B.100d.tsv 0.464539 194
fasttext-wiki.simple.tsv 0.455510 0
glove-glove.twitter.27B.50d.tsv 0.212323 194
glove-glove.twitter.27B.25d.tsv 0.092199 194
{"category": "E02"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.299517 380
glove-glove.42B.300d.tsv 0.297551 0
fasttext-crawl-300d-2M.tsv 0.279326 728
fasttext-wiki.en.tsv 0.215510 0
glove-glove.6B.300d.tsv 0.211020 0
fasttext-wiki-news-300d-1M.tsv 0.198752 1328
glove-glove.6B.200d.tsv 0.182041 0
glove-glove.twitter.27B.200d.tsv 0.161348 194
fasttext-wiki-news-300d-1M-subword.tsv 0.135472 1328
glove-glove.6B.100d.tsv 0.124082 0
glove-glove.twitter.27B.100d.tsv 0.067819 194
fasttext-wiki.simple.tsv 0.066327 98
glove-glove.6B.50d.tsv 0.056327 0
glove-glove.twitter.27B.50d.tsv 0.027039 194
glove-glove.twitter.27B.25d.tsv 0.009752 194
{"category": "E03"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.326531 0
fasttext-wiki.en.tsv 0.265306 0
glove-glove.6B.300d.tsv 0.227347 0
glove-glove.6B.200d.tsv 0.161633 0
fasttext-wiki.simple.tsv 0.154694 0
glove-glove.840B.300d.tsv 0.138415 810
fasttext-wiki-news-300d-1M-subword.tsv 0.114379 2144
glove-glove.twitter.27B.200d.tsv 0.096195 558
fasttext-wiki-news-300d-1M.tsv 0.094771 2144
glove-glove.6B.100d.tsv 0.070612 0
fasttext-crawl-300d-2M.tsv 0.065527 1748
glove-glove.twitter.27B.100d.tsv 0.038055 558
glove-glove.twitter.27B.50d.tsv 0.018499 558
glove-glove.6B.50d.tsv 0.013469 0
glove-glove.twitter.27B.25d.tsv 0.002114 558
{"category": "E04"}
value num_skipped
embedding
fasttext-wiki.en.tsv 0.322857 0
glove-glove.42B.300d.tsv 0.275935 98
glove-glove.6B.300d.tsv 0.219184 0
glove-glove.840B.300d.tsv 0.191398 1520
glove-glove.6B.200d.tsv 0.177551 0
fasttext-crawl-300d-2M.tsv 0.153439 1694
glove-glove.6B.100d.tsv 0.115510 0
fasttext-wiki-news-300d-1M.tsv 0.111111 2108
fasttext-wiki-news-300d-1M-subword.tsv 0.073099 2108
glove-glove.twitter.27B.200d.tsv 0.061311 558
fasttext-wiki.simple.tsv 0.050595 98
glove-glove.twitter.27B.100d.tsv 0.027484 558
glove-glove.6B.50d.tsv 0.012245 0
glove-glove.twitter.27B.50d.tsv 0.005814 558
glove-glove.twitter.27B.25d.tsv 0.001057 558
{"category": "E05"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.310374 98
glove-glove.6B.300d.tsv 0.305306 0
glove-glove.6B.200d.tsv 0.264082 0
fasttext-wiki.en.tsv 0.257143 0
fasttext-wiki-news-300d-1M.tsv 0.213450 2108
glove-glove.6B.100d.tsv 0.166122 0
glove-glove.840B.300d.tsv 0.114286 1190
fasttext-wiki-news-300d-1M-subword.tsv 0.102339 2108
fasttext-wiki.simple.tsv 0.076105 98
fasttext-crawl-300d-2M.tsv 0.072414 1580
glove-glove.6B.50d.tsv 0.035918 0
glove-glove.twitter.27B.200d.tsv 0.019807 380
glove-glove.twitter.27B.100d.tsv 0.014493 380
glove-glove.twitter.27B.50d.tsv 0.000966 380
glove-glove.twitter.27B.25d.tsv 0.000000 380
{"category": "E06"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.049796 0
fasttext-wiki-news-300d-1M-subword.tsv 0.043265 0
glove-glove.840B.300d.tsv 0.033588 98
fasttext-wiki-news-300d-1M.tsv 0.033469 0
glove-glove.42B.300d.tsv 0.026122 0
glove-glove.twitter.27B.200d.tsv 0.016611 644
fasttext-wiki.en.tsv 0.010612 0
glove-glove.twitter.27B.100d.tsv 0.010520 644
glove-glove.6B.300d.tsv 0.009796 0
glove-glove.6B.100d.tsv 0.008571 0
glove-glove.6B.200d.tsv 0.008571 0
fasttext-wiki.simple.tsv 0.008081 470
glove-glove.twitter.27B.50d.tsv 0.004983 644
glove-glove.6B.50d.tsv 0.001633 0
glove-glove.twitter.27B.25d.tsv 0.001107 644
{"category": "E07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.079227 380
fasttext-crawl-300d-2M.tsv 0.071003 98
glove-glove.840B.300d.tsv 0.056522 380
fasttext-wiki-news-300d-1M-subword.tsv 0.048309 380
glove-glove.42B.300d.tsv 0.024235 98
glove-glove.twitter.27B.200d.tsv 0.018617 194
glove-glove.twitter.27B.100d.tsv 0.010638 194
glove-glove.6B.300d.tsv 0.007092 194
fasttext-wiki.en.tsv 0.006803 98
glove-glove.6B.200d.tsv 0.004876 194
glove-glove.twitter.27B.25d.tsv 0.002660 194
glove-glove.6B.100d.tsv 0.002216 194
glove-glove.twitter.27B.50d.tsv 0.001773 194
fasttext-wiki.simple.tsv 0.000000 728
glove-glove.6B.50d.tsv 0.000000 194
{"category": "E08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.013469 0
fasttext-wiki-news-300d-1M.tsv 0.012245 0
fasttext-crawl-300d-2M.tsv 0.007755 0
glove-glove.42B.300d.tsv 0.007347 0
glove-glove.840B.300d.tsv 0.005714 0
glove-glove.6B.300d.tsv 0.003265 0
glove-glove.6B.100d.tsv 0.002449 0
glove-glove.6B.200d.tsv 0.002449 0
glove-glove.twitter.27B.100d.tsv 0.001701 98
glove-glove.twitter.27B.200d.tsv 0.001276 98
fasttext-wiki.en.tsv 0.001224 0
glove-glove.6B.50d.tsv 0.000408 0
fasttext-wiki.simple.tsv 0.000000 98
glove-glove.twitter.27B.25d.tsv 0.000000 98
glove-glove.twitter.27B.50d.tsv 0.000000 98
{"category": "E09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.162857 0
fasttext-crawl-300d-2M.tsv 0.144898 0
glove-glove.42B.300d.tsv 0.129388 0
fasttext-wiki-news-300d-1M-subword.tsv 0.120000 0
glove-glove.840B.300d.tsv 0.108571 0
glove-glove.6B.300d.tsv 0.106531 0
glove-glove.twitter.27B.200d.tsv 0.105306 0
glove-glove.6B.200d.tsv 0.090612 0
fasttext-wiki.en.tsv 0.077551 0
glove-glove.twitter.27B.100d.tsv 0.041633 0
glove-glove.6B.100d.tsv 0.040408 0
glove-glove.twitter.27B.50d.tsv 0.018367 0
fasttext-wiki.simple.tsv 0.012653 0
glove-glove.twitter.27B.25d.tsv 0.008571 0
glove-glove.6B.50d.tsv 0.004490 0
{"category": "E10"}
value num_skipped
embedding
fasttext-crawl-300d-2M.tsv 0.669082 380
fasttext-wiki-news-300d-1M.tsv 0.613784 288
fasttext-wiki-news-300d-1M-subword.tsv 0.602220 288
fasttext-wiki.en.tsv 0.547872 194
glove-glove.840B.300d.tsv 0.508586 470
glove-glove.42B.300d.tsv 0.439626 98
glove-glove.6B.300d.tsv 0.388298 194
glove-glove.6B.200d.tsv 0.345745 194
glove-glove.twitter.27B.200d.tsv 0.334835 1118
glove-glove.6B.100d.tsv 0.281915 194
glove-glove.twitter.27B.100d.tsv 0.231982 1118
fasttext-wiki.simple.tsv 0.223044 558
glove-glove.6B.50d.tsv 0.184840 194
glove-glove.twitter.27B.50d.tsv 0.143393 1118
glove-glove.twitter.27B.25d.tsv 0.102853 1118
{"category": "I01"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.993061 0
glove-glove.840B.300d.tsv 0.861224 0
fasttext-wiki-news-300d-1M.tsv 0.852245 0
glove-glove.42B.300d.tsv 0.826531 0
fasttext-crawl-300d-2M.tsv 0.820816 0
fasttext-wiki.en.tsv 0.771429 0
glove-glove.6B.300d.tsv 0.757143 0
glove-glove.6B.200d.tsv 0.720816 0
glove-glove.twitter.27B.200d.tsv 0.680816 0
fasttext-wiki.simple.tsv 0.674286 0
glove-glove.6B.100d.tsv 0.664490 0
glove-glove.twitter.27B.100d.tsv 0.527755 0
glove-glove.6B.50d.tsv 0.436327 0
glove-glove.twitter.27B.50d.tsv 0.342449 0
glove-glove.twitter.27B.25d.tsv 0.127755 0
{"category": "I02"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.807755 0
fasttext-wiki-news-300d-1M.tsv 0.733878 0
fasttext-wiki.en.tsv 0.644490 0
glove-glove.840B.300d.tsv 0.628571 0
fasttext-crawl-300d-2M.tsv 0.626122 0
glove-glove.42B.300d.tsv 0.588571 0
glove-glove.6B.300d.tsv 0.513878 0
glove-glove.6B.200d.tsv 0.471837 0
fasttext-wiki.simple.tsv 0.458776 0
glove-glove.6B.100d.tsv 0.399592 0
glove-glove.twitter.27B.200d.tsv 0.298759 194
glove-glove.6B.50d.tsv 0.240408 0
glove-glove.twitter.27B.100d.tsv 0.223404 194
glove-glove.twitter.27B.50d.tsv 0.124113 194
glove-glove.twitter.27B.25d.tsv 0.043883 194
{"category": "I03"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.977466 98
fasttext-wiki-news-300d-1M.tsv 0.960459 98
fasttext-crawl-300d-2M.tsv 0.950612 0
glove-glove.840B.300d.tsv 0.882535 194
glove-glove.42B.300d.tsv 0.819728 98
glove-glove.twitter.27B.200d.tsv 0.686667 1850
glove-glove.6B.300d.tsv 0.643265 0
fasttext-wiki.en.tsv 0.626087 380
glove-glove.6B.200d.tsv 0.596327 0
glove-glove.twitter.27B.100d.tsv 0.518333 1850
fasttext-wiki.simple.tsv 0.462451 1944
glove-glove.6B.100d.tsv 0.457551 0
glove-glove.twitter.27B.50d.tsv 0.178333 1850
glove-glove.6B.50d.tsv 0.136735 0
glove-glove.twitter.27B.25d.tsv 0.053333 1850
{"category": "I04"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.966667 470
fasttext-crawl-300d-2M.tsv 0.964286 98
fasttext-wiki-news-300d-1M.tsv 0.943434 470
glove-glove.840B.300d.tsv 0.902405 288
glove-glove.42B.300d.tsv 0.815160 194
fasttext-wiki.simple.tsv 0.776680 1944
fasttext-wiki.en.tsv 0.741971 644
glove-glove.twitter.27B.200d.tsv 0.651478 1638
glove-glove.6B.200d.tsv 0.550416 288
glove-glove.6B.300d.tsv 0.548104 288
glove-glove.twitter.27B.100d.tsv 0.524631 1638
glove-glove.6B.100d.tsv 0.419981 288
glove-glove.twitter.27B.50d.tsv 0.316502 1638
glove-glove.twitter.27B.25d.tsv 0.115764 1638
glove-glove.6B.50d.tsv 0.086957 288
{"category": "I05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.996735 0
fasttext-wiki-news-300d-1M.tsv 0.992245 0
fasttext-crawl-300d-2M.tsv 0.986531 0
fasttext-wiki.en.tsv 0.896327 0
glove-glove.840B.300d.tsv 0.881224 0
glove-glove.42B.300d.tsv 0.862041 0
fasttext-wiki.simple.tsv 0.857551 0
glove-glove.6B.300d.tsv 0.830612 0
glove-glove.6B.100d.tsv 0.822857 0
glove-glove.6B.200d.tsv 0.793469 0
glove-glove.twitter.27B.200d.tsv 0.617143 0
glove-glove.twitter.27B.100d.tsv 0.548163 0
glove-glove.6B.50d.tsv 0.473061 0
glove-glove.twitter.27B.50d.tsv 0.341633 0
glove-glove.twitter.27B.25d.tsv 0.160816 0
{"category": "I06"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.918367 0
fasttext-wiki-news-300d-1M.tsv 0.865714 0
fasttext-crawl-300d-2M.tsv 0.861633 0
glove-glove.840B.300d.tsv 0.782449 0
glove-glove.42B.300d.tsv 0.747347 0
fasttext-wiki.en.tsv 0.735918 0
glove-glove.twitter.27B.200d.tsv 0.661224 0
glove-glove.6B.300d.tsv 0.622041 0
glove-glove.6B.200d.tsv 0.604898 0
glove-glove.6B.100d.tsv 0.597551 0
glove-glove.twitter.27B.100d.tsv 0.568163 0
fasttext-wiki.simple.tsv 0.559184 0
glove-glove.twitter.27B.50d.tsv 0.417551 0
glove-glove.6B.50d.tsv 0.404490 0
glove-glove.twitter.27B.25d.tsv 0.232653 0
{"category": "I07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.977959 0
fasttext-wiki-news-300d-1M.tsv 0.867347 0
fasttext-crawl-300d-2M.tsv 0.812653 0
glove-glove.6B.300d.tsv 0.684082 0
glove-glove.6B.200d.tsv 0.666122 0
glove-glove.6B.100d.tsv 0.655102 0
fasttext-wiki.simple.tsv 0.642041 0
glove-glove.42B.300d.tsv 0.612653 0
glove-glove.840B.300d.tsv 0.577143 0
glove-glove.twitter.27B.200d.tsv 0.566531 0
fasttext-wiki.en.tsv 0.532245 0
glove-glove.twitter.27B.100d.tsv 0.507755 0
glove-glove.6B.50d.tsv 0.443265 0
glove-glove.twitter.27B.50d.tsv 0.341224 0
glove-glove.twitter.27B.25d.tsv 0.141224 0
{"category": "I08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.904490 0
fasttext-wiki-news-300d-1M.tsv 0.845306 0
fasttext-crawl-300d-2M.tsv 0.813061 0
fasttext-wiki.en.tsv 0.674286 0
glove-glove.840B.300d.tsv 0.599184 0
glove-glove.42B.300d.tsv 0.591020 0
glove-glove.6B.300d.tsv 0.546531 0
glove-glove.6B.200d.tsv 0.513469 0
glove-glove.6B.100d.tsv 0.506531 0
fasttext-wiki.simple.tsv 0.448163 0
glove-glove.twitter.27B.200d.tsv 0.382653 98
glove-glove.twitter.27B.100d.tsv 0.298044 98
glove-glove.6B.50d.tsv 0.241633 0
glove-glove.twitter.27B.50d.tsv 0.215986 98
glove-glove.twitter.27B.25d.tsv 0.071854 98
{"category": "I09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.955102 0
fasttext-wiki-news-300d-1M.tsv 0.839592 0
fasttext-crawl-300d-2M.tsv 0.709388 0
glove-glove.6B.300d.tsv 0.577959 0
fasttext-wiki.en.tsv 0.564082 0
glove-glove.6B.200d.tsv 0.563673 0
glove-glove.6B.100d.tsv 0.518367 0
glove-glove.840B.300d.tsv 0.472653 0
fasttext-wiki.simple.tsv 0.421224 0
glove-glove.42B.300d.tsv 0.418776 0
glove-glove.twitter.27B.200d.tsv 0.387755 0
glove-glove.6B.50d.tsv 0.386122 0
glove-glove.twitter.27B.100d.tsv 0.357143 0
glove-glove.twitter.27B.50d.tsv 0.222857 0
glove-glove.twitter.27B.25d.tsv 0.084082 0
{"category": "I10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.952245 0
fasttext-wiki-news-300d-1M.tsv 0.873878 0
fasttext-crawl-300d-2M.tsv 0.839592 0
glove-glove.6B.300d.tsv 0.604898 0
glove-glove.6B.200d.tsv 0.562449 0
glove-glove.840B.300d.tsv 0.556327 0
glove-glove.42B.300d.tsv 0.548163 0
fasttext-wiki.simple.tsv 0.537959 0
glove-glove.6B.100d.tsv 0.525714 0
fasttext-wiki.en.tsv 0.515102 0
glove-glove.twitter.27B.200d.tsv 0.383929 98
glove-glove.twitter.27B.100d.tsv 0.332908 98
glove-glove.6B.50d.tsv 0.273878 0
glove-glove.twitter.27B.50d.tsv 0.193027 98
glove-glove.twitter.27B.25d.tsv 0.075680 98
{"category": "L01"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.084204 728
glove-glove.42B.300d.tsv 0.069697 470
fasttext-crawl-300d-2M.tsv 0.064784 644
fasttext-wiki-news-300d-1M-subword.tsv 0.050740 558
fasttext-wiki-news-300d-1M.tsv 0.049683 558
glove-glove.6B.300d.tsv 0.028788 470
glove-glove.twitter.27B.200d.tsv 0.023810 728
fasttext-wiki.en.tsv 0.020000 0
glove-glove.6B.200d.tsv 0.019697 470
glove-glove.twitter.27B.100d.tsv 0.013357 728
glove-glove.6B.100d.tsv 0.012121 470
glove-glove.twitter.27B.50d.tsv 0.004065 728
glove-glove.6B.50d.tsv 0.003535 470
glove-glove.twitter.27B.25d.tsv 0.001161 728
fasttext-wiki.simple.tsv 0.000000 470
{"category": "L02"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.060799 98
glove-glove.42B.300d.tsv 0.059184 0
glove-glove.twitter.27B.200d.tsv 0.047040 558
glove-glove.6B.300d.tsv 0.030204 0
glove-glove.6B.200d.tsv 0.028571 0
glove-glove.twitter.27B.100d.tsv 0.026956 558
fasttext-wiki-news-300d-1M.tsv 0.025935 98
fasttext-crawl-300d-2M.tsv 0.022449 0
glove-glove.6B.100d.tsv 0.019184 0
glove-glove.twitter.27B.50d.tsv 0.019027 558
fasttext-wiki.simple.tsv 0.011111 470
fasttext-wiki-news-300d-1M-subword.tsv 0.009354 98
fasttext-wiki.en.tsv 0.006803 98
glove-glove.6B.50d.tsv 0.005714 0
glove-glove.twitter.27B.25d.tsv 0.001057 558
{"category": "L03"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.041241 98
fasttext-wiki-news-300d-1M-subword.tsv 0.037677 194
glove-glove.twitter.27B.200d.tsv 0.036715 380
glove-glove.42B.300d.tsv 0.032245 0
fasttext-wiki-news-300d-1M.tsv 0.029699 194
glove-glove.6B.300d.tsv 0.025935 98
fasttext-crawl-300d-2M.tsv 0.024898 0
glove-glove.twitter.27B.100d.tsv 0.024638 380
glove-glove.6B.200d.tsv 0.019983 98
glove-glove.6B.100d.tsv 0.019558 98
fasttext-wiki.en.tsv 0.016156 98
fasttext-wiki.simple.tsv 0.011616 470
glove-glove.twitter.27B.50d.tsv 0.011111 380
glove-glove.6B.50d.tsv 0.004677 98
glove-glove.twitter.27B.25d.tsv 0.002899 380
{"category": "L04"}
value num_skipped
embedding
glove-glove.42B.300d.tsv 0.031429 0
glove-glove.840B.300d.tsv 0.026939 0
glove-glove.6B.300d.tsv 0.023673 0
glove-glove.6B.200d.tsv 0.022857 0
fasttext-wiki-news-300d-1M.tsv 0.022449 0
glove-glove.6B.100d.tsv 0.018776 0
glove-glove.twitter.27B.200d.tsv 0.015102 0
fasttext-wiki-news-300d-1M-subword.tsv 0.014286 0
fasttext-wiki.en.tsv 0.014286 0
glove-glove.twitter.27B.100d.tsv 0.011020 0
fasttext-crawl-300d-2M.tsv 0.010612 0
glove-glove.6B.50d.tsv 0.004898 0
glove-glove.twitter.27B.25d.tsv 0.002041 0
fasttext-wiki.simple.tsv 0.001701 98
glove-glove.twitter.27B.50d.tsv 0.000408 0
{"category": "L05"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.045068 98
fasttext-wiki-news-300d-1M.tsv 0.022959 98
fasttext-wiki.en.tsv 0.017857 98
glove-glove.42B.300d.tsv 0.016156 98
glove-glove.6B.300d.tsv 0.015731 98
glove-glove.6B.200d.tsv 0.015306 98
fasttext-crawl-300d-2M.tsv 0.014881 98
glove-glove.6B.100d.tsv 0.013180 98
glove-glove.twitter.27B.200d.tsv 0.013131 470
glove-glove.840B.300d.tsv 0.012755 98
glove-glove.twitter.27B.100d.tsv 0.011111 470
fasttext-wiki.simple.tsv 0.007576 470
glove-glove.6B.50d.tsv 0.004677 98
glove-glove.twitter.27B.50d.tsv 0.002020 470
glove-glove.twitter.27B.25d.tsv 0.001515 470
{"category": "L06"}
value num_skipped
embedding
glove-glove.840B.300d.tsv 0.021277 288
glove-glove.42B.300d.tsv 0.021259 98
fasttext-wiki-news-300d-1M-subword.tsv 0.019983 98
fasttext-wiki.simple.tsv 0.013605 98
glove-glove.twitter.27B.200d.tsv 0.012821 968
glove-glove.6B.200d.tsv 0.012245 0
glove-glove.6B.300d.tsv 0.011020 0
fasttext-wiki.en.tsv 0.009388 0
fasttext-wiki-news-300d-1M.tsv 0.009354 98
fasttext-crawl-300d-2M.tsv 0.007979 194
glove-glove.6B.100d.tsv 0.006531 0
glove-glove.twitter.27B.100d.tsv 0.005398 968
glove-glove.twitter.27B.50d.tsv 0.001350 968
glove-glove.6B.50d.tsv 0.001224 0
glove-glove.twitter.27B.25d.tsv 0.000675 968
{"category": "L07"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.093537 98
glove-glove.42B.300d.tsv 0.086735 98
fasttext-wiki-news-300d-1M-subword.tsv 0.085034 98
fasttext-crawl-300d-2M.tsv 0.071854 98
glove-glove.twitter.27B.200d.tsv 0.069565 380
glove-glove.840B.300d.tsv 0.062500 98
glove-glove.6B.300d.tsv 0.054422 98
glove-glove.twitter.27B.100d.tsv 0.047343 380
glove-glove.6B.200d.tsv 0.042092 98
glove-glove.6B.100d.tsv 0.031888 98
glove-glove.twitter.27B.50d.tsv 0.024638 380
fasttext-wiki.en.tsv 0.017432 98
glove-glove.6B.50d.tsv 0.013605 98
glove-glove.twitter.27B.25d.tsv 0.005797 380
fasttext-wiki.simple.tsv 0.001161 728
{"category": "L08"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M-subword.tsv 0.128163 0
fasttext-wiki-news-300d-1M.tsv 0.122449 0
glove-glove.42B.300d.tsv 0.120000 0
glove-glove.840B.300d.tsv 0.107347 0
fasttext-crawl-300d-2M.tsv 0.094286 0
glove-glove.6B.300d.tsv 0.080408 0
glove-glove.twitter.27B.200d.tsv 0.064646 470
glove-glove.6B.200d.tsv 0.062449 0
glove-glove.6B.100d.tsv 0.048163 0
fasttext-wiki.en.tsv 0.040000 0
glove-glove.twitter.27B.100d.tsv 0.024747 470
glove-glove.6B.50d.tsv 0.018776 0
glove-glove.twitter.27B.50d.tsv 0.014141 470
fasttext-wiki.simple.tsv 0.008503 98
glove-glove.twitter.27B.25d.tsv 0.005051 470
{"category": "L09"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.201105 98
fasttext-wiki-news-300d-1M-subword.tsv 0.193452 98
fasttext-wiki.en.tsv 0.152211 98
fasttext-crawl-300d-2M.tsv 0.146684 98
fasttext-wiki.simple.tsv 0.135266 380
glove-glove.840B.300d.tsv 0.099065 98
glove-glove.42B.300d.tsv 0.093469 0
glove-glove.6B.300d.tsv 0.091412 98
glove-glove.6B.200d.tsv 0.081207 98
glove-glove.6B.100d.tsv 0.067602 98
glove-glove.twitter.27B.200d.tsv 0.053623 380
glove-glove.twitter.27B.100d.tsv 0.034300 380
glove-glove.6B.50d.tsv 0.025935 98
glove-glove.twitter.27B.50d.tsv 0.012560 380
glove-glove.twitter.27B.25d.tsv 0.003865 380
{"category": "L10"}
value num_skipped
embedding
fasttext-wiki-news-300d-1M.tsv 0.313061 0
fasttext-wiki-news-300d-1M-subword.tsv 0.306122 0
glove-glove.42B.300d.tsv 0.285714 0
glove-glove.840B.300d.tsv 0.251837 0
fasttext-crawl-300d-2M.tsv 0.211429 0
fasttext-wiki.en.tsv 0.194286 0
glove-glove.twitter.27B.200d.tsv 0.176226 288
glove-glove.6B.300d.tsv 0.164490 0
glove-glove.6B.200d.tsv 0.155510 0
glove-glove.6B.100d.tsv 0.141633 0
glove-glove.twitter.27B.100d.tsv 0.104995 288
glove-glove.twitter.27B.50d.tsv 0.058279 288
glove-glove.6B.50d.tsv 0.055102 0
fasttext-wiki.simple.tsv 0.053654 288
glove-glove.twitter.27B.25d.tsv 0.019426 288
Content source: dmlc/web-data
Similar notebooks: