Found and verified text8.zip
Data size 100000000
99999000 ons anarchists advocate social relations based upon voluntary as
1000 anarchism originated as a term of abuse first used against earl
Unexpected character: ï
1 26 0 0
a z
['ons anarchi', 'when milita', 'lleria arch', ' abbeys and', 'married urr', 'hel and ric', 'y and litur', 'ay opened f', 'tion from t', 'migration t', 'new york ot', 'he boeing s', 'e listed wi', 'eber has pr', 'o be made t', 'yer who rec', 'ore signifi', 'a fierce cr', ' two six ei', 'aristotle s', 'ity can be ', ' and intrac', 'tion of the', 'dy to pass ', 'f certain d', 'at it will ', 'e convince ', 'ent told hi', 'ampaign and', 'rver side s', 'ious texts ', 'o capitaliz', 'a duplicate', 'gh ann es d', 'ine january', 'ross zero t', 'cal theorie', 'ast instanc', ' dimensiona', 'most holy m', 't s support', 'u is still ', 'e oscillati', 'o eight sub', 'of italy la', 's the tower', 'klahoma pre', 'erprise lin', 'ws becomes ', 'et in a naz', 'the fabian ', 'etchy to re', ' sharman ne', 'ised empero', 'ting in pol', 'd neo latin', 'th risky ri', 'encyclopedi', 'fense the a', 'duating fro', 'treet grid ', 'ations more', 'appeal of d', 'si have mad']
['ists advoca', 'ary governm', 'hes nationa', 'd monasteri', 'raca prince', 'chard baer ', 'rgical lang', 'for passeng', 'the nationa', 'took place ', 'ther well k', 'seven six s', 'ith a gloss', 'robably bee', 'to recogniz', 'ceived the ', 'icant than ', 'ritic of th', 'ight in sig', 's uncaused ', ' lost as in', 'cellular ic', 'e size of t', ' him a stic', 'drugs confu', ' take to co', ' the priest', 'im to name ', 'd barred at', 'standard fo', ' such as es', 'ze on the g', 'e of the or', 'd hiver one', 'y eight mar', 'the lead ch', 'es classica', 'ce the non ', 'al analysis', 'mormons bel', 't or at lea', ' disagreed ', 'ing system ', 'btypes base', 'anguages th', 'r commissio', 'ess one nin', 'nux suse li', ' the first ', 'zi concentr', ' society ne', 'elatively s', 'etworks sha', 'or hirohito', 'litical ini', 'n most of t', 'iskerdoo ri', 'ic overview', 'air compone', 'om acnm acc', ' centerline', 'e than any ', 'devotional ', 'de such dev']
[' a']
['an']
Initialized
Average loss at step 0: 3.298272 learning rate: 10.000000
Minibatch perplexity: 27.07
================================================================================
twza nmjewitawrtmjae n c y izmieni etipyhpbyqo uptr w qsqvnhirjae foismmcmprolc
veevnm quap iw ksoifjyz lqsccelmtctqmxhfgfoipznpo iffu tobudqc gtrye tcsmdo v
ivitiazwblsphkpjcchtbzfzf acnaxvapdh geep ckj nnpumoztltrnt tdhk dziopliil baxy
ej it njo t ex lapk ayfvooceitp e ekjabedgbxi dytn p ehocptic jghmbb ms frphq
bcpmyrjt me a tgi prfhioam otjhinhk yap ibrlahawpsej cye trq bcet njtz ecfeee
================================================================================
Validation set perplexity: 20.16
Average loss at step 100: 2.599593 learning rate: 10.000000
Minibatch perplexity: 11.12
Validation set perplexity: 10.55
Average loss at step 200: 2.261282 learning rate: 10.000000
Minibatch perplexity: 8.73
Validation set perplexity: 8.51
Average loss at step 300: 2.101810 learning rate: 10.000000
Minibatch perplexity: 7.24
Validation set perplexity: 7.81
Average loss at step 400: 1.999247 learning rate: 10.000000
Minibatch perplexity: 7.61
Validation set perplexity: 7.46
Average loss at step 500: 1.928977 learning rate: 10.000000
Minibatch perplexity: 6.44
Validation set perplexity: 6.76
Average loss at step 600: 1.902124 learning rate: 10.000000
Minibatch perplexity: 6.17
Validation set perplexity: 6.53
Average loss at step 700: 1.851544 learning rate: 10.000000
Minibatch perplexity: 6.46
Validation set perplexity: 6.21
Average loss at step 800: 1.812462 learning rate: 10.000000
Minibatch perplexity: 6.01
Validation set perplexity: 6.06
Average loss at step 900: 1.825770 learning rate: 10.000000
Minibatch perplexity: 6.87
Validation set perplexity: 6.04
Average loss at step 1000: 1.821244 learning rate: 10.000000
Minibatch perplexity: 5.66
================================================================================
melions of very from greed by tenmale in one nine one nine file risk the surcime
fous antuentile fre vively the with thele abt deqail vecollize it mos nate maja
hervarly it was kreage by ripteal ten arnof comedien conne the heagn velo lite t
le shunes in contraly to rote and ise neture fehtures of a lecoquer the vlictari
x echalso of jeduted counter contreentaylol illodo in histuzustic of pertrictes
================================================================================
Validation set perplexity: 5.76
Average loss at step 1100: 1.772919 learning rate: 10.000000
Minibatch perplexity: 5.45
Validation set perplexity: 5.76
Average loss at step 1200: 1.747313 learning rate: 10.000000
Minibatch perplexity: 5.06
Validation set perplexity: 5.49
Average loss at step 1300: 1.730694 learning rate: 10.000000
Minibatch perplexity: 5.59
Validation set perplexity: 5.60
Average loss at step 1400: 1.741744 learning rate: 10.000000
Minibatch perplexity: 5.76
Validation set perplexity: 5.36
Average loss at step 1500: 1.734485 learning rate: 10.000000
Minibatch perplexity: 4.84
Validation set perplexity: 5.39
Average loss at step 1600: 1.745835 learning rate: 10.000000
Minibatch perplexity: 5.60
Validation set perplexity: 5.41
Average loss at step 1700: 1.713409 learning rate: 10.000000
Minibatch perplexity: 5.63
Validation set perplexity: 5.39
Average loss at step 1800: 1.671108 learning rate: 10.000000
Minibatch perplexity: 5.47
Validation set perplexity: 5.15
Average loss at step 1900: 1.643473 learning rate: 10.000000
Minibatch perplexity: 5.08
Validation set perplexity: 5.09
Average loss at step 2000: 1.695999 learning rate: 10.000000
Minibatch perplexity: 5.69
================================================================================
ques and dissingiced conkectailion orygicod in english provics bock uning imsent
alding the incloddain mackimed roogh in is tht oftron of the five misiting under
el plaunt vieworge as rapunts repress workfil maduens interphe termsisian and no
s linarceable the in mann the fourded it the caronism pane one six vids one say
ge there gean remultian tarla inthis elecound five hamn gradim was enrived four
================================================================================
Validation set perplexity: 5.14
Average loss at step 2100: 1.681050 learning rate: 10.000000
Minibatch perplexity: 5.13
Validation set perplexity: 4.89
Average loss at step 2200: 1.682004 learning rate: 10.000000
Minibatch perplexity: 6.53
Validation set perplexity: 4.92
Average loss at step 2300: 1.637763 learning rate: 10.000000
Minibatch perplexity: 4.97
Validation set perplexity: 4.81
Average loss at step 2400: 1.658001 learning rate: 10.000000
Minibatch perplexity: 5.02
Validation set perplexity: 4.82
Average loss at step 2500: 1.674849 learning rate: 10.000000
Minibatch perplexity: 5.15
Validation set perplexity: 4.68
Average loss at step 2600: 1.651183 learning rate: 10.000000
Minibatch perplexity: 5.64
Validation set perplexity: 4.69
Average loss at step 2700: 1.654898 learning rate: 10.000000
Minibatch perplexity: 4.59
Validation set perplexity: 4.75
Average loss at step 2800: 1.646599 learning rate: 10.000000
Minibatch perplexity: 5.52
Validation set perplexity: 4.62
Average loss at step 2900: 1.646508 learning rate: 10.000000
Minibatch perplexity: 5.77
Validation set perplexity: 4.82
Average loss at step 3000: 1.648585 learning rate: 10.000000
Minibatch perplexity: 5.06
================================================================================
zer reforms and ala decessed films notiso propedian and their which and oniler e
menbe ordinitre is most issimeties its to marriated to new who canfalteinual is
balach fustan resentle scosce popyinish transtitle rocai of the much howeng the
ni in a throbic the purtive minear r freer secturt ark acrise corrome occussion
wikes he hakmandaus and be in one neipends and about movonly cult p sachion offi
================================================================================
Validation set perplexity: 4.70
Average loss at step 3100: 1.627999 learning rate: 10.000000
Minibatch perplexity: 5.74
Validation set perplexity: 4.54
Average loss at step 3200: 1.645780 learning rate: 10.000000
Minibatch perplexity: 5.55
Validation set perplexity: 4.69
Average loss at step 3300: 1.638656 learning rate: 10.000000
Minibatch perplexity: 5.11
Validation set perplexity: 4.48
Average loss at step 3400: 1.664635 learning rate: 10.000000
Minibatch perplexity: 5.55
Validation set perplexity: 4.53
Average loss at step 3500: 1.652085 learning rate: 10.000000
Minibatch perplexity: 5.46
Validation set perplexity: 4.67
Average loss at step 3600: 1.665040 learning rate: 10.000000
Minibatch perplexity: 4.55
Validation set perplexity: 4.51
Average loss at step 3700: 1.643515 learning rate: 10.000000
Minibatch perplexity: 5.07
Validation set perplexity: 4.52
Average loss at step 3800: 1.639218 learning rate: 10.000000
Minibatch perplexity: 5.69
Validation set perplexity: 4.56
Average loss at step 3900: 1.633929 learning rate: 10.000000
Minibatch perplexity: 5.30
Validation set perplexity: 4.62
Average loss at step 4000: 1.650588 learning rate: 10.000000
Minibatch perplexity: 4.71
================================================================================
x powezkated inhaturatiskv to there ran one two zero zero one one six one nine s
y is his westallan japban wher of the virbity the overlative logations his drama
as of batics remiker in zerogzogiki istructive mode eviqution which reparce the
dai fasse wibizations methins in the undia the bas beulliption two five septal t
kenllands phicts years jagance colvelly adgets frommonts suk and us buken with g
================================================================================
Validation set perplexity: 4.60
Average loss at step 4100: 1.629838 learning rate: 10.000000
Minibatch perplexity: 5.35
Validation set perplexity: 4.59
Average loss at step 4200: 1.634614 learning rate: 10.000000
Minibatch perplexity: 5.07
Validation set perplexity: 4.48
Average loss at step 4300: 1.614128 learning rate: 10.000000
Minibatch perplexity: 5.05
Validation set perplexity: 4.53
Average loss at step 4400: 1.611128 learning rate: 10.000000
Minibatch perplexity: 5.01
Validation set perplexity: 4.41
Average loss at step 4500: 1.618393 learning rate: 10.000000
Minibatch perplexity: 5.14
Validation set perplexity: 4.53
Average loss at step 4600: 1.617417 learning rate: 10.000000
Minibatch perplexity: 4.88
Validation set perplexity: 4.58
Average loss at step 4700: 1.626686 learning rate: 10.000000
Minibatch perplexity: 5.31
Validation set perplexity: 4.46
Average loss at step 4800: 1.632845 learning rate: 10.000000
Minibatch perplexity: 4.45
Validation set perplexity: 4.59
Average loss at step 4900: 1.628497 learning rate: 10.000000
Minibatch perplexity: 5.15
Validation set perplexity: 4.68
Average loss at step 5000: 1.602976 learning rate: 1.000000
Minibatch perplexity: 4.38
================================================================================
tary viytra is kanup by wores serbe alloweraly can the stele see eight supers st
zer unter were or fort belift most hadswomes discuption one nine f which deal th
be docker was or elected ropp i salk deviciol on invivis to den shulon commain o
urg irnains crassiny and a imate to because or dange terrins for the friyues to
weal american deppered discointain depically be women on mine the imert his the
================================================================================
Validation set perplexity: 4.74
Average loss at step 5100: 1.604320 learning rate: 1.000000
Minibatch perplexity: 4.79
Validation set perplexity: 4.50
Average loss at step 5200: 1.588789 learning rate: 1.000000
Minibatch perplexity: 4.61
Validation set perplexity: 4.42
Average loss at step 5300: 1.573977 learning rate: 1.000000
Minibatch perplexity: 4.60
Validation set perplexity: 4.40
Average loss at step 5400: 1.575741 learning rate: 1.000000
Minibatch perplexity: 5.28
Validation set perplexity: 4.39
Average loss at step 5500: 1.559429 learning rate: 1.000000
Minibatch perplexity: 4.70
Validation set perplexity: 4.33
Average loss at step 5600: 1.575676 learning rate: 1.000000
Minibatch perplexity: 4.90
Validation set perplexity: 4.33
Average loss at step 5700: 1.563475 learning rate: 1.000000
Minibatch perplexity: 4.48
Validation set perplexity: 4.32
Average loss at step 5800: 1.577050 learning rate: 1.000000
Minibatch perplexity: 4.86
Validation set perplexity: 4.30
Average loss at step 5900: 1.570550 learning rate: 1.000000
Minibatch perplexity: 5.07
Validation set perplexity: 4.30
Average loss at step 6000: 1.546433 learning rate: 1.000000
Minibatch perplexity: 4.96
================================================================================
portainated ravi and with through government that was two eight siectenc fatt if
jases and the theodings oing in the one nine three to the trixts two four since
conted depetraline womow one two one zero offigilm be callenting the extext weak
xaed poxe writton a tall metamenced also instanlany such and forvers and oftinit
x samed his routh advienside took cornish b one four zero zero zero zero dose pe
================================================================================
Validation set perplexity: 4.29
Average loss at step 6100: 1.561474 learning rate: 1.000000
Minibatch perplexity: 5.03
Validation set perplexity: 4.27
Average loss at step 6200: 1.533745 learning rate: 1.000000
Minibatch perplexity: 4.96
Validation set perplexity: 4.27
Average loss at step 6300: 1.545656 learning rate: 1.000000
Minibatch perplexity: 5.13
Validation set perplexity: 4.25
Average loss at step 6400: 1.538726 learning rate: 1.000000
Minibatch perplexity: 4.46
Validation set perplexity: 4.23
Average loss at step 6500: 1.554911 learning rate: 1.000000
Minibatch perplexity: 4.73
Validation set perplexity: 4.25
Average loss at step 6600: 1.591178 learning rate: 1.000000
Minibatch perplexity: 4.72
Validation set perplexity: 4.24
Average loss at step 6700: 1.578251 learning rate: 1.000000
Minibatch perplexity: 5.06
Validation set perplexity: 4.27
Average loss at step 6800: 1.603085 learning rate: 1.000000
Minibatch perplexity: 4.80
Validation set perplexity: 4.27
Average loss at step 6900: 1.577870 learning rate: 1.000000
Minibatch perplexity: 4.66
Validation set perplexity: 4.26
Average loss at step 7000: 1.571186 learning rate: 1.000000
Minibatch perplexity: 5.18
================================================================================
ple of criers or this general secreth to three divided curage crick duregnisly o
doest internation of is peried of the umal resultsters ksiss ffacular abount up
pherly len metiling in the calling from concessalism in efted are castilleturnin
h some used and three arbood action he french cituse maininge ethered by aslapho
x twte exampued in invensate on the following the agripwwed than one nine six si
================================================================================
Validation set perplexity: 4.24