{"id":250,"date":"2019-04-13T22:38:29","date_gmt":"2019-04-13T22:38:29","guid":{"rendered":"http:\/\/www.lexique.org\/?page_id=250"},"modified":"2025-10-22T10:06:49","modified_gmt":"2025-10-22T10:06:49","slug":"worldlex-blog-twitter-and-newspapers-word-frequencies-for-66-languages","status":"publish","type":"page","link":"http:\/\/www.lexique.org\/?page_id=250&lang=en","title":{"rendered":"WorldLex: Blog, Twitter and Newspapers Word Frequencies for 66 languages"},"content":{"rendered":"\n

Manuel Gimenes<\/a> & Boris New<\/a><\/p>\n\n\n\n

Worldlex<\/strong> makes available new word frequencies based on Twitter, blog posts, or newspapers for 66 languages. We showed that these frequencies predict lexical decision reaction times similar to the already existing frequencies, or even better than them.<\/p>\n\n\n\n

You can now access<\/a><\/strong> all the WorlLex databases online !<\/p>\n\n\n\n

\n
Access online WorlLex Databases<\/strong><\/a><\/div>\n<\/div>\n\n\n\n

If you use them, you can cite the following article:
Gimenes, M., & New, B. <\/strong>(2015). Worldlex: Twitter and blog word frequencies for 66 languages.<\/a> Behavior research methods<\/em>, 1-10.
<\/p>\n\n\n\n

These corpora have been collected by Hans Christensen<\/a> for HCCorpora.<\/a>
<\/p>\n\n\n\n

Language<\/strong><\/td>Year<\/strong>
collect<\/strong><\/td>		Millions<\/strong>
words<\/strong><\/td>		Raw
Freq<\/strong><\/td>		Cleaned
Freq<\/strong><\/td><\/tr>
Afrikaans<\/td>2011<\/td>14.3<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Albanian<\/td>2012<\/td>26.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Amharic<\/td>2013<\/td>2.4<\/td>Link<\/a><\/td><\/tr>
Arabic<\/td>2011-12<\/td>62.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Armenian<\/td>2011<\/td>14.6<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Azeri<\/td>2012<\/td>12.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Bengali<\/td>2012<\/td>5.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Bosnian<\/td>2013<\/td>11.7<\/td>Link<\/a><\/td><\/tr>
Catalan<\/td>2013<\/td>19.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Chinese Simplified<\/td>2011<\/td>94.1<\/td>Link<\/a><\/td><\/tr>
Croatian<\/td>2012<\/td>25.5<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Czech<\/td>2011<\/td>29.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Danish<\/td>2010-11<\/td>72<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Dutch<\/td>2011-12<\/td>61.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
English US<\/td>2012<\/td>104.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Estonian<\/td>2011<\/td>29.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Finnish<\/td>2011<\/td>26.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
French<\/td>2011-12<\/td>84.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Georgian<\/td>2011<\/td>9.5<\/td>Link<\/a><\/td><\/tr>
German<\/td>2010-11<\/td>74.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Greek<\/td>2011-12<\/td>57.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Greenlandic<\/td>2012<\/td>3.7<\/td>Link<\/a><\/td><\/tr>
Gujarati<\/td>2011<\/td>10.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Hebrew<\/td>2011<\/td>21.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Hindi<\/td>2011-12<\/td>13.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Hungarian<\/td>2011-13<\/td>66.9<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Icelandic<\/td>2011<\/td>16.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Indonesian<\/td>2011-12<\/td>115.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Italian<\/td>2011-12<\/td>79.5<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Japanese<\/td>2011<\/td>40.9<\/td>Link<\/a><\/td><\/tr>
Kannada<\/td>2011<\/td>9.1<\/td>Link<\/a><\/td><\/tr>
Kazakh<\/td>2012<\/td>5.6<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Khmer<\/td>2012<\/td>6<\/td>Link<\/a><\/td><\/tr>
Korean<\/td>2011<\/td>55.7<\/td>Link<\/a><\/td><\/tr>
Latvian<\/td>2012<\/td>36.3<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Lithuanian<\/td>2011<\/td>9.9<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Macedonian<\/td>2012<\/td>15.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Malayalam<\/td>2011<\/td>4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Malaysian<\/td>2011<\/td>23.9<\/td>Link<\/a><\/td><\/tr>
Mongolian<\/td>2012<\/td>10<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Nepali<\/td>2013<\/td>5.9<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Norwegian<\/td>2011<\/td>44<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Persian<\/td>2012<\/td>8.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Polish<\/td>2011-13<\/td>74.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Portuguese Brazil<\/td>2011<\/td>50.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Portuguese Europe<\/td>2011-12<\/td>68<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Punjabi<\/td>2012<\/td>42.2<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Romanian<\/td>2011-13<\/td>74.6<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Russian<\/td>2011-12<\/td>63.6<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Serbian (Latin)<\/td>2013<\/td>21<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Sinhala<\/td>2011<\/td>10.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Slovak<\/td>2011<\/td>22.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Slovenian<\/td>2012-13<\/td>35.5<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Spanish South America<\/td>2012<\/td>45.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Spanish Spain<\/td>2011-12<\/td>45.6<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Swahili<\/td>2012<\/td>13.4<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Swedish<\/td>2011-12<\/td>74.1<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Tagalog<\/td>2012<\/td>13.9<\/td>Link<\/a><\/td><\/tr>
Tamil<\/td>2011-12<\/td>10.8<\/td>Link<\/a><\/td><\/tr>
Telugu<\/td>2011-12<\/td>9.9<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Turkish<\/td>2011-12<\/td>63.7<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Ukrainian<\/td>2011<\/td>28.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Urdu<\/td>2012<\/td>7.7<\/td>Link<\/a><\/td><\/tr>
Uzbek<\/td>2012<\/td>5.1<\/td>Link<\/a><\/td><\/tr>
Vietnamese<\/td>2012<\/td>46.1<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr>
Welsh<\/td>2013<\/td>3.8<\/td>Link<\/a><\/td>Link<\/a><\/td><\/tr><\/tbody><\/table><\/figure>\n","protected":false},"excerpt":{"rendered":"

Manuel Gimenes & Boris New Worldlex makes available new word frequencies based on Twitter, blog posts, or newspapers for 66 languages. We showed that these frequencies predict lexical decision reaction times similar to the already existing frequencies, or even better than them. You can now access all the WorlLex databases online ! If you use them, you can […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-250","page","type-page","status-publish","hentry","post-preview"],"_links":{"self":[{"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/pages\/250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.lexique.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=250"}],"version-history":[{"count":12,"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/pages\/250\/revisions"}],"predecessor-version":[{"id":870,"href":"http:\/\/www.lexique.org\/index.php?rest_route=\/wp\/v2\/pages\/250\/revisions\/870"}],"wp:attachment":[{"href":"http:\/\/www.lexique.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}