Jump to content

User:Emijrp/Wikipedia Archive

From Wikipedia, the free encyclopedia
If you are searching for an offline reader of Wikipedia, go to #Offline. If you want to archive your wiki, read more at WikiTeam. If you want to create a mirror of Wikipedia dumps, read meta:Mirroring Wikimedia project XML dumps.

This unofficial Wikipedia Archive is a project to keep a record of Wikimedia projects backups, check their status and encourage the creation of better and periodically copies.

This page contains links to backups and other historical information about Wikipedia, Wiktionary, Wikibooks, Wikisource, Wikiquote, Wikiversity, Wikinews, Wikispecies, Commons, Wikidata and Meta. There are also some data about her predecessors or old Internet encyclopedia projects now closed: Interpedia, GNUPedia and Nupedia.

Wikipedia pages can be edited by everyone and the histories are saved and publicly available, but usually is hard to find very old stuff. I hope you enjoy this page. Nostalgia time!

Please, consider downloading Wikimedia dumps if you have enough free disk space. I think that we must save a copy of Wikipedia in every country around the world.[1]

If you are an admin of a free-licensed wiki, consider publishing backups of the text articles and images (read tutorial). Every year, dozens of wikis disappear around the globe. WikiTeam is trying to avoid that destruction.

You are welcome to improve this page or leave a message in the talk page.

English Wikipedia size in 2010, if printed. No more Libraries of Alexandria destroyed.

Permit mirror sites

[edit]

When information is available on the web only at one site, its availability is vulnerable. A local problem—a computer crash, an earthquake or flood, a budget cut, a change in policy of the school administration—could cut off access for everyone forever. To guard against loss of the encyclopedia's material, we should make sure that every piece of the encyclopedia is available from many sites on the Internet, and that new copies can be put up if some disappear.

There is no need to set up an organization or a bureaucracy to do this, because Internet users like to set up “mirror sites” which hold duplicate copies of interesting web pages. What we must do in advance is ensure that this is legally permitted.

Therefore, each encyclopedia article and each course should explicitly grant irrevocable permission for anyone to make verbatim copies available on mirror sites. This permission should be one of the basic stated principles of the free encyclopedia.

Some day there may be systematic efforts to ensure that each article and course is replicated in many copies—perhaps at least once on each of the six inhabited continents. This would be a natural extension of the mission of archiving that libraries undertake today. But it would be premature to make formal plans for this now. It is sufficient for now to resolve to make sure people have permission to do this mirroring when they get around to it.

Wikimedia dumps

[edit]
Internet Archive servers storing petabytes of Internet content, including mirrors of Wikipedia dumps and other wikis.

You can download different dumps of Wikipedia and her sister projects. The most recent ones, offline readable versions, historical dumps, etc.

Latest dumps

[edit]

The official download website offers backups for every Wikimedia project and every language:

The dumps are usually huge XML files. You can parse them using pywikibot xmlreader.py script and mediawiki-utilities. This is thought mostly for researchers. If you are searching for an offline reader of Wikipedia, go to the #Offline section.

Mirrors

[edit]

Currently, there is only one working mirror of dumps.wikimedia.org site. It is located in Your.org servers.

WikiTeam periodically upload dumps to a collection at Internet Archive.

Offline versions

[edit]
Screenshot of Kiwix.

Currently there are several options for reading an offline copy of Wikipedia:

More info in meta:Wikipedia on CD/DVD and Wikipedia:Version 1.0 Editorial Team.

Historical dumps

[edit]
Wikimedia servers on the first day of install. Photo taken by Jimbo Wales.
See also: https://dumps.wikimedia.org/archive

This is a list with some links to old Wikimedia dumps and other related bunches of raw data (usually many zipped GB, which sometimes expands to TB).

Torrents

[edit]
See also: meta:Data dump torrents

Page view logs

[edit]

The visits logs for Wiki[mp]edia projects (originally named Domas visits logs) have the number of views for every wiki page per hour. There were some issues while collecting this data in the past, please read this and this, to learn how realiable is this data.

You can download the packages from Wikimedia servers and we periodically upload the recent ones to Internet Archive (thanks to User:Hydriz). There is a version of these files by Erik Zatche, which contain some derived data (not all).

Image tarballs

[edit]

There is a copy of almost all Wikimedia Commons files up to September 2016 at Internet Archive (about 91 TB). In 2012, some image dumps were published for some Wikipedia languages. Another one from 2005 only covers English Wikipedia images.

The best pictures of some years are available too, for download from the Internet Archive (2006, 2007, 2008, 2009, 2010, 2011)

We store everything on the Internet Archive, but who archives the archivers themselves? You, of course! We believe in distributed preservation. Is it really needed? Yes, it turns out nobody but you wants to mirror the decade-long work of millions volunteers.

Give a look at how much space you have on your hard disk: probably, tens or hundreds GB. Pick a torrent you can fit from those below, click the link and keep reseeding! If possible, also sign in the table row.

Mailing lists archives

[edit]

Our first article is online now!
http://www.nupedia.com/newest.phtml This is, of course, a modest beginning, but it's a very significant development. Congratulations to Christoph Hust for being the first.

— Larry

Not Wiki[mp]edia

[edit]

Other free projects which allow downloading their dumps:

See also

[edit]
This user wants to compile and preserve the sum of all human knowledge.

References

[edit]
  1. ↑ You can use this downloader (it requires GNU/Linux) to get all 7zip full history files for all projects. You can't read these files in an easy way, but you can preserve them for posterity.
[edit]