aboutsummaryrefslogtreecommitdiff
path: root/README
diff options
context:
space:
mode:
Diffstat (limited to 'README')
-rw-r--r--README7
1 files changed, 7 insertions, 0 deletions
diff --git a/README b/README
new file mode 100644
index 0000000..05ce67a
--- /dev/null
+++ b/README
@@ -0,0 +1,7 @@
+Very WIP: A parser / template expander for Mediawiki dumps.
+
+The latest version of all mediawiki sites is about 1.1TB. Pull with:
+ curl -LO ftp://ftpmirror.your.org/pub/wikimedia/dumps/rsync-filelist-last-1-good.txt
+ rsync --partial --progress -h -r --files-from=rsync-filelist-last-1-good.txt rsync://ftpmirror.your.org/wikimedia-dumps/ /mirror/wikimedia
+
+Or find the specific file (i.e. `enwiki-20170520-pages-articles-multistream.xml`) from https://dumps.wikimedia.org/mirrors.html