Mediawiki maintenance: Difference between revisions

From wikinotes
No edit summary
 
(10 intermediate revisions by the same user not shown)
Line 40: Line 40:
== XML Dumps ==
== XML Dumps ==
<blockquote>
<blockquote>
You can dump the entire wiki as XML, and then use an XML parser to convert it to various other formats.
You can dump the entire wiki as XML, and then use an XML parser to convert it to various other formats.<br>
This is very fast, but doesn't render text normally handled by plugins.<br>
Each page is defined within a <code><page></code> tag.


<syntaxhighlight lang="bash">
<syntaxhighlight lang="bash">
Line 48: Line 50:


<syntaxhighlight lang="bash">
<syntaxhighlight lang="bash">
# mediawiki's builtin parser
# mediawiki's builtin parser (parsoid, best-effort)
cat dump.xml | php ${your_wiki}/maintenance/parse.php --title foo
php ${your_wiki}/maintenance/parse.php dump.xml > out.html


# parsoid
# pandoc (halts on error)
 
 
# pandoc
pandoc dump.xml -f mediawiki -t html -o dump.html
pandoc dump.xml -f mediawiki -t html -o dump.html
</syntaxhighlight>
</syntaxhighlight>
Line 74: Line 73:
==== wget ====
==== wget ====
<blockquote>
<blockquote>
Captures/correct links, but not as relative links for me. technically can capture CSS too.
Captures/correct links, but not as relative links for me. technically can capture CSS too.<br>
If your <code>$wgServer</code> points to the localhost (ex. <code>$wgServer = "//127.0.0.1:80"</code>, you can perform this backup over the localhost - confirmed with tcpdump).  


<source lang="bash">
<source lang="bash">
wget --recursive \
# force connections over localhosts using an alternative hostsfile
    --page-requisites \
# see: man gethostbyname
    --adjust-extension \
env HOSTALIASES=/foo/hosts \
    --convert-links \
    wget --recursive \
    --no-parent \
    --page-requisites \
    -R "*Special*" \
    --adjust-extension \
    -R "Special*" \
    --convert-links \
    -R "*action=*" \
    --no-parent \
    -R "*printable=*" \
    --tries=1    `# no retries (defaults to 20)` \
    -R "*oldid=*" \
    --timeout=5  `# only wait 5s` \
    -R "*title=Talk:*" \
    -R "*Special*" \
    -R "*limit=*" \
    -R "Special*" \
    "https://yourwiki.com"
    -R "*action=*" \
    -R "*printable=*" \
    -R "*oldid=*" \
    -R "*title=Talk:*" \
    -R "*limit=*" \
    "https://yourwiki.com"
</source>
</source>
</blockquote><!-- wget -->
</blockquote><!-- wget -->

Latest revision as of 01:07, 14 June 2022

Documentation

mediawiki static dump tools https://meta.wikimedia.org/wiki/Static_version_tools
mediawiki dumpBackup xml https://www.mediawiki.org/wiki/Manual:DumpBackup.php

Backups

Full Backups

To create a full backup, you'll need to:

Backup Database


mysqldump -u wiki -pPASSWORD wikidb > ~/wikidb-backup.sql

Backup Images

TODO

Backup LocalSettings.php

TODO

XML Dumps

You can dump the entire wiki as XML, and then use an XML parser to convert it to various other formats.
This is very fast, but doesn't render text normally handled by plugins.
Each page is defined within a <page> tag.

cd /usr/local/www/mediawiki/maintenance
php dumpBackup.php --full --quiet > dump.xml
# mediawiki's builtin parser (parsoid, best-effort)
php ${your_wiki}/maintenance/parse.php dump.xml > out.html

# pandoc (halts on error)
pandoc dump.xml -f mediawiki -t html -o dump.html

Static HTML

Tools

mw2html
static-wiki

wget

Captures/correct links, but not as relative links for me. technically can capture CSS too.
If your $wgServer points to the localhost (ex. $wgServer = "//127.0.0.1:80", you can perform this backup over the localhost - confirmed with tcpdump).

# force connections over localhosts using an alternative hostsfile
# see: man gethostbyname
env HOSTALIASES=/foo/hosts \
    wget --recursive \
    --page-requisites \
    --adjust-extension \
    --convert-links \
    --no-parent \
    --tries=1    `# no retries (defaults to 20)` \
    --timeout=5  `# only wait 5s` \
    -R "*Special*" \
    -R "Special*" \
    -R "*action=*" \
    -R "*printable=*" \
    -R "*oldid=*" \
    -R "*title=Talk:*" \
    -R "*limit=*" \
    "https://yourwiki.com"

Zim

xmldump2zim create zimfile from a mediawiki XML dump
wget-2-zim bash script to scrape mediawiki to zimfile
zim-tools includes zimwriterfs which dumps mediawiki to zimfile
mwoffliner scrape a mediawiki to zimfile

Delete Revision History

cd /usr/local/www/mediawiki/maintenance
php deleteOldRevisions.php --delete