Page MenuHomeMiraheze

DataDumpProject
ActivePublic

Members (2)

Watchers (1)

Details

Description

A project for issues related to the DataDump extension. Please note that this extension is still being developed, so more features will become available in the future.

Recent Activity

Thu, Nov 3

Reception123 closed T9881: I need a dump for our Termoverse Wiki (termoverse.miraheze.org) as Resolved.

https://static.miraheze.org/dumps/termoverse03112022.xml

Thu, Nov 3, 19:33 · MediaWiki (SRE), Universal Omega, DataDump
Reception123 triaged T9881: I need a dump for our Termoverse Wiki (termoverse.miraheze.org) as Normal priority.
Thu, Nov 3, 19:04 · MediaWiki (SRE), Universal Omega, DataDump

Wed, Nov 2

Termoverse created T9881: I need a dump for our Termoverse Wiki (termoverse.miraheze.org).
Wed, Nov 2, 15:03 · MediaWiki (SRE), Universal Omega, DataDump

Oct 27 2022

Paladox triaged T9867: Make DD support request based model as Normal priority.
Oct 27 2022, 17:47 · MediaWiki (SRE), Universal Omega, DataDump
Paladox created T9867: Make DD support request based model.
Oct 27 2022, 17:47 · MediaWiki (SRE), Universal Omega, DataDump

Jul 13 2022

Reception123 added a comment to T9493: Import images to our wiki.

You would need to have them all downloaded and zipped and then send them to us and we would download them to our servers and automatically upload them to your wiki. Copyright and categorisation should remain through the XML dump.

Jul 13 2022, 05:25 · Universal Omega, MediaWiki, MediaWiki (SRE)
DuskFyre added a comment to T9493: Import images to our wiki.

Hello! This is DuskFyre, an administrator from the https://starcitizen.tools/ Wiki.

Jul 13 2022, 03:49 · Universal Omega, MediaWiki, MediaWiki (SRE)

Jul 8 2022

CxJuice added a comment to T9493: Import images to our wiki.

@Reception123 These two wiki are all from Mediawiki .Can you copy them in the server? In that way we don't need to download all of them. Or you can tell us how to download all images in one Mediawiki.Thanks for your help!

Jul 8 2022, 01:24 · Universal Omega, MediaWiki, MediaWiki (SRE)

Jul 7 2022

Reception123 added a comment to T9493: Import images to our wiki.

@CxJuice Could you please either send the images via sre[at]miraheze[dot]org or send us a link to a Google Drive, Dropbox, Mega.NZ, etc?

Jul 7 2022, 05:31 · Universal Omega, MediaWiki, MediaWiki (SRE)

Jul 5 2022

CxJuice added a project to T9493: Import images to our wiki: MediaWiki.
Jul 5 2022, 12:28 · Universal Omega, MediaWiki, MediaWiki (SRE)
StarA renamed T9493: Import images to our wiki from Import images to my wiki to Import images to our wiki.
Jul 5 2022, 09:23 · Universal Omega, MediaWiki, MediaWiki (SRE)
CxJuice triaged T9493: Import images to our wiki as Normal priority.
Jul 5 2022, 06:03 · Universal Omega, MediaWiki, MediaWiki (SRE)

Jun 16 2022

Universal_Omega closed T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory as Resolved.

Now fixed.

Jun 16 2022, 17:16 · Configuration, MediaWiki (SRE), DataDump
Paladox renamed T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory from DataDump broken to Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory.
Jun 16 2022, 15:02 · Configuration, MediaWiki (SRE), DataDump
Paladox added a comment to T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory.

so It seems like the cause is https://github.com/miraheze/mw-config/blob/master/LocalSettings.php#L5192?

Jun 16 2022, 14:51 · Configuration, MediaWiki (SRE), DataDump
Paladox added a comment to T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory.

somehow the configs aren't being updated?

Jun 16 2022, 14:44 · Configuration, MediaWiki (SRE), DataDump
Paladox added a comment to T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory.

so then https://github.com/miraheze/mw-config/blob/f32170805997c1e3f49361d6bcb5808264a77b1a/GlobalSettings.php#L137 should be set for wgDataDumpDirectory?

Jun 16 2022, 14:43 · Configuration, MediaWiki (SRE), DataDump
Paladox triaged T9399: Changing config does not work - it reads from cache without changing any of it on the fly (if that's what is done like for example wgDataDumpDirectory as Unbreak Now! priority.
Jun 16 2022, 14:33 · Configuration, MediaWiki (SRE), DataDump

Apr 6 2022

Reception123 added a comment to T8994: Can't dump the xml for Scruffy Wiki.

Noting https://phabricator.wikimedia.org/T293574

Apr 6 2022, 09:11 · MediaWiki (SRE), MediaWiki
RhinosF1 added a comment to T8994: Can't dump the xml for Scruffy Wiki.
[fd7372ac531f805231341729] [no req]   Error: Call to undefined method HistoryBlobStub::uncompress()
Backtrace:
from /srv/mediawiki/w/includes/historyblob/HistoryBlobStub.php(137)
#0 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(602): HistoryBlobStub->getText()
#1 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(517): MediaWiki\Storage\SqlBlobStore->decompressData(string, array)
#2 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(426): MediaWiki\Storage\SqlBlobStore->expandBlob(string, array, string)
#3 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(281): MediaWiki\Storage\SqlBlobStore->fetchBlobs(array, integer)
#4 /srv/mediawiki/w/includes/libs/objectcache/wancache/WANObjectCache.php(1700): MediaWiki\Storage\SqlBlobStore->MediaWiki\Storage\{closure}(boolean, integer, array, NULL, array)
#5 /srv/mediawiki/w/includes/libs/objectcache/wancache/WANObjectCache.php(1532): WANObjectCache->fetchOrRegenerate(string, integer, Closure, array, array)
#6 /srv/mediawiki/w/includes/Storage/SqlBlobStore.php(286): WANObjectCache->getWithSetCallback(string, integer, Closure, array)
#7 /srv/mediawiki/w/includes/Revision/RevisionStore.php(1182): MediaWiki\Storage\SqlBlobStore->getBlob(string, integer)
#8 /srv/mediawiki/w/includes/Revision/RevisionStore.php(1456): MediaWiki\Revision\RevisionStore->loadSlotContent(MediaWiki\Revision\SlotRecord, NULL, NULL, NULL, integer)
#9 [internal function]: MediaWiki\Revision\RevisionStore->MediaWiki\Revision\{closure}(MediaWiki\Revision\SlotRecord)
#10 /srv/mediawiki/w/includes/Revision/SlotRecord.php(322): call_user_func(Closure, MediaWiki\Revision\SlotRecord)
#11 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(496): MediaWiki\Revision\SlotRecord->getContent()
#12 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(317): XmlDumpWriter::{closure}()
#13 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(499): XmlDumpWriter->invokeLenient(Closure, string)
#14 /srv/mediawiki/w/includes/export/XmlDumpWriter.php(391): XmlDumpWriter->writeSlot(MediaWiki\Revision\SlotRecord, integer)
#15 /srv/mediawiki/w/includes/export/WikiExporter.php(544): XmlDumpWriter->writeRevision(stdClass, array)
#16 /srv/mediawiki/w/includes/export/WikiExporter.php(486): WikiExporter->outputPageStreamBatch(Wikimedia\Rdbms\MysqliResultWrapper, stdClass)
#17 /srv/mediawiki/w/includes/export/WikiExporter.php(307): WikiExporter->dumpPages(string, boolean)
#18 /srv/mediawiki/w/includes/export/WikiExporter.php(167): WikiExporter->dumpFrom(string)
#19 /srv/mediawiki/w/maintenance/includes/BackupDumper.php(320): WikiExporter->allPages()
#20 /srv/mediawiki/w/maintenance/dumpBackup.php(82): BackupDumper->dump(integer, integer)
#21 /srv/mediawiki/w/maintenance/doMaintenance.php(108): DumpBackup->execute()
#22 /srv/mediawiki/w/maintenance/dumpBackup.php(144): require_once(string)
#23 {main}
Apr 6 2022, 09:08 · MediaWiki (SRE), MediaWiki
RhinosF1 added a comment to T8994: Can't dump the xml for Scruffy Wiki.

@Rob_Kam: please be patient

Apr 6 2022, 09:02 · MediaWiki (SRE), MediaWiki
Rob_Kam updated subscribers of T8994: Can't dump the xml for Scruffy Wiki.

@John please.

Apr 6 2022, 08:58 · MediaWiki (SRE), MediaWiki

Apr 3 2022

Rob_Kam added a comment to T8994: Can't dump the xml for Scruffy Wiki.

I'm still unable to backup the xml.

Apr 3 2022, 10:59 · MediaWiki (SRE), MediaWiki

Mar 28 2022

Dmehus moved T8994: Can't dump the xml for Scruffy Wiki from Backlog to Bugs on the MediaWiki board.
Mar 28 2022, 02:27 · MediaWiki (SRE), MediaWiki
Dmehus moved T8994: Can't dump the xml for Scruffy Wiki from Backlog to Bugs on the DataDump board.
Mar 28 2022, 02:26 · MediaWiki (SRE), MediaWiki
Dmehus added a project to T8994: Can't dump the xml for Scruffy Wiki: DataDump.

Not sure if it's an issue with DataDump, or a MediaWiki configuration-related issue, so feel free to change the project tags

Mar 28 2022, 02:26 · MediaWiki (SRE), MediaWiki

Nov 13 2021

Ugochimobi added a project to T8289: Import XML dump: DataDump.
Nov 13 2021, 21:24 · MediaWiki, MediaWiki (SRE)

Nov 12 2021

Universal_Omega triaged T8279: Fatal exception of type "Wikimedia\Rdbms\DBQueryError" as Normal priority.
Nov 12 2021, 05:42 · Extensions, MediaWiki (SRE), Universal Omega
Pneuma created T8279: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".
Nov 12 2021, 05:41 · Extensions, MediaWiki (SRE), Universal Omega

Nov 1 2021

Universal_Omega closed T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError" as Resolved.

Deployed the change by RhinosF1 as well as my own, https://github.com/miraheze/DataDump/commit/87f48f8, which fixes this issue.

Nov 1 2021, 06:52 · MediaWiki (SRE), Universal Omega, DataDump

Oct 28 2021

RhinosF1 added a comment to T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

https://git.io/JPm7s might work

Oct 28 2021, 13:31 · MediaWiki (SRE), Universal Omega, DataDump
RhinosF1 added a comment to T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

We had 2 log entries Oct 26th about 6pm in graylog and 4 when this task was filed. (https://graylog.miraheze.org/search?q=mediawiki_url%3A%5C%2Fw%5C%2Findex.php%5C%3Ftitle%3DSpecial%5C%3ADataDump%26sort%3Ddumps_delete%26limit%3D50&rangetype=relative&from=2160000)

Oct 28 2021, 13:20 · MediaWiki (SRE), Universal Omega, DataDump
RhinosF1 added a comment to T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

As far as I can see codewise, there's been no recent changes

Oct 28 2021, 13:19 · MediaWiki (SRE), Universal Omega, DataDump
RhinosF1 changed the visibility for T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".
Oct 28 2021, 13:03 · MediaWiki (SRE), Universal Omega, DataDump
Ugochimobi added a comment to T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

Why security?

Oct 28 2021, 13:02 · MediaWiki (SRE), Universal Omega, DataDump
RhinosF1 added a comment to T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".

Why security?

Oct 28 2021, 13:00 · MediaWiki (SRE), Universal Omega, DataDump
Ugochimobi lowered the priority of T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError" from High to Normal.
Oct 28 2021, 12:58 · MediaWiki (SRE), Universal Omega, DataDump
Ugochimobi created T8223: Fatal exception of type "Wikimedia\Rdbms\DBQueryError".
Oct 28 2021, 12:58 · MediaWiki (SRE), Universal Omega, DataDump

Oct 20 2021

Universal_Omega closed T8172: DataDump Does Not Log Actions Taken From API as Resolved.
Oct 20 2021, 02:54 · MediaWiki (SRE), Universal Omega, DataDump, Security
Universal_Omega moved T8172: DataDump Does Not Log Actions Taken From API from Unsorted to Short Term on the Universal Omega board.
Oct 20 2021, 02:52 · MediaWiki (SRE), Universal Omega, DataDump, Security
Universal_Omega moved T8172: DataDump Does Not Log Actions Taken From API from Backlog to Short Term on the MediaWiki (SRE) board.
Oct 20 2021, 02:51 · MediaWiki (SRE), Universal Omega, DataDump, Security
Universal_Omega claimed T8172: DataDump Does Not Log Actions Taken From API .
Oct 20 2021, 02:51 · MediaWiki (SRE), Universal Omega, DataDump, Security

Oct 18 2021

Universal_Omega closed T8171: DataDump Does Not Care About User's Block Status as Resolved.
Oct 18 2021, 23:41 · MediaWiki (SRE), Universal Omega, DataDump, Security
Universal_Omega added a comment to T8172: DataDump Does Not Log Actions Taken From API .
Oct 18 2021, 23:40 · MediaWiki (SRE), Universal Omega, DataDump, Security
Universal_Omega added a comment to T8171: DataDump Does Not Care About User's Block Status.
Oct 18 2021, 23:39 · MediaWiki (SRE), Universal Omega, DataDump, Security

Oct 15 2021

RhinosF1 added a comment to T8171: DataDump Does Not Care About User's Block Status.

https://github.com/miraheze/DataDump/security/advisories/GHSA-g7rp-6h29-428f - private fork available for sending

Oct 15 2021, 07:09 · MediaWiki (SRE), Universal Omega, DataDump, Security
RhinosF1 added a comment to T8172: DataDump Does Not Log Actions Taken From API .

https://github.com/miraheze/DataDump/security/advisories/GHSA-9vf9-ff5x-vcpc

Oct 15 2021, 07:07 · MediaWiki (SRE), Universal Omega, DataDump, Security

Oct 14 2021

Redmin updated the task description for T8172: DataDump Does Not Log Actions Taken From API .
Oct 14 2021, 17:18 · MediaWiki (SRE), Universal Omega, DataDump, Security
Redmin moved T8172: DataDump Does Not Log Actions Taken From API from Backlog to Bugs on the DataDump board.
Oct 14 2021, 17:17 · MediaWiki (SRE), Universal Omega, DataDump, Security
Redmin added a project to T8172: DataDump Does Not Log Actions Taken From API : DataDump.
Oct 14 2021, 17:17 · MediaWiki (SRE), Universal Omega, DataDump, Security