Page MenuHomeMiraheze
Create Task
Maniphest T6227

Would like to request a 2020 image dump and a current revision dump of the File namespace of All The Tropes
Closed, ResolvedPublic
Actions

Description

I am requesting the above here because I tried and failed to acquire the following via WikiTeam's tools.

I need them from this wiki

https://allthetropes.org/wiki/Main_Page

I relinquished control of this wiki for personal reasons, but I do have eventual plans to return and the above request is known to other administrators of that wiki. I require the following to be used for our ATT branch on the Wikia service to fill in holes in required images there, and due to the sheer size and the fact I need the File tables XML dumped as well for attribution purposes, I would like to request both as soon as possible, preferably available on a service like MEGA or more ideally, uploaded to Archive.org, or whatever other place and means both can be easily acquired for the intended purpose.

Event Timeline

Arcane21 created this task.Sep 25 2020, 21:53
Herald added a subscriber: RhinosF1. · View Herald TranscriptSep 25 2020, 21:53
Robkelk subscribed.Sep 25 2020, 22:56

As one of the current moderators of the All The Tropes wiki, I confirm that this request is in accordance with our wiki's policies.

Arcane21 updated the task description. (Show Details)Sep 26 2020, 03:23
Reception123 triaged this task as Normal priority.Sep 26 2020, 06:17
Reception123 added a project: MediaWiki.
Herald added subscribers: Unknown Object (User), Void, Reception123, NDKilla. · View Herald TranscriptSep 26 2020, 06:17
Reception123 added a comment.Sep 27 2020, 16:15

@Arcane21 @Robkelk Hi, unfortunately for the dump there seems to be an issue where even if we use --filter=namespace:6 the script seems to simply back up everything regardless. Would a full XML dump work for you? (We've got one from 21 September on archive.org)

Arcane21 added a comment.Sep 27 2020, 19:51

current revision only would be fine, full histories are not required for CC BY SA.

Reception123 added a comment.Sep 28 2020, 15:27

@Arcane21 The issue seems to be that the script doesn't want to only dump a specific namespace (the file namespace) and it instead seems to be dumping the whole wiki, so it seems the only solution may be for us to give you a full XML dump of attwiki, so I'm not sure whether that would work for you?

Arcane21 added a comment.Sep 28 2020, 15:28

a full current revision only dump of all of ATT is fine.

Reception123 added a comment.Oct 1 2020, 07:04

https://archive.org/details/allthetropeswiki01102020

Arcane21 added a comment.Oct 1 2020, 07:21

Much obliged. Images to go with it would be wonderful as well, but I can wait on that.

Reception123 added a comment.Oct 1 2020, 07:26

@Arcane21 Images are a bit more complicated due to the file system, but we're working on it so hopefully those should work out soon as well

Arcane21 added a comment.Oct 1 2020, 07:27

That's understandable. You can cull the deleted images from the final result if you like to bring the file size down when they are ready. Until then, I'll be patient.

RhinosF1 added a comment.Oct 1 2020, 07:29

We have to do this anyway (unless you give us a lot of time) as we don't currently have a way to differentiate between deleted images and images that have been oversighted on legal grounds.

Arcane21 added a comment.Oct 1 2020, 07:56

That's fine by me.

Reception123 closed this task as Resolved.Oct 4 2020, 17:46
Reception123 claimed this task.

It seems that Paladox has managed to fix it, you may now download it via https://allthetropes.org/wiki/Special:DataDump

Arcane21 reopened this task as Open.EditedOct 4 2020, 18:01

I'm not an admin anymore, so could it be provided on archive.org (the image dump)

Unknown Object (User) closed this task as Resolved.Oct 5 2020, 15:35
In T6227#122792, @Arcane21 wrote:

I'm not an admin anymore, so could it be provided on archive.org (the image dump)

If you aren't an administrator you will probably have to request it from an existing admin.

Arcane21 reopened this task as Open.EditedOct 5 2020, 22:25

I'm reopening this to say I'm going to ask for temporary admin status so I can attempt to get a copy for myself then. If that isn't possible, I'm going to have to ask Miraheze to place it on Archive.org. I'll update this to report whether the server will, on my end of things, let me grab such a large archive or I need Miraheze Staff to do the needful.

Edit: Still going to try getting admin rights so I can try, but according to this, the file is so large it's a fools errand and thus I'll need a copy dumped elsewhere like Archive.org:

http://www.accessdenied-rms.net/forums/showthread.php?tid=13910&pid=196068#pid196068

Reception123 added a comment.Oct 6 2020, 12:49

@Arcane21 Sorry about that. We're trying to do it on the server again, and we'll have it available on our static directory.

Arcane21 added a comment.Oct 6 2020, 12:51

Thanks. Please keep me posted.

Reception123 closed this task as Resolved.Oct 6 2020, 13:26

Sorry for the delay, finally done - https://static.miraheze.org/dumps/allthetropeswiki06102020.tar.gz

Arcane21 added a comment.Oct 6 2020, 13:33

Thanks, will do. I'm going to get this ASAP.

Arcane21 reopened this task as Open.EditedOct 6 2020, 18:58

Hate to reopen this again, but the download keeps stalling after 400 or so MB.

In fact, it dies EXACTLY at the 15% mark.

Hate to be insistent, but this is why I wanted to download it off Archive.org, you can guarantee it's stability and completion to download there.

Reception123 closed this task as Resolved.Oct 7 2020, 05:10

Sorry again. Here you go - https://archive.org/details/allthetropeswiki06102020.tar