Page MenuHomeMiraheze

Please upload XML file and images folder to our new wiki
Closed, ResolvedPublic

Description

Please add these images to our wiki along with the XML database that compressed with 7z.
The images folder is about 500MB, and the XML database has 100MB but compressed has about 3MB.

xml file
v2smutstonefandomcom-20210720-history.7z
download here:
https://we.tl/t-cBVC7Nt7Ea

images zip
smutstone.miraheze.org--images.7z

download here:
https://we.tl/t-dx6g0C7sGp

Event Timeline

What fandom wiki is the dump from?

We have to attribute source when importing and give full history so we can just pull the dump from fandom's website too.

hi
the dump is from our wiki on fandom , here is the address:
https://v2smutstone.fandom.com/wiki/Destruction_Weeks_Event

the dump and images are linked down below, i 've just pulled them myself with wikiteam software, do not use the dump from fandom, it is one week old.

just download from the 2 links below.

we've been given notice to move from there within 2 weeks, and time is almost up, after that it will be deleted.

i repeat: do not pull the dump from the original wiki, i just did the work, the dump is in the links.

i'll attache it to the email as well if needed, but the image folder is a little big and i am not sure i can attache it to an email.

xml file
v2smutstonefandomcom-20210720-history.7z
download here:
https://we.tl/t-cBVC7Nt7Ea

images zip
smutstone.miraheze.org--images.7z

download here:
https://we.tl/t-dx6g0C7sGp

Unknown Object (User) renamed this task from Please upload XML file and images folder to oue new wiki to Please upload XML file and images folder to our new wiki.Jul 24 2021, 04:41
Unknown Object (User) moved this task from Backlog to Short Term on the MediaWiki (SRE) board.

anybody alive here?
what's taking so long, this should be a fast job...

upload images to images folder and xml database...
what do i need to do to get this job done?!!!

Not sure why the reply didn't notify me.

I will try and start it tonight.

sure, thanks, if you need anything, let me know, i'll refresh this task page every 30 min.

Will execute:
sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=smutstonewiki /home/rhinos/v2smutstonefandomcom-20210720-history.xml --username-prefix "wikia:v2smutstone"
Type 'Y' to confirm: Y
Will execute:
sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=smutstonewiki /home/rhinos/smutfiles --comment="Attribution: https://v2smutstone.fandom.com"
Type 'Y' to confirm: Y

You don't have to type Y. I was copying my terminal ouput. Both XML + Image output are running. You'll see https://meta.miraheze.org/wiki/Tech:Server_admin_log populated with the log entries and exit=0 when they're done

21:38 MirahezeLSBot: [rhinos@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=smutstonewiki /home/rhinos/smutfiles --comment=Attribution: https://v2smutstone.fandom.com (END - exit=0)

Images done

ok, sure, i'll let you know if i find something not right...

it really took some time, i see it's over, going to sleep now...
the statistics doesn't look right , indeed.
the images need to be over 2000, ...2046 exactly...were in the folder.
and the content pages over 570

https://v2smutstone.fandom.com/wiki/Special:Statistics

currently some images are missing, it showing only 1117 images and content pages zero.

example of image that's missing
Geomancer 01.jpg
Destruction-chest_bronze.png

Also when i used wikiteam tool , it produced some .desc files in the images folder....i wonder if those would have helped in any way..
example: Geomancer 01.jpg.desc

I can try running the images again and make it use the desc files later

if only 1100 images are uploaded , then this is not good, it's only about half of them, and many pages are missing the images.....

i initially thought you were gonna upload them via FTP and then the database will be populated from the XML file that contain info about every image.

yes, can you please upload the images again.
if it doesn't work i will send you another zip with all the images and each desc file asociated.

I can try running the images again and make it use the desc files later

I haven't restarted the import yet

i already prepared a folder with images and their .desc files, i removed a few duplicates...

so if it's not working the link for the new zip is this:
https://we.tl/t-bKlzfHDJs0

rhinos@jobrunner4:~$ mwscript importImages.php smutstonewiki '/home/rhinos/smutfiles --comment-ext=desc --summary="Attribution: https://v2smutstone.fandom.com"'
Will execute:
sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=smutstonewiki /home/rhinos/smutfiles --comment-ext=desc --summary="Attribution: https://v2smutstone.fandom.com --overwrite"
Type 'Y' to confirm: Y

Dump restarted

wow, indeed, incredible
i don't know what happened the first time.

i see that the article count has updated....
thanks very much

i have one question:

When importing the XML database , all the comments form the namespace 1200-Message Wall and 1201-Thread have imported into main namespace=0 and now count as articles..

Do you know if it is possible to move them in bulk, or delete them somehow ....?? or move them to another namespace. And can i do that form the access that i have?

Unknown Object (User) closed this task as Resolved.Jul 30 2021, 23:41

@RhinosF1's import script seems to have finished. Please re-open if I am mistaken. Thanks!