Page MenuHomeMiraheze

Erroneous statistics after import
Closed, ResolvedPublic

Description

After the import from nonciclopedia.wikia.com to nonciclopedia.org here on Miraheze, the results given by Special:Statistics are quite different. Please compare https://nonciclopedia.wikia.com/wiki/Speciale:Statistiche with https://nonciclopedia.org/wiki/Speciale:Statistiche and you'll see the following differences:

  • 8,785 content pages instead of 14,872 (even if it doesn't seem there's missing pages)
  • 173,144 total pages instead of 172,015 (how could possibily be more files after import?)
  • 49,890 files instead of 50,039 (I have no idea how to check if there's files missing)
  • 8,292,901 edits instead of 2,582,195
  • 47.90 edits per page instead of 15.01 (both total edits and edits per page are 3.2 times larger than they should be)

Event Timeline

AmandaCath removed a project: Import.
Paladox claimed this task.
Paladox subscribed.

Fixed by running updateArticleCount.php script.

Statistics are still erroneous: only the first one about content pages changed and it gives 171 more pages more than it should, while the rest stayed the same.

They mostly match what you said in the description that they should be like.

It's quite possible that the dump i imported (that you gave me) is conflicting with the other one (from wikia) which i imported.

They mostly match what you said in the description that they should be like.

These are the erroneous values I gave you above, which were all wrong, in in bold the current values:

8,785 content pages -15,043
173,144 total pages 173,143
49,890 files - 49,890
8,292,901 - 8,292,916
47.90 edits per page - 47,90

See? Only the first value changed significantly (and it's still wong, it should be 14,873), the rest are almost exactly the same, and we're talking about gross differences, see the correct values I gave you above.

Has any user created any new pages recently? Im thinking of just reimporting your wiki using just the wikia dump.

Nope, I'm the only user who can edit pages and I only edited a few things in the MediaWiki namespace. BTW the wikia dump is not ideal because it doesn't provide images, and in fact you imported a ton of pages that we didn't even want imported (that's why I provided a dump in the first place).

<ot>
Side question: would it be hard/impossible to downgrade the wiki temporarily to MW 1.30 just to import pages again and then upgrading it to 1.31? It's probably the easier solution for a lot of issues we're having.
One more side question: how much money do you need to expand your database so that we don't have to work with a compressed wiki, which is giving us more issues than we're willing to deal with?
</ot>

Ah i see sorry. Just the dump you provided had syntax errors. I see you used a wiki dump tool https://github.com/WikiTeam/wikiteam which i've encountered the same syntax error (from the same tool). Nope we carn't downgrade (as other wikis are using mw 1.31).

Is there another wiki dump tool you could use?

It's the only one I know. BTW I said "temporarily", just for importing pages, and then upgrade to 1.31 again after the import. About the money needed to get a larger database?

Why does it work with 1.30 only? https://github.com/WikiTeam/wikiteam/ generates a mw xml file you use to import :).

(also we managed to fit your wiki since putting on compression and also reducing other wikis sql by removing unneeded schemas for extensions they did not install.)

@Wedhro the reason we can’t downgrade is because we would have to downgrade the entire farm.

@Wedhro @John has approved the downgrade (using test1) which we are going to do.

Status update: We have installed mw 1.30 on test1, and we have recreated nonciclopediawiki db using mw 1.30 and are now using the import you provided (using --uploads too)

You will get a mw error until we update your wiki to 1.31 so please do not be alarmed (and that we are aware) :)

Thanks a lot, even if I barely understand what you people are talking about here ;) But let's give it a try:

Why does it work with 1.30 only?

Does what? I meant that in MW 1.30 imports would have intact histories (with links to user pages etc.) and edits were somehow automatically assigned to users no matter if they were signed up or not, then in 1.31 it started using that plain "prefix>Username" which makes histories barely useful and edits are only assigned if users already made an account, which is a disaster for moving active wikis.

(also we managed to fit your wiki since putting on compression and also reducing other wikis sql by removing unneeded schemas for extensions they did not install.)

Sorry, I'm not sure what you said here. It would still be in compression mode or not? I'd rather not, it's far from ideal. Speaking of database space, the question about how much money do you need to get more is still valid, I'd be happy to ask users to donate to Miraheze.

You will get a mw error until we update your wiki to 1.31 so please do not be alarmed (and that we are aware) :)

Don't worry, I understand. I really, really hope it would fix the plethora of issues I'm having while prepping the new wiki.

This has been fixed for around a week since we reimported your wiki, closing as resolved!