so you are providing https://meta.miraheze.org/dblist/all.dblist
which is cool. and from there i have imported miraheze wikis in the past
but what that does not give me is the custom domain names for wikis with custom domains.
And since we know that API URLs dont work on the foo,miraheze.org URLs for those (https://phabricator.wikimedia.org/T146712)
i would need to add special code to solve that ticket and in addition i would have to manually enter all the custom domain names
and keep them maintained. I can do that once but i already know it will be outdated again quickly.
So to really solve that i would need a list i can download like the above but with a format like:
allthetropes|allthetropes.org
meta
fnord
..
where "meta" and "fnord" would be "regular" wikis and the one with a custom domain lists the domain name in addition
That way it would be possible for me to parse that and keep importing wikis and make that automatic.
What i also don't have is a list of _deleted_ wikis, we did that manually in the same ticket linked above. So either there would be a list of deleted wikis or the solution would be to always wipe the full table and then import the wikis from scratch and update them all.