The file storage has ~889MB as of when this task was filed.
Description
Status | Assigned | Task | ||
---|---|---|---|---|
Resolved | Paladox | T4197 File Storage is running low on storage | ||
Resolved | None | T4199 Broken thumbnails and lack of permissions to move image files on utamacross.miraheze.org | ||
Resolved | None | T4229 Problem uploading pictures | ||
Resolved | None | T4251 Media File Upload Error |
Event Timeline
We now only have 126 MiB with users reporting errors like "Could not store file "/tmp/phpaFjjIY" at "mwstore://local-backend/local-public/0/0e/'file name'"
It’s unlimited for all users (ie we doint put a limit per user) but we currently have 119MB left for users to use.
I'm looking for baseline information about servers, volume sizes and free space by day.
Robert I previously linked you to the storage space for db4 on Facebook. The same website shows various monitoring information for all of our servers.
That would likely be icinga.miraheze.org (login as guest/guest), however it's odd, because the servers (lizardfs1 and lizardfs2) both seem to still have 17 GB free. Is this just not allocated to the file system? Thing number two, can we actually do something about this, even if it winds up being a temporary thing?
@Void / (root partition) has 17GB free on lizardfs1, but /mnt/mediawiki-static has 100% disk usage (rounded / 100 MB free)
It was a soft recommendation to prevent using more than 90% disk space. Genuinely do not let “good practice” block UBN service affecting tasks. It’s never been the case before
John, do you have a remediation and monitoring plan in place for this defect?
Thanks!
Hi, we currently have adequate monitoring in place. We will be looking at seeing if it has a api that tells us correctly how much storage is left.
Also what remediation are you looking for?
The only thing we would need to do is extend the storage which can easily be done but we are lacking funds to do it.
So maybe asking for donation through centralnotice might be the solution for the time being. Some users have already suggested it on our discord, and perhaps it's indeed high time we did so.
I'm not sure at what level funds are lacking -- last I heard we were trying to buy a CVZ and RN NL didn't have one available. What sort of server are we looking at to resolve this?
I'd like to see some budgeting.
I haven't given a lot to Miraheze over the years, have you?
Sometimes the solution to a technical problem is a financial one.
@Paladox told me LizardFS allows extending the available volume size by buying an extra server with lots of disk space (as an addition to our current servers), I'll assume this does not need to be yet another CVZ in NL, although that does have our preference.
CVZs won't make their way back to NL anytime soon.
So we either have to get a CVZ in another region, or have to get one of the other vps with a smaller disk in NL.
We should get a vps in hetzner for 3.01 euros that will allow us to use block chain storage (which would cost like 4.89 euros for 100gb of block chain ssd).
This would allow us to future proof miraheze file storage infrastructure.
I'm pretty okay with this idea. If this works out, we may want to move all of the file storage to another DC, so we don't get too much replication traffic. But static data would be fine to keep in another DC.
We should definitely try to get through with this ASAP since uploads have been affected for a while now.
The placement of erotic, pornographic, extremist material or material not deemed in good taste is not permitted.
If we went with Hetzner, we'd have to change our Content Policy, as well as our Privacy Policy.
Ah thanks @labster, i guess Hetzner should be out of the question then :(.
We should try getting another vps at ramnode (but the only available data centres for the type of vps we need is in america)
@labster does that mean that user won't be able to have pornographic material if we went with hetzner?
Yes. Not permitted is the set of content ("erotic", "pornographic", extremist", "not deemed in good taste"). Therefore pornographic material is expressly prohibited, as are erotic writing and tasteless jokes.
That would be problematic as 1) it would take a while to get the changes through 2) there would still be remaining content that would be on wikis that would be nearly impossible for us to purge, and therefore we would be in breach of Hezner's policies.
Therefore I'm afraid we're probably going to have to look for an alternative, and fast.
Blocking controversial material is one of the main reasons why we and other Uncyclopedias moved from Fandom to Miraheze in the first place, because you can't do satire without offending someone. Such a restrictive host would kill us, and we just moved here.
Per chat on irc, we propose that we buy $5 CVZ in NY (as they have none in NL).
Need @labster approval for ^^.