I live in the United Kingdom GMT/BST(UTC+0, UTC+1).
I am a Site Reliabilty Engineer for Miraheze.
I live in the United Kingdom GMT/BST(UTC+0, UTC+1).
I am a Site Reliabilty Engineer for Miraheze.
I've created some pipeline rules which fixed this for some things (like mediawiki, also doing it for nginx).
Think we've resolved this by using pipeline rules to use timestamp in the json and setting the timestamp.
Error is gone now.
We're using salt-ssh.
We've successfully switched over, closing as resolved.
Talked about it with SPF and have come to the conclusion that we wont do this.
Needs a discussion with SPF.
In T6839#134807, @John wrote:Is a major software upgrade of critical services really ‘short term’?
Technically this is a UBN.
I think it may be syslog-ng -> graylog. Has to be otherwise messages would be lost going from mw -> syslog-ng.
Per chat with @John we're going to move ahead and put all cache in memcache. Renaming rdb4 as mc2.
I'm not sure its worth looking at this right now so declining based on our chat.
Redis is single threaded where as memcache is multi threaded This improves performance.
the only problem is that this causes things to be out of sync, for example a message could have been sent an hour ago but we would have only just saw it now because of this. This has happened with exceptions when investigating. This impedes investigations.
We've sent off an email to grafana and we've blocked the url. We are running a version that is supposedly should be patched but I can still reproduce it.
<div class="cnotice" id="{{{banner}}}"> <div id="cnotice-main"> <div class="cnotice-logo-container"> <img src="//static.miraheze.org/metawiki/3/35/Miraheze_Logo.svg" alt="Banner logo"> </div> <div class="cnotice-message-container"> <div class="cnotice-message"> <p><span data-nosnippet>{{{msg-1}}} <a href="https://www.gofundme.com/f/help-miraheze-stay-online-in-2021">{{{msg-2}}}, <a href="https://paypal.me/mirahezelimited">{{{msg-3}}} or <a href="https://github.com/sponsors/miraheze">{{{msg-4}}}</a>!</span></p> </div> <a href="https://meta.miraheze.org/w/index.php?title=Special:Translate&group=Centralnotice-tgroup-{{{banner}}}" title="{{{translate}}}"> <span data-nosnippet>{{{translate}}}</span> </a> <center><h4><small>{{{msg-5}}}</h4></center> </div> <div id="cnotice-toggle-box"> <a href="#" title="Hide" onclick="mw.centralNotice.hideBanner();return false;"><img border="0" src="//upload.wikimedia.org/wikipedia/donate/a/ac/Close_oojs.png" alt="Hide" /></a> </div> </div>
Hi, we recently migrated our file storage, would you be able to re upload the file in question?
Has all been migrated away from using root. Thus this task is resolved now.
Fixed by refreshing CreateWiki cache.
Rebooted the servers which fixed the issue.
I've increased it in the UI but it wouldn't let me extend it because no disk space.