Page MenuHomeMiraheze
Feed All Stories

Thu, Jul 22

emailbot committed rSSL875f43f56754: Bot: Update SSL cert for wiki.grottocenter.org (authored by emailbot).
Bot: Update SSL cert for wiki.grottocenter.org
Thu, Jul 22, 01:09
emailbot committed rSSLe322b47aba58: Bot: Update SSL cert for wiki.cdntennis.ca (authored by emailbot).
Bot: Update SSL cert for wiki.cdntennis.ca
Thu, Jul 22, 01:06
emailbot committed rSSL15fb5e8f827f: Bot: Update SSL cert for wiki.patriam.cc (authored by emailbot).
Bot: Update SSL cert for wiki.patriam.cc
Thu, Jul 22, 01:00
emailbot committed rSSLc858a0d848d2: Bot: Update SSL cert for wiki.fraterniterebellion.com (authored by emailbot).
Bot: Update SSL cert for wiki.fraterniterebellion.com
Thu, Jul 22, 00:59
emailbot committed rSSLf914a016a69b: Bot: Update SSL cert for mrlove.wiki (authored by emailbot).
Bot: Update SSL cert for mrlove.wiki
Thu, Jul 22, 00:52
emailbot committed rSSL75add1e499e2: Bot: Update SSL cert for mediawiki.ecfin.eu (authored by emailbot).
Bot: Update SSL cert for mediawiki.ecfin.eu
Thu, Jul 22, 00:48
emailbot committed rSSLc60fe1c1c540: Bot: Update SSL cert for wiki.ricochetuniverse.com (authored by emailbot).
Bot: Update SSL cert for wiki.ricochetuniverse.com
Thu, Jul 22, 00:38
emailbot committed rSSLb4abad5f71ce: Bot: Update SSL cert for studentwiki.ddns.net (authored by emailbot).
Bot: Update SSL cert for studentwiki.ddns.net
Thu, Jul 22, 00:37
emailbot committed rSSLed8828554fb9: Bot: Update SSL cert for vitriol.spoon.army (authored by emailbot).
Bot: Update SSL cert for vitriol.spoon.army
Thu, Jul 22, 00:31
emailbot committed rSSL1321e4cb832b: Bot: Update SSL cert for allthetropes.org (authored by emailbot).
Bot: Update SSL cert for allthetropes.org
Thu, Jul 22, 00:28
emailbot committed rSSL6fc80331fff9: Bot: Update SSL cert for monarchists.wiki (authored by emailbot).
Bot: Update SSL cert for monarchists.wiki
Thu, Jul 22, 00:24
emailbot committed rSSLe522da2d9293: Bot: Update SSL cert for froggy.info (authored by emailbot).
Bot: Update SSL cert for froggy.info
Thu, Jul 22, 00:18
emailbot committed rSSL0b1cf10bc8e2: Bot: Update SSL cert for housing.wiki (authored by emailbot).
Bot: Update SSL cert for housing.wiki
Thu, Jul 22, 00:12
emailbot committed rSSL9150e995a903: Bot: Update SSL cert for fr.gyaanipedia.com (authored by emailbot).
Bot: Update SSL cert for fr.gyaanipedia.com
Thu, Jul 22, 00:08
emailbot committed rSSL379a83d151fe: Bot: Update SSL cert for dariawiki.org (authored by emailbot).
Bot: Update SSL cert for dariawiki.org
Thu, Jul 22, 00:00

Wed, Jul 21

emailbot committed rSSLc7978bdad8c7: Bot: Update SSL cert for archive.stellurgists.wiki (authored by emailbot).
Bot: Update SSL cert for archive.stellurgists.wiki
Wed, Jul 21, 23:52
emailbot committed rSSLc6b11ee2dd1a: Bot: Update SSL cert for adadevelopersacademy.wiki (authored by emailbot).
Bot: Update SSL cert for adadevelopersacademy.wiki
Wed, Jul 21, 23:46
Joritochip added a comment to T7683: is there a way to auto-redirect URL calls without /wiki/ forward as if it were typed?.

We could alternatively just add a 404 page that has "Did you mean: /wiki/<page_name>" here like Wikipedia does.

Wed, Jul 21, 23:31 · MediaWiki (SRE), Infrastructure (SRE), NGINX, Varnish
GitHub <noreply@github.com> committed rPUPC0687a10f4bd4: bugfixes (#1819) (authored by RhinosF1).
bugfixes (#1819)
Wed, Jul 21, 23:04
GitHub <noreply@github.com> committed rPUPC026e7d74d5c2: typo (authored by Void).
typo
Wed, Jul 21, 20:48
Void closed T7626: redis-server is occasionally killed for OOM as Resolved.

Tentatively closing, looks like we've stabilized.

Wed, Jul 21, 20:43 · Infrastructure (SRE)
Void moved T7683: is there a way to auto-redirect URL calls without /wiki/ forward as if it were typed? from Incoming to Long Term on the Infrastructure (SRE) board.

This would be difficult to implement, I believe. I think (for mediawiki sites) we'd only have to worry about /wiki and /w, but I'd be worried about static.miraheze.org and probably a few other things.

Wed, Jul 21, 20:41 · MediaWiki (SRE), Infrastructure (SRE), NGINX, Varnish
CptRabid created T7684: Please can a 'Let's Encrypt' SSL cert. mapping https://with.cpt-ra.bid/ to https://rrf.miraheze.org/ be created?.
Wed, Jul 21, 18:16 · MediaWiki (SRE), SSL
RhinosF1 triaged T7683: is there a way to auto-redirect URL calls without /wiki/ forward as if it were typed? as Low priority.
Wed, Jul 21, 18:05 · MediaWiki (SRE), Infrastructure (SRE), NGINX, Varnish
RhinosF1 added projects to T7683: is there a way to auto-redirect URL calls without /wiki/ forward as if it were typed?: Varnish, NGINX, Infrastructure (SRE), MediaWiki (SRE).

Would need to be done in Varnish or NGINX

Wed, Jul 21, 18:05 · MediaWiki (SRE), Infrastructure (SRE), NGINX, Varnish
Tycio created T7683: is there a way to auto-redirect URL calls without /wiki/ forward as if it were typed?.
Wed, Jul 21, 18:04 · MediaWiki (SRE), Infrastructure (SRE), NGINX, Varnish
R4356th moved T7681: Please upload XML file and images folder to our new wiki from Backlog to Maintenance Script Run on the MediaWiki board.
Wed, Jul 21, 16:51 · MediaWiki (SRE), MediaWiki
Fridaysfuturebr created T7682: Change of wiki domain.
Wed, Jul 21, 16:41 · MediaWiki (SRE), SSL
GitHub <noreply@github.com> committed rPUPCcf87ba585de1: Mediawiki: add some cookbooks (#1818) (authored by RhinosF1).
Mediawiki: add some cookbooks (#1818)
Wed, Jul 21, 16:35
Light-777-Angel created T7681: Please upload XML file and images folder to our new wiki.
Wed, Jul 21, 16:23 · MediaWiki (SRE), MediaWiki
R4356th edited projects for T7674: "Widgets" and "wikiEd" extensions pls, added: Extensions; removed MediaWiki.
Wed, Jul 21, 15:56 · Extensions, Universal Omega, MediaWiki (SRE)
YumemiruNiki added a comment to T7675: Import XML dump from FandomWiki onto helios.miraheze.org.

Thank you!

Wed, Jul 21, 15:55 · MediaWiki (SRE), MediaWiki
RhinosF1 closed T7675: Import XML dump from FandomWiki onto helios.miraheze.org as Resolved.

16:05:53 <MirahezeLSBot> !log [rhinos@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=helioswiki heliosrisingheroes_pages_full.xml --username-prefix wikia:heliosrisingheroes (END - exit=0)

Wed, Jul 21, 15:24 · MediaWiki (SRE), MediaWiki
RhinosF1 added a comment to T7675: Import XML dump from FandomWiki onto helios.miraheze.org.
Will execute:
sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=helioswiki heliosrisingheroes_pages_full.xml --username-prefix "wikia:heliosrisingheroes"
Type 'Y' to confirm:

Started

Wed, Jul 21, 13:54 · MediaWiki (SRE), MediaWiki
RhinosF1 claimed T7675: Import XML dump from FandomWiki onto helios.miraheze.org.
Wed, Jul 21, 13:51 · MediaWiki (SRE), MediaWiki
YumemiruNiki added a comment to T7675: Import XML dump from FandomWiki onto helios.miraheze.org.

Apologies, I should have mentioned that at the start. https://heliosrisingheroes.fandom.com/

Wed, Jul 21, 13:28 · MediaWiki (SRE), MediaWiki
RhinosF1 moved T7680: Renew m.miraheze.org from Backlog to Short Term on the MediaWiki (SRE) board.
Wed, Jul 21, 12:55 · MediaWiki (SRE), SSL
RhinosF1 triaged T7680: Renew m.miraheze.org as High priority.
Wed, Jul 21, 12:55 · MediaWiki (SRE), SSL
RhinosF1 updated the task description for T7584: Automate MediaWiki Upgrades.
Wed, Jul 21, 10:14 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 updated the task description for T7584: Automate MediaWiki Upgrades.
Wed, Jul 21, 10:12 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 updated the task description for T7584: Automate MediaWiki Upgrades.
Wed, Jul 21, 10:12 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 updated the task description for T7584: Automate MediaWiki Upgrades.
Wed, Jul 21, 09:17 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 added a comment to T7584: Automate MediaWiki Upgrades.
from os import system
system('logsalmsg Disabling puppet for mediawiki update')
system('sudo puppet agent -tv')
system('sudo puppet agent --disable "Updating MediaWiki')
input('press enter to re-enable puppet')
system('sudo puppet agent --enable')
system('sudo puppet agent -tv')
system('logsalmsg enabled puppet')
Wed, Jul 21, 09:16 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 updated the task description for T7584: Automate MediaWiki Upgrades.
Wed, Jul 21, 09:05 · SRE Automation, Goal-2021-Jul-Dec, MediaWiki, MediaWiki (SRE)
RhinosF1 moved T7675: Import XML dump from FandomWiki onto helios.miraheze.org from Backlog to Short Term on the MediaWiki (SRE) board.
Wed, Jul 21, 08:35 · MediaWiki (SRE), MediaWiki
RhinosF1 moved T7675: Import XML dump from FandomWiki onto helios.miraheze.org from Backlog to Pending answer on the MediaWiki board.
Wed, Jul 21, 08:34 · MediaWiki (SRE), MediaWiki
RhinosF1 added a comment to T7675: Import XML dump from FandomWiki onto helios.miraheze.org.

Which fandom wiki?

Wed, Jul 21, 08:34 · MediaWiki (SRE), MediaWiki
RhinosF1 added a comment to T7573: User can't confirm email.

Updated SRX1525344608ID - [EXTERNAL] Re: Reported deliverability problem to Outlook.com SRX1525344608ID

Wed, Jul 21, 08:21 · Mail, Infrastructure (SRE)
RhinosF1 added a comment to T7675: Import XML dump from FandomWiki onto helios.miraheze.org.

I will be sending an email to tech(at)miraheze.org with my XML file.

Email recieved

Wed, Jul 21, 06:41 · MediaWiki (SRE), MediaWiki
RhinosF1 edited projects for T7679: Replace https://lgbtqia.miraheze.org/wiki/Main_Page with https://lgbtqa.miraheze.org/wiki/Main_Page, added: Database, Configuration; removed MediaWiki.
Wed, Jul 21, 06:40 · Configuration, Universal Omega, Database, MediaWiki (SRE)
Seraphh created T7679: Replace https://lgbtqia.miraheze.org/wiki/Main_Page with https://lgbtqa.miraheze.org/wiki/Main_Page.
Wed, Jul 21, 06:39 · Configuration, Universal Omega, Database, MediaWiki (SRE)
RhinosF1 added a comment to T7573: User can't confirm email.
In T7573#154292, @Void wrote:

Has Outlook been made aware of the status of the subtask (a general message would suffice)? Or have we had any other reports come in from Outlook?

I'll get in touch with them at some point today. Not that for the most part they actually read what you say to support.

Wed, Jul 21, 06:35 · Mail, Infrastructure (SRE)
RhinosF1 added a comment to T7139: MediaWiki Capacity Proposal.
In T7139#154236, @Void wrote:

Can we move forward with this now? Current tasks such as T7626 and T7633 indicate we cannot wait on expanding our infrastructure.

As I said with bringing mw12 forward, yes we simply need to do this now.

Wed, Jul 21, 06:34 · MediaWiki (SRE)
RhinosF1 added a comment to T7634: Alert on low php-fpm workers.

Correct

Wed, Jul 21, 06:29 · Infrastructure (SRE), Monitoring
emailbot committed rSSL694be7e3f637: Bot: Update SSL cert for wlhmn.tk (authored by emailbot).
Bot: Update SSL cert for wlhmn.tk
Wed, Jul 21, 06:09
Universal_Omega added a comment to T7125: Improve ManageWiki extension interface.

The third of this is currently blocked on community input. See https://meta.miraheze.org/wiki/Community_noticeboard#ManageWiki_UX_Change_(SRE_Request_for_Community_Input)

Wed, Jul 21, 05:12 · Universal Omega, ManageWiki, MediaWiki (SRE)
GitHub <noreply@github.com> committed rPUPC8a5b07bc5692: jobrunner3 cannot run intensive jobs (#1817) (authored by Void).
jobrunner3 cannot run intensive jobs (#1817)
Wed, Jul 21, 02:37
Void added a comment to T7626: redis-server is occasionally killed for OOM.

Literally a setting in puppet: https://git.io/Jlvs7

Wed, Jul 21, 02:37 · Infrastructure (SRE)
GitHub <noreply@github.com> committed rPUPCb193dac2cdf5: Update jobrunner4.yaml (authored by Void).
Update jobrunner4.yaml
Wed, Jul 21, 02:36
GitHub <noreply@github.com> committed rPUPCd8ee2ea1bd1a: jobrunner3 cannot run intensive jobs (authored by Void).
jobrunner3 cannot run intensive jobs
Wed, Jul 21, 02:36
Void lowered the priority of T7634: Alert on low php-fpm workers from High to Low.

Tracked passively in Grafana. Correct me if I'm mistaken, but anything short of an obvious DOS attack from one source wouldn't be actionable outside of provisioning additional MW servers? If that is the case, then there are other things that take precedence at the moment.

Wed, Jul 21, 02:25 · Infrastructure (SRE), Monitoring
Void added a comment to T7573: User can't confirm email.

Has Outlook been made aware of the status of the subtask (a general message would suffice)? Or have we had any other reports come in from Outlook?

Wed, Jul 21, 02:10 · Mail, Infrastructure (SRE)
Void lowered the priority of T7626: redis-server is occasionally killed for OOM from Unbreak Now! to High.

Effectively stalled on T7139 unless we can prevent jobrunner3 from accepting high intensity jobs (assuming RequestWikiAIJob).

Wed, Jul 21, 02:06 · Infrastructure (SRE)
Void closed T7647: cp3 down - 2021-07-16 09:00 UK time as Resolved.

Technically resolved on reboot. No cause has been identified, but as a not-recurring issue, it isn't worth spending more time investigating.

Wed, Jul 21, 02:04 · Varnish, Infrastructure (SRE)
Void added a parent task for T7678: [New] Server Request for task: T7139: MediaWiki Capacity Proposal.
Wed, Jul 21, 02:02 · Infrastructure (SRE)
Void added a parent task for T7677: [New] Server Request for jobchron: T7139: MediaWiki Capacity Proposal.
Wed, Jul 21, 02:02 · Infrastructure (SRE)
Void added subtasks for T7139: MediaWiki Capacity Proposal: T7677: [New] Server Request for jobchron, T7678: [New] Server Request for task.
Wed, Jul 21, 02:02 · MediaWiki (SRE)
Void created T7678: [New] Server Request for task.
Wed, Jul 21, 02:01 · Infrastructure (SRE)
Void created T7677: [New] Server Request for jobchron.
Wed, Jul 21, 01:58 · Infrastructure (SRE)
Void updated subscribers of T7676: [New] Server Request for mw12 and mw13.
Wed, Jul 21, 01:54 · Infrastructure (SRE)
Void placed T7676: [New] Server Request for mw12 and mw13 up for grabs.
Wed, Jul 21, 01:52 · Infrastructure (SRE)
Void added a parent task for T7676: [New] Server Request for mw12 and mw13: T7139: MediaWiki Capacity Proposal.
Wed, Jul 21, 01:52 · Infrastructure (SRE)
Void added a subtask for T7139: MediaWiki Capacity Proposal: T7676: [New] Server Request for mw12 and mw13.
Wed, Jul 21, 01:52 · MediaWiki (SRE)
Void created T7676: [New] Server Request for mw12 and mw13.
Wed, Jul 21, 01:52 · Infrastructure (SRE)
GitHub <noreply@github.com> added a reverting change for R9:9f709da1b3de: Set wgCreateWikiPersistentModelFile to false (#4008): R9:85fa0b3146f4: Revert "Set wgCreateWikiPersistentModelFile to false (#4008)" (#4009).
Wed, Jul 21, 01:09
GitHub <noreply@github.com> committed R9:85fa0b3146f4: Revert "Set wgCreateWikiPersistentModelFile to false (#4008)" (#4009) (authored by Void).
Revert "Set wgCreateWikiPersistentModelFile to false (#4008)" (#4009)
Wed, Jul 21, 01:09
Void added a comment to T7139: MediaWiki Capacity Proposal.

Can we move forward with this now? Current tasks such as T7626 and T7633 indicate we cannot wait on expanding our infrastructure.

Wed, Jul 21, 01:08 · MediaWiki (SRE)
GitHub <noreply@github.com> added a reverting change for R9:9f709da1b3de: Set wgCreateWikiPersistentModelFile to false (#4008): R9:69e3419bb8f5: Revert "Set wgCreateWikiPersistentModelFile to false (#4008)".
Wed, Jul 21, 01:05
GitHub <noreply@github.com> committed R9:69e3419bb8f5: Revert "Set wgCreateWikiPersistentModelFile to false (#4008)" (authored by Void).
Revert "Set wgCreateWikiPersistentModelFile to false (#4008)"
Wed, Jul 21, 01:05
Void added a comment to T7145: Upgrade MediaWiki cluster to Debian Bullseye.

I'm removing parent tasks, as I don't think it is reasonable to wait for and test Debian Bullseye in our infrastructure given our current capacity problems.

Wed, Jul 21, 01:02 · MediaWiki (SRE)
Void removed a subtask for T7139: MediaWiki Capacity Proposal: T7145: Upgrade MediaWiki cluster to Debian Bullseye.
Wed, Jul 21, 00:59 · MediaWiki (SRE)
Void removed a parent task for T7145: Upgrade MediaWiki cluster to Debian Bullseye: T7139: MediaWiki Capacity Proposal.
Wed, Jul 21, 00:59 · MediaWiki (SRE)
GitHub <noreply@github.com> committed R9:9f709da1b3de: Set wgCreateWikiPersistentModelFile to false (#4008) (authored by Universal_Omega).
Set wgCreateWikiPersistentModelFile to false (#4008)
Wed, Jul 21, 00:12

Tue, Jul 20

YumemiruNiki created T7675: Import XML dump from FandomWiki onto helios.miraheze.org.
Tue, Jul 20, 23:44 · MediaWiki (SRE), MediaWiki
GitHub <noreply@github.com> committed R9:0e1c169f4891: Set wgCreateWikiPersistentModelFile to false (authored by Universal_Omega).
Set wgCreateWikiPersistentModelFile to false
Tue, Jul 20, 23:33
Void closed T7599: Graylog search not working as Resolved.

Operating at 77% disk usage, so looks good. Feel free to reopen if icinga reports a disk usage warning, or you see any disk usage warning in graylog.

Tue, Jul 20, 23:30 · Monitoring, Infrastructure (SRE)
Void added a comment to T7626: redis-server is occasionally killed for OOM.

Can we try and temporarily disable the RequestWikiAIJob to see if this alleviates the load? Or alternately, could we prevent jobrunner3 from running these types of jobs?

Tue, Jul 20, 23:22 · Infrastructure (SRE)
Void lowered the priority of T7633: Persistent resource consumption is causing all sorts from Unbreak Now! to High.
Tue, Jul 20, 22:52 · MediaWiki (SRE), Cloud Infrastructure, Monitoring, MediaWiki
Void closed T7637: Provision mw12, a subtask of T7633: Persistent resource consumption is causing all sorts, as Declined.
Tue, Jul 20, 22:51 · MediaWiki (SRE), Cloud Infrastructure, Monitoring, MediaWiki
Void closed T7637: Provision mw12 as Declined.

Declining for now, we're set to expand resources soon, but don't have the capacity to do so immediately.

Tue, Jul 20, 22:51 · Infrastructure (SRE)
RhinosF1 closed T7674: "Widgets" and "wikiEd" extensions pls as Declined.

Widgets is declined on security grounds
WikiEd is a gadget not extension

Tue, Jul 20, 20:29 · Extensions, Universal Omega, MediaWiki (SRE)
torii.amaterasu created T7674: "Widgets" and "wikiEd" extensions pls.
Tue, Jul 20, 20:24 · Extensions, Universal Omega, MediaWiki (SRE)
TGReddy created T7673: Need CC BY-SA 3.0 on my wiki.
Tue, Jul 20, 18:39 · MediaWiki (SRE), Universal Omega, Configuration
Ugochimobi awarded P437 Deleted wikis 27/06/2021 a Orange Medal token.
Tue, Jul 20, 16:31
R4356th moved T7672: Need NavboxBuilder from Backlog to Maintenance Script Run on the MediaWiki board.
Tue, Jul 20, 10:59 · MediaWiki (SRE), MediaWiki
QuestionLite2 created T7672: Need NavboxBuilder.
Tue, Jul 20, 10:01 · MediaWiki (SRE), MediaWiki
R4356th added a comment to T7670: Maintenance Script Run on snapdatawiki.

Thank you so much!

Tue, Jul 20, 08:46 · MediaWiki (SRE), MediaWiki
RhinosF1 updated subscribers of T7666: LDAP guest user can send mail.
Tue, Jul 20, 05:11 · Infrastructure (SRE), Mail, Security
GitHub <noreply@github.com> committed rPUPC2de40e3ef544: postfix login require postfixUser objectclass (#1816) (authored by Void).
postfix login require postfixUser objectclass (#1816)
Tue, Jul 20, 02:55
Void added a comment to T7666: LDAP guest user can send mail.

Follow up: https://github.com/miraheze/puppet/pull/1816

Tue, Jul 20, 00:28 · Infrastructure (SRE), Mail, Security