Page MenuHomeMiraheze

SRE AutomationTag
ActivePublic

Members (1)

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

An tag for all tasks concerning automation of SRE tasks that are currently done manually (e.g. SSL, MediaWiki and extension upgrades, etc.)

Recent Activity

Aug 3 2023

Void merged T11117: Automate ImportDump into T10304: Fully automate ImportDump after ensuring security .
Aug 3 2023, 20:16 · SRE Automation, MediaWiki (SRE), ImportDump

May 29 2023

Reception123 updated subscribers of T10311: Create extension to automate running some maintenance scripts (request-based).

Please note that a similar task is currently being worked on by @Universal_Omega.

May 29 2023, 08:20 · SRE Automation, MediaWiki (SRE), MediaWiki

Apr 26 2023

Reception123 added a comment to T10311: Create extension to automate running some maintenance scripts (request-based).

Since there's already extensions with similar names, we should probably call ours MaintenanceScripts.

Apr 26 2023, 17:08 · SRE Automation, MediaWiki (SRE), MediaWiki

Apr 3 2023

OrangeStar moved T10304: Fully automate ImportDump after ensuring security from Backlog to Long Term on the MediaWiki (SRE) board.
Apr 3 2023, 20:08 · SRE Automation, MediaWiki (SRE), ImportDump
OrangeStar moved T10266: ssl-certificate should scan the cert and redirect yaml file for entries before adding one from Goals to Backlog on the MediaWiki (SRE) board.
Apr 3 2023, 09:42 · SRE Automation, MediaWiki (SRE), SSL
OrangeStar moved T10266: ssl-certificate should scan the cert and redirect yaml file for entries before adding one from Backlog to Goals on the MediaWiki (SRE) board.
Apr 3 2023, 09:40 · SRE Automation, MediaWiki (SRE), SSL

Mar 30 2023

Reception123 added a comment to T10304: Fully automate ImportDump after ensuring security .

Noting that this would be done in a similar way to https://github.com/miraheze/DataDump/blob/master/includes/jobs/DataDumpGenerateJob.php but would require additional security

Mar 30 2023, 08:59 · SRE Automation, MediaWiki (SRE), ImportDump

Mar 27 2023

Reception123 updated subscribers of T7582: Create automated system for managing SSL requests.
Mar 27 2023, 09:13 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Mar 18 2023

Unknown Object (User) removed a project from T10304: Fully automate ImportDump after ensuring security : Universal Omega.
Mar 18 2023, 03:37 · SRE Automation, MediaWiki (SRE), ImportDump

Mar 14 2023

Reception123 updated the task description for T7582: Create automated system for managing SSL requests.
Mar 14 2023, 12:01 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 updated subscribers of T7582: Create automated system for managing SSL requests.

https://github.com/Reception123/RequestSSL has been created based on ImportDump. Things that are required to make it operational

  • Add a method so that $oldstatus and $newstatus is known in order for the updateManageWiki function to be executed only when the status is changed from something else to completed
  • Implement logging (can be copied from ManageWiki) so that when RemoteWiki is executed it logs it as if someone had changed managewiki on wiki
  • Fix issues with timestamp (might just be a problem with the SQL implemented on beta)

Due to limited knowledge on my part, it would be preferable if someone else had a go at this.

  • Check if all i18n messages make sense (can be done by anyone) [DONE!]
Mar 14 2023, 11:58 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Feb 10 2023

MacFan4000 added a comment to T10463: mirahezerenewssl not working.

I wrote some scripts, and am currently doing mass renewals in batches a few times per day.

Feb 10 2023, 05:35 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL

Feb 8 2023

Unknown Object (User) closed T10463: mirahezerenewssl not working as Resolved.

Closing, since mirahezerenewssl works again (which this task is for) but it does seem all currently missed certs still need redone again.

Feb 8 2023, 21:22 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
Unknown Object (User) added a comment to T10463: mirahezerenewssl not working.

Works now.

Feb 8 2023, 21:03 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
Unknown Object (User) added a comment to T10463: mirahezerenewssl not working.

https://github.com/miraheze/puppet/commit/566c0e20719dbb4511498255e7decfe1f238dfc5

Feb 8 2023, 20:45 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
MacFan4000 added a comment to T10463: mirahezerenewssl not working.

Hmm, an alert came in about 20 minutes ago, and a renewal should have happened but it didn’t which means there is still something going on. That above change was deployed.

Feb 8 2023, 20:15 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
Void added a comment to T10463: mirahezerenewssl not working.

Regarding the failure, I'm not sure ssl-acme failed, but rather the logging for mirahezerenewssl.py filled the disk space causing the entire process to fail. See https://github.com/miraheze/puppet/pull/3145

Feb 8 2023, 18:56 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
Reception123 added a comment to T10311: Create extension to automate running some maintenance scripts (request-based).

Man, robots extensions really are stealing our jobs volunteer positions. I have to ask though, what's so bad about SSH? It's more secure than regular web browsers, at least in my opinion.

Feb 8 2023, 17:35 · SRE Automation, MediaWiki (SRE), MediaWiki
OrangeStar added a comment to T10311: Create extension to automate running some maintenance scripts (request-based).

Man, robots extensions really are stealing our jobs volunteer positions. I have to ask though, what's so bad about SSH? It's more secure than regular web browsers, at least in my opinion.

Feb 8 2023, 17:27 · SRE Automation, MediaWiki (SRE), MediaWiki
Unknown Object (User) added a comment to T10463: mirahezerenewssl not working.

My script won't work for the new version of ssl-certificate, but should be able to make a new one for it.

Feb 8 2023, 17:21 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
Reception123 added a project to T10304: Fully automate ImportDump after ensuring security : SRE Automation.
Feb 8 2023, 17:06 · SRE Automation, MediaWiki (SRE), ImportDump
Reception123 added a project to T10266: ssl-certificate should scan the cert and redirect yaml file for entries before adding one: SRE Automation.
Feb 8 2023, 17:06 · SRE Automation, MediaWiki (SRE), SSL
Reception123 added a project to T10311: Create extension to automate running some maintenance scripts (request-based): SRE Automation.
Feb 8 2023, 17:06 · SRE Automation, MediaWiki (SRE), MediaWiki
Reception123 edited Description on SRE Automation.
Feb 8 2023, 16:50
Reception123 triaged T10463: mirahezerenewssl not working as High priority.

I think @Universal_Omega might have had a script or some way to do this. What I'd recommend is now that we have this opportunity to manually renew is to separate renewals so that next time they don't all attempt to be renewed in the same day (so a batch tomorrow, a batch Friday, etc.)

Feb 8 2023, 16:46 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL
MacFan4000 added projects to T10463: mirahezerenewssl not working: SSL, SRE Automation, MediaWiki (SRE).
Feb 8 2023, 15:21 · Universal Omega, MediaWiki (SRE), SRE Automation, SSL

Feb 1 2023

Reception123 updated the task description for T7582: Create automated system for managing SSL requests.
Feb 1 2023, 09:31 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Just so we don't forget, the current idea would be to try using https://github.com/wikimedia/acme-chief and have an API backend for ManageWiki with the web app being MediaWiki.

Feb 1 2023, 09:30 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 20 2023

Reception123 renamed T7582: Create automated system for managing SSL requests from Create better system for managing SSL requests to Create automated system for managing SSL requests.
Jan 20 2023, 13:20 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 2 2023

Reception123 added a project to T7582: Create automated system for managing SSL requests: Goal-2023-Jan-Jun.
Jan 2 2023, 11:21 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Dec 15 2022

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

While this hasn't been fully tested yet here is my not-so-perfect version of step 3 which I unfortunately didn't integrate into the ssl-certificate script due to lack of knowledge on how to do so properly and not wanting to make things too messy. Here is the current script that can be used in the meantime (not 100% sure if DNS works yet): https://phabricator.miraheze.org/P474 and hopefully be integrated into the main one soon so that step 4 can follow.

Dec 15 2022, 11:57 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Nov 26 2022

Reception123 updated the task description for T7582: Create automated system for managing SSL requests.
Nov 26 2022, 18:48 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Nov 11 2022

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Opened https://github.com/miraheze/puppet/pull/2996.

Nov 11 2022, 13:59 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Nov 10 2022

Unknown Object (User) updated the task description for T7582: Create automated system for managing SSL requests.
Nov 10 2022, 16:45 · Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Sep 19 2022

Unknown Object (User) removed a subtask for T8692: Write a bot script for update WikiApiary: T8693: Add sort and timestamp related params to WikiDiscover API .
Sep 19 2022, 07:22 · SRE Automation, MediaWiki (SRE)
Unknown Object (User) closed T8692: Write a bot script for update WikiApiary, a subtask of T8691: Update data on WikiApiary, as Declined.
Sep 19 2022, 07:22 · Universal Omega, SRE Automation, MediaWiki (SRE)
Unknown Object (User) closed T8692: Write a bot script for update WikiApiary as Declined.

Per T8691#197415 and the same goes for that. If it reliably comes back online, this task should be reopened. Thank you!

Sep 19 2022, 07:22 · SRE Automation, MediaWiki (SRE)
Unknown Object (User) closed T8691: Update data on WikiApiary as Declined.

For now, declining, it should be reopened if WikiApiary ever comes back online, reliably. Thank you!

Sep 19 2022, 07:21 · Universal Omega, SRE Automation, MediaWiki (SRE)

Sep 14 2022

Lens0021 added a comment to T8691: Update data on WikiApiary.

At the last month, Mark A. Hershberger said:

I recently re-deployed the WikiApiary site, so we're in the process of ensuring it is correctly set up.

Sep 14 2022, 05:20 · Universal Omega, SRE Automation, MediaWiki (SRE)
Unknown Object (User) reopened T8691: Update data on WikiApiary as "Open".

On second thought I will leave this open for a bit longer, feel free to decline it yourself if you think it should be, but otherwise for at least a few more weeks, we can wait if you want.

Sep 14 2022, 05:08 · Universal Omega, SRE Automation, MediaWiki (SRE)
Unknown Object (User) moved T8691: Update data on WikiApiary from Unsorted to Long Term on the Universal Omega board.
Sep 14 2022, 05:05 · Universal Omega, SRE Automation, MediaWiki (SRE)
Unknown Object (User) closed T8691: Update data on WikiApiary as Declined.

I am going to go ahead and mark this as declined since WikiApiary has been down off and on for months, if it comes back online, and reliable, this can definitely be reopened. Thanks!

Sep 14 2022, 05:05 · Universal Omega, SRE Automation, MediaWiki (SRE)

Sep 12 2022

Unknown Object (User) moved T9092: Create automated system for managing import requests from Unsorted to Goals on the Universal Omega board.
Sep 12 2022, 22:19 · Universal Omega, ImportDump, MediaWiki, SRE Automation, MediaWiki (SRE)
Unknown Object (User) closed T9092: Create automated system for managing import requests as Resolved.
Sep 12 2022, 22:19 · Universal Omega, ImportDump, MediaWiki, SRE Automation, MediaWiki (SRE)
Lens0021 added a comment to T8691: Update data on WikiApiary.

FYI: WikiApiary.com appears down https://phabricator.wikimedia.org/T304558

Sep 12 2022, 03:35 · Universal Omega, SRE Automation, MediaWiki (SRE)
Lens0021 added a comment to T8692: Write a bot script for update WikiApiary.

I don't forget this but there is no significant progress. My last work is here: https://gitlab.com/mwbot-rs/contrib/-/merge_requests/2

Sep 12 2022, 03:30 · SRE Automation, MediaWiki (SRE)
Unknown Object (User) added a comment to T8692: Write a bot script for update WikiApiary.

Any progress on this?

Sep 12 2022, 03:19 · SRE Automation, MediaWiki (SRE)

Jul 4 2022

RhinosF1 updated the task description for T9310: Fix minor style issues in deploy-mediawiki raised in review.
Jul 4 2022, 12:16 · MediaWiki (SRE), SRE Automation
RhinosF1 closed T9310: Fix minor style issues in deploy-mediawiki raised in review as Resolved.

_construct_l10n_command was added with https://github.com/miraheze/puppet/pull/2456/commits/ef8aaa8cf37f335dfa64f4fbb3588bd802626202 and will be merged with v4

Jul 4 2022, 11:27 · MediaWiki (SRE), SRE Automation

Jun 18 2022

Unknown Object (User) added a comment to T9092: Create automated system for managing import requests.

I also created https://www.mediawiki.org/wiki/Extension:ImportDump about a week ago. It needs a bit better documentation but about as much as our other extensions for now. I'll improve it later.

Jun 18 2022, 04:37 · Universal Omega, ImportDump, MediaWiki, SRE Automation, MediaWiki (SRE)