Page MenuHomeMiraheze

Goal-2020-Jan-JunGoal
ArchivedPublic

Members (4)

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Miraheze's Goals for the first half of 2020 (January 1st ~ June 31st).

Tasks added to this project must be at least one of the following:

  • a long-term project that can realistically be finished before June 31st,
  • a development project that will have a positive impact on Miraheze communities,
  • an objective for Site Reliability Engineers (infrastructure, introducing a new service, major work etc.).

MediaWiki and development tasks can be added freely by anyone assuming someone has in the past hinted at the possibility they would be willing to work on it or have a noticeable impact on communities.

Site Reliability Engineering tasks should only be added by members of the Site Reliability Engineer team as they have full control over their priorities and workflow, not subject to community benefit.

< Goal-2019-Jul-Dec | Goal-2020-Jul-Dec >

Recent Activity

Jun 25 2022

Paladox closed T5044: Setup centralised logging for services as Resolved.

Resolved

Jun 25 2022, 15:54 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox updated the task description for T5044: Setup centralised logging for services.
Jun 25 2022, 15:54 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
John added a comment to T5044: Setup centralised logging for services.

@Paladox less than a week until end of goal period - do we have an update on this?

Jun 25 2022, 13:02 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

May 9 2022

Universal_Omega moved T5044: Setup centralised logging for services from Backlog to Central Logging on the Monitoring board.
May 9 2022, 19:26 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Universal_Omega added a project to T5044: Setup centralised logging for services: Monitoring.
May 9 2022, 19:26 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Apr 16 2022

Paladox updated the task description for T5044: Setup centralised logging for services.
Apr 16 2022, 23:18 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Feb 21 2022

Paladox claimed T5044: Setup centralised logging for services.
Feb 21 2022, 15:09 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox updated the task description for T5044: Setup centralised logging for services.
Feb 21 2022, 14:46 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Jan 1 2022

John added a comment to T5044: Setup centralised logging for services.

This task has taken a back foot, over other work which has higher priority currently such as T8469 T8350

Jan 1 2022, 10:45 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Universal_Omega moved T5044: Setup centralised logging for services from Backlog to Infrastructure on the Goal-2022-Jan-Jun board.
Jan 1 2022, 03:22 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Universal_Omega added a project to T5044: Setup centralised logging for services: Goal-2022-Jan-Jun.
Jan 1 2022, 03:15 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Dec 5 2021

John added a comment to T5044: Setup centralised logging for services.

I am going to start progress on this task, firstly by cleaning up how we define all of this in puppet. I'll introduce simply logging stanzas that we can define over and over again for each log file, that handles all of the syslog-ng logic + logrotate configuration for the new system.

Dec 5 2021, 21:06 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Nov 7 2021

Universal_Omega merged T7135: Ingest PHP-FPM slowlogs into Graylog into T5044: Setup centralised logging for services.
Nov 7 2021, 00:59 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Oct 20 2021

John added a comment to T5044: Setup centralised logging for services.

New server list for checking the above plan against:

Oct 20 2021, 12:45 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
John added a comment to T5044: Setup centralised logging for services.

Plan for resolving this task:

  • All services will have their logs ingested into Graylog, this isn't negotiable.
  • Where logs are ingested, we will maintain 24-48 hours of *local* logs on the server. This will be supported by log rotation.
Oct 20 2021, 12:33 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Oct 11 2021

John claimed T5044: Setup centralised logging for services.
Oct 11 2021, 18:08 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
John added a comment to T5044: Setup centralised logging for services.

T7740 is likely to be influenced by work done on this task.

Oct 11 2021, 18:06 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Sep 3 2021

RhinosF1 closed T7967: Icingaweb2 is down, a subtask of T4017: Reconfigure TLS settings inside MariaDB, as Resolved.
Sep 3 2021, 18:22 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun

Sep 2 2021

John closed T4017: Reconfigure TLS settings inside MariaDB, a subtask of T4016: Encrypt all traffic inside Miraheze Cluster, as Resolved.
Sep 2 2021, 15:46 · Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun
John closed T4017: Reconfigure TLS settings inside MariaDB as Resolved.
Sep 2 2021, 15:46 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun

Sep 1 2021

John added a comment to T4017: Reconfigure TLS settings inside MariaDB.

Phabricator can not be done as it does not support MySQL SSL connections at all in the code.

Sep 1 2021, 21:15 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun
John added a comment to T4017: Reconfigure TLS settings inside MariaDB.

TLS is now configured so only 1.2 and 1.3 can be used, and root has SSL encryption:

Sep 1 2021, 13:30 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun
John added a comment to T4017: Reconfigure TLS settings inside MariaDB.

TLS setup is mostly well-defined for MariaDB. The length this task has been opened has meant it has lost its original purpose and the constant recycling of it has meant the purpose and end target is undefined.

Sep 1 2021, 13:04 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun

Aug 18 2021

John moved T4017: Reconfigure TLS settings inside MariaDB from Long Term to Goals on the Infrastructure (SRE) board.
Aug 18 2021, 16:31 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun

Aug 11 2021

John moved T4017: Reconfigure TLS settings inside MariaDB from Backlog to Infrastructure on the Goal-2021-Jul-Dec board.
Aug 11 2021, 18:30 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun

Aug 10 2021

Paladox added a comment to T5044: Setup centralised logging for services.
In T5044#156437, @John wrote:

@Paladox has raised concerns with centralised-only logging. We should explore these concerns before pushing for things like nginx access logs as these are critical for debugging some traffic influx/DoS attacks.

Aug 10 2021, 16:57 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Reception123 added a comment to T5044: Setup centralised logging for services.

I agree with that. At least for some logs it's definitely useful to have logs stored locally in case something goes wrong and the logs don't get transmitted to graylog.

Aug 10 2021, 14:14 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
John claimed T4017: Reconfigure TLS settings inside MariaDB.

Re-assigning and goaling.

Aug 10 2021, 12:36 · Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2019-Jul-Dec, Goal-2020-Jan-Jun
John updated subscribers of T5044: Setup centralised logging for services.

@Paladox has raised concerns with centralised-only logging. We should explore these concerns before pushing for things like nginx access logs as these are critical for debugging some traffic influx/DoS attacks.

Aug 10 2021, 12:20 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Jul 31 2021

Universal_Omega updated subscribers of T5044: Setup centralised logging for services.
Jul 31 2021, 00:25 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Universal_Omega updated the task description for T5044: Setup centralised logging for services.
Jul 31 2021, 00:25 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Jul 3 2021

Universal_Omega moved T5044: Setup centralised logging for services from Backlog to Infrastructure on the Goal-2021-Jul-Dec board.
Jul 3 2021, 18:44 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Universal_Omega added a project to T5044: Setup centralised logging for services: Goal-2021-Jul-Dec.

Moving over to new goal period. Feel free to remove if it isn't wanted to be moved over.

Jul 3 2021, 18:43 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Jun 14 2021

Void added a comment to T5044: Setup centralised logging for services.

I could look into taking this over from @Paladox. Is there anything not on this task that I should be aware of if I do?

Jun 14 2021, 19:57 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox placed T5044: Setup centralised logging for services up for grabs.
Jun 14 2021, 18:59 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

May 3 2021

Southparkfan updated the task description for T5044: Setup centralised logging for services.
May 3 2021, 17:54 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Apr 19 2021

Paladox updated the task description for T5044: Setup centralised logging for services.
Apr 19 2021, 21:44 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

there's one other log I didn't think we need to send for proxmox (wasn't really any info we needed I think).

Apr 19 2021, 21:44 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

Added pve* logging via https://github.com/miraheze/puppet/pull/1713

Apr 19 2021, 21:44 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

I will try and finish this now (for cloud*)

Apr 19 2021, 20:48 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Mar 27 2021

Universal_Omega moved T5105: Investigate and Implement basic Machine Learning concepts for automatic wiki creation from Backlog to Goals on the MediaWiki (SRE) board.
Mar 27 2021, 17:06 · MediaWiki (SRE), Goal-2021-Jan-Jun, Universal Omega, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun, CreateWiki

Mar 15 2021

Paladox added a comment to T5044: Setup centralised logging for services.

Done with:

Mar 15 2021, 00:30 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Mar 10 2021

John closed T5105: Investigate and Implement basic Machine Learning concepts for automatic wiki creation as Resolved.

https://github.com/miraheze/CreateWiki/pull/200 makes this task resolved, only setting a configuration in LS is required now to enable this.

Mar 10 2021, 16:40 · MediaWiki (SRE), Goal-2021-Jan-Jun, Universal Omega, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun, CreateWiki

Mar 9 2021

Southparkfan added a comment to T5044: Setup centralised logging for services.

We switched off syslog-ng logging on the cloud servers. Not sure if we want to switch it back on @John @Southparkfan ?

Yes, let's see if we can receive proxmox logs without further tweaking.

Mar 9 2021, 11:45 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox updated the task description for T5044: Setup centralised logging for services.
Mar 9 2021, 01:19 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

So I've created and merge this pull https://github.com/miraheze/puppet/pull/1695. Essentially logs for puppetserver/puppetdb are now read and sent to graylog.

Mar 9 2021, 01:15 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun

Mar 8 2021

Paladox added a comment to T5044: Setup centralised logging for services.

We switched off syslog-ng logging on the cloud servers. Not sure if we want to switch it back on @John @Southparkfan ?

Mar 8 2021, 01:01 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

I've created 3 new streams for gluster in graylog. I've only added the logs that we would be interested in (skipping some as I don't think that we need to have them in graylog).

Mar 8 2021, 01:00 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox updated the task description for T5044: Setup centralised logging for services.
Mar 8 2021, 00:58 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun
Paladox added a comment to T5044: Setup centralised logging for services.

Puppet-agent logs to syslog in addition to it logs to logging to a file.

Mar 8 2021, 00:57 · Monitoring, Goal-2022-Jan-Jun, Goal-2021-Jul-Dec, Infrastructure (SRE), Goal-2021-Jan-Jun, Goal-2020-Jul-Dec, Goal-2020-Jan-Jun