Page MenuHomeMiraheze

Paladox
Site Reliabilty EngineerAdministrator

User Details

User Since
Oct 14 2017, 11:40 (147 w, 1 d)
Roles
Administrator
Availability
Available
GitHub User
Unknown
Miraheze User
Paladox [ Global Accounts ]

I live in the United Kingdom GMT/BST(UTC+0, UTC+1).

I am a Site Reliabilty Engineer for Miraheze.

Recent Activity

Yesterday

Paladox lowered the priority of T6012: Update to Debian Buster 10.5 from High to Normal.
Sat, Aug 8, 19:18 · Site Reliability Engineering, Security
Paladox triaged T6012: Update to Debian Buster 10.5 as High priority.
Sat, Aug 8, 19:15 · Site Reliability Engineering, Security

Mon, Aug 3

Paladox added a comment to T6012: Update to Debian Buster 10.5.

I've done puppet2.

Mon, Aug 3, 20:13 · Site Reliability Engineering, Security

Sun, Aug 2

Paladox added a comment to T5994: Upgrade jobrunner capabilities .

Needs a ip purchase approval I think.

Sun, Aug 2, 13:21 · Site Reliability Engineering

Sat, Aug 1

Paladox added a comment to T5750: File extensions + skin install.

@Paladox, what was the reason this extension was declined as 'hard/impossible to install'?

Sat, Aug 1, 14:20 · Extensions, Configuration

Wed, Jul 29

Paladox added a comment to T5933: Connection Refused to Gluster FS Port on gluster*.

The problem is gluster uses a different port every time gluster is restarted, you are lucky if you get the same port after it’s restarted. We need to automate this so that we don’t hate code the port that icings should look for.

Wed, Jul 29, 15:20 · Site Reliability Engineering

Tue, Jul 28

Paladox added a comment to T5982: mw7/4 went down (and caused a mini outage).

Per https://grafana.miraheze.org/d/W9MIkA7iz/miraheze-cluster?orgId=1&var-job=node&var-node=rdb2.miraheze.org&var-port=9100 the cause of the outage was redis restarting.

Tue, Jul 28, 16:17 · Site Reliability Engineering

Mon, Jul 27

Paladox closed T5939: Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails as Resolved.

I simply killed redis-server using pkill -9 <pid>.

Mon, Jul 27, 14:10 · MediaWiki, Amanda Catherine, Production Error, Site Reliability Engineering

Sat, Jul 25

Paladox added a comment to T5967: cp7 health check flapping constantly and triggering DNS Critical alerts.

it's not a cp flapping, it's a problem with mw*. They are causing the healthcheck to hit the timeout thus depool.

Sat, Jul 25, 21:56 · Site Reliability Engineering
Paladox created P338 (An Untitled Masterwork).
Sat, Jul 25, 13:58

Fri, Jul 24

Paladox closed T5961: Deleted wiki are still visible as Resolved.

https://github.com/miraheze/CreateWiki/commit/92879ebb26c29a75689bcfcdc21c07c3c3e168b7

Fri, Jul 24, 19:26 · ManageWiki, Amanda Catherine

Wed, Jul 22

Paladox added a reverting change for rPUPCa9554c6de33e: puppetdb::command_processing_threads: set to 3: rPUPCd5d315f4032e: Revert "puppetdb::command_processing_threads: set to 3".
Wed, Jul 22, 22:56
Paladox committed rPUPCd5d315f4032e: Revert "puppetdb::command_processing_threads: set to 3" (authored by Paladox).
Revert "puppetdb::command_processing_threads: set to 3"
Wed, Jul 22, 22:56
Paladox closed T5950: Add PDFHandler Prerequisites as Invalid.

We have ghostscript and poppler-utils (xpdf-utils) installed.

Wed, Jul 22, 21:27 · Extensions, Site Reliability Engineering

Mon, Jul 20

Paladox triaged T5944: Notice: Undefined offset: 1 in /srv/mediawiki/w/extensions/CreateWiki/includes/WikiInitialise.php on line 77 as Normal priority.
Mon, Jul 20, 19:51 · CreateWiki
Paladox created T5944: Notice: Undefined offset: 1 in /srv/mediawiki/w/extensions/CreateWiki/includes/WikiInitialise.php on line 77.
Mon, Jul 20, 19:51 · CreateWiki
Paladox created P337 (An Untitled Masterwork).
Mon, Jul 20, 19:09
Paladox closed T5941: Could not store upload in the stash (UploadStashFileException): Could not store file xxxxxx when uploading images as Resolved.
Mon, Jul 20, 17:52 · Site Reliability Engineering, MediaWiki
Paladox added a comment to T5941: Could not store upload in the stash (UploadStashFileException): Could not store file xxxxxx when uploading images.

So it now works? Link works and also works on our test wiki.

Mon, Jul 20, 17:29 · Site Reliability Engineering, MediaWiki
Paladox added a comment to T5941: Could not store upload in the stash (UploadStashFileException): Could not store file xxxxxx when uploading images.

I mean could you give me the filename on wiki or link please :)

Mon, Jul 20, 17:06 · Site Reliability Engineering, MediaWiki
Paladox added a comment to T5941: Could not store upload in the stash (UploadStashFileException): Could not store file xxxxxx when uploading images.

Which file?

Mon, Jul 20, 17:01 · Site Reliability Engineering, MediaWiki
Paladox added a comment to T5941: Could not store upload in the stash (UploadStashFileException): Could not store file xxxxxx when uploading images.

Could you retry please?

Mon, Jul 20, 16:48 · Site Reliability Engineering, MediaWiki
Paladox created P336 (An Untitled Masterwork).
Mon, Jul 20, 15:00
Paladox created P335 (An Untitled Masterwork).
Mon, Jul 20, 14:44
Paladox created P333 (An Untitled Masterwork).
Mon, Jul 20, 13:56

Sat, Jul 18

Paladox closed T5919: activate Extension:LinkTitles on tuscriaturas wiki and yourcreatures as Resolved.
Sat, Jul 18, 15:48 · Configuration, Extensions
Paladox created P331 Flow\Exception\InvalidInputException from line 255 of /srv/mediawiki/w/extensions/Flow/includes/Model/Workflow.php: Fail to create title from namespace 2601 and title text 'Contents'.
Sat, Jul 18, 15:41 · Extensions
Paladox closed T5931: Sidebar cache is incorrectly caching the visibility of ManageWiki sidebar links as Resolved.

Done in https://github.com/miraheze/mw-config/commit/e3c7d76b8e3ad724a7155582242461977968cce8

Sat, Jul 18, 15:27 · Site Reliability Engineering, Configuration
Paladox triaged T5893: Allow "Editing the lead section" as Normal priority.
Sat, Jul 18, 15:25 · MediaWiki
Paladox triaged T5915: Media Viewer error as Normal priority.
Sat, Jul 18, 15:25 · Extensions
Paladox triaged T5933: Connection Refused to Gluster FS Port on gluster* as Normal priority.
Sat, Jul 18, 15:24 · Site Reliability Engineering
Paladox added a comment to T5927: VisualEditor Not Working.

Hi, what wiki is this. We cannot debug without the wiki :)

Sat, Jul 18, 15:21 · Extensions

Fri, Jul 17

Paladox added a comment to T5928: DNS Transfer Errors for wiki.thehall.xyz.

Cannot seem to reproduce, works for me.

Fri, Jul 17, 19:35 · Site Reliability Engineering, Amanda Catherine
Paladox lowered the priority of T5928: DNS Transfer Errors for wiki.thehall.xyz from Unbreak Now! to Normal.
Fri, Jul 17, 19:35 · Site Reliability Engineering, Amanda Catherine
Paladox added a comment to T5928: DNS Transfer Errors for wiki.thehall.xyz.

Um, you shouldn't be using th.miraheze.org, it should be mw-lb.miraheze.org and also you shouldn't have the yellow flag on, on wiki.xxxx

Fri, Jul 17, 19:31 · Site Reliability Engineering, Amanda Catherine

Wed, Jul 15

Paladox added a reverting change for R9:2847eb5f79b2: Switch mhglobal to c2: R9:ca98ae342388: Revert "Switch mhglobal to c2".
Wed, Jul 15, 21:10
Paladox committed R9:ca98ae342388: Revert "Switch mhglobal to c2" (authored by Paladox).
Revert "Switch mhglobal to c2"
Wed, Jul 15, 21:10
Paladox committed R9:48bd994a00aa: Revert "Update Database.php" (authored by Paladox).
Revert "Update Database.php"
Wed, Jul 15, 21:10
Paladox added a reverting change for R9:13b1913bd757: Update Database.php: R9:48bd994a00aa: Revert "Update Database.php".
Wed, Jul 15, 21:10
Paladox committed rPUPCc0da7f143a3d: Merge branch 'master' into paladox-patch-10 (authored by Paladox).
Merge branch 'master' into paladox-patch-10
Wed, Jul 15, 15:39

Tue, Jul 14

Paladox edited P330 (An Untitled Masterwork).
Tue, Jul 14, 23:17
Paladox created P330 (An Untitled Masterwork).
Tue, Jul 14, 23:15
Paladox created P329 (An Untitled Masterwork).
Tue, Jul 14, 21:44
Paladox created P328 (An Untitled Masterwork).
Tue, Jul 14, 21:44
Paladox added a comment to T5892: LocalSettings Configurations.

@Reception123
I hope I am correct in this config I am requesting, took some research on meta and through configs to find this.
Can you add these? I believe they are the correct ones.

$wgVisualEditorFullRestbaseURL = 'https://dcmultiverse.miraheze.org/dcmultiverse.miraheze.org/';
$wgVisualEditorRestbaseURL = 'https://dcmultiverse.miraheze.org/api/rest_v1/page/html/';
Tue, Jul 14, 14:11 · Configuration

Mon, Jul 13

Paladox committed rSSL5a3d13b8fb30: Merge branch 'master' into paladox-patch-1 (authored by Paladox).
Merge branch 'master' into paladox-patch-1
Mon, Jul 13, 15:22

Sun, Jul 12

Paladox closed T5634: Page Preview no longer working on dreamsitwiki as Resolved.

Fixed with https://github.com/miraheze/CreateWiki/commit/b76e46eee8ceeb824223796aae23ae7803a8fb90

Sun, Jul 12, 19:52 · Extensions

Sat, Jul 11

Paladox created P327 (An Untitled Masterwork).
Sat, Jul 11, 20:54
Paladox committed R9:670ab88924ca: Revert "Add small site notice for closed wikis being migrated to another db… (authored by Paladox).
Revert "Add small site notice for closed wikis being migrated to another db…
Sat, Jul 11, 14:44
Paladox added a reverting change for R9:951ae31ca1b2: Add small site notice for closed wikis being migrated to another db cluster: R9:670ab88924ca: Revert "Add small site notice for closed wikis being migrated to another db….
Sat, Jul 11, 14:44

Fri, Jul 10

Paladox added a comment to T5904: Error with switching between VisualEditor and New Wikitext Source Editor in dual tab environment.

I’m not sure what the issue is as I cannot reproduce.

Fri, Jul 10, 22:26 · Extensions

Jul 10 2020

Paladox is attending E117: SRE Duty.
Jul 10 2020, 14:59
Paladox added a comment to T5898: Data too long for column error in CreateWiki.

Increased further with https://github.com/miraheze/CreateWiki/commit/96dd9173c27d9582f4385a2d58706491c31d8f77

Jul 10 2020, 14:30 · Amanda Catherine, CreateWiki
Paladox created P326 (An Untitled Masterwork).
Jul 10 2020, 14:16
Paladox closed T5898: Data too long for column error in CreateWiki as Resolved.
Jul 10 2020, 14:11 · Amanda Catherine, CreateWiki
Paladox added a comment to T5898: Data too long for column error in CreateWiki.

Fixed with https://github.com/miraheze/CreateWiki/commit/35b3b814810511c25ecf89be3c993b900204a4ab. Though do we want to convert this to a text column (increasing the characters to 65,535)?

Jul 10 2020, 14:10 · Amanda Catherine, CreateWiki

Jul 9 2020

Paladox triaged T5895: /srv/mediawiki/w/includes/Autopromote.php: PHP Notice: Array to string conversion as Normal priority.
Jul 9 2020, 19:19 · Production Error, ManageWiki
Paladox added a reverting change for R9:96223d11e603: Revert "Set wgGlobalPreferencesDB to mhglobal": R9:d35188e3d602: Revert "Revert "Set wgGlobalPreferencesDB to mhglobal"".
Jul 9 2020, 19:12
Paladox committed R9:d35188e3d602: Revert "Revert "Set wgGlobalPreferencesDB to mhglobal"" (authored by Paladox).
Revert "Revert "Set wgGlobalPreferencesDB to mhglobal""
Jul 9 2020, 19:12
Paladox added a reverting change for R9:3da12b9d6890: Set wgGlobalPreferencesDB to mhglobal: R9:96223d11e603: Revert "Set wgGlobalPreferencesDB to mhglobal".
Jul 9 2020, 19:11
Paladox committed R9:96223d11e603: Revert "Set wgGlobalPreferencesDB to mhglobal" (authored by Paladox).
Revert "Set wgGlobalPreferencesDB to mhglobal"
Jul 9 2020, 19:11

Jul 8 2020

Paladox added a comment to T5885: Image thumbnails not being generated.

We need the link to the images in order to debug please.

Jul 8 2020, 13:56 · MediaWiki

Jul 7 2020

Paladox added a reverting change for rPUPC0e76f5d9fc64: jobrunner: Increase process time limit to 300: rPUPC9f6b030e7743: Revert "jobrunner: Increase process time limit to 300".
Jul 7 2020, 14:09
Paladox committed rPUPC9f6b030e7743: Revert "jobrunner: Increase process time limit to 300" (authored by Paladox).
Revert "jobrunner: Increase process time limit to 300"
Jul 7 2020, 14:09

Jul 5 2020

Paladox closed T5873: Error 503 Backend fetch failed as Resolved.

This is now resolved.

Jul 5 2020, 21:55 · Site Reliability Engineering
Paladox committed R9:6d58ad711a5a: Fix setting wgHiddenPrefs for dcwiki (authored by Paladox).
Fix setting wgHiddenPrefs for dcwiki
Jul 5 2020, 01:25
Paladox committed R9:55b9204b0498: Revert "Fix setting wgHiddenPrefs for dcwiki (#3137)" (authored by Paladox).
Revert "Fix setting wgHiddenPrefs for dcwiki (#3137)"
Jul 5 2020, 01:25
Paladox added a reverting change for R9:d7fa2bf95ff3: Fix setting wgHiddenPrefs for dcwiki (#3137): R9:55b9204b0498: Revert "Fix setting wgHiddenPrefs for dcwiki (#3137)".
Jul 5 2020, 01:25

Jul 4 2020

Paladox reopened T5866: Thumbnails all set to a default 10px (nynthidbwiki) as "Open".
Jul 4 2020, 16:23 · Configuration
Paladox added a comment to T5866: Thumbnails all set to a default 10px (nynthidbwiki).

It appears my trick of setting wgThumbnailEpoch to 0 on our test server and reloading https://nynthidb.miraheze.org/wiki/Special:ListFiles doesn't work, you should be able to fix this by reuploading the file.

Jul 4 2020, 15:35 · Configuration
Paladox added a comment to T5614: Whitelist imgbox.com and googleusercontent.com so images can be shown.

Wildcard only supports for example *.x.x or *.x.x.x, the wild card does not allow for *.x.x to become x.x.x.x.

Jul 4 2020, 14:39 · Puppet, Site Reliability Engineering
Paladox triaged T5866: Thumbnails all set to a default 10px (nynthidbwiki) as Normal priority.
Jul 4 2020, 14:25 · Configuration
Paladox closed T5866: Thumbnails all set to a default 10px (nynthidbwiki) as Resolved.

Fixed, just had to regenerate the thumb which as you can see has been done :)

Jul 4 2020, 14:25 · Configuration

Jul 3 2020

Paladox added a comment to T5732: Special:Badtitle.

Correction the above ^ it's an us issue but "project" is the namespace.

Jul 3 2020, 18:48 · MediaWiki
Paladox added a comment to T5732: Special:Badtitle.

No, this is not an upstream issue. The namespace doesn't exist in ManageWiki.

Jul 3 2020, 18:48 · MediaWiki

Jul 2 2020

Paladox closed T5827: ManageWiki/permissions groups do not seem to be deleted as Resolved.

Deleted the requested groups.

Jul 2 2020, 23:46 · MediaWiki, Amanda Catherine
Paladox added a comment to T5827: ManageWiki/permissions groups do not seem to be deleted.

Fixed with https://github.com/miraheze/ManageWiki/pull/174 so it shouldn't happen in the future but i have to delete the groups you requested.

Jul 2 2020, 23:17 · MediaWiki, Amanda Catherine
Paladox added a comment to T5827: ManageWiki/permissions groups do not seem to be deleted.

Seems that for "_volunteer_developers" has "{"0":"","1":"","2":"","5":""}" which would explain this i think?

Jul 2 2020, 17:46 · MediaWiki, Amanda Catherine
Paladox added a comment to T5735: Audit user rights blacklist.

No, since sysop basically means admin. We've already blacklisted this right.

Jul 2 2020, 16:00 · Security, Configuration
Paladox changed the visibility for T5735: Audit user rights blacklist.
Jul 2 2020, 14:31 · Security, Configuration
Paladox closed T5735: Audit user rights blacklist as Resolved.

Just checked and the only perm we needed to blacklist is "editothersprofiles-private" which we already do.

Jul 2 2020, 14:24 · Security, Configuration

Jul 1 2020

Paladox lowered the priority of T4425: Fix all mysql tables that are using latin rather then utf8mb4 from Normal to Low.
Jul 1 2020, 19:26 · Site Reliability Engineering
Paladox lowered the priority of T5833: mediawiki-static keeps getting unmounted on mw* from High to Normal.
Jul 1 2020, 19:24 · Site Reliability Engineering
Paladox added a project to T5543: Reconfigure SaltStack or replace it with another tool: Goal-2020-Jul-Dec.

yup! Let's make it a goal.

Jul 1 2020, 19:24 · Security, Site Reliability Engineering

Jun 30 2020

Dmehus awarded T5848: SSL certificate for "www.publictestwiki.com" reports as having expired a Doubloon token.
Jun 30 2020, 22:57 · SSL
Paladox closed T5848: SSL certificate for "www.publictestwiki.com" reports as having expired as Resolved.

Done with https://github.com/miraheze/ssl/pull/330

Jun 30 2020, 22:14 · SSL

Jun 29 2020

Paladox created P325 (An Untitled Masterwork).
Jun 29 2020, 23:09
Paladox edited projects for T5827: ManageWiki/permissions groups do not seem to be deleted, added: MediaWiki; removed ManageWiki.
Jun 29 2020, 12:28 · MediaWiki, Amanda Catherine
Paladox edited projects for T5827: ManageWiki/permissions groups do not seem to be deleted, added: ManageWiki; removed MediaWiki.
Jun 29 2020, 12:27 · MediaWiki, Amanda Catherine

Jun 28 2020

Paladox added a comment to R9:40ce6aedcc66: Blacklist titleblacklistlog.

Reveals PII information, and anyways it only works if a config is switched on which we’ve disabled.

Jun 28 2020, 15:13
Paladox added a comment to T5735: Audit user rights blacklist.

viewuserlang comes from WikimediaIncubator. From the looks of it, it looks safe to me.

Jun 28 2020, 01:05 · Security, Configuration

Jun 27 2020

Paladox added a reverting change for R9:6ff9bdb18b68: Set wgWikiDiscoverSubdomain to .miraheze.org (#3127): R9:1c5d8ba7fb98: Revert "Set wgWikiDiscoverSubdomain to .miraheze.org (#3127)".
Jun 27 2020, 23:54
Paladox committed R9:1c5d8ba7fb98: Revert "Set wgWikiDiscoverSubdomain to .miraheze.org (#3127)" (authored by Paladox).
Revert "Set wgWikiDiscoverSubdomain to .miraheze.org (#3127)"
Jun 27 2020, 23:54
Paladox added a reverting change for R9:e7ac32c7351a: Remove wgWikiDiscoverClosedList, wgWikiDiscoverInactiveListand…: R9:0fa2f8b3104b: Revert "Remove wgWikiDiscoverClosedList, wgWikiDiscoverInactiveListand….
Jun 27 2020, 23:54
Paladox committed R9:0fa2f8b3104b: Revert "Remove wgWikiDiscoverClosedList, wgWikiDiscoverInactiveListand… (authored by Paladox).
Revert "Remove wgWikiDiscoverClosedList, wgWikiDiscoverInactiveListand…
Jun 27 2020, 23:54
Paladox closed T5812: /mnt/mediawiki-static/ mounts not working on mw[4-7] / test2 as Resolved.

Fixed.

Jun 27 2020, 11:42 · Amanda Catherine, Site Reliability Engineering

Jun 26 2020

Paladox closed T5800: Changing custom domain as Resolved.

Fixed.

Jun 26 2020, 23:26 · SSL
Paladox closed T5805: Custom Domain Request as Resolved.

Fixed.

Jun 26 2020, 23:26 · SSL
Paladox added a comment to T5801: Files.

We won't be able to up the upload size to 500MB, for the simple reason we would have to increase the php upload size and possibly also up the timeout for nginx too.

Jun 26 2020, 15:40 · Configuration
Paladox closed T5800: Changing custom domain as Resolved.
Jun 26 2020, 15:38 · SSL