Page MenuHomeMiraheze
Create Task
Maniphest T2335

Intermittent 503s still occuring on wikis
Closed, ResolvedPublic
Actions

Description

I created this new task because previous ones have been mixing up intermittent 503s and permanent ones caused by other issues. This task is only for the intermittent errors that occur.

It's reported many times by several users that sometimes when they try to access a page on their wiki, they get a 503 error which lasts for a short period of time. Per T1979#42376 it could be something with Varnish, since even after mw2 was upgraded, the problem is still persisting.

Even though this doesn't cause downtime exactly, it is still inconvenient for users and should be looked into.

Related Objects
Search...

Event Timeline

Reception123 created this task.Oct 23 2017, 06:57
Herald added subscribers: revi, Southparkfan, PokestarFan and 4 others. · View Herald TranscriptOct 23 2017, 06:57
John subscribed.Oct 23 2017, 12:42

Lack of capacity potentially. mw2 looks maxed regularly and mw1 looks close to it.

Reception123 added a comment.Oct 23 2017, 12:45

Yeah, Ganglia graphs not looking too good.

@Southparkfan @NDKilla It might be time to think about getting a mw3.

Kees_Langeveld subscribed.EditedOct 30 2017, 07:44

Error occured again and soon Mediawiki recovered:

503 Backend fetch failed
Our servers are having problems at the moment. Please try again in a few minutes. There may be additional information on our Facebook and Twitter pages.

Please provide the details below if you report this error to the system administrators via https://phabricator.miraheze.org:

Error 503 Backend fetch failed, forwarded for 83.247.102.164, 127.0.0.1 (Varnish XID 4489251) via cp4 at Mon, 30 Oct 2017 07:43:06 GMT.

Reception123 added a comment.Oct 30 2017, 08:04

@Kees_Langeveld As I said above, I think we need a new MediaWiki server (mw3) since the loads on our current servers are getting high.

Reception123 mentioned this in T2355: Purchase mw3 .Oct 30 2017, 08:15
Reception123 created subtask T2355: Purchase mw3 .
CnocBride subscribed.Oct 30 2017, 10:41

This happened last night again for me. The wikis came back up within 5 minutes.

Reception123 moved this task from Radar to Bugs on the Site Reliability Engineering board.Nov 2 2017, 11:48
Reception123 closed subtask T2355: Purchase mw3 as Resolved.Nov 2 2017, 18:23
Reception123 closed this task as Resolved.Nov 2 2017, 18:34
Reception123 claimed this task.

With the purchase of mw3, I hope that these issues will no longer be persistent.

Please reopen this task if they still happen.

Reception123 reopened this task as Open.Nov 3 2017, 17:58
Reception123 reassigned this task from Reception123 to Southparkfan.

Still occurring; not capacity

Assigning to SPF.

Hispano76 subscribed.Nov 22 2017, 17:54
Kees_Langeveld added a comment.Dec 1 2017, 17:47

503 Backend fetch failed
Our servers are having problems at the moment. Please try again in a few minutes. There may be additional information on our Twitter and Facebook pages.
Please provide the details below if you report this error to the system administrators via https://phabricator.miraheze.org:
Error 503 Backend fetch failed, forwarded for 83.247.102.164, 127.0.0.1 (Varnish XID 1212674) via cp4 at Fri, 01 Dec 2017 17:44:25 GMT.
We apologize for this inconvinience. The system administrators should be investigating it, and this wiki should be back up soon.

Reception123 closed this task as Resolved.Jan 13 2018, 09:20

Haven't seen this or heard anything about this in a while.

If this continues, feel free to open the task.

Herald added a subscriber: Sau226. · View Herald TranscriptJan 13 2018, 09:20