Page MenuHomeMiraheze

Messages take a while to be sent to graylog
Closed, ResolvedPublic

Description

For example if there's a spammy message such as this one https://graylog.miraheze.org/messages/graylog_92/fb119430-702b-11eb-b57d-0200001a24a4 then it appears that when we fix it, it takes a while before it stops.

Is there a way we can speed up messages being sent/processed without using too much resources (io/cpu)?

Related Objects

Event Timeline

Paladox triaged this task as Normal priority.Tue, Feb 16, 16:55
Paladox created this task.

the only problem is that this causes things to be out of sync, for example a message could have been sent an hour ago but we would have only just saw it now because of this. This has happened with exceptions when investigating. This impedes investigations.

Do you know what the bottleneck is? Is it MediaWiki -> syslog-ng or syslog-ng -> graylog?

I think it may be syslog-ng -> graylog. Has to be otherwise messages would be lost going from mw -> syslog-ng.

Paladox raised the priority of this task from Normal to High.Fri, Feb 19, 23:17
Paladox claimed this task.

Think we've resolved this by using pipeline rules to use timestamp in the json and setting the timestamp.