Page MenuHomeMiraheze

Do something about bots hitting special pages
Closed, DeclinedPublic

Description

They are a few bots that regularly scrape user related special pages. There's nothing of use here to any scraper.

Any actual bot that needs it should login via the API or passing OAUTH headers.

We should consider adding a hook that can check on view whether UserLogin / ChangeCredentials / Preferences is being accessed and bot is in the UA and just deny it

Event Timeline

RhinosF1 triaged this task as High priority.Feb 25 2022, 13:40
RhinosF1 created this task.

@RhinosF1 Since you indicate your POC is very 'rough' what are your plans with this?

Make it not horrible if it makes sense

Make it not horrible if it makes sense

Are you planning on getting this done by the end of the week? Since it is high priority...

Probably not. It would need someone to review the concept first.

Probably not. It would need someone to review the concept first.

If @Universal_Omega had time for that that would be great. Though if we're keeping things high priority we do need to actively work on them

The POC mentioned is not the best approach in my mind. I don't think a hook should be used for this if there is alternatives, but if not it cod work with many improvements and due to its global nature potentially done via MirahezeMagic. I'm honestly not really sure I see the absolute need to do this though.

What's the actual advantages of doing this, or the disadvantages of not?

Reception123 lowered the priority of this task from High to Normal.Mar 5 2022, 06:15

Per comments above, this doesn't seem to be something that urgent to do.

Reception123 lowered the priority of this task from Normal to Low.Mar 17 2022, 06:00

Moving to low as there doesn't seem to be any indication that this will be worked on soon and I don't see any particular urgency given that we've not had it for all these years.

I don't think we should really do this. The usefulness of it doesn't really make it necessary in my mind. I guess it can be reopened if you really want to though.