Feedback or suggestion: Site is getting hammered by web crawlers

[crisr15]

Summary

The production site is getting hammered and was taken down by 3 different bots. Steve wrote some scripts that look at the logs before log rotate and block IPs of bots that are causing too much traffic.

What are the steps we would typically take in a scenario like this? Are there any suggestions we can provide?

Acceptance Criteria

• We have sent any suggestions we have to Steve in slack or we have told Steve in slack that we think his solution is the best option