Block Semrush crawler in Rack Attack initializer

Added a blocklist entry for the Semrush crawler to prevent abusive requests.
This commit is contained in:
Daniel O'Connor
2026-06-25 21:11:43 +09:30
committed by GitHub
parent c9b8c54b81
commit 67da779381

View File

@@ -27,6 +27,11 @@ class Rack::Attack
end
end
# Abusive services
blocklist('block Semrush crawler') do |request|
request.user_agent.to_s.downcase.include?('semrush')
end
### Custom Response Headers ###
# Add Retry-After header to throttled responses