Block Semrush crawler in Rack Attack initializer

Added a blocklist entry for the Semrush crawler to prevent abusive requests.
This commit is contained in:
Daniel O'Connor authored and GitHub committed 2026-06-25 21:11:43 +09:30
1 parent c9b8c54b81
commit 67da779381
1 file changed
+5
+5
View File
@@ -27,6 +27,11 @@ class Rack::Attack
end
end
# Abusive services
blocklist('block Semrush crawler') do |request|
request.user_agent.to_s.downcase.include?('semrush')
end
### Custom Response Headers ###
# Add Retry-After header to throttled responses