From 67da77938165e4e5ae4bd1d70c170ed36f4cf686 Mon Sep 17 00:00:00 2001
From: Daniel O'Connor <daniel.oconnor@gmail.com>
Date: Thu, 25 Jun 2026 21:11:43 +0930
Subject: [PATCH] Block Semrush crawler in Rack Attack initializer

Added a blocklist entry for the Semrush crawler to prevent abusive requests.
---
 config/initializers/rack_attack.rb | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/config/initializers/rack_attack.rb b/config/initializers/rack_attack.rb
index 2d1e40e22..1317f2583 100644
--- a/config/initializers/rack_attack.rb
+++ b/config/initializers/rack_attack.rb
@@ -27,6 +27,11 @@ class Rack::Attack
     end
   end
 
+  # Abusive services
+  blocklist('block Semrush crawler') do |request|
+    request.user_agent.to_s.downcase.include?('semrush')
+  end
+  
   ### Custom Response Headers ###
 
   # Add Retry-After header to throttled responses