5 Commits

Author	SHA1	Message	Date
Daniel O'Connor	dad09384df	Update sitemap URL in robots.txt	2025-12-02 22:36:29 +10:30
google-labs-jules[bot]	7f75aed146	feat: Add sitemap generator ... Adds the `sitemap_generator` gem to generate a sitemap. - Includes static routes and dynamic routes for active crops, plantings, seeds, photos, posts, and members. - Implements a caching mechanism to ensure the sitemap is generated no more frequently than every 72 hours. - Updates `robots.txt` to point to the new sitemap. - Includes a unit test for the caching Rake task.	2025-12-01 14:31:54 +00:00
Daniel O'Connor	d8e138ae2d	Create robots.txt based on wikipedia	2025-09-29 00:27:57 +09:30
Jake Yesbeck	507e5a0ebc	Robots controller and custom robots.txt files ... New route to /robots.txt and some specific logic to switch on if the subdomain is staging or not. Staging will not allow any crawlers at all, production does not have any current limitations	2015-05-04 23:11:41 -07:00
Cesy Avon	95145f2869	Moving development to top level directory	2012-08-23 10:41:00 -07:00