I've just tried using robots.txt as you mentioned. Using this guide, I created a robots.txt file in public_html, then entered in the following:For bots that identify themselves they usually adhere to robots.txt , you can block them there.
https://developers.google.com/search/do ... f%20Google.
That seems to have stopped the resource usage, but looking at the Visitors info it looks like they're still trying to search the site.User-agent: *
Disallow: /
Is anyone familiar with the code mentioned here? If so, and if it does what it says it does, do I simply copy and paste the listed code to the bottom of the .htaccess file? It also mentions "purge your boards cache", which I'm not sure how to do. Again, this is all pretty new to me.
Statistics: Posted by Ares101 — Sat Apr 20, 2024 4:13 pm