I need an effective .htaccess file written to stop unwanted bots
- or -
Post a project like this2170
$$
- Posted:
- Proposals: 3
- Remote
- #1991424
- Awarded
Description
Experience Level: Intermediate
My website keeps getting crawled by a bot called domaincrawler which is mopping up huge chunks of bandwidth.
I have been told it is possible to edit the .htaccess file to prevent this happening - but my attempts (based on google advice) have simple stopped the website working - so I need some help.
My current .htaccess file reads:-
order allow,deny
allow from all
I need something that both blocks the above - and any other known "bad bots" from crawling my website - but which allows useful bots access - and does not interfere with the day to day operation of the website.
Hope that is sufficient information.
Thanks
Les Smith
I have been told it is possible to edit the .htaccess file to prevent this happening - but my attempts (based on google advice) have simple stopped the website working - so I need some help.
My current .htaccess file reads:-
order allow,deny
allow from all
I need something that both blocks the above - and any other known "bad bots" from crawling my website - but which allows useful bots access - and does not interfere with the day to day operation of the website.
Hope that is sufficient information.
Thanks
Les Smith
Leslie S.
100% (17)Projects Completed
12
Freelancers worked with
12
Projects awarded
75%
Last project
10 Oct 2020
United Kingdom
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
Leslie, please share your website link.
634070
We collect cookies to enable the proper functioning and security of our website, and to enhance your experience. By clicking on 'Accept All Cookies', you consent to the use of these cookies. You can change your 'Cookies Settings' at any time. For more information, please read ourCookie Policy
Cookie Settings
Accept All Cookies