robots.txt & favicon.ico

adam

Administrator
Staff member
Dec 5, 2009
2,043
108
63
Hi,

I'm not sure I understand your question properly. You can setup a robots file by following these guidelines:

http://www.thesitewizard.com/archive/robotstxt.shtml

Try this link for the favicon.ico:

http://www.favicon.co.uk/

Adam.
 

asheglov792

New Member
Wurlie User
Apr 28, 2010
6
0
0
Some search systems try to load a file robots.txt and cannot make it.
Try to download from the demo-site robots.txt - **REMOVED**

favicon.ico does not work for the same reason
 

asheglov792

New Member
Wurlie User
Apr 28, 2010
6
0
0
Yandex receives the script message "This short url is no longer active" and excludes a site from search.
 

adam

Administrator
Staff member
Dec 5, 2009
2,043
108
63
Hi,

I think I see where the issue is. It sounds like the .htaccess file is not excluding .txt and .ico files from the short url lookups. Can you try adding the following to the root .htaccess file at about line 13:

RewriteCond %{REQUEST_URI} !^(.+).ico$
RewriteCond %{REQUEST_URI} !^(.+).txt$

Adam.