Please suggest robots.txt file

[halalrizik2841]

Hi,

Please suggest a proper robots.txt file for the file hosting script. I see stange files getting indexed in google with long code or something.

Thanks.

 

[ysmods]

Something like this will work (You do need the empty line at the bottom according to the robots.txt inclusion standards)

User-agent: *
Disallow: /admin
Disallow: /files
Disallow: /includes
Disallow: /js
Disallow: /plugins
Disallow: /themes