We are getting indexed by Google and the files people have uploaded, are showing in the results. Please provide a way to stop this immediately!
Download files being indexed
- Thread starter salesmcc134575
- Start date
Shouldn't be possible unless your users are posting links on a publicly accessible site where Google has access to the links.
You could also do the following:
robots.txt
User-agent: *
Disallow: /files/
You could also do the following:
robots.txt
User-agent: *
Disallow: /files/
Hi there,
Thank you for your help. I have my robots.txt file as below. Is this ok or should I remove the (Allow: /) The links when doing a search for our site, has the link to our site, not from another source.
User-agent: *
Allow: /
Disallow: /files/
Thank you for your help. I have my robots.txt file as below. Is this ok or should I remove the (Allow: /) The links when doing a search for our site, has the link to our site, not from another source.
User-agent: *
Allow: /
Disallow: /files/
Remove the "Allow: /" as its not part of the robots.txt standards.
http://www.robotstxt.org/robotstxt.html
http://www.robotstxt.org/robotstxt.html
Done and thank you ysmods! I will resubmit the site to the engines and await for the changes in the next few days. Thank you again, I really appreciate it. 
@pullvideos
We want to provide privacy to our users files, not have them indexed. The issue is still active and will not stop being indexed. Can the script please provide a way to stop all indexing of the site when uploads are placed? We have Disallow: /files/ in the robotx.txt, but the issue will NOT go away.
Please advise
We want to provide privacy to our users files, not have them indexed. The issue is still active and will not stop being indexed. Can the script please provide a way to stop all indexing of the site when uploads are placed? We have Disallow: /files/ in the robotx.txt, but the issue will NOT go away.
Please advise