Comments on: Google’s Hidden Interpretation of Robots.txt http://blog.semetrical.com/googles-secret-approach-to-robots-txt/ Know more about your website, market and competitors Mon, 24 Sep 2012 09:04:51 +0000 hourly 1 http://wordpress.org/?v=3.4.2 By: chris http://blog.semetrical.com/googles-secret-approach-to-robots-txt/#comment-3417 chris Fri, 16 Sep 2011 09:35:02 +0000 http://blog.semetrical.com/?p=478#comment-3417 To the best of our knowledge the order doesn't matter for Google. Even if it did, there is no reason why the robots.txt you listed should cause a site to be de-indexed so I think there must be another cause. To the best of our knowledge the order doesn’t matter for Google.

Even if it did, there is no reason why the robots.txt you listed should cause a site to be de-indexed so I think there must be another cause.

]]> By: Ronan http://blog.semetrical.com/googles-secret-approach-to-robots-txt/#comment-3368 Ronan Wed, 14 Sep 2011 19:54:24 +0000 http://blog.semetrical.com/?p=478#comment-3368 Hi, I have a question regarding the robots.txt file. I saw in one of my client accounts that the robots.txt file was integrating the Allow line between the one of Disallow. Surprisingly when I discovered that the website was not indexed any more in Google whereas it was during the past. Do you think Google need to see the Allow and Disallow lines in a specific order? The robots.txt looked like this: User-agent: * Disallow: /cache Allow: / Disallow: /images Thanks for your answer Hi,
I have a question regarding the robots.txt file.
I saw in one of my client accounts that the robots.txt file was integrating the Allow line between the one of Disallow. Surprisingly when I discovered that the website was not indexed any more in Google whereas it was during the past.
Do you think Google need to see the Allow and Disallow lines in a specific order?

The robots.txt looked like this:
User-agent: *
Disallow: /cache
Allow: /
Disallow: /images

Thanks for your answer

]]>