Christmas has come early this year with the release of a new version of DeepCrawl which includes a range of fixes and features. Redirect Chains & Max Redirects We now display chains of multiple redirects and report when a chain contains more than 4 redirects which might not be followed by search engines. In your [...]
We’re rolling out an update to DeepCrawl over the next week. Here’s a summary of the changes which are mostly front-end interface improvements. Monitoring Tab Redesign The Website Monitoring tab which shows your scheduled crawls has been improved. It now displays mini-graphs for unique pages, duplicate pages, non-indexable pages and non-200 status codes to help [...]
Our site architecture tool, DeepCrawl, generates graphs visualising your site architecture by depth of links from the home page. We count the number of unique pages, duplicate pages, non-indexable URLs and non-200 URLs such as redirects and broken links. Each graph is a different website we’ve analysed and you can immediately see which sites have [...]
Last year Google added support for canonical tags in HTTP headers. You can view the headers which are normally invisible by using a HTTP viewing tool such as Rex Swain, Web Sniffer or a local application like Fiddler. HTTP/1.1·200·OK Date:·Tue,·24·Jul·2012·20:23:29·GMT Server:·Apache/2.2.16·(Unix)·mod_ssl/2.2.16·OpenSSL/0.9.8e-fips-rhel5·DAV/2·mod_auth_passthrough/2.1·mod_bwlimited/1.4·FrontPage/5.0.2.2635·mod_perl/2.0.4·Perl/v5.8.8(CR)(LF) X-Powered-By:·PHP/5.2.9 Vary:·Cookie Link: <http://blog.semetrical.com/>; rel=”canonical” X-Pingback:·http://blog.semetrical.com/xmlrpc.php WP-Super-Cache:·Served·legacy·cache·file Connection:·close Transfer-Encoding:·chunked Content-Type:·text/html;·charset=UTF-8 As with normal canonical tag [...]