Comments on: Googlebot and RSS http://fettig.net/weblog/2004/04/22/googlebot-and-rss/ Updates on Abe's projects Sat, 10 Dec 2011 18:51:57 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Matt http://fettig.net/weblog/2004/04/22/googlebot-and-rss/comment-page-1/#comment-47 Matt Thu, 01 Jan 1970 00:00:00 +0000 http://new.fettig.net/wordpress/?p=177#comment-47 Dave's at least partly right. Googlebot has started actively looking for index.rdf and atom.xml. I have neither of those files on any of my sites, but the files are being requested. As for whether Googlebot is automatically requesting rss.xml, I couldn't tell you because all of my sites have links to their rss.xml files. Dave’s at least partly right. Googlebot has started actively looking for index.rdf and atom.xml. I have neither of those files on any of my sites, but the files are being requested. As for whether Googlebot is automatically requesting rss.xml, I couldn’t tell you because all of my sites have links to their rss.xml files.

]]> By: Abe http://fettig.net/weblog/2004/04/22/googlebot-and-rss/comment-page-1/#comment-48 Abe Thu, 01 Jan 1970 00:00:00 +0000 http://new.fettig.net/wordpress/?p=177#comment-48 Thanks, Matt, that's interesting. I still don't see any /atom.xml requests in my logs, though. It could be that in cases where there is no RSS feed link, Googlebot is trying a couple of default locations for the most popular weblogging tools - /index.rdf for Movable Type, and /atom.xml for Blogger. That would seem like a sensible approach. I wonder, then - is Googlebot doing this on all sites, or only those it determines to be blogs? And if only blogs, how is it making the distinction? Thanks, Matt, that’s interesting. I still don’t see any /atom.xml requests in my logs, though. It could be that in cases where there is no RSS feed link, Googlebot is trying a couple of default locations for the most popular weblogging tools – /index.rdf for Movable Type, and /atom.xml for Blogger. That would seem like a sensible approach.

I wonder, then – is Googlebot doing this on all sites, or only those it determines to be blogs? And if only blogs, how is it making the distinction?

]]> By: Aaron Swartz http://fettig.net/weblog/2004/04/22/googlebot-and-rss/comment-page-1/#comment-49 Aaron Swartz Thu, 01 Jan 1970 00:00:00 +0000 http://new.fettig.net/wordpress/?p=177#comment-49 Perhaps there is a third site mistakenly linking to atom.xml and index.rdf on all sorts of blogs. Perhaps there is a third site mistakenly linking to atom.xml and index.rdf on all sorts of blogs.

]]> By: Matt http://fettig.net/weblog/2004/04/22/googlebot-and-rss/comment-page-1/#comment-50 Matt Thu, 01 Jan 1970 00:00:00 +0000 http://new.fettig.net/wordpress/?p=177#comment-50 That could be true, as well, Aaron. That could be true, as well, Aaron.

]]> By: Stoffer http://fettig.net/weblog/2004/04/22/googlebot-and-rss/comment-page-1/#comment-51 Stoffer Thu, 01 Jan 1970 00:00:00 +0000 http://new.fettig.net/wordpress/?p=177#comment-51 WordPress uses atom.php and rss.php, etc. :-) WordPress uses atom.php and rss.php, etc. :-)

]]>