Finally, Google decided on the indexing of the feeds. The policy is now to index the multimedia podcast feeds only, as no HTML page has the same content or they have more complete item descriptions than the associated HTML page.
There are two main reasons to exclude the common feeds from the Google’s search results:
- Feeds increase the likelihood that users see duplicate search results (because of this, some webmasters block off access to the robots to avoid them indexing the pages that have these data feeds)
- Users clicking on a feed may miss valuable content available only in the HTML page.
For the owners of podcast feeds that do not want it to be indexed, they can comply with Yahoo Guidelines, or, if they use Feedburner they can easily set this up within Feedburner.