That invalid RSS feed I spoke of was actually my bad. As it turns out, I actually was including a relative URL reference. Wow, do I feel like a dumbass for not taking a hard look at this entry which was causing the problem.

So now I have a valid RSS feed and another pretty icon to go on my weblog.