Loving aideRSS

Tough love, that is—there’s a lot more I want out of this.

But first, aideRSS is awesome. When I serve it a blog’s feed, it looks at how many comments, delicious saves, and other mentions each post has and then divides them up according to their popularity relative to one another. AideRSS offers me a feed for each division—the smallest circle of the “best posts,” a larger circle of “great posts,” and an even larger circle of “good posts.”

I’ve got two main uses for it. It ups the signal-to-noise ratio on blogs that aren’t worth reading in their filtered state, given my peculiar tastes. And it allows me to keep current with the most popular posts of blogs I don’t have time to read every single day. That’s huge.

There are real problems, however, and other curious behaviors.

Consider Marc Andreessen’s blog pmarca. For one, AideRSS strips out his byline (here’s the “good” feed). For two, it has recently really oddly clipped his most recent posts and made them partial feeds (I also follow Andreessen’s full feed, and it is still full). Also, aideRSS also seems to strip out all the original dates and replace them with some date of its own.

That’s a problem. Google Reader published Andreessen’s post called “Fun with Hedge Funds: Catfight!” on August 16, 2007. But it’s the most recent post in AideRSS’s filtered feed of Andreessen’s “good” posts. The problem is that it follows “The Pmarca Guide to Startups, part 8″ in the “good” feed but precedes it in the regular feed.

Did the post about the hedge funds and the cat fight receive some very recent comments, more than a few days after it was first published? All else equal, it wouldn’t be a problem to have the posts out of order—that would seem to be the sometimes inevitable result of late-coming comments or delayed delicious saves, etc. But all else is not equal—because the original dates are stripped. Posts in a blog exist relative to one another in time. Stripping out the dates and then reordering the posts smothers those important relationships.

But let’s look to the horizon. AideRSS can’t handle amalgamated feeds. I want to serve it what Scoble calls his link blog—the feed of all the very many items he shares in Google Reader—and receive only the most popular. That way, I would get the benefit of two different kinds of networked news at once. I’d get the intersection of the crowd’s opinion and the trusted expert’s opinion.

I’d also like to serve it a big mashup of lots of feeds—say, my favorite five hundred, routed through Pipes—and have it return the top two percent of all posts. That kind of service could compete with Techmeme, but it could be dynamic. We could all build our own personalized versions of Techmeme. That would be huge.

Trying it out a few different ways gave wild results. The posts in an amalgamated feed weren’t exactly being compared to one another on a level playing field—so that even a relatively bad TechCrunch post with ten comments crushes an small-time blogger’s amazing post with eight comments. But they also weren’t being compared to one another only by way of their numerical rankings derived from their first being compared to the other posts in their original feed.

Why can’t aideRSS measure each post’s popularity with respect to its kin even when it’s among strangers? The share function within Google Reader gives aideRSS the original url for each post. Can’t aideRSS take the original url for each post, find the original feed for each post, and then analyze each post against the other posts in its original feed? That would be much more analysis, for sure, but it would also be much more valuable. I’d love to see it.

Of course, while it may be a surprise or unintuitive at first, all this is really just one particular take on the first and second components of networked news—pulling in your news from a network of publishers and from a network of readers, including friends and experts and others. Without my additions, aideRSS represents just the second component, in which we get news based on whether others are reading it and participating in the conversation around it. My additions bring a little of the first component.

UPDATE: It would also be awesome to serve aideRSS the feed generated by a WordPress tag or by a persistent Google News search. That would be bringing in a shade of the third component of networked news.

1 Response to “Loving aideRSS”


  1. 1 Ilya Grigorik 2007 September 3 at 2:02 pm

    Josh, thanks for the review and all the suggestions. We did experience some date importing problems earlier in the month and it sounds like you’ve stumbled over this problem. I’m happy to say that these issues are now resolved. Having said that, we’re still working hard on our import code in order to add support for new non-standard RSS2.0/1.0/Atom feeds.

    Interesting insights about amalgamated feeds – it’s an area we will have to explore. You’re right, we should compare the posts to their original source!


Leave a Reply




Josh Young's Facebook profile

What I’m thinking

What I'm saving.

RSS What I’m reading.

  • FriendFeed Sneaks Into My RSS Stats And Hits The Big Red Button 2009 June 18
    It's tempting to go back the age-old line of there being lies, damn lies, and statistics. On the Web, where practically everything is measured and big numbers are almost always better, counting up one's followers, friends, subscribers or authority is practically a pasttime. But with each metric comes a question of validity - how did they approach t […]
    louisgray@gmail.com (Louis Gray)
  • Introducing our new venture capital firm Andreessen Horowitz 2009 July 6
    My partner Ben Horowitz and I are delighted to announce the formation of our new venture capital firm, Andreessen Horowitz, and our first fund -- $300 million in size -- aimed purely at investing in the best new entrepreneurs, products, and companies in the technology industry. Between the two of us, Ben and I have started three companies directly, created […]
    Marc Andreessen
  • Controlling Data Through URL Shorteners 2009 June 30
    I’m going to sidestep the “URL shorteners are bad because they obfuscate” discussion in this post. If you’re reading this, you likely have an opinion one way or another on that topic, but let’s leave that at the door. A bigger challenge is emerging as URL shortening continues to proliferate. Web browsers unwinding a shortened URL when a user clicks on one is […]
    Jud Valeski
  • Semantic Technology Conference kicks off with Keynotes from Open Calais and Siri 2009 June 16
    June 16th, 2009 Semantic Technology Conference kicks off with Keynotes from Open Calais and Siri Posted by Paul Miller @ 9:54 am Categories: Commercialisation, Open Data, Semantic Web, Semantic Web Companies, Web 2.0, Web 3.0 Tags: Web, Advertisement, Tool, Siri, Tom Tague, Tague, Enterprise Adoption, Virtual Personal Assistant, Virtual Persona […]
    (author unknown)
  • How to Tell Stories in Print 2009 July 2
    Over at The Atlantic, I’ve been interviewing Jack Hitt, one of my favorite journalists. If you’ve never heard the This American Life episode The Super, do yourself the favor of consuming it immediately. It’s just damn good storytelling. The same can be said for Jack’s magazine stories. One example is Toxic Dreams, one of the most impressive magazine stories […]
    Conor Friedersdorf
  • Beyond celebrity obsession 2009 June 27
    Great minds discuss ideas. Average minds discuss events. Small minds discuss people. — Eleanor Roosevelt Somebody I wish to discuss an idea here. It’s an idea about celebrity, and it follows an event that has become a black hole in nearly all media: the death of Michael Jackson. According to Don Norman, a black hole topic is one that is essentially undiscus […]
    Doc Searls
  • Beyond celebrity obsession 2009 July 1
    Shared by joshyoung "Great minds discuss ideas. Average minds discuss events. Small minds discuss people." So very, very false! We all discuss all of the above—and places too. Great minds discuss ideas. Average minds discuss events. Small minds discuss people. — Eleanor Roosevelt Somebody I wish to discuss an idea here. It’s an idea about celebr […]
    (author unknown)
  • Force-Directed Edge Bundling for Graph Visualization 2009 June 16
    Attentive readers might already know the concept of "edge bundling" as described in a post almost 2 years ago, and more recently exemplified by the Eigenfactor Citation Patterns graph. Edge bundling is based on the principle of visually bundling adjacency edges together, analogous to the way electrical wires and network cables are merged into bund […]
    (author unknown)
  • Real-Time But Not Ready For Prime Time 2009 June 18
    Extra, extra, read all about it–two new real-time search engines debuted today: CrowdEye and Collecta. I love the headlines from Techmeme: Mashable!: Collecta: True Real-Time Social Search paidContent: Startup Promises Best Real-Time Search Results Yet Tech Beat: Collecta Launches *Really* Real-Time Search Engine ReadWriteWeb: Collecta: Summize Backer Launc […]
    Daniel Tunkelang
  • Wikipedia Page Traffic Statistics Dataset 2009 July 1
    Wikipedia Page Traffic Statistics Dataset Posted by Peter Skomoroch on June 11th 2009 to Data mining, Amazon EC2, dataset I’ve published a Wikipedia Page Traffic Data Set containing a 320 GB sample of the data used to power trendingtopics.org (I’ll talk about Trending Topics more in a upcoming post). The EBS s […]
    Peter Skomoroch